-- Logs begin at Sat 2022-05-21 20:01:16 UTC, end at Sat 2022-05-21 22:40:51 UTC. -- May 21 20:59:50.384968 ncdv-master-1 systemd[1]: Started Devstack devstack@c-vol.service. May 21 20:59:53.712133 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=124233) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 21 20:59:53.712770 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=124233) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 21 20:59:54.145376 ncdv-master-1 cinder-volume[124233]: INFO dbcounter [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] Registered counter for database cinder May 21 20:59:54.165806 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_db.sqlalchemy.engines [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124233) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 21 20:59:54.181059 ncdv-master-1 cinder-volume[124233]: DEBUG dbcounter [-] [124233] Writer thread running {{(pid=124233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 21 20:59:54.483650 ncdv-master-1 cinder-volume[124233]: INFO cinder.rpc [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. May 21 20:59:54.488432 ncdv-master-1 cinder-volume[124233]: INFO cinder.rpc [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. May 21 20:59:54.496649 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_db.sqlalchemy.engines [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124233) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 21 20:59:54.577222 ncdv-master-1 cinder-volume[124233]: INFO cinder.volume.manager [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] Determined volume DB was empty at startup. May 21 20:59:54.577222 ncdv-master-1 cinder-volume[124233]: DEBUG cinder.volume.manager [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=124233) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} May 21 20:59:54.581014 ncdv-master-1 cinder-volume[124233]: INFO cinder.volume.manager [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] Service not found for updating active_backend_id, assuming default for driver init. May 21 20:59:54.581875 ncdv-master-1 cinder-volume[124233]: WARNING stevedore.named [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 21 20:59:54.582373 ncdv-master-1 cinder-volume[124233]: WARNING castellan.key_manager [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 21 20:59:54.584614 ncdv-master-1 cinder-volume[124233]: WARNING cinder.keymgr.conf_key_mgr [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 21 20:59:54.600554 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_db.sqlalchemy.engines [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124233) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 21 20:59:54.605679 ncdv-master-1 cinder-volume[124233]: INFO cinder.rpc [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. May 21 20:59:54.610064 ncdv-master-1 cinder-volume[124233]: INFO cinder.rpc [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] Automatically selected cinder-volume RPC version 3.18 as minimum service version. May 21 20:59:54.610796 ncdv-master-1 cinder-volume[124233]: WARNING stevedore.named [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 21 20:59:54.611299 ncdv-master-1 cinder-volume[124233]: WARNING castellan.key_manager [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 21 20:59:54.613068 ncdv-master-1 cinder-volume[124233]: INFO cinder.volume.manager [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] Image-volume cache enabled for host ncdv-master-1@ceph. May 21 20:59:54.619390 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_db.sqlalchemy.engines [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124233) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 21 20:59:54.692258 ncdv-master-1 cinder-volume[124233]: INFO oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] Starting 1 workers May 21 20:59:54.718333 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] Started child 124407 {{(pid=124233) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} May 21 20:59:54.718333 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] Full set of CONF: {{(pid=124233) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} May 21 20:59:54.718333 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ******************************************************************************** {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 21 20:59:54.718333 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] Configuration options gathered from: {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 21 20:59:54.718333 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 21 20:59:54.718333 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 21 20:59:54.726126 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ================================================================================ {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 21 20:59:54.726126 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] allow_availability_zone_fallback = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.726126 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] allow_compression_on_image_upload = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.726126 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] allowed_direct_url_schemes = [] {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.726126 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] api_rate_limit = True {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.726126 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] auth_strategy = keystone {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.726707 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] az_cache_duration = 3600 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.726707 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_availability_zone = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.726707 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_host = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.726707 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_name = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.726707 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_stats_polling_interval = 60 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.726707 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backup_api_class = cinder.backup.api.API {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.727239 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.727239 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backup_name_template = backup-%s {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.727239 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backup_use_same_host = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.727239 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backup_use_temp_snapshot = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.727239 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] chap_password = **** {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.727239 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] chap_username = {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.727712 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.727712 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] cinder_internal_tenant_project_id = e624588d8a9b48dc82eff460e157b277 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.727712 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] cinder_internal_tenant_user_id = 4e497527a115478d9c8f08e83c64cd74 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.727712 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] cloned_volume_same_az = True {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.727712 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] cluster = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.727712 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] compression_format = gzip {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.729848 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] compute_api_class = cinder.compute.nova.API {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.729848 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] config_dir = [] {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.729848 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.729848 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] config_source = [] {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.730220 ncdv-master-1 cinder-volume[124407]: INFO cinder.service [-] Starting cinder-volume node (version 20.1.0) May 21 20:59:54.730670 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.730670 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] control_exchange = openstack {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.730670 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] debug = True {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.730670 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] default_availability_zone = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.730670 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] default_group_type = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.731088 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.731088 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] default_volume_type = ceph {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.731088 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] driver_client_cert = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.731088 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] driver_client_cert_key = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.731088 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] driver_data_namespace = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.731501 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] driver_ssl_cert_path = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.731501 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] driver_ssl_cert_verify = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.731501 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] driver_use_ssl = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.731501 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] enable_force_upload = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.731501 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] enable_new_services = True {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.731501 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] enable_unsupported_driver = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.731501 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] enabled_backends = ['ceph'] {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.732073 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] enforce_multipath_for_image_xfer = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.732073 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] filter_function = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.732073 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] glance_api_insecure = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.732073 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] glance_api_servers = ['http://10.222.0.49/image'] {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.732073 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] glance_api_ssl_compression = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.732073 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] glance_ca_certificates_file = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.732590 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] glance_catalog_info = image:glance:publicURL {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.732590 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] glance_certfile = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.732590 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.732590 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] glance_keyfile = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.732590 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] glance_num_retries = 3 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.732590 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] glance_request_timeout = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.733086 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] goodness_function = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.733086 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] graceful_shutdown_timeout = 5 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.733086 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] group_api_class = cinder.group.api.API {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.733086 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] host = ncdv-master-1 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.733086 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] iet_conf = /etc/iet/ietd.conf {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.733086 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] image_compress_on_upload = True {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.733853 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] image_conversion_address_space_limit = 1 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.734269 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] image_conversion_cpu_limit = 60 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.734915 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.735367 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] image_upload_use_cinder_backend = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.735825 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] image_upload_use_internal_tenant = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.736258 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] image_volume_cache_enabled = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.740619 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] image_volume_cache_max_count = 0 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.740619 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] image_volume_cache_max_size_gb = 0 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.740619 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] init_host_max_objects_retrieval = 0 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.740619 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] instance_format = [instance: %(uuid)s] {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.740619 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.740619 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] iscsi_iotype = fileio {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.740619 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] iscsi_secondary_ip_addresses = [] {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.741208 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] iscsi_target_flags = {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.741208 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] iscsi_write_cache = on {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.741208 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] iser_helper = tgtadm {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.741719 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] iser_ip_address = 10.222.0.49 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.742224 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] iser_port = 3260 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.742687 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.743162 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] log_config_append = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.743633 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.744118 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] log_dir = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.744589 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] log_file = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.744975 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] log_options = True {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.745427 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] log_rotate_interval = 1 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.745918 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] log_rotate_interval_type = days {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.746407 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] log_rotation_type = none {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.746798 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.747186 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.747649 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.748140 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.748662 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.749172 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] max_age = 0 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.749611 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] max_logfile_count = 30 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.750200 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] max_logfile_size_mb = 200 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.750795 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] max_over_subscription_ratio = 20.0 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.751284 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] message_reap_interval = 86400 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.751728 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] message_ttl = 2592000 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.752224 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] migration_create_volume_timeout_secs = 300 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.752702 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] monkey_patch = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.753319 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] monkey_patch_modules = [] {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.753569 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] my_ip = 10.222.0.49 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.754043 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] no_snapshot_gb_quota = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.754663 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] num_iser_scan_tries = 3 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.755126 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] num_shell_tries = 3 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.755590 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] num_volume_device_scan_tries = 3 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.756605 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] nvmet_ns_id = 10 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.757249 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] nvmet_port_id = 1 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.757740 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] osapi_max_limit = 1000 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.758209 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] osapi_volume_ext_list = [] {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.758759 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.759250 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] osapi_volume_listen = 0.0.0.0 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.759722 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] osapi_volume_listen_port = 8776 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.760184 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] osapi_volume_use_ssl = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.761193 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] osapi_volume_workers = 2 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.762923 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] per_volume_size_limit = -1 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.762923 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] periodic_fuzzy_delay = 60 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.763458 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] periodic_interval = 60 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.763983 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] project_id_regex = [0-9a-f\-]+ {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.764473 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] public_endpoint = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.764927 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] publish_errors = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.765382 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] quota_backup_gigabytes = 1000 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.765838 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] quota_backups = 10 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.766313 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] quota_consistencygroups = 10 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.766769 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.767229 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] quota_gigabytes = 1000 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.767685 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] quota_groups = 10 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.768151 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] quota_snapshots = 10 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.768632 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] quota_volumes = 10 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.769087 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] rate_limit_burst = 0 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.769548 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] rate_limit_except_level = CRITICAL {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.769990 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] rate_limit_interval = 0 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.770572 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] reinit_driver_count = 3 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.771159 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] replication_device = **** {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.772432 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] report_discard_supported = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.772889 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] report_interval = 10 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.773186 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-8dc6d8e7-c11f-4d95-b0cf-d672bbfda4b3 None None] Starting volume driver RBDDriver (1.2.0) May 21 20:59:54.773530 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] reservation_clean_interval = 86400 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.774175 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] reservation_expire = 86400 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.774654 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] reserved_percentage = 0 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.775135 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.775594 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.776095 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8dc6d8e7-c11f-4d95-b0cf-d672bbfda4b3 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 20:59:54.776221 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] rpc_response_timeout = 120 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.776636 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] run_external_periodic_tasks = True {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.777085 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.777566 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] scst_target_driver = iscsi {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.778011 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] scst_target_iqn_name = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.778392 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] service_down_time = 60 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.778848 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] snapshot_name_template = snapshot-%s {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.779316 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] snapshot_same_host = True {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.779777 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] split_loggers = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.780161 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] state_path = /opt/stack/data/cinder {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.780776 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] storage_availability_zone = nova {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.781337 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] storage_protocol = iSCSI {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.781819 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] syslog_log_facility = LOG_USER {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.782302 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] target_helper = lioadm {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.782878 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] target_ip_address = 10.222.0.49 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.783340 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] target_port = 3260 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.783813 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.784306 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] target_protocol = iscsi {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.784789 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] trace_flags = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.785324 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] transfer_api_class = cinder.transfer.api.API {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.785798 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] transport_url = **** {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.786257 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] until_refresh = 0 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.786708 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] use_chap_auth = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.787192 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] use_default_quota_class = True {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.787678 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] use_eventlog = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.797040 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] use_journal = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.797040 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] use_json = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.797040 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] use_multipath_for_image_xfer = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.797040 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] use_stderr = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.797040 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] use_syslog = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.797040 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] verify_glance_signatures = enabled {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.797040 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] volume_api_class = cinder.volume.api.API {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.817143 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] volume_backend_name = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.817143 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] volume_clear = zero {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.817143 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] volume_clear_ionice = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.817143 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] volume_clear_size = 0 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.817143 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.817143 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] volume_copy_bps_limit = 0 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.817143 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] volume_dd_blocksize = 1M {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.817926 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.817926 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] volume_name_template = volume-%s {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.817926 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] volume_service_inithost_offload = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.817926 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] volume_usage_audit_period = month {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.817926 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.817926 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] watch_log_file = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.819026 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] zoning_mode = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 21 20:59:54.819026 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.819026 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.819026 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_concurrency.disable_process_locking = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.819026 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.819026 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.819629 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.819629 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.819629 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.819629 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.819629 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] keystone_authtoken.admin_password = **** {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.819629 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.820247 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] keystone_authtoken.admin_token = **** {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.820247 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] keystone_authtoken.admin_user = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.820247 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] keystone_authtoken.auth_admin_prefix = {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.820247 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.820247 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] keystone_authtoken.auth_port = 35357 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.820247 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] keystone_authtoken.auth_protocol = https {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.820247 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] keystone_authtoken.auth_section = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.820989 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] keystone_authtoken.auth_type = password {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.820989 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] keystone_authtoken.auth_uri = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.820989 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] keystone_authtoken.auth_version = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.820989 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] keystone_authtoken.cache = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.820989 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.820989 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] keystone_authtoken.certfile = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.821646 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.821646 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.821646 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.821646 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.821646 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] keystone_authtoken.identity_uri = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.821646 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] keystone_authtoken.include_service_catalog = True {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.822374 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] keystone_authtoken.insecure = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.822374 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] keystone_authtoken.interface = public {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.822374 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] keystone_authtoken.keyfile = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.822374 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.822374 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.822374 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.822987 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.822987 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.822987 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.822987 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.822987 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.822987 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.823571 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] keystone_authtoken.region_name = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.823571 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.823571 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] keystone_authtoken.service_token_roles_required = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.823571 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] keystone_authtoken.service_type = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.823571 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.823571 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.824032 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] cache.backend = dogpile.cache.null {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.824032 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] cache.backend_argument = **** {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.824032 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] cache.config_prefix = cache.oslo {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.824032 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] cache.dead_timeout = 60.0 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.824032 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] cache.debug_cache_backend = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.824032 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] cache.enable_retry_client = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.824032 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] cache.enable_socket_keepalive = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.826342 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] cache.enabled = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.826342 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] cache.expiration_time = 600 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.826342 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] cache.hashclient_retry_attempts = 2 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.826342 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] cache.hashclient_retry_delay = 1.0 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.827574 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] cache.memcache_dead_retry = 300 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.827574 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.827825 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.828330 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] cache.memcache_pool_maxsize = 10 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.828833 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.829515 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.830191 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] cache.memcache_socket_timeout = 1.0 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.830706 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] cache.proxies = [] {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.831305 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] cache.retry_attempts = 2 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.831795 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] cache.retry_delay = 0.0 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.832330 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] cache.socket_keepalive_count = 1 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.832885 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] cache.socket_keepalive_idle = 1 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.833371 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] cache.socket_keepalive_interval = 1 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.833909 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] cache.tls_allowed_ciphers = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.834412 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] cache.tls_cafile = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.834862 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] cache.tls_certfile = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.835370 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] cache.tls_enabled = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.835858 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] cache.tls_keyfile = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.836538 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] coordination.backend_url = etcd3+http://10.222.0.49:2379 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.837247 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] database.backend = sqlalchemy {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.837789 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] database.connection = **** {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.838457 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] database.connection_debug = 0 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.839068 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] database.connection_parameters = {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.839666 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] database.connection_recycle_time = 3600 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.840258 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] database.connection_trace = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.840970 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] database.db_inc_retry_interval = True {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.841606 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] database.db_max_retries = 20 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.842503 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] database.db_max_retry_interval = 10 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.843088 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] database.db_retry_interval = 1 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.843672 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8dc6d8e7-c11f-4d95-b0cf-d672bbfda4b3 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 20:59:54.844023 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] database.max_overflow = 50 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.844623 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] database.max_pool_size = 5 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.845227 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] database.max_retries = 10 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.845809 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] database.mysql_enable_ndb = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.846450 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.847022 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] database.pool_timeout = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.847900 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] database.retry_interval = 10 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.848557 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] database.slave_connection = **** {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.849147 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] database.sqlite_synchronous = True {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.850257 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] database.use_db_reconnect = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.850923 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_policy.enforce_new_defaults = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.851511 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_policy.enforce_scope = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.852127 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_policy.policy_default_rule = default {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.853081 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.853714 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_policy.policy_file = policy.yaml {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.854236 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.854702 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.855166 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.855654 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.856118 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.856668 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] profiler.connection_string = messaging:// {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.857071 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] profiler.enabled = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.857664 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] profiler.es_doc_type = notification {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.858272 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] profiler.es_scroll_size = 10000 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.858857 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] profiler.es_scroll_time = 2m {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.859427 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] profiler.filter_error_trace = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.860006 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] profiler.hmac_keys = SECRET_KEY {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.860494 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] profiler.sentinel_service_name = mymaster {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.860932 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] profiler.socket_timeout = 0.1 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.861352 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] profiler.trace_sqlalchemy = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.861841 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] privsep_osbrick.capabilities = [21] {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.862300 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] privsep_osbrick.group = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.862746 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] privsep_osbrick.helper_command = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.863310 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] privsep_osbrick.logger_name = oslo_privsep.daemon {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.863798 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.864231 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] privsep_osbrick.user = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.864729 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.865215 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] cinder_sys_admin.group = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.865631 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] cinder_sys_admin.helper_command = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.866062 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.866465 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.866877 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] cinder_sys_admin.user = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.867334 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] service_user.auth_section = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.867758 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] service_user.auth_type = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.868202 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] service_user.cafile = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.868639 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] service_user.certfile = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.869074 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] service_user.collect_timing = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.869600 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] service_user.insecure = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.869945 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] service_user.keyfile = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.870296 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] service_user.send_service_user_token = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.870671 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] service_user.split_loggers = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.871015 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] service_user.timeout = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.871407 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.backend_availability_zone = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.871767 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.872128 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.872537 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.chap_password = **** {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.872900 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.chap_username = {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.873310 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.873669 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.deferred_deletion_delay = 0 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.874031 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.deferred_deletion_purge_interval = 60 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.874380 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.driver_client_cert = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.874723 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.driver_client_cert_key = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.875067 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.driver_data_namespace = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.875409 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.875758 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.876126 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.driver_use_ssl = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.877169 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.enable_deferred_deletion = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.878110 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.878632 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.879156 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.extra_capabilities = {} {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.879707 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.filter_function = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.881327 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.goodness_function = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.881739 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.iet_conf = /etc/iet/ietd.conf {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.882082 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.882915 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.883419 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.884150 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.884556 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.884928 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.iscsi_iotype = fileio {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.885411 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.iscsi_secondary_ip_addresses = [] {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.885806 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.iscsi_target_flags = {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.886193 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.iscsi_write_cache = on {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.886578 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.iser_helper = tgtadm {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.887127 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.iser_ip_address = 10.222.0.49 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.887491 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.iser_port = 3260 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.887858 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.888226 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.888608 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.888965 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.num_shell_tries = 3 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.889317 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.889668 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.889958 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8dc6d8e7-c11f-4d95-b0cf-d672bbfda4b3 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 20:59:54.890065 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.890362 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.rados_connect_timeout = -1 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.890714 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.rados_connection_interval = 5 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.891065 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.rados_connection_retries = 3 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.891459 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.rbd_ceph_conf = {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.891830 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.rbd_cluster_name = ceph {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.892207 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.rbd_exclusive_cinder_pool = True {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.892606 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.rbd_flatten_volume_from_snapshot = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.892961 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.rbd_max_clone_depth = 5 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.893332 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.rbd_pool = rbd {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.893680 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.rbd_secret_uuid = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.894031 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.rbd_store_chunk_size = 4 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.894406 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.rbd_user = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.894759 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.replication_connect_timeout = 5 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.895110 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.replication_device = **** {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.895466 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.report_discard_supported = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.895827 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.report_dynamic_total_capacity = True {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.896208 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.reserved_percentage = 0 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.896641 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.896999 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.897366 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.897721 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.898120 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.target_helper = tgtadm {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.898593 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.target_ip_address = 10.222.0.49 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.899235 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.target_port = 3260 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.899598 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.899980 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.target_protocol = iscsi {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.905757 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.trace_flags = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.905757 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.unique_fqdn_network = True {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.905757 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.use_chap_auth = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.905757 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.905757 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.volume_backend_name = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.905757 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.volume_clear = zero {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.931113 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.volume_clear_ionice = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.931113 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.volume_clear_size = 0 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.931113 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.931113 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.931113 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.931113 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.937231 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.937231 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_reports.file_event_handler = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.937231 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.937231 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_reports.log_dir = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.937231 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.backend_availability_zone = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.937231 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.backend_host = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.937635 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.backend_native_threads_pool_size = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.937635 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.backup_use_temp_snapshot = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.937635 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.chap_password = **** {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.937635 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.chap_username = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.937635 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.chiscsi_conf = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.937635 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.deferred_deletion_delay = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.937635 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.deferred_deletion_purge_interval = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.938113 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.driver_client_cert = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.938113 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.driver_client_cert_key = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.938113 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.driver_data_namespace = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.938113 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.driver_ssl_cert_path = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.938113 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.driver_ssl_cert_verify = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.938113 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.driver_use_ssl = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.938113 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.enable_deferred_deletion = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.938617 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.enable_unsupported_driver = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.938617 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.enforce_multipath_for_image_xfer = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.938617 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.extra_capabilities = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.938617 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.filter_function = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.938617 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.goodness_function = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.938617 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.iet_conf = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.938617 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.image_upload_use_cinder_backend = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.939168 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.image_upload_use_internal_tenant = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.939168 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.image_volume_cache_enabled = True {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.939168 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.image_volume_cache_max_count = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.939168 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.image_volume_cache_max_size_gb = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.939168 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.iscsi_iotype = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.939168 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.iscsi_secondary_ip_addresses = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.939168 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.iscsi_target_flags = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.939684 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.iscsi_write_cache = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.939684 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.iser_helper = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.939684 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.iser_ip_address = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.939684 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.iser_port = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.939684 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.iser_target_prefix = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.939684 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.max_over_subscription_ratio = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.939684 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.num_iser_scan_tries = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.940152 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.num_shell_tries = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.940152 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.num_volume_device_scan_tries = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.940152 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.nvmet_ns_id = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.940152 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.nvmet_port_id = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.940152 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.rados_connect_timeout = -1 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.940152 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.rados_connection_interval = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.940152 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.rados_connection_retries = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.940668 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.rbd_ceph_conf = /etc/ceph/ceph.conf {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.940668 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.rbd_cluster_name = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.940668 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.rbd_exclusive_cinder_pool = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.940668 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.rbd_flatten_volume_from_snapshot = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.940668 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.rbd_max_clone_depth = 5 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.940668 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.rbd_pool = volumes {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.941084 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.rbd_secret_uuid = efef91cd-d8f8-4d93-9ad2-86d0b33251f4 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.941084 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.rbd_store_chunk_size = 4 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.941084 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.rbd_user = cinder {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.941084 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.replication_connect_timeout = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.941084 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.replication_device = **** {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.941084 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.report_discard_supported = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.941572 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.report_dynamic_total_capacity = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.941572 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.reserved_percentage = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.941572 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.scst_target_driver = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.941572 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.scst_target_iqn_name = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.941572 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.storage_protocol = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.941572 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.suppress_requests_ssl_warnings = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.941572 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.target_helper = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.942117 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.target_ip_address = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.942117 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.target_port = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.942117 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.target_prefix = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.942117 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.target_protocol = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.942117 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.trace_flags = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.942117 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.unique_fqdn_network = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.942117 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.use_chap_auth = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.942681 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.use_multipath_for_image_xfer = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.942681 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.volume_backend_name = ceph {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.942681 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.volume_clear = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.942681 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.volume_clear_ionice = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.942681 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.volume_clear_size = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.942681 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.volume_copy_blkio_cgroup_name = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.942681 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.volume_copy_bps_limit = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.943374 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.volume_dd_blocksize = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.943374 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.volume_driver = cinder.volume.drivers.rbd.RBDDriver {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.943374 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ceph.volumes_dir = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.943374 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.943374 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.943374 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.944383 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.944383 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.944383 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.944383 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.944383 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.944383 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.944938 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.944938 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.944938 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.944938 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.944938 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.944938 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.945419 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.945419 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.947113 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.947113 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.947113 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.947706 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.948627 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.949281 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_messaging_rabbit.ssl = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.949799 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.950317 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.950819 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.951344 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.951876 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_messaging_rabbit.ssl_version = {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.952254 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.driver [None req-8dc6d8e7-c11f-4d95-b0cf-d672bbfda4b3 None None] Driver hasn't implemented _init_vendor_properties() May 21 20:59:54.952534 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_messaging_notifications.driver = [] {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.952892 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.driver [None req-8dc6d8e7-c11f-4d95-b0cf-d672bbfda4b3 None None] Initialized capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:ec07190a-fb05-40c3-a80d-35117997cae4:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=124407) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:812}} May 21 20:59:54.953235 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_messaging_notifications.retry = -1 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.953820 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.954354 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.954852 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.955296 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] key_manager.fixed_key = **** {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.956010 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.956611 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] barbican.barbican_api_version = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.957492 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] barbican.barbican_endpoint = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.958046 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] barbican.barbican_endpoint_type = public {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.958573 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] barbican.barbican_region_name = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.959904 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] barbican.cafile = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.960442 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] barbican.certfile = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.960969 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] barbican.collect_timing = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.961470 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] barbican.insecure = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.961968 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] barbican.keyfile = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.962497 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] barbican.number_of_retries = 60 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.963005 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] barbican.retry_delay = 1 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.963525 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] barbican.send_service_user_token = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.964019 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] barbican.split_loggers = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.964557 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] barbican.timeout = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.965050 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] barbican.verify_ssl = True {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.965553 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] barbican.verify_ssl_path = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.966193 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] barbican_service_user.auth_section = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.966685 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] barbican_service_user.auth_type = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.967181 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] barbican_service_user.cafile = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.967405 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_db.sqlalchemy.engines [None req-8dc6d8e7-c11f-4d95-b0cf-d672bbfda4b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124407) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 21 20:59:54.968046 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] barbican_service_user.certfile = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.968572 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] barbican_service_user.collect_timing = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.969073 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] barbican_service_user.insecure = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.969572 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] barbican_service_user.keyfile = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.970080 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] barbican_service_user.split_loggers = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.970571 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] barbican_service_user.timeout = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.971088 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] vault.approle_role_id = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.971587 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] vault.approle_secret_id = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.972078 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] vault.cafile = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.972596 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] vault.certfile = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.973097 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] vault.collect_timing = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.973585 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] vault.insecure = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.974046 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writer thread running {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 21 20:59:54.974223 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] vault.keyfile = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.975940 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] vault.kv_mountpoint = secret {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.976573 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] vault.kv_version = 2 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.977088 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] vault.namespace = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.977612 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] vault.root_token_id = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.978281 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] vault.split_loggers = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.978777 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] vault.ssl_ca_crt_file = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.979275 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] vault.timeout = None {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.979761 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] vault.use_ssl = False {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.980428 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 21 20:59:54.980877 ncdv-master-1 cinder-volume[124233]: DEBUG oslo_service.service [None req-2f8a0c0b-5b26-42c9-99f0-1dff5d09bfa7 None None] ******************************************************************************** {{(pid=124233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 21 20:59:55.010298 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.db.sqlalchemy.api [None req-8dc6d8e7-c11f-4d95-b0cf-d672bbfda4b3 None None] Building query based on filter {{(pid=124407) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3773}} May 21 20:59:55.047755 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.image_utils [None req-8dc6d8e7-c11f-4d95-b0cf-d672bbfda4b3 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=124407) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:955}} May 21 20:59:55.047755 ncdv-master-1 cinder-volume[124407]: INFO cinder.keymgr.migration [None req-2fad8ece-c2ec-4798-9c4e-31b16a45dcd4 None None] Not migrating encryption keys because the ConfKeyManager is still in use. May 21 20:59:55.047755 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8dc6d8e7-c11f-4d95-b0cf-d672bbfda4b3 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 20:59:55.074382 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8dc6d8e7-c11f-4d95-b0cf-d672bbfda4b3 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 20:59:55.102143 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-8dc6d8e7-c11f-4d95-b0cf-d672bbfda4b3 None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 20:59:55.127110 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-8dc6d8e7-c11f-4d95-b0cf-d672bbfda4b3 None None] Driver initialization completed successfully. May 21 20:59:55.128328 ncdv-master-1 cinder-volume[124407]: INFO cinder.manager [None req-8dc6d8e7-c11f-4d95-b0cf-d672bbfda4b3 None None] Initiating service 3 cleanup May 21 20:59:55.139705 ncdv-master-1 cinder-volume[124407]: INFO cinder.manager [None req-8dc6d8e7-c11f-4d95-b0cf-d672bbfda4b3 None None] Service 3 cleanup completed. May 21 20:59:55.140046 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.service [None req-8dc6d8e7-c11f-4d95-b0cf-d672bbfda4b3 None None] Creating RPC server for service cinder-volume {{(pid=124407) start /opt/stack/cinder/cinder/service.py:231}} May 21 20:59:55.150354 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.service [None req-8dc6d8e7-c11f-4d95-b0cf-d672bbfda4b3 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=124407) start /opt/stack/cinder/cinder/service.py:237}} May 21 20:59:55.197156 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-8dc6d8e7-c11f-4d95-b0cf-d672bbfda4b3 None None] Initializing RPC dependent components of volume driver RBDDriver (1.2.0) May 21 20:59:55.198293 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8dc6d8e7-c11f-4d95-b0cf-d672bbfda4b3 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 20:59:55.296582 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8dc6d8e7-c11f-4d95-b0cf-d672bbfda4b3 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 20:59:55.393284 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-8dc6d8e7-c11f-4d95-b0cf-d672bbfda4b3 None None] Driver post RPC initialization completed successfully. May 21 21:00:04.632742 ncdv-master-1 cinder-volume[124233]: DEBUG dbcounter [-] [124233] Writing DB stats cinder:SELECT=16,cinder:INSERT=1 {{(pid=124233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:00:05.338468 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=24,cinder:INSERT=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:00:05.347915 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:00:45.398781 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:00:45.400336 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=11,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:00:55.557597 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:01:15.407495 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:01:35.415429 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:01:45.414246 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:01:47.396642 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:01:47.397889 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:01:47.419357 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:01:47.443378 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:02:05.416491 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:02:15.413889 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:02:35.414228 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:02:47.398933 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:02:47.399586 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:02:47.422252 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:02:47.445581 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:02:55.415989 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:03:15.421067 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:03:35.421055 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:03:47.400146 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:03:47.400825 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:03:47.423090 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:03:47.445620 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:03:55.426577 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:04:15.418356 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:04:25.424232 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:04:45.425103 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:04:47.400969 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:04:47.401652 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:04:47.423682 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:04:47.446391 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:04:55.423217 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:05:05.430389 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:05:15.433560 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:05:25.434311 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:05:35.439421 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:05:45.444241 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:05:47.401654 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:05:47.402612 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:05:47.424547 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:05:47.445825 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:06:05.450454 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:06:15.453717 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=10,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:06:25.460142 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:06:45.462227 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:06:47.400682 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:06:47.401353 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:06:47.422266 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:06:47.445371 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:07:05.462479 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:07:25.459680 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:07:45.461304 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:UPDATE=2,cinder:SELECT=5 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:07:47.400771 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:07:47.401478 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:07:47.424438 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:07:47.445931 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:08:05.468001 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:08:25.470762 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:08:35.477547 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:08:47.401541 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:08:47.402226 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:08:47.423295 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:08:47.445655 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:08:55.473737 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:09:05.478333 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:09:15.480132 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:09:25.477382 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:09:45.473183 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:09:47.400518 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:09:47.401218 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:09:47.423191 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:09:47.445800 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:09:55.485660 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:10:15.480216 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:10:25.493589 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:10:45.483885 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:10:47.401199 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:10:47.402530 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:10:47.463939 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:10:47.552803 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:10:55.493384 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:11:15.492257 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:11:25.492228 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:11:35.492623 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:11:45.506968 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:11:47.399699 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:11:47.400457 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:11:47.508599 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:11:47.602486 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:12:05.491798 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:12:15.491405 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:12:35.504890 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:12:47.397762 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:12:47.404639 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:12:47.488443 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:12:47.574699 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:12:55.498090 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:13:05.509143 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:13:31.552523 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:13:31.629691 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f593490-6cef-424e-a645-3c6aeafd3d69 tempest-AttachSCSIVolumeTestJSON-459177358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:13:31.728124 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8f593490-6cef-424e-a645-3c6aeafd3d69 tempest-AttachSCSIVolumeTestJSON-459177358 None] Flow 'volume_create_manager' (451a7774-5527-4950-b629-a1f2636e2a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:13:31.737376 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8f593490-6cef-424e-a645-3c6aeafd3d69 tempest-AttachSCSIVolumeTestJSON-459177358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb96334b-7b4f-41ab-97a3-12e98ed8fec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:13:31.797113 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8f593490-6cef-424e-a645-3c6aeafd3d69 tempest-AttachSCSIVolumeTestJSON-459177358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb96334b-7b4f-41ab-97a3-12e98ed8fec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-103192732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a8a19dad-a211-4b3c-948b-1c4f05f69948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec45624cf8a940fd952008d56b0d2465',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:13:31Z,use_quota=True,user_id='331fe55d374249f6bbd9291adf78d5a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:13:31.802510 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8f593490-6cef-424e-a645-3c6aeafd3d69 tempest-AttachSCSIVolumeTestJSON-459177358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7bafe4b-b658-4ff9-891e-1b00ef0d0401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:13:31.812338 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8f593490-6cef-424e-a645-3c6aeafd3d69 tempest-AttachSCSIVolumeTestJSON-459177358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7bafe4b-b658-4ff9-891e-1b00ef0d0401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:13:31.812338 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8f593490-6cef-424e-a645-3c6aeafd3d69 tempest-AttachSCSIVolumeTestJSON-459177358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56c7da49-45a2-4660-93df-97c40db62402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:13:31.827378 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8f593490-6cef-424e-a645-3c6aeafd3d69 tempest-AttachSCSIVolumeTestJSON-459177358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56c7da49-45a2-4660-93df-97c40db62402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8a19dad-a211-4b3c-948b-1c4f05f69948', 'volume_name': 'volume-a8a19dad-a211-4b3c-948b-1c4f05f69948', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:13:31.840431 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8f593490-6cef-424e-a645-3c6aeafd3d69 tempest-AttachSCSIVolumeTestJSON-459177358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (939a69c2-283e-4f93-bd02-01f523e5f5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:13:31.848833 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8f593490-6cef-424e-a645-3c6aeafd3d69 tempest-AttachSCSIVolumeTestJSON-459177358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (939a69c2-283e-4f93-bd02-01f523e5f5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:13:31.855185 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8f593490-6cef-424e-a645-3c6aeafd3d69 tempest-AttachSCSIVolumeTestJSON-459177358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe486b92-efc2-41a2-b5a2-b20a8c7caa50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:13:31.856683 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-8f593490-6cef-424e-a645-3c6aeafd3d69 tempest-AttachSCSIVolumeTestJSON-459177358 None] Volume a8a19dad-a211-4b3c-948b-1c4f05f69948: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8a19dad-a211-4b3c-948b-1c4f05f69948', 'volume_size': 1} May 21 21:13:31.857699 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8f593490-6cef-424e-a645-3c6aeafd3d69 tempest-AttachSCSIVolumeTestJSON-459177358 None] creating volume 'volume-a8a19dad-a211-4b3c-948b-1c4f05f69948' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:13:31.858927 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8f593490-6cef-424e-a645-3c6aeafd3d69 tempest-AttachSCSIVolumeTestJSON-459177358 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:13:32.661722 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8f593490-6cef-424e-a645-3c6aeafd3d69 tempest-AttachSCSIVolumeTestJSON-459177358 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:13:32.663153 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8f593490-6cef-424e-a645-3c6aeafd3d69 tempest-AttachSCSIVolumeTestJSON-459177358 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:13:32.667184 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8f593490-6cef-424e-a645-3c6aeafd3d69 tempest-AttachSCSIVolumeTestJSON-459177358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe486b92-efc2-41a2-b5a2-b20a8c7caa50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8a19dad-a211-4b3c-948b-1c4f05f69948', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:13:32.675853 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8f593490-6cef-424e-a645-3c6aeafd3d69 tempest-AttachSCSIVolumeTestJSON-459177358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02c36db4-d345-4972-896c-9b7ec72e8e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:13:32.784673 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-8f593490-6cef-424e-a645-3c6aeafd3d69 tempest-AttachSCSIVolumeTestJSON-459177358 None] Volume volume-a8a19dad-a211-4b3c-948b-1c4f05f69948 (a8a19dad-a211-4b3c-948b-1c4f05f69948): created successfully May 21 21:13:32.790075 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8f593490-6cef-424e-a645-3c6aeafd3d69 tempest-AttachSCSIVolumeTestJSON-459177358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02c36db4-d345-4972-896c-9b7ec72e8e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:13:32.795745 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8f593490-6cef-424e-a645-3c6aeafd3d69 tempest-AttachSCSIVolumeTestJSON-459177358 None] Flow 'volume_create_manager' (451a7774-5527-4950-b629-a1f2636e2a3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:13:32.883521 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-8f593490-6cef-424e-a645-3c6aeafd3d69 tempest-AttachSCSIVolumeTestJSON-459177358 None] Created volume successfully. May 21 21:13:36.570031 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-68209917-d5ae-4e02-ab09-be307c2ca64b req-41547dca-ec75-409b-9b0e-b80a1805ac83 tempest-AttachSCSIVolumeTestJSON-459177358 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:13:37.775914 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-68209917-d5ae-4e02-ab09-be307c2ca64b req-41547dca-ec75-409b-9b0e-b80a1805ac83 tempest-AttachSCSIVolumeTestJSON-459177358 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.206s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:13:37.777736 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-68209917-d5ae-4e02-ab09-be307c2ca64b req-41547dca-ec75-409b-9b0e-b80a1805ac83 tempest-AttachSCSIVolumeTestJSON-459177358 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a8a19dad-a211-4b3c-948b-1c4f05f69948', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'efef91cd-d8f8-4d93-9ad2-86d0b33251f4', 'volume_id': 'a8a19dad-a211-4b3c-948b-1c4f05f69948', 'discard': True}} {{(pid=124407) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} May 21 21:13:37.912788 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-68209917-d5ae-4e02-ab09-be307c2ca64b req-41547dca-ec75-409b-9b0e-b80a1805ac83 tempest-AttachSCSIVolumeTestJSON-459177358 None] Connection info returned from driver {'name': 'volumes/volume-a8a19dad-a211-4b3c-948b-1c4f05f69948', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a8a19dad-a211-4b3c-948b-1c4f05f69948', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b99c7985-3dd0-48b4-8d08-05a1d7ca4fa4'} {{(pid=124407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4826}} May 21 21:13:38.195983 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-68209917-d5ae-4e02-ab09-be307c2ca64b req-41547dca-ec75-409b-9b0e-b80a1805ac83 tempest-AttachSCSIVolumeTestJSON-459177358 None] attachment_update completed successfully. May 21 21:13:47.403293 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:13:47.404193 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:13:47.480637 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:13:47.546854 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:13:50.028588 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=23,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:13:50.063298 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-8c925f0b-9977-4c1c-9f2d-4b6de652a32a req-96b437eb-c8b5-432d-a1a3-cf4d8c1ff729 tempest-AttachSCSIVolumeTestJSON-459177358 None] Terminate volume connection completed successfully. May 21 21:13:50.063998 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-8c925f0b-9977-4c1c-9f2d-4b6de652a32a req-96b437eb-c8b5-432d-a1a3-cf4d8c1ff729 tempest-AttachSCSIVolumeTestJSON-459177358 None] Deleting attachment b99c7985-3dd0-48b4-8d08-05a1d7ca4fa4. {{(pid=124407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4957}} May 21 21:13:50.725328 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-b64d5f3c-5193-4ac7-998e-dff75dbded43 tempest-LiveMigrationTest-1650172315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:13:50.757002 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b64d5f3c-5193-4ac7-998e-dff75dbded43 tempest-LiveMigrationTest-1650172315 None] Flow 'volume_create_manager' (e635345f-d457-4d8a-8464-77be8d579102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:13:50.764263 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b64d5f3c-5193-4ac7-998e-dff75dbded43 tempest-LiveMigrationTest-1650172315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ba59847-00d2-4c7a-9087-9871833973fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:13:50.788318 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b64d5f3c-5193-4ac7-998e-dff75dbded43 tempest-LiveMigrationTest-1650172315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ba59847-00d2-4c7a-9087-9871833973fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveMigrationTest-volume-1797250544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=733be916-b25a-45e6-a958-0a250da2a456,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5284da653ac24d73a21e8442609889c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:13:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:13:50Z,use_quota=True,user_id='34c22f04c3114d46b6b1b1168aa064f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:13:50.793512 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b64d5f3c-5193-4ac7-998e-dff75dbded43 tempest-LiveMigrationTest-1650172315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8c3dcce-2aa2-42fa-912c-1c2d86e5ca28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:13:50.797903 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b64d5f3c-5193-4ac7-998e-dff75dbded43 tempest-LiveMigrationTest-1650172315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8c3dcce-2aa2-42fa-912c-1c2d86e5ca28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:13:50.803067 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b64d5f3c-5193-4ac7-998e-dff75dbded43 tempest-LiveMigrationTest-1650172315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55d7b30b-c0ef-4b7f-9540-5826ee682500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:13:50.807198 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b64d5f3c-5193-4ac7-998e-dff75dbded43 tempest-LiveMigrationTest-1650172315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55d7b30b-c0ef-4b7f-9540-5826ee682500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '733be916-b25a-45e6-a958-0a250da2a456', 'volume_name': 'volume-733be916-b25a-45e6-a958-0a250da2a456', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:13:50.812745 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b64d5f3c-5193-4ac7-998e-dff75dbded43 tempest-LiveMigrationTest-1650172315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8626b171-409b-41e1-9687-ed972c056d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:13:50.817260 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b64d5f3c-5193-4ac7-998e-dff75dbded43 tempest-LiveMigrationTest-1650172315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8626b171-409b-41e1-9687-ed972c056d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:13:50.829972 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b64d5f3c-5193-4ac7-998e-dff75dbded43 tempest-LiveMigrationTest-1650172315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e05bf0bc-d41e-48a9-b2a4-5825809d15c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:13:50.831079 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-b64d5f3c-5193-4ac7-998e-dff75dbded43 tempest-LiveMigrationTest-1650172315 None] Volume 733be916-b25a-45e6-a958-0a250da2a456: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-733be916-b25a-45e6-a958-0a250da2a456', 'volume_size': 1} May 21 21:13:50.831631 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b64d5f3c-5193-4ac7-998e-dff75dbded43 tempest-LiveMigrationTest-1650172315 None] creating volume 'volume-733be916-b25a-45e6-a958-0a250da2a456' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:13:50.832469 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b64d5f3c-5193-4ac7-998e-dff75dbded43 tempest-LiveMigrationTest-1650172315 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:13:51.542907 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b64d5f3c-5193-4ac7-998e-dff75dbded43 tempest-LiveMigrationTest-1650172315 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:13:51.544707 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b64d5f3c-5193-4ac7-998e-dff75dbded43 tempest-LiveMigrationTest-1650172315 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:13:51.548476 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b64d5f3c-5193-4ac7-998e-dff75dbded43 tempest-LiveMigrationTest-1650172315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e05bf0bc-d41e-48a9-b2a4-5825809d15c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-733be916-b25a-45e6-a958-0a250da2a456', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:13:51.552895 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b64d5f3c-5193-4ac7-998e-dff75dbded43 tempest-LiveMigrationTest-1650172315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74b895e0-e682-47f8-9982-23125b9908d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:13:51.655098 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-b64d5f3c-5193-4ac7-998e-dff75dbded43 tempest-LiveMigrationTest-1650172315 None] Volume volume-733be916-b25a-45e6-a958-0a250da2a456 (733be916-b25a-45e6-a958-0a250da2a456): created successfully May 21 21:13:51.659043 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b64d5f3c-5193-4ac7-998e-dff75dbded43 tempest-LiveMigrationTest-1650172315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74b895e0-e682-47f8-9982-23125b9908d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:13:51.666812 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b64d5f3c-5193-4ac7-998e-dff75dbded43 tempest-LiveMigrationTest-1650172315 None] Flow 'volume_create_manager' (e635345f-d457-4d8a-8464-77be8d579102) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:13:51.745089 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-b64d5f3c-5193-4ac7-998e-dff75dbded43 tempest-LiveMigrationTest-1650172315 None] Created volume successfully. May 21 21:13:55.869022 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-75570629-17cf-47fe-81b2-4870cb0fb345 req-b6549cfe-81cf-41bc-a56b-548954862460 tempest-LiveMigrationTest-1650172315 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:13:56.729436 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-75570629-17cf-47fe-81b2-4870cb0fb345 req-b6549cfe-81cf-41bc-a56b-548954862460 tempest-LiveMigrationTest-1650172315 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.861s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:13:56.730424 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-75570629-17cf-47fe-81b2-4870cb0fb345 req-b6549cfe-81cf-41bc-a56b-548954862460 tempest-LiveMigrationTest-1650172315 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-733be916-b25a-45e6-a958-0a250da2a456', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'efef91cd-d8f8-4d93-9ad2-86d0b33251f4', 'volume_id': '733be916-b25a-45e6-a958-0a250da2a456', 'discard': True}} {{(pid=124407) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} May 21 21:13:56.872356 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-75570629-17cf-47fe-81b2-4870cb0fb345 req-b6549cfe-81cf-41bc-a56b-548954862460 tempest-LiveMigrationTest-1650172315 None] Connection info returned from driver {'name': 'volumes/volume-733be916-b25a-45e6-a958-0a250da2a456', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '733be916-b25a-45e6-a958-0a250da2a456', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '151ac083-77da-4db6-aa73-d0e01dc6db00'} {{(pid=124407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4826}} May 21 21:13:57.055456 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-75570629-17cf-47fe-81b2-4870cb0fb345 req-b6549cfe-81cf-41bc-a56b-548954862460 tempest-LiveMigrationTest-1650172315 None] attachment_update completed successfully. May 21 21:14:03.205596 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=37,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:14:03.321154 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-821ebc38-3de4-4d63-ac9b-3d1c4f44d0c9 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:14:03.349486 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-821ebc38-3de4-4d63-ac9b-3d1c4f44d0c9 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Flow 'volume_create_manager' (6332e62c-c760-4130-a649-e5a37cbd99a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:14:03.369447 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-821ebc38-3de4-4d63-ac9b-3d1c4f44d0c9 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (624f7a7a-9220-4c4b-8e8b-5d331188dd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:14:03.391783 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-821ebc38-3de4-4d63-ac9b-3d1c4f44d0c9 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (624f7a7a-9220-4c4b-8e8b-5d331188dd80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:14:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveAutoBlockMigrationV225Test-volume-211870566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=43913e24-b1c1-4a82-9f77-46cfbc414199,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='220204ccbcf443c98a64994f29700ef0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:14:03Z,use_quota=True,user_id='b7199de1e6f04147b197c086ac6cc6fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:14:03.399550 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-821ebc38-3de4-4d63-ac9b-3d1c4f44d0c9 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2c70bef-76b0-486f-849d-67e815c6464f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:14:03.410556 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-821ebc38-3de4-4d63-ac9b-3d1c4f44d0c9 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2c70bef-76b0-486f-849d-67e815c6464f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:14:03.413549 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-821ebc38-3de4-4d63-ac9b-3d1c4f44d0c9 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (329db2b1-c6c0-462d-bc01-3e99c817fae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:14:03.417578 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-821ebc38-3de4-4d63-ac9b-3d1c4f44d0c9 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (329db2b1-c6c0-462d-bc01-3e99c817fae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43913e24-b1c1-4a82-9f77-46cfbc414199', 'volume_name': 'volume-43913e24-b1c1-4a82-9f77-46cfbc414199', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:14:03.424589 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-821ebc38-3de4-4d63-ac9b-3d1c4f44d0c9 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25663dc1-0628-45a1-babc-7c07233a442e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:14:03.429161 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-821ebc38-3de4-4d63-ac9b-3d1c4f44d0c9 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25663dc1-0628-45a1-babc-7c07233a442e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:14:03.435330 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-821ebc38-3de4-4d63-ac9b-3d1c4f44d0c9 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beddd757-ad67-48bf-82ae-a24615b4853e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:14:03.439301 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-821ebc38-3de4-4d63-ac9b-3d1c4f44d0c9 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Volume 43913e24-b1c1-4a82-9f77-46cfbc414199: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43913e24-b1c1-4a82-9f77-46cfbc414199', 'volume_size': 1} May 21 21:14:03.439301 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-821ebc38-3de4-4d63-ac9b-3d1c4f44d0c9 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] creating volume 'volume-43913e24-b1c1-4a82-9f77-46cfbc414199' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:14:03.439301 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-821ebc38-3de4-4d63-ac9b-3d1c4f44d0c9 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:14:04.244170 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-821ebc38-3de4-4d63-ac9b-3d1c4f44d0c9 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:14:04.245192 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-821ebc38-3de4-4d63-ac9b-3d1c4f44d0c9 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:14:04.253821 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-821ebc38-3de4-4d63-ac9b-3d1c4f44d0c9 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beddd757-ad67-48bf-82ae-a24615b4853e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43913e24-b1c1-4a82-9f77-46cfbc414199', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:14:04.263429 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-821ebc38-3de4-4d63-ac9b-3d1c4f44d0c9 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b4943bd-7777-4129-8048-8fe6926dc4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:14:04.398198 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-821ebc38-3de4-4d63-ac9b-3d1c4f44d0c9 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Volume volume-43913e24-b1c1-4a82-9f77-46cfbc414199 (43913e24-b1c1-4a82-9f77-46cfbc414199): created successfully May 21 21:14:04.404555 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-821ebc38-3de4-4d63-ac9b-3d1c4f44d0c9 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b4943bd-7777-4129-8048-8fe6926dc4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:14:04.423954 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-821ebc38-3de4-4d63-ac9b-3d1c4f44d0c9 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Flow 'volume_create_manager' (6332e62c-c760-4130-a649-e5a37cbd99a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:14:04.509512 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-821ebc38-3de4-4d63-ac9b-3d1c4f44d0c9 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Created volume successfully. May 21 21:14:06.745028 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-35991072-e9d7-4699-b5e3-38c8ea5dc018 req-3ca66089-9a23-496d-a80f-8f02fd732b47 tempest-LiveMigrationTest-369289799 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:14:06.822909 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-e9e1f07a-ed2d-441f-ba68-c02f6de7728e tempest-AttachSCSIVolumeTestJSON-459177358 None] Lock "b'cinder-a8a19dad-a211-4b3c-948b-1c4f05f69948-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:14:06.990275 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-e9e1f07a-ed2d-441f-ba68-c02f6de7728e tempest-AttachSCSIVolumeTestJSON-459177358 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:14:07.323377 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-e9e1f07a-ed2d-441f-ba68-c02f6de7728e tempest-AttachSCSIVolumeTestJSON-459177358 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:14:07.326474 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-e9e1f07a-ed2d-441f-ba68-c02f6de7728e tempest-AttachSCSIVolumeTestJSON-459177358 None] Volume volume-a8a19dad-a211-4b3c-948b-1c4f05f69948 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:14:07.507441 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-e9e1f07a-ed2d-441f-ba68-c02f6de7728e tempest-AttachSCSIVolumeTestJSON-459177358 None] deleting rbd volume volume-a8a19dad-a211-4b3c-948b-1c4f05f69948 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:14:07.613186 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-c343da4c-b40f-4818-9b38-bc92b1a05add req-ad9ddc74-880a-458c-9b4e-ee50f82f52d9 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:14:07.764670 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-35991072-e9d7-4699-b5e3-38c8ea5dc018 req-3ca66089-9a23-496d-a80f-8f02fd732b47 tempest-LiveMigrationTest-369289799 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.020s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:14:07.766701 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-35991072-e9d7-4699-b5e3-38c8ea5dc018 req-3ca66089-9a23-496d-a80f-8f02fd732b47 tempest-LiveMigrationTest-369289799 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-733be916-b25a-45e6-a958-0a250da2a456', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'efef91cd-d8f8-4d93-9ad2-86d0b33251f4', 'volume_id': '733be916-b25a-45e6-a958-0a250da2a456', 'discard': True}} {{(pid=124407) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} May 21 21:14:07.919575 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-35991072-e9d7-4699-b5e3-38c8ea5dc018 req-3ca66089-9a23-496d-a80f-8f02fd732b47 tempest-LiveMigrationTest-369289799 None] Connection info returned from driver {'name': 'volumes/volume-733be916-b25a-45e6-a958-0a250da2a456', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '733be916-b25a-45e6-a958-0a250da2a456', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f585f6ca-29ea-4d2c-89cb-6a3b1cf41927'} {{(pid=124407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4826}} May 21 21:14:08.147793 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-35991072-e9d7-4699-b5e3-38c8ea5dc018 req-3ca66089-9a23-496d-a80f-8f02fd732b47 tempest-LiveMigrationTest-369289799 None] attachment_update completed successfully. May 21 21:14:08.735132 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-c343da4c-b40f-4818-9b38-bc92b1a05add req-ad9ddc74-880a-458c-9b4e-ee50f82f52d9 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.123s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:14:08.735839 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-c343da4c-b40f-4818-9b38-bc92b1a05add req-ad9ddc74-880a-458c-9b4e-ee50f82f52d9 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-43913e24-b1c1-4a82-9f77-46cfbc414199', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'efef91cd-d8f8-4d93-9ad2-86d0b33251f4', 'volume_id': '43913e24-b1c1-4a82-9f77-46cfbc414199', 'discard': True}} {{(pid=124407) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} May 21 21:14:08.880976 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-c343da4c-b40f-4818-9b38-bc92b1a05add req-ad9ddc74-880a-458c-9b4e-ee50f82f52d9 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Connection info returned from driver {'name': 'volumes/volume-43913e24-b1c1-4a82-9f77-46cfbc414199', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '43913e24-b1c1-4a82-9f77-46cfbc414199', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '95aa88dd-d437-43d9-a9fd-26d3cf584586'} {{(pid=124407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4826}} May 21 21:14:09.096507 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-c343da4c-b40f-4818-9b38-bc92b1a05add req-ad9ddc74-880a-458c-9b4e-ee50f82f52d9 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] attachment_update completed successfully. May 21 21:14:12.111066 ncdv-master-1 cinder-volume[124407]: WARNING cinder.quota [None req-e9e1f07a-ed2d-441f-ba68-c02f6de7728e tempest-AttachSCSIVolumeTestJSON-459177358 None] Deprecated: Default quota for resource: volumes_ceph is set by the default quota flag: quota_volumes_ceph, it is now deprecated. Please use the default quota class for default quota. May 21 21:14:12.112004 ncdv-master-1 cinder-volume[124407]: WARNING cinder.quota [None req-e9e1f07a-ed2d-441f-ba68-c02f6de7728e tempest-AttachSCSIVolumeTestJSON-459177358 None] Deprecated: Default quota for resource: gigabytes_ceph is set by the default quota flag: quota_gigabytes_ceph, it is now deprecated. Please use the default quota class for default quota. May 21 21:14:12.243882 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-e9e1f07a-ed2d-441f-ba68-c02f6de7728e tempest-AttachSCSIVolumeTestJSON-459177358 None] Created reservations ['e0b0ee76-7de1-4177-b4bd-f8e653ff9ba0', 'a2e46451-4360-4a43-98ad-83112e804578', 'ff864a21-8508-49a6-a722-cec1a0a5cbce', '7f51943a-02d3-439d-9945-2e1f64bc97d3'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:14:12.483013 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-e9e1f07a-ed2d-441f-ba68-c02f6de7728e tempest-AttachSCSIVolumeTestJSON-459177358 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:14:12.528189 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-e9e1f07a-ed2d-441f-ba68-c02f6de7728e tempest-AttachSCSIVolumeTestJSON-459177358 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:14:12.564337 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-e9e1f07a-ed2d-441f-ba68-c02f6de7728e tempest-AttachSCSIVolumeTestJSON-459177358 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:14:12.570926 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-e9e1f07a-ed2d-441f-ba68-c02f6de7728e tempest-AttachSCSIVolumeTestJSON-459177358 None] Deleted volume successfully. May 21 21:14:12.635674 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-e9e1f07a-ed2d-441f-ba68-c02f6de7728e tempest-AttachSCSIVolumeTestJSON-459177358 None] Lock "b'cinder-a8a19dad-a211-4b3c-948b-1c4f05f69948-delete_volume'" released by "delete_volume" :: held 5.813s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:14:22.140022 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-4b5b9260-e922-4417-9999-5cbadac25ef0 req-9a170ca5-2b0c-4f2c-86ee-fade418f4cc8 tempest-LiveAutoBlockMigrationV225Test-1494818173 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:14:22.260101 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=62,cinder:UPDATE=14,cinder:DELETE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:14:22.278194 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-35991072-e9d7-4699-b5e3-38c8ea5dc018 req-ec79f221-4dc1-40e6-a558-b927b7196a80 tempest-LiveMigrationTest-369289799 None] Terminate volume connection completed successfully. May 21 21:14:22.278537 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-35991072-e9d7-4699-b5e3-38c8ea5dc018 req-ec79f221-4dc1-40e6-a558-b927b7196a80 tempest-LiveMigrationTest-369289799 None] Deleting attachment 151ac083-77da-4db6-aa73-d0e01dc6db00. {{(pid=124407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4957}} May 21 21:14:23.309476 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-4b5b9260-e922-4417-9999-5cbadac25ef0 req-9a170ca5-2b0c-4f2c-86ee-fade418f4cc8 tempest-LiveAutoBlockMigrationV225Test-1494818173 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.169s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:14:23.310081 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-4b5b9260-e922-4417-9999-5cbadac25ef0 req-9a170ca5-2b0c-4f2c-86ee-fade418f4cc8 tempest-LiveAutoBlockMigrationV225Test-1494818173 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-43913e24-b1c1-4a82-9f77-46cfbc414199', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'efef91cd-d8f8-4d93-9ad2-86d0b33251f4', 'volume_id': '43913e24-b1c1-4a82-9f77-46cfbc414199', 'discard': True}} {{(pid=124407) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} May 21 21:14:23.438182 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-4b5b9260-e922-4417-9999-5cbadac25ef0 req-9a170ca5-2b0c-4f2c-86ee-fade418f4cc8 tempest-LiveAutoBlockMigrationV225Test-1494818173 None] Connection info returned from driver {'name': 'volumes/volume-43913e24-b1c1-4a82-9f77-46cfbc414199', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '43913e24-b1c1-4a82-9f77-46cfbc414199', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '75d9817c-ca0d-442d-aa81-75e19da8e2ce'} {{(pid=124407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4826}} May 21 21:14:23.603760 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-4b5b9260-e922-4417-9999-5cbadac25ef0 req-9a170ca5-2b0c-4f2c-86ee-fade418f4cc8 tempest-LiveAutoBlockMigrationV225Test-1494818173 None] attachment_update completed successfully. May 21 21:14:35.500293 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:14:38.919922 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=65,cinder:UPDATE=20,cinder:INSERT=4 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:14:38.929302 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-08a2d552-caeb-4ed3-9a43-22fba66d1abe req-54a46597-199d-477a-b100-9e57fab6b363 tempest-LiveMigrationTest-1650172315 None] Terminate volume connection completed successfully. May 21 21:14:38.929733 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-08a2d552-caeb-4ed3-9a43-22fba66d1abe req-54a46597-199d-477a-b100-9e57fab6b363 tempest-LiveMigrationTest-1650172315 None] Deleting attachment f585f6ca-29ea-4d2c-89cb-6a3b1cf41927. {{(pid=124407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4957}} May 21 21:14:39.134764 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-4b5b9260-e922-4417-9999-5cbadac25ef0 req-4f0a42ab-eb4a-4535-9faa-fa487a46e9ed tempest-LiveAutoBlockMigrationV225Test-1494818173 None] Terminate volume connection completed successfully. May 21 21:14:39.135934 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-4b5b9260-e922-4417-9999-5cbadac25ef0 req-4f0a42ab-eb4a-4535-9faa-fa487a46e9ed tempest-LiveAutoBlockMigrationV225Test-1494818173 None] Deleting attachment 95aa88dd-d437-43d9-a9fd-26d3cf584586. {{(pid=124407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4957}} May 21 21:14:41.985757 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:14:42.011544 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Flow 'volume_create_manager' (c327f588-4306-430e-9ae3-de36434e4db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:14:42.021776 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bacf11b-f329-42e5-b541-9dff4d2aef4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:14:42.046946 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bacf11b-f329-42e5-b541-9dff4d2aef4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1692066521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b9ebacac-5f32-42e3-9194-003aee7e2435,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5284da653ac24d73a21e8442609889c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:14:42Z,use_quota=True,user_id='34c22f04c3114d46b6b1b1168aa064f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:14:42.053197 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4110d206-fc75-4a7a-ad47-6229f9319188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:14:42.059225 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4110d206-fc75-4a7a-ad47-6229f9319188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:14:42.064968 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd8461d3-d0c2-4da7-95ea-dde9a383e3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:14:42.201722 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd8461d3-d0c2-4da7-95ea-dde9a383e3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b9ebacac-5f32-42e3-9194-003aee7e2435', 'volume_name': 'volume-b9ebacac-5f32-42e3-9194-003aee7e2435', 'volume_size': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5593f8cb452404083dfa177b4ee68b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'created_at': datetime.datetime(2022, 5, 21, 21, 0, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:14:42.208011 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3967722a-0f1a-4095-8af8-0aff44566ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:14:42.214066 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3967722a-0f1a-4095-8af8-0aff44566ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:14:42.217993 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (820c6482-3e26-4d79-8288-4ebdc29a476e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:14:42.219245 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Volume b9ebacac-5f32-42e3-9194-003aee7e2435: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b9ebacac-5f32-42e3-9194-003aee7e2435', 'volume_size': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5593f8cb452404083dfa177b4ee68b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'created_at': datetime.datetime(2022, 5, 21, 21, 0, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } May 21 21:14:42.220047 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Cloning b9ebacac-5f32-42e3-9194-003aee7e2435 from image e570f5eb-6047-4214-a420-fdfdbdf19a4c at location (None, None). {{(pid=124407) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1053}} May 21 21:14:42.233279 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Lock "b'cinder-e570f5eb-6047-4214-a420-fdfdbdf19a4c'" acquired by "_prepare_image_cache_entry" :: waited 0.012s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:14:42.242692 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Preparing cache entry for image = e570f5eb-6047-4214-a420-fdfdbdf19a4c on host ncdv-master-1@ceph#ceph. {{(pid=124407) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:881}} May 21 21:14:42.243788 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Attempting to retrieve cache entry for image = e570f5eb-6047-4214-a420-fdfdbdf19a4c on host ncdv-master-1@ceph#ceph. {{(pid=124407) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:817}} May 21 21:14:47.405087 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:14:47.406701 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:14:47.446451 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:14:47.510747 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:14:50.218615 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-41c191ff-263c-4bf4-bb1c-ed83b3498cae req-4c651456-b125-4b9a-8a88-68b42bf55b32 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Terminate volume connection completed successfully. May 21 21:14:50.219288 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-41c191ff-263c-4bf4-bb1c-ed83b3498cae req-4c651456-b125-4b9a-8a88-68b42bf55b32 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Deleting attachment 75d9817c-ca0d-442d-aa81-75e19da8e2ce. {{(pid=124407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4957}} May 21 21:14:53.280373 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-836cfbb6-8a05-4556-9de7-3937cae09791 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:14:53.315145 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-836cfbb6-8a05-4556-9de7-3937cae09791 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Flow 'volume_create_manager' (175ec07e-dd65-4432-8c76-8baf881e31a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:14:53.329098 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-836cfbb6-8a05-4556-9de7-3937cae09791 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d65259b2-111f-4739-bad4-b349aa66e18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:14:53.349973 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-836cfbb6-8a05-4556-9de7-3937cae09791 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d65259b2-111f-4739-bad4-b349aa66e18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1864019526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=73a5c123-08b5-4e7a-b93d-aa0e02e78bd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='220204ccbcf443c98a64994f29700ef0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:14:53Z,use_quota=True,user_id='b7199de1e6f04147b197c086ac6cc6fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:14:53.356695 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-836cfbb6-8a05-4556-9de7-3937cae09791 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef709e2c-31a7-4408-9796-88f6f538eeef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:14:53.361101 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-836cfbb6-8a05-4556-9de7-3937cae09791 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef709e2c-31a7-4408-9796-88f6f538eeef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:14:53.367058 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-836cfbb6-8a05-4556-9de7-3937cae09791 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4532d01-cc01-45a3-963f-8a68125852c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:14:53.489709 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-836cfbb6-8a05-4556-9de7-3937cae09791 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4532d01-cc01-45a3-963f-8a68125852c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '73a5c123-08b5-4e7a-b93d-aa0e02e78bd2', 'volume_name': 'volume-73a5c123-08b5-4e7a-b93d-aa0e02e78bd2', 'volume_size': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5593f8cb452404083dfa177b4ee68b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'created_at': datetime.datetime(2022, 5, 21, 21, 0, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:14:53.495194 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-836cfbb6-8a05-4556-9de7-3937cae09791 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa3b682a-eb2b-45b1-b8fc-327a1f9890bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:14:53.498936 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-836cfbb6-8a05-4556-9de7-3937cae09791 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa3b682a-eb2b-45b1-b8fc-327a1f9890bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:14:53.503551 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-836cfbb6-8a05-4556-9de7-3937cae09791 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9c2d767-2471-41d7-b525-a5140f02a9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:14:53.504643 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-836cfbb6-8a05-4556-9de7-3937cae09791 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Volume 73a5c123-08b5-4e7a-b93d-aa0e02e78bd2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-73a5c123-08b5-4e7a-b93d-aa0e02e78bd2', 'volume_size': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5593f8cb452404083dfa177b4ee68b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'created_at': datetime.datetime(2022, 5, 21, 21, 0, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } May 21 21:14:53.505208 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-836cfbb6-8a05-4556-9de7-3937cae09791 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Cloning 73a5c123-08b5-4e7a-b93d-aa0e02e78bd2 from image e570f5eb-6047-4214-a420-fdfdbdf19a4c at location (None, None). {{(pid=124407) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1053}} May 21 21:15:03.044498 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.image_utils [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e570f5eb-6047-4214-a420-fdfdbdf19a4c_g5jedvzdncdv-master-1@ceph, size 616.00 MB, duration 20.78 sec {{(pid=124407) fetch /opt/stack/cinder/cinder/image/image_utils.py:580}} May 21 21:15:03.045785 ncdv-master-1 cinder-volume[124407]: INFO cinder.image.image_utils [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Image download 616.00 MB at 29.64 MB/s May 21 21:15:03.102109 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_e570f5eb-6047-4214-a420-fdfdbdf19a4c_g5jedvzdncdv-master-1@ceph {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:15:03.327841 ncdv-master-1 sudo[136505]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_e570f5eb-6047-4214-a420-fdfdbdf19a4c_g5jedvzdncdv-master-1@ceph May 21 21:15:03.329587 ncdv-master-1 sudo[136505]: pam_unix(sudo:session): session opened for user root by (uid=0) May 21 21:15:05.131100 ncdv-master-1 sudo[136505]: pam_unix(sudo:session): session closed for user root May 21 21:15:05.133278 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_e570f5eb-6047-4214-a420-fdfdbdf19a4c_g5jedvzdncdv-master-1@ceph" returned: 0 in 2.031s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:15:05.142031 ncdv-master-1 cinder-volume[124407]: WARNING py.warnings [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' May 21 21:15:05.142031 ncdv-master-1 cinder-volume[124407]: debtcollector.deprecate( May 21 21:15:05.142031 ncdv-master-1 cinder-volume[124407]: May 21 21:15:05.143623 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.image_utils [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Temporary image e570f5eb-6047-4214-a420-fdfdbdf19a4c is fetched for user 34c22f04c3114d46b6b1b1168aa064f5. {{(pid=124407) fetch /opt/stack/cinder/cinder/image/image_utils.py:1088}} May 21 21:15:05.332770 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_e570f5eb-6047-4214-a420-fdfdbdf19a4c_g5jedvzdncdv-master-1@ceph {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:15:05.489622 ncdv-master-1 sudo[136514]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_e570f5eb-6047-4214-a420-fdfdbdf19a4c_g5jedvzdncdv-master-1@ceph May 21 21:15:05.490504 ncdv-master-1 sudo[136514]: pam_unix(sudo:session): session opened for user root by (uid=0) May 21 21:15:07.499498 ncdv-master-1 sudo[136514]: pam_unix(sudo:session): session closed for user root May 21 21:15:07.502471 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_e570f5eb-6047-4214-a420-fdfdbdf19a4c_g5jedvzdncdv-master-1@ceph" returned: 0 in 2.169s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:15:07.505865 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] creating volume 'volume-b9ebacac-5f32-42e3-9194-003aee7e2435' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:15:07.508054 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:15:08.136528 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:15:08.137287 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:15:08.145733 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=25,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:15:08.315816 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.volume_utils [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Attempting download of e570f5eb-6047-4214-a420-fdfdbdf19a4c ((None, None)) to volume b9ebacac-5f32-42e3-9194-003aee7e2435. {{(pid=124407) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1181}} May 21 21:15:08.392227 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_e570f5eb-6047-4214-a420-fdfdbdf19a4c_pv512uml {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:15:08.558903 ncdv-master-1 sudo[136535]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_e570f5eb-6047-4214-a420-fdfdbdf19a4c_pv512uml May 21 21:15:08.560503 ncdv-master-1 sudo[136535]: pam_unix(sudo:session): session opened for user root by (uid=0) May 21 21:15:10.074888 ncdv-master-1 sudo[136535]: pam_unix(sudo:session): session closed for user root May 21 21:15:10.077009 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_e570f5eb-6047-4214-a420-fdfdbdf19a4c_pv512uml" returned: 0 in 1.685s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:15:10.078994 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_e570f5eb-6047-4214-a420-fdfdbdf19a4c_g5jedvzdncdv-master-1@ceph {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:15:10.277283 ncdv-master-1 sudo[136540]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_e570f5eb-6047-4214-a420-fdfdbdf19a4c_g5jedvzdncdv-master-1@ceph May 21 21:15:10.278777 ncdv-master-1 sudo[136540]: pam_unix(sudo:session): session opened for user root by (uid=0) May 21 21:15:11.813899 ncdv-master-1 sudo[136540]: pam_unix(sudo:session): session closed for user root May 21 21:15:11.816811 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_e570f5eb-6047-4214-a420-fdfdbdf19a4c_g5jedvzdncdv-master-1@ceph" returned: 0 in 1.738s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:15:11.818513 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.image_utils [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] e570f5eb-6047-4214-a420-fdfdbdf19a4c was vhdx, converting to raw {{(pid=124407) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:793}} May 21 21:15:11.819792 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_e570f5eb-6047-4214-a420-fdfdbdf19a4c_g5jedvzdncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmp1n97e1lh {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:15:11.843095 ncdv-master-1 sudo[136547]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_e570f5eb-6047-4214-a420-fdfdbdf19a4c_g5jedvzdncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmp1n97e1lh May 21 21:15:11.844472 ncdv-master-1 sudo[136547]: pam_unix(sudo:session): session opened for user root by (uid=0) May 21 21:15:14.425999 ncdv-master-1 sudo[136547]: pam_unix(sudo:session): session closed for user root May 21 21:15:14.428174 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_e570f5eb-6047-4214-a420-fdfdbdf19a4c_g5jedvzdncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmp1n97e1lh" returned: 0 in 2.608s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:15:14.429766 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_e570f5eb-6047-4214-a420-fdfdbdf19a4c_g5jedvzdncdv-master-1@ceph {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:15:14.545581 ncdv-master-1 sudo[136557]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_e570f5eb-6047-4214-a420-fdfdbdf19a4c_g5jedvzdncdv-master-1@ceph May 21 21:15:14.546393 ncdv-master-1 sudo[136557]: pam_unix(sudo:session): session opened for user root by (uid=0) May 21 21:15:15.645731 ncdv-master-1 sudo[136557]: pam_unix(sudo:session): session closed for user root May 21 21:15:15.647868 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_e570f5eb-6047-4214-a420-fdfdbdf19a4c_g5jedvzdncdv-master-1@ceph" returned: 0 in 1.218s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:15:15.648564 ncdv-master-1 cinder-volume[124407]: WARNING py.warnings [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' May 21 21:15:15.648564 ncdv-master-1 cinder-volume[124407]: debtcollector.deprecate( May 21 21:15:15.648564 ncdv-master-1 cinder-volume[124407]: May 21 21:15:15.649819 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.image_utils [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e570f5eb-6047-4214-a420-fdfdbdf19a4c_g5jedvzdncdv-master-1@ceph, size 700.00 MB, duration 2.61 sec, destination /opt/stack/data/cinder/conversion/tmp1n97e1lh {{(pid=124407) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:412}} May 21 21:15:15.650188 ncdv-master-1 cinder-volume[124407]: INFO cinder.image.image_utils [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Converted 700.00 MB image at 268.27 MB/s May 21 21:15:15.651413 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:15:15.929993 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:15:15.931095 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Volume volume-b9ebacac-5f32-42e3-9194-003aee7e2435 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:15:16.109838 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] deleting rbd volume volume-b9ebacac-5f32-42e3-9194-003aee7e2435 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:15:18.233086 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=15,cinder:UPDATE=4 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:15:22.056702 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Running cmd (subprocess): rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmp1n97e1lh volume-b9ebacac-5f32-42e3-9194-003aee7e2435 --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:15:45.501382 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:15:47.404656 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:15:47.405701 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:15:47.440932 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:15:47.471619 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:15:55.505329 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:16:15.509116 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:16:20.737681 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] CMD "rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmp1n97e1lh volume-b9ebacac-5f32-42e3-9194-003aee7e2435 --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 58.684s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:16:20.931603 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:16:22.215782 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:16:22.216812 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:16:22.217258 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.volume_utils [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Downloaded image e570f5eb-6047-4214-a420-fdfdbdf19a4c ((None, None)) to volume b9ebacac-5f32-42e3-9194-003aee7e2435 successfully. {{(pid=124407) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1221}} May 21 21:16:22.259156 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.image_utils [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Temporary image e570f5eb-6047-4214-a420-fdfdbdf19a4c for user 34c22f04c3114d46b6b1b1168aa064f5 is deleted. {{(pid=124407) fetch /opt/stack/cinder/cinder/image/image_utils.py:1092}} May 21 21:16:22.264270 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:16:22.611407 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Created reservations ['e54fbed3-e04f-4310-9798-5f7fc7ee9658', 'd97a1a3f-9e1e-49a3-a1fa-5e2a3b13d70d', '3a3d1ed2-2858-4cb1-aa69-b8db2536c6f7', '84e7dd55-c02e-4318-981d-704d4102169f'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:16:22.623579 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Creating image volume entry: {'volume_glance_metadata': [{'key': 'signature_verified', 'value': 'False'}], 'previous_status': None, 'replication_extended_status': None, 'display_description': None, 'ec2_id': None, 'volume_type_id': '2a50b958-f250-4971-b588-7e8b741444ba', 'consistencygroup_id': None, 'host': 'ncdv-master-1@ceph#ceph', 'group_id': None, 'service_uuid': None, 'shared_targets': True, 'created_at': datetime.datetime(2022, 5, 21, 21, 14, 41, tzinfo=datetime.timezone.utc), 'metadata': {}, 'scheduled_at': datetime.datetime(2022, 5, 21, 21, 14, 42, tzinfo=datetime.timezone.utc), 'provider_id': None, 'user_id': '34c22f04c3114d46b6b1b1168aa064f5', 'cluster_name': None, 'volume_metadata': [], 'provider_location': None, 'multiattach': False, 'bootable': False, 'size': 1, 'launched_at': None, 'deleted_at': None, 'provider_geometry': None, 'replication_status': None, 'updated_at': datetime.datetime(2022, 5, 21, 21, 14, 42, tzinfo=datetime.timezone.utc), 'replication_driver_data': None, 'deleted': False, 'project_id': 'e624588d8a9b48dc82eff460e157b277', 'terminated_at': None, 'provider_auth': None, 'volume_admin_metadata': [], 'encryption_key_id': None, 'display_name': 'image-e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'availability_zone': 'nova', 'attach_status': 'detached', 'status': 'creating', 'source_volid': 'b9ebacac-5f32-42e3-9194-003aee7e2435'}. {{(pid=124407) _clone_image_volume /opt/stack/cinder/cinder/volume/manager.py:1618}} May 21 21:16:22.896230 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Volume reschedule parameters: False retry: None {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:16:22.919893 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Flow 'volume_create_manager' (82e7c709-65ae-48d4-ad82-49477906353b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:16:22.927607 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d8751a-f435-4cb6-aebc-1a80808f8445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:16:22.965696 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d8751a-f435-4cb6-aebc-1a80808f8445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='image-e570f5eb-6047-4214-a420-fdfdbdf19a4c',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4057e637-23ba-493f-a45d-eb28c07ac60a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e624588d8a9b48dc82eff460e157b277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=b9ebacac-5f32-42e3-9194-003aee7e2435,status='creating',terminated_at=None,updated_at=2022-05-21T21:14:42Z,use_quota=True,user_id='34c22f04c3114d46b6b1b1168aa064f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:16:22.985010 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65067b8f-734f-4a57-bc27-e92b30d5fcc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:16:22.993530 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65067b8f-734f-4a57-bc27-e92b30d5fcc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:16:23.001404 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1d7d005-ecf0-4da6-9504-1148e742b753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:16:23.028246 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1d7d005-ecf0-4da6-9504-1148e742b753) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4057e637-23ba-493f-a45d-eb28c07ac60a', 'volume_name': 'volume-4057e637-23ba-493f-a45d-eb28c07ac60a', 'volume_size': 1, 'source_volid': 'b9ebacac-5f32-42e3-9194-003aee7e2435', 'source_volstatus': 'downloading'}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:16:23.033188 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ec21cc7-d6aa-49b6-869c-cbbf7c822d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:16:23.040382 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ec21cc7-d6aa-49b6-869c-cbbf7c822d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:16:23.046207 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2a59a6a-bd3e-4acc-bb18-0655ea6ddd34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:16:23.047534 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Volume 4057e637-23ba-493f-a45d-eb28c07ac60a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4057e637-23ba-493f-a45d-eb28c07ac60a', 'volume_size': 1, 'source_volid': 'b9ebacac-5f32-42e3-9194-003aee7e2435', 'source_volstatus': 'downloading'} May 21 21:16:23.063315 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:16:23.278823 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] creating snapshot='volume-4057e637-23ba-493f-a45d-eb28c07ac60a.clone_snap' {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 21 21:16:25.510818 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] cloning 'volume-b9ebacac-5f32-42e3-9194-003aee7e2435@volume-4057e637-23ba-493f-a45d-eb28c07ac60a.clone_snap' to 'volume-4057e637-23ba-493f-a45d-eb28c07ac60a' {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:789}} May 21 21:16:26.799946 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Volume volume-b9ebacac-5f32-42e3-9194-003aee7e2435 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:16:26.803115 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:16:26.803693 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:16:27.172327 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] clone created successfully {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:862}} May 21 21:16:27.176513 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2a59a6a-bd3e-4acc-bb18-0655ea6ddd34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4057e637-23ba-493f-a45d-eb28c07ac60a', 'volume_size': 1, 'source_volid': 'b9ebacac-5f32-42e3-9194-003aee7e2435', 'source_volstatus': 'downloading'}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:16:27.195761 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a0e3524-7cdd-44fb-a1a4-900df4db6d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:16:27.293964 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Volume volume-4057e637-23ba-493f-a45d-eb28c07ac60a (4057e637-23ba-493f-a45d-eb28c07ac60a): created successfully May 21 21:16:27.298693 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a0e3524-7cdd-44fb-a1a4-900df4db6d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:16:27.307859 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Flow 'volume_create_manager' (82e7c709-65ae-48d4-ad82-49477906353b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:16:27.382084 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Created volume successfully. May 21 21:16:27.656081 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Creating new image-volume cache entry for image e570f5eb-6047-4214-a420-fdfdbdf19a4c on ncdv-master-1@ceph#ceph {{(pid=124407) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:104}} May 21 21:16:27.730157 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] New image-volume cache entry created: {'id': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'volume_id': '4057e637-23ba-493f-a45d-eb28c07ac60a', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28), 'last_used': datetime.datetime(2022, 5, 21, 21, 16, 27, 659257)}. {{(pid=124407) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:129}} May 21 21:16:27.734372 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Lock "b'cinder-e570f5eb-6047-4214-a420-fdfdbdf19a4c'" released by "_prepare_image_cache_entry" :: held 105.501s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:16:27.735184 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.volume_utils [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Marking volume b9ebacac-5f32-42e3-9194-003aee7e2435 as bootable. {{(pid=124407) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} May 21 21:16:27.809911 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Copying metadata from image e570f5eb-6047-4214-a420-fdfdbdf19a4c to b9ebacac-5f32-42e3-9194-003aee7e2435. {{(pid=124407) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} May 21 21:16:27.810562 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Creating volume glance metadata for volume b9ebacac-5f32-42e3-9194-003aee7e2435 backed by image e570f5eb-6047-4214-a420-fdfdbdf19a4c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=124407) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:673}} May 21 21:16:27.938801 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (820c6482-3e26-4d79-8288-4ebdc29a476e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9ebacac-5f32-42e3-9194-003aee7e2435', 'volume_size': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5593f8cb452404083dfa177b4ee68b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'created_at': datetime.datetime(2022, 5, 21, 21, 0, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:16:27.943463 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4841730-8593-4f4e-be53-3bb9e3ee7f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:16:28.027344 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Volume volume-b9ebacac-5f32-42e3-9194-003aee7e2435 (b9ebacac-5f32-42e3-9194-003aee7e2435): created successfully May 21 21:16:28.031099 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4841730-8593-4f4e-be53-3bb9e3ee7f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:16:28.037011 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Flow 'volume_create_manager' (c327f588-4306-430e-9ae3-de36434e4db9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:16:28.096143 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-44dee822-936d-438e-9519-6e5c7cf368ec tempest-LiveMigrationTest-1650172315 None] Created volume successfully. May 21 21:16:28.598956 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-836cfbb6-8a05-4556-9de7-3937cae09791 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Lock "b'cinder-e570f5eb-6047-4214-a420-fdfdbdf19a4c'" acquired by "_prepare_image_cache_entry" :: waited 95.089s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:16:28.656525 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-836cfbb6-8a05-4556-9de7-3937cae09791 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'volume_id': '4057e637-23ba-493f-a45d-eb28c07ac60a', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28), 'last_used': datetime.datetime(2022, 5, 21, 21, 16, 28, 599699)}. {{(pid=124407) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 21 21:16:28.657052 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-836cfbb6-8a05-4556-9de7-3937cae09791 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Image-volume cache entry image_update_at = 2022-05-21 21:00:28+00:00, requested image updated_at = 2022-05-21 21:00:28+00:00. {{(pid=124407) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 21 21:16:28.657551 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-836cfbb6-8a05-4556-9de7-3937cae09791 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Found cache entry for image = e570f5eb-6047-4214-a420-fdfdbdf19a4c on host ncdv-master-1@ceph#ceph. {{(pid=124407) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:876}} May 21 21:16:28.668845 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-836cfbb6-8a05-4556-9de7-3937cae09791 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Lock "b'cinder-e570f5eb-6047-4214-a420-fdfdbdf19a4c'" released by "_prepare_image_cache_entry" :: held 0.073s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:16:28.669777 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-836cfbb6-8a05-4556-9de7-3937cae09791 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Attempting to retrieve cache entry for image = e570f5eb-6047-4214-a420-fdfdbdf19a4c on host ncdv-master-1@ceph#ceph. {{(pid=124407) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:817}} May 21 21:16:28.676029 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-836cfbb6-8a05-4556-9de7-3937cae09791 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'volume_id': '4057e637-23ba-493f-a45d-eb28c07ac60a', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28), 'last_used': datetime.datetime(2022, 5, 21, 21, 16, 28, 673631)}. {{(pid=124407) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 21 21:16:28.676563 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-836cfbb6-8a05-4556-9de7-3937cae09791 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Image-volume cache entry image_update_at = 2022-05-21 21:00:28+00:00, requested image updated_at = 2022-05-21 21:00:28+00:00. {{(pid=124407) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 21 21:16:28.676955 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-836cfbb6-8a05-4556-9de7-3937cae09791 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Creating from source image-volume 4057e637-23ba-493f-a45d-eb28c07ac60a {{(pid=124407) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:831}} May 21 21:16:28.691322 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-836cfbb6-8a05-4556-9de7-3937cae09791 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:16:29.032894 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-836cfbb6-8a05-4556-9de7-3937cae09791 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] creating snapshot='volume-73a5c123-08b5-4e7a-b93d-aa0e02e78bd2.clone_snap' {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 21 21:16:30.885223 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-836cfbb6-8a05-4556-9de7-3937cae09791 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] cloning 'volume-4057e637-23ba-493f-a45d-eb28c07ac60a@volume-73a5c123-08b5-4e7a-b93d-aa0e02e78bd2.clone_snap' to 'volume-73a5c123-08b5-4e7a-b93d-aa0e02e78bd2' {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:789}} May 21 21:16:32.083969 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-836cfbb6-8a05-4556-9de7-3937cae09791 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Volume volume-b9ebacac-5f32-42e3-9194-003aee7e2435 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:16:32.086356 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-836cfbb6-8a05-4556-9de7-3937cae09791 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:16:32.086919 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-836cfbb6-8a05-4556-9de7-3937cae09791 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:16:32.558973 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-836cfbb6-8a05-4556-9de7-3937cae09791 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] clone created successfully {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:862}} May 21 21:16:32.559740 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.volume_utils [None req-836cfbb6-8a05-4556-9de7-3937cae09791 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Marking volume 73a5c123-08b5-4e7a-b93d-aa0e02e78bd2 as bootable. {{(pid=124407) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} May 21 21:16:32.670163 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-836cfbb6-8a05-4556-9de7-3937cae09791 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Copying metadata from image e570f5eb-6047-4214-a420-fdfdbdf19a4c to 73a5c123-08b5-4e7a-b93d-aa0e02e78bd2. {{(pid=124407) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} May 21 21:16:32.671261 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-836cfbb6-8a05-4556-9de7-3937cae09791 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Creating volume glance metadata for volume 73a5c123-08b5-4e7a-b93d-aa0e02e78bd2 backed by image e570f5eb-6047-4214-a420-fdfdbdf19a4c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=124407) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:673}} May 21 21:16:32.735116 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:UPDATE=17,cinder:SELECT=66,cinder:INSERT=17 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:16:32.892747 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-836cfbb6-8a05-4556-9de7-3937cae09791 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9c2d767-2471-41d7-b525-a5140f02a9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73a5c123-08b5-4e7a-b93d-aa0e02e78bd2', 'volume_size': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5593f8cb452404083dfa177b4ee68b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'created_at': datetime.datetime(2022, 5, 21, 21, 0, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:16:32.897267 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-836cfbb6-8a05-4556-9de7-3937cae09791 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cecdff4-29b0-4885-9d5e-23565c3898d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:16:32.987379 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-836cfbb6-8a05-4556-9de7-3937cae09791 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Volume volume-73a5c123-08b5-4e7a-b93d-aa0e02e78bd2 (73a5c123-08b5-4e7a-b93d-aa0e02e78bd2): created successfully May 21 21:16:32.997233 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-836cfbb6-8a05-4556-9de7-3937cae09791 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cecdff4-29b0-4885-9d5e-23565c3898d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:16:32.997744 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-836cfbb6-8a05-4556-9de7-3937cae09791 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Flow 'volume_create_manager' (175ec07e-dd65-4432-8c76-8baf881e31a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:16:33.073290 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-836cfbb6-8a05-4556-9de7-3937cae09791 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Created volume successfully. May 21 21:16:33.854512 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-84e054f7-9589-4760-9eef-59ea64a34e42 req-93a9a98f-8868-4d54-9b7b-5e0fcd1a2c1d tempest-LiveMigrationTest-1650172315 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:16:35.308344 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-84e054f7-9589-4760-9eef-59ea64a34e42 req-93a9a98f-8868-4d54-9b7b-5e0fcd1a2c1d tempest-LiveMigrationTest-1650172315 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.454s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:16:35.309906 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-84e054f7-9589-4760-9eef-59ea64a34e42 req-93a9a98f-8868-4d54-9b7b-5e0fcd1a2c1d tempest-LiveMigrationTest-1650172315 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b9ebacac-5f32-42e3-9194-003aee7e2435', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'efef91cd-d8f8-4d93-9ad2-86d0b33251f4', 'volume_id': 'b9ebacac-5f32-42e3-9194-003aee7e2435', 'discard': True}} {{(pid=124407) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} May 21 21:16:35.446202 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-84e054f7-9589-4760-9eef-59ea64a34e42 req-93a9a98f-8868-4d54-9b7b-5e0fcd1a2c1d tempest-LiveMigrationTest-1650172315 None] Connection info returned from driver {'name': 'volumes/volume-b9ebacac-5f32-42e3-9194-003aee7e2435', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'b9ebacac-5f32-42e3-9194-003aee7e2435', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ceb3f68d-23c1-4ca6-8778-6a3a2744eb02'} {{(pid=124407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4826}} May 21 21:16:35.693570 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-84e054f7-9589-4760-9eef-59ea64a34e42 req-93a9a98f-8868-4d54-9b7b-5e0fcd1a2c1d tempest-LiveMigrationTest-1650172315 None] attachment_update completed successfully. May 21 21:16:38.984680 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-e6baab63-8216-492f-b1ba-78761f9b8dbf req-388af32a-7b3b-420d-995c-bcf8311ff375 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:16:39.963114 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-e6baab63-8216-492f-b1ba-78761f9b8dbf req-388af32a-7b3b-420d-995c-bcf8311ff375 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.981s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:16:39.963999 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-e6baab63-8216-492f-b1ba-78761f9b8dbf req-388af32a-7b3b-420d-995c-bcf8311ff375 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-73a5c123-08b5-4e7a-b93d-aa0e02e78bd2', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'efef91cd-d8f8-4d93-9ad2-86d0b33251f4', 'volume_id': '73a5c123-08b5-4e7a-b93d-aa0e02e78bd2', 'discard': True}} {{(pid=124407) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} May 21 21:16:40.092274 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-e6baab63-8216-492f-b1ba-78761f9b8dbf req-388af32a-7b3b-420d-995c-bcf8311ff375 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Connection info returned from driver {'name': 'volumes/volume-73a5c123-08b5-4e7a-b93d-aa0e02e78bd2', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '73a5c123-08b5-4e7a-b93d-aa0e02e78bd2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b0a0a18a-40f0-401f-9292-95ccfe60278b'} {{(pid=124407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4826}} May 21 21:16:40.131485 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=65,cinder:UPDATE=13,cinder:DELETE=3,cinder:INSERT=19 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:16:40.271669 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-e6baab63-8216-492f-b1ba-78761f9b8dbf req-388af32a-7b3b-420d-995c-bcf8311ff375 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] attachment_update completed successfully. May 21 21:16:47.410699 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:16:47.411858 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:16:47.510816 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:16:47.633116 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:16:55.542474 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:17:07.474418 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=21,cinder:UPDATE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:17:07.491456 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-b251ef9e-ba82-4ca5-9e5c-fecf40103045 req-96a3043d-6497-4d37-9747-2dbd9d4f3dda tempest-LiveMigrationTest-369289799 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:17:08.852640 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-b251ef9e-ba82-4ca5-9e5c-fecf40103045 req-96a3043d-6497-4d37-9747-2dbd9d4f3dda tempest-LiveMigrationTest-369289799 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.357s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:17:08.855337 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-b251ef9e-ba82-4ca5-9e5c-fecf40103045 req-96a3043d-6497-4d37-9747-2dbd9d4f3dda tempest-LiveMigrationTest-369289799 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b9ebacac-5f32-42e3-9194-003aee7e2435', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'efef91cd-d8f8-4d93-9ad2-86d0b33251f4', 'volume_id': 'b9ebacac-5f32-42e3-9194-003aee7e2435', 'discard': True}} {{(pid=124407) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} May 21 21:17:09.074546 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-b251ef9e-ba82-4ca5-9e5c-fecf40103045 req-96a3043d-6497-4d37-9747-2dbd9d4f3dda tempest-LiveMigrationTest-369289799 None] Connection info returned from driver {'name': 'volumes/volume-b9ebacac-5f32-42e3-9194-003aee7e2435', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'b9ebacac-5f32-42e3-9194-003aee7e2435', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b2daa067-c6a5-48c5-b052-af64239cf923'} {{(pid=124407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4826}} May 21 21:17:09.334228 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-b251ef9e-ba82-4ca5-9e5c-fecf40103045 req-96a3043d-6497-4d37-9747-2dbd9d4f3dda tempest-LiveMigrationTest-369289799 None] attachment_update completed successfully. May 21 21:17:18.331564 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-3be2596d-db0b-4a51-b1e3-bef549fec5b1 tempest-TaggedBootDevicesTest-674948933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:17:18.366969 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3be2596d-db0b-4a51-b1e3-bef549fec5b1 tempest-TaggedBootDevicesTest-674948933 None] Flow 'volume_create_manager' (78f36fa3-cad8-4d53-89de-63afb367f9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:17:18.377748 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3be2596d-db0b-4a51-b1e3-bef549fec5b1 tempest-TaggedBootDevicesTest-674948933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3132ad89-eb8d-4e4a-a388-e74a7388703b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:17:18.409926 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3be2596d-db0b-4a51-b1e3-bef549fec5b1 tempest-TaggedBootDevicesTest-674948933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3132ad89-eb8d-4e4a-a388-e74a7388703b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:17:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1228171836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=827936d3-46db-437b-a044-b86ceba4daab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e409e3743001461b9dee85d7db50f6a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:17:18Z,use_quota=True,user_id='c07dc02a0f494ff99b010cf0447c8338',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:17:18.419942 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3be2596d-db0b-4a51-b1e3-bef549fec5b1 tempest-TaggedBootDevicesTest-674948933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16679b3d-e48e-41a2-a52b-1c7f38a8a4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:17:18.428557 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3be2596d-db0b-4a51-b1e3-bef549fec5b1 tempest-TaggedBootDevicesTest-674948933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16679b3d-e48e-41a2-a52b-1c7f38a8a4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:17:18.437199 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3be2596d-db0b-4a51-b1e3-bef549fec5b1 tempest-TaggedBootDevicesTest-674948933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28330a17-d4cf-41ac-9dce-53e9ddc4f2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:17:18.586204 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3be2596d-db0b-4a51-b1e3-bef549fec5b1 tempest-TaggedBootDevicesTest-674948933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28330a17-d4cf-41ac-9dce-53e9ddc4f2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '827936d3-46db-437b-a044-b86ceba4daab', 'volume_name': 'volume-827936d3-46db-437b-a044-b86ceba4daab', 'volume_size': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5593f8cb452404083dfa177b4ee68b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'created_at': datetime.datetime(2022, 5, 21, 21, 0, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:17:18.601057 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3be2596d-db0b-4a51-b1e3-bef549fec5b1 tempest-TaggedBootDevicesTest-674948933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8db76c0b-e892-41f9-a814-7f8e007370a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:17:18.611213 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3be2596d-db0b-4a51-b1e3-bef549fec5b1 tempest-TaggedBootDevicesTest-674948933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8db76c0b-e892-41f9-a814-7f8e007370a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:17:18.616987 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3be2596d-db0b-4a51-b1e3-bef549fec5b1 tempest-TaggedBootDevicesTest-674948933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d229cd1b-6097-4cb1-845c-f445d00669b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:17:18.618705 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-3be2596d-db0b-4a51-b1e3-bef549fec5b1 tempest-TaggedBootDevicesTest-674948933 None] Volume 827936d3-46db-437b-a044-b86ceba4daab: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-827936d3-46db-437b-a044-b86ceba4daab', 'volume_size': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5593f8cb452404083dfa177b4ee68b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'created_at': datetime.datetime(2022, 5, 21, 21, 0, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } May 21 21:17:18.619574 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-3be2596d-db0b-4a51-b1e3-bef549fec5b1 tempest-TaggedBootDevicesTest-674948933 None] Cloning 827936d3-46db-437b-a044-b86ceba4daab from image e570f5eb-6047-4214-a420-fdfdbdf19a4c at location (None, None). {{(pid=124407) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1053}} May 21 21:17:18.630296 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-3be2596d-db0b-4a51-b1e3-bef549fec5b1 tempest-TaggedBootDevicesTest-674948933 None] Lock "b'cinder-e570f5eb-6047-4214-a420-fdfdbdf19a4c'" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:17:18.743146 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-3be2596d-db0b-4a51-b1e3-bef549fec5b1 tempest-TaggedBootDevicesTest-674948933 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'volume_id': '4057e637-23ba-493f-a45d-eb28c07ac60a', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28), 'last_used': datetime.datetime(2022, 5, 21, 21, 17, 18, 636813)}. {{(pid=124407) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 21 21:17:18.743146 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-3be2596d-db0b-4a51-b1e3-bef549fec5b1 tempest-TaggedBootDevicesTest-674948933 None] Image-volume cache entry image_update_at = 2022-05-21 21:00:28+00:00, requested image updated_at = 2022-05-21 21:00:28+00:00. {{(pid=124407) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 21 21:17:18.743146 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-3be2596d-db0b-4a51-b1e3-bef549fec5b1 tempest-TaggedBootDevicesTest-674948933 None] Found cache entry for image = e570f5eb-6047-4214-a420-fdfdbdf19a4c on host ncdv-master-1@ceph#ceph. {{(pid=124407) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:876}} May 21 21:17:18.747008 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-3be2596d-db0b-4a51-b1e3-bef549fec5b1 tempest-TaggedBootDevicesTest-674948933 None] Lock "b'cinder-e570f5eb-6047-4214-a420-fdfdbdf19a4c'" released by "_prepare_image_cache_entry" :: held 0.117s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:17:18.747760 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-3be2596d-db0b-4a51-b1e3-bef549fec5b1 tempest-TaggedBootDevicesTest-674948933 None] Attempting to retrieve cache entry for image = e570f5eb-6047-4214-a420-fdfdbdf19a4c on host ncdv-master-1@ceph#ceph. {{(pid=124407) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:817}} May 21 21:17:18.766183 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-3be2596d-db0b-4a51-b1e3-bef549fec5b1 tempest-TaggedBootDevicesTest-674948933 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'volume_id': '4057e637-23ba-493f-a45d-eb28c07ac60a', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28), 'last_used': datetime.datetime(2022, 5, 21, 21, 17, 18, 755997)}. {{(pid=124407) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 21 21:17:18.766642 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-3be2596d-db0b-4a51-b1e3-bef549fec5b1 tempest-TaggedBootDevicesTest-674948933 None] Image-volume cache entry image_update_at = 2022-05-21 21:00:28+00:00, requested image updated_at = 2022-05-21 21:00:28+00:00. {{(pid=124407) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 21 21:17:18.767043 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-3be2596d-db0b-4a51-b1e3-bef549fec5b1 tempest-TaggedBootDevicesTest-674948933 None] Creating from source image-volume 4057e637-23ba-493f-a45d-eb28c07ac60a {{(pid=124407) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:831}} May 21 21:17:18.788774 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3be2596d-db0b-4a51-b1e3-bef549fec5b1 tempest-TaggedBootDevicesTest-674948933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:17:19.486914 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3be2596d-db0b-4a51-b1e3-bef549fec5b1 tempest-TaggedBootDevicesTest-674948933 None] creating snapshot='volume-827936d3-46db-437b-a044-b86ceba4daab.clone_snap' {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 21 21:17:23.174981 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3be2596d-db0b-4a51-b1e3-bef549fec5b1 tempest-TaggedBootDevicesTest-674948933 None] cloning 'volume-4057e637-23ba-493f-a45d-eb28c07ac60a@volume-827936d3-46db-437b-a044-b86ceba4daab.clone_snap' to 'volume-827936d3-46db-437b-a044-b86ceba4daab' {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:789}} May 21 21:17:23.307441 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-a31c58e3-cfa2-43fb-87cf-74e424dce8dd tempest-ServersTestBootFromVolume-614856547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:17:23.330118 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a31c58e3-cfa2-43fb-87cf-74e424dce8dd tempest-ServersTestBootFromVolume-614856547 None] Flow 'volume_create_manager' (fc06f3d0-a760-4d7b-8e0e-514cd136a2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:17:23.341337 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a31c58e3-cfa2-43fb-87cf-74e424dce8dd tempest-ServersTestBootFromVolume-614856547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6ffa0f5-c338-46d5-9423-f6f51bf95776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:17:23.363702 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a31c58e3-cfa2-43fb-87cf-74e424dce8dd tempest-ServersTestBootFromVolume-614856547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6ffa0f5-c338-46d5-9423-f6f51bf95776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-218194713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a5550cbf-3582-4751-9f41-ccd248d7de61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28107ae255f24328bcce84129cec62d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:17:20Z,use_quota=True,user_id='ac2cc0075e654fe2b9ac0fbad3a7c239',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:17:23.370217 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a31c58e3-cfa2-43fb-87cf-74e424dce8dd tempest-ServersTestBootFromVolume-614856547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (636cb73b-be5b-449c-9487-52879bf9be87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:17:23.379243 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a31c58e3-cfa2-43fb-87cf-74e424dce8dd tempest-ServersTestBootFromVolume-614856547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (636cb73b-be5b-449c-9487-52879bf9be87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:17:23.382613 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a31c58e3-cfa2-43fb-87cf-74e424dce8dd tempest-ServersTestBootFromVolume-614856547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4cf57d4-0448-4100-b860-43fc0753a7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:17:23.527714 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a31c58e3-cfa2-43fb-87cf-74e424dce8dd tempest-ServersTestBootFromVolume-614856547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4cf57d4-0448-4100-b860-43fc0753a7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a5550cbf-3582-4751-9f41-ccd248d7de61', 'volume_name': 'volume-a5550cbf-3582-4751-9f41-ccd248d7de61', 'volume_size': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5593f8cb452404083dfa177b4ee68b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'created_at': datetime.datetime(2022, 5, 21, 21, 0, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:17:23.533335 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a31c58e3-cfa2-43fb-87cf-74e424dce8dd tempest-ServersTestBootFromVolume-614856547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d883f9bf-02a6-4fb0-87d2-b9d7898d133f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:17:23.538620 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a31c58e3-cfa2-43fb-87cf-74e424dce8dd tempest-ServersTestBootFromVolume-614856547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d883f9bf-02a6-4fb0-87d2-b9d7898d133f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:17:23.544662 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a31c58e3-cfa2-43fb-87cf-74e424dce8dd tempest-ServersTestBootFromVolume-614856547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc8b7d69-d615-4450-bd0c-f1b57a8aa9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:17:23.553193 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-a31c58e3-cfa2-43fb-87cf-74e424dce8dd tempest-ServersTestBootFromVolume-614856547 None] Volume a5550cbf-3582-4751-9f41-ccd248d7de61: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a5550cbf-3582-4751-9f41-ccd248d7de61', 'volume_size': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5593f8cb452404083dfa177b4ee68b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'created_at': datetime.datetime(2022, 5, 21, 21, 0, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } May 21 21:17:23.553193 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-a31c58e3-cfa2-43fb-87cf-74e424dce8dd tempest-ServersTestBootFromVolume-614856547 None] Cloning a5550cbf-3582-4751-9f41-ccd248d7de61 from image e570f5eb-6047-4214-a420-fdfdbdf19a4c at location (None, None). {{(pid=124407) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1053}} May 21 21:17:23.562225 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-a31c58e3-cfa2-43fb-87cf-74e424dce8dd tempest-ServersTestBootFromVolume-614856547 None] Lock "b'cinder-e570f5eb-6047-4214-a420-fdfdbdf19a4c'" acquired by "_prepare_image_cache_entry" :: waited 0.015s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:17:23.658559 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-a31c58e3-cfa2-43fb-87cf-74e424dce8dd tempest-ServersTestBootFromVolume-614856547 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'volume_id': '4057e637-23ba-493f-a45d-eb28c07ac60a', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28), 'last_used': datetime.datetime(2022, 5, 21, 21, 17, 23, 567716)}. {{(pid=124407) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 21 21:17:23.659187 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-a31c58e3-cfa2-43fb-87cf-74e424dce8dd tempest-ServersTestBootFromVolume-614856547 None] Image-volume cache entry image_update_at = 2022-05-21 21:00:28+00:00, requested image updated_at = 2022-05-21 21:00:28+00:00. {{(pid=124407) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 21 21:17:23.659759 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-a31c58e3-cfa2-43fb-87cf-74e424dce8dd tempest-ServersTestBootFromVolume-614856547 None] Found cache entry for image = e570f5eb-6047-4214-a420-fdfdbdf19a4c on host ncdv-master-1@ceph#ceph. {{(pid=124407) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:876}} May 21 21:17:23.668811 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-a31c58e3-cfa2-43fb-87cf-74e424dce8dd tempest-ServersTestBootFromVolume-614856547 None] Lock "b'cinder-e570f5eb-6047-4214-a420-fdfdbdf19a4c'" released by "_prepare_image_cache_entry" :: held 0.106s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:17:23.669891 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-a31c58e3-cfa2-43fb-87cf-74e424dce8dd tempest-ServersTestBootFromVolume-614856547 None] Attempting to retrieve cache entry for image = e570f5eb-6047-4214-a420-fdfdbdf19a4c on host ncdv-master-1@ceph#ceph. {{(pid=124407) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:817}} May 21 21:17:23.689045 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-a31c58e3-cfa2-43fb-87cf-74e424dce8dd tempest-ServersTestBootFromVolume-614856547 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'volume_id': '4057e637-23ba-493f-a45d-eb28c07ac60a', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28), 'last_used': datetime.datetime(2022, 5, 21, 21, 17, 23, 674590)}. {{(pid=124407) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 21 21:17:23.689925 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-a31c58e3-cfa2-43fb-87cf-74e424dce8dd tempest-ServersTestBootFromVolume-614856547 None] Image-volume cache entry image_update_at = 2022-05-21 21:00:28+00:00, requested image updated_at = 2022-05-21 21:00:28+00:00. {{(pid=124407) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 21 21:17:23.690528 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-a31c58e3-cfa2-43fb-87cf-74e424dce8dd tempest-ServersTestBootFromVolume-614856547 None] Creating from source image-volume 4057e637-23ba-493f-a45d-eb28c07ac60a {{(pid=124407) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:831}} May 21 21:17:23.713320 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a31c58e3-cfa2-43fb-87cf-74e424dce8dd tempest-ServersTestBootFromVolume-614856547 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:17:24.289916 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a31c58e3-cfa2-43fb-87cf-74e424dce8dd tempest-ServersTestBootFromVolume-614856547 None] creating snapshot='volume-a5550cbf-3582-4751-9f41-ccd248d7de61.clone_snap' {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 21 21:17:27.749115 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a31c58e3-cfa2-43fb-87cf-74e424dce8dd tempest-ServersTestBootFromVolume-614856547 None] cloning 'volume-4057e637-23ba-493f-a45d-eb28c07ac60a@volume-a5550cbf-3582-4751-9f41-ccd248d7de61.clone_snap' to 'volume-a5550cbf-3582-4751-9f41-ccd248d7de61' {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:789}} May 21 21:17:27.853977 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3be2596d-db0b-4a51-b1e3-bef549fec5b1 tempest-TaggedBootDevicesTest-674948933 None] Volume volume-b9ebacac-5f32-42e3-9194-003aee7e2435 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:17:27.856053 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3be2596d-db0b-4a51-b1e3-bef549fec5b1 tempest-TaggedBootDevicesTest-674948933 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:17:27.857505 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3be2596d-db0b-4a51-b1e3-bef549fec5b1 tempest-TaggedBootDevicesTest-674948933 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:17:28.885410 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3be2596d-db0b-4a51-b1e3-bef549fec5b1 tempest-TaggedBootDevicesTest-674948933 None] clone created successfully {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:862}} May 21 21:17:28.886096 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.volume_utils [None req-3be2596d-db0b-4a51-b1e3-bef549fec5b1 tempest-TaggedBootDevicesTest-674948933 None] Marking volume 827936d3-46db-437b-a044-b86ceba4daab as bootable. {{(pid=124407) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} May 21 21:17:28.893807 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=39,cinder:UPDATE=6 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:17:28.921500 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-b251ef9e-ba82-4ca5-9e5c-fecf40103045 req-20f87b11-310f-4583-bb2a-d3a267d265e3 tempest-LiveMigrationTest-369289799 None] Terminate volume connection completed successfully. May 21 21:17:28.922248 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-b251ef9e-ba82-4ca5-9e5c-fecf40103045 req-20f87b11-310f-4583-bb2a-d3a267d265e3 tempest-LiveMigrationTest-369289799 None] Deleting attachment ceb3f68d-23c1-4ca6-8778-6a3a2744eb02. {{(pid=124407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4957}} May 21 21:17:29.048752 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-3be2596d-db0b-4a51-b1e3-bef549fec5b1 tempest-TaggedBootDevicesTest-674948933 None] Copying metadata from image e570f5eb-6047-4214-a420-fdfdbdf19a4c to 827936d3-46db-437b-a044-b86ceba4daab. {{(pid=124407) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} May 21 21:17:29.049269 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-3be2596d-db0b-4a51-b1e3-bef549fec5b1 tempest-TaggedBootDevicesTest-674948933 None] Creating volume glance metadata for volume 827936d3-46db-437b-a044-b86ceba4daab backed by image e570f5eb-6047-4214-a420-fdfdbdf19a4c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=124407) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:673}} May 21 21:17:29.296808 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3be2596d-db0b-4a51-b1e3-bef549fec5b1 tempest-TaggedBootDevicesTest-674948933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d229cd1b-6097-4cb1-845c-f445d00669b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-827936d3-46db-437b-a044-b86ceba4daab', 'volume_size': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5593f8cb452404083dfa177b4ee68b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'created_at': datetime.datetime(2022, 5, 21, 21, 0, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:17:29.297181 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3be2596d-db0b-4a51-b1e3-bef549fec5b1 tempest-TaggedBootDevicesTest-674948933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fa9041f-e2c6-4a3e-9f0e-e861e8b942cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:17:29.384446 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-3be2596d-db0b-4a51-b1e3-bef549fec5b1 tempest-TaggedBootDevicesTest-674948933 None] Volume volume-827936d3-46db-437b-a044-b86ceba4daab (827936d3-46db-437b-a044-b86ceba4daab): created successfully May 21 21:17:29.388667 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3be2596d-db0b-4a51-b1e3-bef549fec5b1 tempest-TaggedBootDevicesTest-674948933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fa9041f-e2c6-4a3e-9f0e-e861e8b942cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:17:29.416053 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3be2596d-db0b-4a51-b1e3-bef549fec5b1 tempest-TaggedBootDevicesTest-674948933 None] Flow 'volume_create_manager' (78f36fa3-cad8-4d53-89de-63afb367f9d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:17:29.574497 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-3be2596d-db0b-4a51-b1e3-bef549fec5b1 tempest-TaggedBootDevicesTest-674948933 None] Created volume successfully. May 21 21:17:30.804864 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a31c58e3-cfa2-43fb-87cf-74e424dce8dd tempest-ServersTestBootFromVolume-614856547 None] Volume volume-b9ebacac-5f32-42e3-9194-003aee7e2435 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:17:30.808081 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a31c58e3-cfa2-43fb-87cf-74e424dce8dd tempest-ServersTestBootFromVolume-614856547 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:17:30.808692 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a31c58e3-cfa2-43fb-87cf-74e424dce8dd tempest-ServersTestBootFromVolume-614856547 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:17:31.136771 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a31c58e3-cfa2-43fb-87cf-74e424dce8dd tempest-ServersTestBootFromVolume-614856547 None] clone created successfully {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:862}} May 21 21:17:31.140095 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.volume_utils [None req-a31c58e3-cfa2-43fb-87cf-74e424dce8dd tempest-ServersTestBootFromVolume-614856547 None] Marking volume a5550cbf-3582-4751-9f41-ccd248d7de61 as bootable. {{(pid=124407) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} May 21 21:17:31.295422 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-618df658-0955-48ed-9cc6-3ba83cf1e569 tempest-TaggedBootDevicesTest-674948933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:17:31.370974 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-618df658-0955-48ed-9cc6-3ba83cf1e569 tempest-TaggedBootDevicesTest-674948933 None] Flow 'volume_create_manager' (73c8fd5a-26e0-48a5-8a9e-51bd8c39d077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:17:31.392455 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-618df658-0955-48ed-9cc6-3ba83cf1e569 tempest-TaggedBootDevicesTest-674948933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b5843c5-6153-4c87-bfbe-dcea02c43d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:17:31.398186 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-a31c58e3-cfa2-43fb-87cf-74e424dce8dd tempest-ServersTestBootFromVolume-614856547 None] Copying metadata from image e570f5eb-6047-4214-a420-fdfdbdf19a4c to a5550cbf-3582-4751-9f41-ccd248d7de61. {{(pid=124407) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} May 21 21:17:31.398682 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-a31c58e3-cfa2-43fb-87cf-74e424dce8dd tempest-ServersTestBootFromVolume-614856547 None] Creating volume glance metadata for volume a5550cbf-3582-4751-9f41-ccd248d7de61 backed by image e570f5eb-6047-4214-a420-fdfdbdf19a4c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=124407) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:673}} May 21 21:17:31.424811 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-618df658-0955-48ed-9cc6-3ba83cf1e569 tempest-TaggedBootDevicesTest-674948933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b5843c5-6153-4c87-bfbe-dcea02c43d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1153749195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2ec648c5-31f0-4665-a957-6a17147b791e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e409e3743001461b9dee85d7db50f6a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:17:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:17:31Z,use_quota=True,user_id='c07dc02a0f494ff99b010cf0447c8338',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:17:31.432141 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-618df658-0955-48ed-9cc6-3ba83cf1e569 tempest-TaggedBootDevicesTest-674948933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32f0fe4e-ecde-4c28-953e-11c8c7e9b85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:17:31.438194 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-618df658-0955-48ed-9cc6-3ba83cf1e569 tempest-TaggedBootDevicesTest-674948933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32f0fe4e-ecde-4c28-953e-11c8c7e9b85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:17:31.444122 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-618df658-0955-48ed-9cc6-3ba83cf1e569 tempest-TaggedBootDevicesTest-674948933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb44569b-8a43-44de-904a-801300f8831d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:17:31.448634 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-618df658-0955-48ed-9cc6-3ba83cf1e569 tempest-TaggedBootDevicesTest-674948933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb44569b-8a43-44de-904a-801300f8831d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ec648c5-31f0-4665-a957-6a17147b791e', 'volume_name': 'volume-2ec648c5-31f0-4665-a957-6a17147b791e', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:17:31.454738 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-618df658-0955-48ed-9cc6-3ba83cf1e569 tempest-TaggedBootDevicesTest-674948933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f323ee2-8ac3-4ab4-b41e-868b8ef654cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:17:31.461226 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-618df658-0955-48ed-9cc6-3ba83cf1e569 tempest-TaggedBootDevicesTest-674948933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f323ee2-8ac3-4ab4-b41e-868b8ef654cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:17:31.474074 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-618df658-0955-48ed-9cc6-3ba83cf1e569 tempest-TaggedBootDevicesTest-674948933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09047ece-3244-4432-91a3-af4b45a65ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:17:31.475208 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-618df658-0955-48ed-9cc6-3ba83cf1e569 tempest-TaggedBootDevicesTest-674948933 None] Volume 2ec648c5-31f0-4665-a957-6a17147b791e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ec648c5-31f0-4665-a957-6a17147b791e', 'volume_size': 1} May 21 21:17:31.475605 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-618df658-0955-48ed-9cc6-3ba83cf1e569 tempest-TaggedBootDevicesTest-674948933 None] creating volume 'volume-2ec648c5-31f0-4665-a957-6a17147b791e' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:17:31.478031 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-618df658-0955-48ed-9cc6-3ba83cf1e569 tempest-TaggedBootDevicesTest-674948933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:17:31.730602 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a31c58e3-cfa2-43fb-87cf-74e424dce8dd tempest-ServersTestBootFromVolume-614856547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc8b7d69-d615-4450-bd0c-f1b57a8aa9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5550cbf-3582-4751-9f41-ccd248d7de61', 'volume_size': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5593f8cb452404083dfa177b4ee68b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'created_at': datetime.datetime(2022, 5, 21, 21, 0, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:17:31.735718 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a31c58e3-cfa2-43fb-87cf-74e424dce8dd tempest-ServersTestBootFromVolume-614856547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0796869f-0bd1-47f5-a677-c26094a8fbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:17:31.883391 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-a31c58e3-cfa2-43fb-87cf-74e424dce8dd tempest-ServersTestBootFromVolume-614856547 None] Volume volume-a5550cbf-3582-4751-9f41-ccd248d7de61 (a5550cbf-3582-4751-9f41-ccd248d7de61): created successfully May 21 21:17:31.887951 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a31c58e3-cfa2-43fb-87cf-74e424dce8dd tempest-ServersTestBootFromVolume-614856547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0796869f-0bd1-47f5-a677-c26094a8fbb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:17:31.893703 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a31c58e3-cfa2-43fb-87cf-74e424dce8dd tempest-ServersTestBootFromVolume-614856547 None] Flow 'volume_create_manager' (fc06f3d0-a760-4d7b-8e0e-514cd136a2a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:17:32.013696 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-a31c58e3-cfa2-43fb-87cf-74e424dce8dd tempest-ServersTestBootFromVolume-614856547 None] Created volume successfully. May 21 21:17:32.782633 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-618df658-0955-48ed-9cc6-3ba83cf1e569 tempest-TaggedBootDevicesTest-674948933 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:17:32.783488 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-618df658-0955-48ed-9cc6-3ba83cf1e569 tempest-TaggedBootDevicesTest-674948933 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:17:32.789040 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-618df658-0955-48ed-9cc6-3ba83cf1e569 tempest-TaggedBootDevicesTest-674948933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09047ece-3244-4432-91a3-af4b45a65ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ec648c5-31f0-4665-a957-6a17147b791e', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:17:32.793980 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-618df658-0955-48ed-9cc6-3ba83cf1e569 tempest-TaggedBootDevicesTest-674948933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86d66904-86cf-4e3a-a5a8-27dfc62fe18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:17:32.877622 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-618df658-0955-48ed-9cc6-3ba83cf1e569 tempest-TaggedBootDevicesTest-674948933 None] Volume volume-2ec648c5-31f0-4665-a957-6a17147b791e (2ec648c5-31f0-4665-a957-6a17147b791e): created successfully May 21 21:17:32.878494 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-618df658-0955-48ed-9cc6-3ba83cf1e569 tempest-TaggedBootDevicesTest-674948933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86d66904-86cf-4e3a-a5a8-27dfc62fe18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:17:32.908924 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-618df658-0955-48ed-9cc6-3ba83cf1e569 tempest-TaggedBootDevicesTest-674948933 None] Flow 'volume_create_manager' (73c8fd5a-26e0-48a5-8a9e-51bd8c39d077) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:17:33.054860 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-618df658-0955-48ed-9cc6-3ba83cf1e569 tempest-TaggedBootDevicesTest-674948933 None] Created volume successfully. May 21 21:17:34.206811 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbc17a00-c8bf-45fb-a518-fdf12adcd0e9 tempest-TaggedBootDevicesTest-674948933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:17:34.284675 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-dbc17a00-c8bf-45fb-a518-fdf12adcd0e9 tempest-TaggedBootDevicesTest-674948933 None] Flow 'volume_create_manager' (663a1d21-824f-457c-872d-d3ba1cbaa295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:17:34.316183 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-dbc17a00-c8bf-45fb-a518-fdf12adcd0e9 tempest-TaggedBootDevicesTest-674948933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b83edec-5a46-4f66-b6b2-c92c2f54752b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:17:34.350929 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-dbc17a00-c8bf-45fb-a518-fdf12adcd0e9 tempest-TaggedBootDevicesTest-674948933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b83edec-5a46-4f66-b6b2-c92c2f54752b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-841154366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=bdba9bc9-a60d-4ef9-b90d-a73d75b3bf73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e409e3743001461b9dee85d7db50f6a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:17:34Z,use_quota=True,user_id='c07dc02a0f494ff99b010cf0447c8338',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:17:34.358750 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-dbc17a00-c8bf-45fb-a518-fdf12adcd0e9 tempest-TaggedBootDevicesTest-674948933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe54e09-feca-4d84-b52f-1f8321adeb59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:17:34.364236 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-dbc17a00-c8bf-45fb-a518-fdf12adcd0e9 tempest-TaggedBootDevicesTest-674948933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe54e09-feca-4d84-b52f-1f8321adeb59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:17:34.387338 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-dbc17a00-c8bf-45fb-a518-fdf12adcd0e9 tempest-TaggedBootDevicesTest-674948933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f30d28eb-22e5-442e-95f4-bf078b7bed3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:17:34.397585 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-dbc17a00-c8bf-45fb-a518-fdf12adcd0e9 tempest-TaggedBootDevicesTest-674948933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f30d28eb-22e5-442e-95f4-bf078b7bed3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdba9bc9-a60d-4ef9-b90d-a73d75b3bf73', 'volume_name': 'volume-bdba9bc9-a60d-4ef9-b90d-a73d75b3bf73', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:17:34.407339 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-dbc17a00-c8bf-45fb-a518-fdf12adcd0e9 tempest-TaggedBootDevicesTest-674948933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5181dff6-6a37-4c1f-be04-b62db3238308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:17:34.426874 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-dbc17a00-c8bf-45fb-a518-fdf12adcd0e9 tempest-TaggedBootDevicesTest-674948933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5181dff6-6a37-4c1f-be04-b62db3238308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:17:34.432805 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-dbc17a00-c8bf-45fb-a518-fdf12adcd0e9 tempest-TaggedBootDevicesTest-674948933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ffb919c-69f8-43aa-886d-79dab829391b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:17:34.434246 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-dbc17a00-c8bf-45fb-a518-fdf12adcd0e9 tempest-TaggedBootDevicesTest-674948933 None] Volume bdba9bc9-a60d-4ef9-b90d-a73d75b3bf73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdba9bc9-a60d-4ef9-b90d-a73d75b3bf73', 'volume_size': 1} May 21 21:17:34.434851 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-dbc17a00-c8bf-45fb-a518-fdf12adcd0e9 tempest-TaggedBootDevicesTest-674948933 None] creating volume 'volume-bdba9bc9-a60d-4ef9-b90d-a73d75b3bf73' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:17:34.435768 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-dbc17a00-c8bf-45fb-a518-fdf12adcd0e9 tempest-TaggedBootDevicesTest-674948933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:17:35.925256 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-dbc17a00-c8bf-45fb-a518-fdf12adcd0e9 tempest-TaggedBootDevicesTest-674948933 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:17:35.925930 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-dbc17a00-c8bf-45fb-a518-fdf12adcd0e9 tempest-TaggedBootDevicesTest-674948933 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:17:35.930387 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-dbc17a00-c8bf-45fb-a518-fdf12adcd0e9 tempest-TaggedBootDevicesTest-674948933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ffb919c-69f8-43aa-886d-79dab829391b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdba9bc9-a60d-4ef9-b90d-a73d75b3bf73', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:17:35.935314 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-dbc17a00-c8bf-45fb-a518-fdf12adcd0e9 tempest-TaggedBootDevicesTest-674948933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60b19ea2-9e72-4fcc-86b9-152ffa5bf318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:17:36.076817 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-dbc17a00-c8bf-45fb-a518-fdf12adcd0e9 tempest-TaggedBootDevicesTest-674948933 None] Volume volume-bdba9bc9-a60d-4ef9-b90d-a73d75b3bf73 (bdba9bc9-a60d-4ef9-b90d-a73d75b3bf73): created successfully May 21 21:17:36.081502 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-dbc17a00-c8bf-45fb-a518-fdf12adcd0e9 tempest-TaggedBootDevicesTest-674948933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60b19ea2-9e72-4fcc-86b9-152ffa5bf318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:17:36.087454 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-dbc17a00-c8bf-45fb-a518-fdf12adcd0e9 tempest-TaggedBootDevicesTest-674948933 None] Flow 'volume_create_manager' (663a1d21-824f-457c-872d-d3ba1cbaa295) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:17:36.500491 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-dbc17a00-c8bf-45fb-a518-fdf12adcd0e9 tempest-TaggedBootDevicesTest-674948933 None] Created volume successfully. May 21 21:17:39.672380 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=62,cinder:UPDATE=13,cinder:INSERT=24,cinder:DELETE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:17:39.688099 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-b9e37ae7-d6a8-487f-b183-b7357be01ca7 req-f6747754-58aa-48cc-8392-d2e427ce877f tempest-ServersTestBootFromVolume-614856547 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:17:40.868581 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-b9e37ae7-d6a8-487f-b183-b7357be01ca7 req-f6747754-58aa-48cc-8392-d2e427ce877f tempest-ServersTestBootFromVolume-614856547 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.180s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:17:40.869420 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-b9e37ae7-d6a8-487f-b183-b7357be01ca7 req-f6747754-58aa-48cc-8392-d2e427ce877f tempest-ServersTestBootFromVolume-614856547 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a5550cbf-3582-4751-9f41-ccd248d7de61', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'efef91cd-d8f8-4d93-9ad2-86d0b33251f4', 'volume_id': 'a5550cbf-3582-4751-9f41-ccd248d7de61', 'discard': True}} {{(pid=124407) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} May 21 21:17:41.026766 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-b9e37ae7-d6a8-487f-b183-b7357be01ca7 req-f6747754-58aa-48cc-8392-d2e427ce877f tempest-ServersTestBootFromVolume-614856547 None] Connection info returned from driver {'name': 'volumes/volume-a5550cbf-3582-4751-9f41-ccd248d7de61', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a5550cbf-3582-4751-9f41-ccd248d7de61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c5bf0d04-bae2-4c77-a41c-038d12fd67a9'} {{(pid=124407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4826}} May 21 21:17:41.131001 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-5dbc5b33-5953-414d-a738-d4420b77ddd2 req-3eeaa233-39ed-4498-ba8e-774475e2346e tempest-LiveMigrationTest-1650172315 None] Terminate volume connection completed successfully. May 21 21:17:41.131435 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-5dbc5b33-5953-414d-a738-d4420b77ddd2 req-3eeaa233-39ed-4498-ba8e-774475e2346e tempest-LiveMigrationTest-1650172315 None] Deleting attachment b2daa067-c6a5-48c5-b052-af64239cf923. {{(pid=124407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4957}} May 21 21:17:41.233386 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-b9e37ae7-d6a8-487f-b183-b7357be01ca7 req-f6747754-58aa-48cc-8392-d2e427ce877f tempest-ServersTestBootFromVolume-614856547 None] attachment_update completed successfully. May 21 21:17:41.663014 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-47c637c4-c6f2-41e2-8091-399cc8cee2fb req-e49ee15b-5a1e-46ae-bf59-90e26d4459de tempest-LiveAutoBlockMigrationV225Test-1494818173 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:17:41.760345 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [req-5dbc5b33-5953-414d-a738-d4420b77ddd2 req-7ea29cdb-f217-4b6c-98d9-27e8539ec99d tempest-LiveMigrationTest-1650172315 None] Lock "b'cinder-b9ebacac-5f32-42e3-9194-003aee7e2435-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:17:41.939225 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-5dbc5b33-5953-414d-a738-d4420b77ddd2 req-7ea29cdb-f217-4b6c-98d9-27e8539ec99d tempest-LiveMigrationTest-1650172315 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:17:42.481473 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-5dbc5b33-5953-414d-a738-d4420b77ddd2 req-7ea29cdb-f217-4b6c-98d9-27e8539ec99d tempest-LiveMigrationTest-1650172315 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:17:42.481883 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-5dbc5b33-5953-414d-a738-d4420b77ddd2 req-7ea29cdb-f217-4b6c-98d9-27e8539ec99d tempest-LiveMigrationTest-1650172315 None] volume has clone snapshot(s) {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1294}} May 21 21:17:42.483277 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-5dbc5b33-5953-414d-a738-d4420b77ddd2 req-7ea29cdb-f217-4b6c-98d9-27e8539ec99d tempest-LiveMigrationTest-1650172315 None] Volume volume-b9ebacac-5f32-42e3-9194-003aee7e2435 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:17:43.150227 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-47c637c4-c6f2-41e2-8091-399cc8cee2fb req-e49ee15b-5a1e-46ae-bf59-90e26d4459de tempest-LiveAutoBlockMigrationV225Test-1494818173 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.487s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:17:43.151581 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-47c637c4-c6f2-41e2-8091-399cc8cee2fb req-e49ee15b-5a1e-46ae-bf59-90e26d4459de tempest-LiveAutoBlockMigrationV225Test-1494818173 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-73a5c123-08b5-4e7a-b93d-aa0e02e78bd2', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'efef91cd-d8f8-4d93-9ad2-86d0b33251f4', 'volume_id': '73a5c123-08b5-4e7a-b93d-aa0e02e78bd2', 'discard': True}} {{(pid=124407) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} May 21 21:17:43.373299 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-47c637c4-c6f2-41e2-8091-399cc8cee2fb req-e49ee15b-5a1e-46ae-bf59-90e26d4459de tempest-LiveAutoBlockMigrationV225Test-1494818173 None] Connection info returned from driver {'name': 'volumes/volume-73a5c123-08b5-4e7a-b93d-aa0e02e78bd2', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '73a5c123-08b5-4e7a-b93d-aa0e02e78bd2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b6496eb0-b6a2-4362-8850-34fd1f7a2c35'} {{(pid=124407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4826}} May 21 21:17:43.639417 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-47c637c4-c6f2-41e2-8091-399cc8cee2fb req-e49ee15b-5a1e-46ae-bf59-90e26d4459de tempest-LiveAutoBlockMigrationV225Test-1494818173 None] attachment_update completed successfully. May 21 21:17:44.459634 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-1fb0cc96-f621-4376-8363-daf318cb09a9 tempest-LiveMigrationTest-1650172315 None] Lock "b'cinder-733be916-b25a-45e6-a958-0a250da2a456-delete_volume'" acquired by "delete_volume" :: waited 0.033s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:17:44.637062 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-1fb0cc96-f621-4376-8363-daf318cb09a9 tempest-LiveMigrationTest-1650172315 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:17:45.185129 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-1fb0cc96-f621-4376-8363-daf318cb09a9 tempest-LiveMigrationTest-1650172315 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:17:45.185565 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-1fb0cc96-f621-4376-8363-daf318cb09a9 tempest-LiveMigrationTest-1650172315 None] Volume volume-733be916-b25a-45e6-a958-0a250da2a456 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:17:45.506752 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-1fb0cc96-f621-4376-8363-daf318cb09a9 tempest-LiveMigrationTest-1650172315 None] deleting rbd volume volume-733be916-b25a-45e6-a958-0a250da2a456 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:17:46.184928 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [req-5dbc5b33-5953-414d-a738-d4420b77ddd2 req-7ea29cdb-f217-4b6c-98d9-27e8539ec99d tempest-LiveMigrationTest-1650172315 None] Created reservations ['d8cc1f30-aa72-4b7e-a71c-29ec35da75d3', 'c8688a6c-b25e-4fd2-9765-64359f7e7f0e', '963dda06-d772-4f05-97cb-bea8f81c8ffa', '3b8e25e0-f6b0-4eb3-b594-678068fb94ea'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:17:46.243641 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=80,cinder:UPDATE=16,cinder:DELETE=3,cinder:INSERT=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:17:46.631989 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-5dbc5b33-5953-414d-a738-d4420b77ddd2 req-7ea29cdb-f217-4b6c-98d9-27e8539ec99d tempest-LiveMigrationTest-1650172315 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:17:46.737031 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-5dbc5b33-5953-414d-a738-d4420b77ddd2 req-7ea29cdb-f217-4b6c-98d9-27e8539ec99d tempest-LiveMigrationTest-1650172315 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:17:46.831399 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [req-5dbc5b33-5953-414d-a738-d4420b77ddd2 req-7ea29cdb-f217-4b6c-98d9-27e8539ec99d tempest-LiveMigrationTest-1650172315 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:17:46.836797 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-5dbc5b33-5953-414d-a738-d4420b77ddd2 req-7ea29cdb-f217-4b6c-98d9-27e8539ec99d tempest-LiveMigrationTest-1650172315 None] Deleted volume successfully. May 21 21:17:46.928312 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [req-5dbc5b33-5953-414d-a738-d4420b77ddd2 req-7ea29cdb-f217-4b6c-98d9-27e8539ec99d tempest-LiveMigrationTest-1650172315 None] Lock "b'cinder-b9ebacac-5f32-42e3-9194-003aee7e2435-delete_volume'" released by "delete_volume" :: held 5.168s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:17:47.408782 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:17:47.419300 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:17:47.480314 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:17:47.562863 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:17:50.934169 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-1fb0cc96-f621-4376-8363-daf318cb09a9 tempest-LiveMigrationTest-1650172315 None] Created reservations ['ccd499bb-2f3d-44d2-b426-779c96bb385c', 'e59846bf-4fc2-4b1f-97de-7804b06c1aea', '90713e76-93b8-446f-9289-afb56d9343ea', '13a4e9d7-62cd-4785-8e49-380323b0feac'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:17:51.225684 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-1fb0cc96-f621-4376-8363-daf318cb09a9 tempest-LiveMigrationTest-1650172315 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:17:51.322859 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-1fb0cc96-f621-4376-8363-daf318cb09a9 tempest-LiveMigrationTest-1650172315 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:17:51.407864 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-1fb0cc96-f621-4376-8363-daf318cb09a9 tempest-LiveMigrationTest-1650172315 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:17:51.424558 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-1fb0cc96-f621-4376-8363-daf318cb09a9 tempest-LiveMigrationTest-1650172315 None] Deleted volume successfully. May 21 21:17:51.528943 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-1fb0cc96-f621-4376-8363-daf318cb09a9 tempest-LiveMigrationTest-1650172315 None] Lock "b'cinder-733be916-b25a-45e6-a958-0a250da2a456-delete_volume'" released by "delete_volume" :: held 7.074s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:17:56.486213 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-47c637c4-c6f2-41e2-8091-399cc8cee2fb req-9f4c3565-2fe6-4dc3-9ec2-9cafd99de19b tempest-LiveAutoBlockMigrationV225Test-1494818173 None] Terminate volume connection completed successfully. May 21 21:17:56.490592 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-47c637c4-c6f2-41e2-8091-399cc8cee2fb req-9f4c3565-2fe6-4dc3-9ec2-9cafd99de19b tempest-LiveAutoBlockMigrationV225Test-1494818173 None] Deleting attachment b0a0a18a-40f0-401f-9292-95ccfe60278b. {{(pid=124407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4957}} May 21 21:18:11.434435 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-de9a6955-1a42-4a83-925f-c0d3a0763b8c tempest-DeleteServersTestJSON-232394369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:18:11.460605 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-de9a6955-1a42-4a83-925f-c0d3a0763b8c tempest-DeleteServersTestJSON-232394369 None] Flow 'volume_create_manager' (5c6c3275-9c24-469a-837e-c901336e5d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:18:11.468472 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-de9a6955-1a42-4a83-925f-c0d3a0763b8c tempest-DeleteServersTestJSON-232394369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68343156-22d0-409c-a441-72ac56ce6142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:18:11.497844 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-de9a6955-1a42-4a83-925f-c0d3a0763b8c tempest-DeleteServersTestJSON-232394369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68343156-22d0-409c-a441-72ac56ce6142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1145957918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=10da5ce0-93b8-4d63-ac54-7c0b2e6dc51f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c48385dc5c24377a7be24da93fc54d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:18:11Z,use_quota=True,user_id='c3e23800ab314cc28dc30330928d8454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:18:11.504974 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-de9a6955-1a42-4a83-925f-c0d3a0763b8c tempest-DeleteServersTestJSON-232394369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d5309aa-aa2e-4879-ac6f-a4369e8f76b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:18:11.510135 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-de9a6955-1a42-4a83-925f-c0d3a0763b8c tempest-DeleteServersTestJSON-232394369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d5309aa-aa2e-4879-ac6f-a4369e8f76b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:18:11.518595 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-de9a6955-1a42-4a83-925f-c0d3a0763b8c tempest-DeleteServersTestJSON-232394369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54d2ab35-76fd-4eea-a314-05ec980e8f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:18:11.525613 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-de9a6955-1a42-4a83-925f-c0d3a0763b8c tempest-DeleteServersTestJSON-232394369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54d2ab35-76fd-4eea-a314-05ec980e8f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10da5ce0-93b8-4d63-ac54-7c0b2e6dc51f', 'volume_name': 'volume-10da5ce0-93b8-4d63-ac54-7c0b2e6dc51f', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:18:11.529896 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-de9a6955-1a42-4a83-925f-c0d3a0763b8c tempest-DeleteServersTestJSON-232394369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cefa5f6-d5d2-4a3d-8885-4326c9c27d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:18:11.536668 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-de9a6955-1a42-4a83-925f-c0d3a0763b8c tempest-DeleteServersTestJSON-232394369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cefa5f6-d5d2-4a3d-8885-4326c9c27d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:18:11.541420 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-de9a6955-1a42-4a83-925f-c0d3a0763b8c tempest-DeleteServersTestJSON-232394369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (392e4435-7562-4dbc-946d-f33071dc93fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:18:11.542658 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-de9a6955-1a42-4a83-925f-c0d3a0763b8c tempest-DeleteServersTestJSON-232394369 None] Volume 10da5ce0-93b8-4d63-ac54-7c0b2e6dc51f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10da5ce0-93b8-4d63-ac54-7c0b2e6dc51f', 'volume_size': 1} May 21 21:18:11.548532 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-de9a6955-1a42-4a83-925f-c0d3a0763b8c tempest-DeleteServersTestJSON-232394369 None] creating volume 'volume-10da5ce0-93b8-4d63-ac54-7c0b2e6dc51f' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:18:11.548532 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-de9a6955-1a42-4a83-925f-c0d3a0763b8c tempest-DeleteServersTestJSON-232394369 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:18:12.789381 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-de9a6955-1a42-4a83-925f-c0d3a0763b8c tempest-DeleteServersTestJSON-232394369 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:18:12.794888 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-de9a6955-1a42-4a83-925f-c0d3a0763b8c tempest-DeleteServersTestJSON-232394369 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:18:12.794888 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-de9a6955-1a42-4a83-925f-c0d3a0763b8c tempest-DeleteServersTestJSON-232394369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (392e4435-7562-4dbc-946d-f33071dc93fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10da5ce0-93b8-4d63-ac54-7c0b2e6dc51f', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:18:12.802487 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-de9a6955-1a42-4a83-925f-c0d3a0763b8c tempest-DeleteServersTestJSON-232394369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c8b4f33-a91b-41a0-87e2-8c24b9c74ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:18:12.913409 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-de9a6955-1a42-4a83-925f-c0d3a0763b8c tempest-DeleteServersTestJSON-232394369 None] Volume volume-10da5ce0-93b8-4d63-ac54-7c0b2e6dc51f (10da5ce0-93b8-4d63-ac54-7c0b2e6dc51f): created successfully May 21 21:18:12.917306 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-de9a6955-1a42-4a83-925f-c0d3a0763b8c tempest-DeleteServersTestJSON-232394369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c8b4f33-a91b-41a0-87e2-8c24b9c74ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:18:12.926485 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-de9a6955-1a42-4a83-925f-c0d3a0763b8c tempest-DeleteServersTestJSON-232394369 None] Flow 'volume_create_manager' (5c6c3275-9c24-469a-837e-c901336e5d53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:18:13.006065 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-de9a6955-1a42-4a83-925f-c0d3a0763b8c tempest-DeleteServersTestJSON-232394369 None] Created volume successfully. May 21 21:18:14.756743 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=30,cinder:UPDATE=26,cinder:INSERT=6,cinder:DELETE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:18:14.792860 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-c5b0f510-54e1-4ad8-bf16-4a240df7c0d1 req-e79068fb-9375-4c2d-b4ff-72956f1a063a tempest-DeleteServersTestJSON-232394369 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:18:15.725897 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-c5b0f510-54e1-4ad8-bf16-4a240df7c0d1 req-e79068fb-9375-4c2d-b4ff-72956f1a063a tempest-DeleteServersTestJSON-232394369 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.933s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:18:15.726726 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-c5b0f510-54e1-4ad8-bf16-4a240df7c0d1 req-e79068fb-9375-4c2d-b4ff-72956f1a063a tempest-DeleteServersTestJSON-232394369 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-10da5ce0-93b8-4d63-ac54-7c0b2e6dc51f', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'efef91cd-d8f8-4d93-9ad2-86d0b33251f4', 'volume_id': '10da5ce0-93b8-4d63-ac54-7c0b2e6dc51f', 'discard': True}} {{(pid=124407) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} May 21 21:18:15.786241 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-6a86565e-7ba2-43ec-8e40-b674f19786f2 req-f5d9c617-9193-42f8-af64-0dc07740bf01 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Terminate volume connection completed successfully. May 21 21:18:15.786888 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-6a86565e-7ba2-43ec-8e40-b674f19786f2 req-f5d9c617-9193-42f8-af64-0dc07740bf01 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Deleting attachment b6496eb0-b6a2-4362-8850-34fd1f7a2c35. {{(pid=124407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4957}} May 21 21:18:15.841949 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-c5b0f510-54e1-4ad8-bf16-4a240df7c0d1 req-e79068fb-9375-4c2d-b4ff-72956f1a063a tempest-DeleteServersTestJSON-232394369 None] Connection info returned from driver {'name': 'volumes/volume-10da5ce0-93b8-4d63-ac54-7c0b2e6dc51f', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '10da5ce0-93b8-4d63-ac54-7c0b2e6dc51f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '46d06009-fe19-4bd4-9409-07a9c18ac5a4'} {{(pid=124407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4826}} May 21 21:18:16.019615 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-c5b0f510-54e1-4ad8-bf16-4a240df7c0d1 req-e79068fb-9375-4c2d-b4ff-72956f1a063a tempest-DeleteServersTestJSON-232394369 None] attachment_update completed successfully. May 21 21:18:16.195303 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [req-6a86565e-7ba2-43ec-8e40-b674f19786f2 req-5870244d-8a87-4dd8-b794-f6ad9a1c4480 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Lock "b'cinder-73a5c123-08b5-4e7a-b93d-aa0e02e78bd2-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:18:16.338607 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-6a86565e-7ba2-43ec-8e40-b674f19786f2 req-5870244d-8a87-4dd8-b794-f6ad9a1c4480 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:18:16.521619 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-6a86565e-7ba2-43ec-8e40-b674f19786f2 req-5870244d-8a87-4dd8-b794-f6ad9a1c4480 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:18:16.591660 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-6a86565e-7ba2-43ec-8e40-b674f19786f2 req-5870244d-8a87-4dd8-b794-f6ad9a1c4480 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] deleting rbd volume volume-73a5c123-08b5-4e7a-b93d-aa0e02e78bd2 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:18:18.051423 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-0db4721c-7885-445b-82ab-4f068e64b6da tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Lock "b'cinder-43913e24-b1c1-4a82-9f77-46cfbc414199-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:18:18.229247 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-0db4721c-7885-445b-82ab-4f068e64b6da tempest-LiveAutoBlockMigrationV225Test-1048081752 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:18:18.442107 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-0db4721c-7885-445b-82ab-4f068e64b6da tempest-LiveAutoBlockMigrationV225Test-1048081752 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:18:18.442897 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-0db4721c-7885-445b-82ab-4f068e64b6da tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Volume volume-43913e24-b1c1-4a82-9f77-46cfbc414199 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:18:18.648137 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-0db4721c-7885-445b-82ab-4f068e64b6da tempest-LiveAutoBlockMigrationV225Test-1048081752 None] deleting rbd volume volume-43913e24-b1c1-4a82-9f77-46cfbc414199 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:18:18.687870 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-5c429e56-e5db-4d1c-9c0f-4fc60d6a8c72 req-6e519975-06c5-48b4-ad7e-765776149b3c tempest-TaggedBootDevicesTest-674948933 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:18:19.583018 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-5c429e56-e5db-4d1c-9c0f-4fc60d6a8c72 req-6e519975-06c5-48b4-ad7e-765776149b3c tempest-TaggedBootDevicesTest-674948933 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.894s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:18:19.584728 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-5c429e56-e5db-4d1c-9c0f-4fc60d6a8c72 req-6e519975-06c5-48b4-ad7e-765776149b3c tempest-TaggedBootDevicesTest-674948933 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-827936d3-46db-437b-a044-b86ceba4daab', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'efef91cd-d8f8-4d93-9ad2-86d0b33251f4', 'volume_id': '827936d3-46db-437b-a044-b86ceba4daab', 'discard': True}} {{(pid=124407) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} May 21 21:18:19.709841 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-5c429e56-e5db-4d1c-9c0f-4fc60d6a8c72 req-6e519975-06c5-48b4-ad7e-765776149b3c tempest-TaggedBootDevicesTest-674948933 None] Connection info returned from driver {'name': 'volumes/volume-827936d3-46db-437b-a044-b86ceba4daab', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '827936d3-46db-437b-a044-b86ceba4daab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '02b155a0-d576-418d-b20a-aa20d8552225'} {{(pid=124407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4826}} May 21 21:18:19.881381 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-5c429e56-e5db-4d1c-9c0f-4fc60d6a8c72 req-6e519975-06c5-48b4-ad7e-765776149b3c tempest-TaggedBootDevicesTest-674948933 None] attachment_update completed successfully. May 21 21:18:22.360315 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=72,cinder:INSERT=1,cinder:UPDATE=16,cinder:DELETE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:18:22.362967 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-5c429e56-e5db-4d1c-9c0f-4fc60d6a8c72 req-3586d465-3ec7-469b-aaab-eaae2bd59390 tempest-TaggedBootDevicesTest-674948933 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:18:23.151703 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-5c429e56-e5db-4d1c-9c0f-4fc60d6a8c72 req-3586d465-3ec7-469b-aaab-eaae2bd59390 tempest-TaggedBootDevicesTest-674948933 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.788s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:18:23.152689 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-5c429e56-e5db-4d1c-9c0f-4fc60d6a8c72 req-3586d465-3ec7-469b-aaab-eaae2bd59390 tempest-TaggedBootDevicesTest-674948933 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2ec648c5-31f0-4665-a957-6a17147b791e', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'efef91cd-d8f8-4d93-9ad2-86d0b33251f4', 'volume_id': '2ec648c5-31f0-4665-a957-6a17147b791e', 'discard': True}} {{(pid=124407) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} May 21 21:18:23.293636 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-5c429e56-e5db-4d1c-9c0f-4fc60d6a8c72 req-3586d465-3ec7-469b-aaab-eaae2bd59390 tempest-TaggedBootDevicesTest-674948933 None] Connection info returned from driver {'name': 'volumes/volume-2ec648c5-31f0-4665-a957-6a17147b791e', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '2ec648c5-31f0-4665-a957-6a17147b791e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '5b9eb899-9589-4b7a-a3ee-09054dcdd06c'} {{(pid=124407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4826}} May 21 21:18:23.516562 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-5c429e56-e5db-4d1c-9c0f-4fc60d6a8c72 req-3586d465-3ec7-469b-aaab-eaae2bd59390 tempest-TaggedBootDevicesTest-674948933 None] attachment_update completed successfully. May 21 21:18:24.335994 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-5c429e56-e5db-4d1c-9c0f-4fc60d6a8c72 req-f2a17372-4b7e-4960-8ee4-8bb3d1e11b72 tempest-TaggedBootDevicesTest-674948933 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:18:24.744695 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-192ed803-2044-471d-b569-4872b90cf419 req-cc13b281-dbc0-4f98-a39d-75a94a946487 tempest-DeleteServersTestJSON-232394369 None] Terminate volume connection completed successfully. May 21 21:18:24.746339 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-192ed803-2044-471d-b569-4872b90cf419 req-cc13b281-dbc0-4f98-a39d-75a94a946487 tempest-DeleteServersTestJSON-232394369 None] Deleting attachment 46d06009-fe19-4bd4-9409-07a9c18ac5a4. {{(pid=124407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4957}} May 21 21:18:25.328478 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-5c429e56-e5db-4d1c-9c0f-4fc60d6a8c72 req-f2a17372-4b7e-4960-8ee4-8bb3d1e11b72 tempest-TaggedBootDevicesTest-674948933 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.993s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:18:25.329188 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-5c429e56-e5db-4d1c-9c0f-4fc60d6a8c72 req-f2a17372-4b7e-4960-8ee4-8bb3d1e11b72 tempest-TaggedBootDevicesTest-674948933 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-bdba9bc9-a60d-4ef9-b90d-a73d75b3bf73', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'efef91cd-d8f8-4d93-9ad2-86d0b33251f4', 'volume_id': 'bdba9bc9-a60d-4ef9-b90d-a73d75b3bf73', 'discard': True}} {{(pid=124407) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} May 21 21:18:25.469817 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-5c429e56-e5db-4d1c-9c0f-4fc60d6a8c72 req-f2a17372-4b7e-4960-8ee4-8bb3d1e11b72 tempest-TaggedBootDevicesTest-674948933 None] Connection info returned from driver {'name': 'volumes/volume-bdba9bc9-a60d-4ef9-b90d-a73d75b3bf73', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'bdba9bc9-a60d-4ef9-b90d-a73d75b3bf73', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '032ff396-de32-4eb1-af55-e4e7aa97dd6d'} {{(pid=124407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4826}} May 21 21:18:25.671337 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-5c429e56-e5db-4d1c-9c0f-4fc60d6a8c72 req-f2a17372-4b7e-4960-8ee4-8bb3d1e11b72 tempest-TaggedBootDevicesTest-674948933 None] attachment_update completed successfully. May 21 21:18:25.716463 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-6a86565e-7ba2-43ec-8e40-b674f19786f2 req-5870244d-8a87-4dd8-b794-f6ad9a1c4480 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] volume is a clone so cleaning references {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1352}} May 21 21:18:26.167953 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-6a86565e-7ba2-43ec-8e40-b674f19786f2 req-5870244d-8a87-4dd8-b794-f6ad9a1c4480 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] deleting parent snapshot volume-73a5c123-08b5-4e7a-b93d-aa0e02e78bd2.clone_snap {{(pid=124407) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1243}} May 21 21:18:29.602910 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-0db4721c-7885-445b-82ab-4f068e64b6da tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Created reservations ['bdf8e9d0-f682-4123-91ee-3afbcd676d64', '647de0e1-f4e7-41df-ad41-8dac24a2464e', 'e9d9452f-fc07-4b6e-a8fc-2ba9e335f03d', '4b46cdfb-a56c-4c5d-a44a-4b7fdfa1d446'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:18:29.809454 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [req-6a86565e-7ba2-43ec-8e40-b674f19786f2 req-5870244d-8a87-4dd8-b794-f6ad9a1c4480 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Created reservations ['38de2a99-26e7-418b-9988-2ce6f24063d3', '8d432c7b-3c3e-4aad-b7e8-8821e82ce5e0', '9620baa4-5dcc-4d11-89c0-f7d6f21e24c3', '011e54b3-74dd-4df2-9518-8e8033b01516'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:18:29.835034 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=79,cinder:UPDATE=14,cinder:INSERT=7 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:18:29.906968 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-0db4721c-7885-445b-82ab-4f068e64b6da tempest-LiveAutoBlockMigrationV225Test-1048081752 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:18:29.998835 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-0db4721c-7885-445b-82ab-4f068e64b6da tempest-LiveAutoBlockMigrationV225Test-1048081752 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:18:30.045121 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-0db4721c-7885-445b-82ab-4f068e64b6da tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:18:30.067364 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-0db4721c-7885-445b-82ab-4f068e64b6da tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Deleted volume successfully. May 21 21:18:30.203832 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-6a86565e-7ba2-43ec-8e40-b674f19786f2 req-5870244d-8a87-4dd8-b794-f6ad9a1c4480 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:18:30.285452 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-6a86565e-7ba2-43ec-8e40-b674f19786f2 req-5870244d-8a87-4dd8-b794-f6ad9a1c4480 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:18:30.329654 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [req-6a86565e-7ba2-43ec-8e40-b674f19786f2 req-5870244d-8a87-4dd8-b794-f6ad9a1c4480 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:18:30.335026 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-6a86565e-7ba2-43ec-8e40-b674f19786f2 req-5870244d-8a87-4dd8-b794-f6ad9a1c4480 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Deleted volume successfully. May 21 21:18:30.340765 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-0db4721c-7885-445b-82ab-4f068e64b6da tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Lock "b'cinder-43913e24-b1c1-4a82-9f77-46cfbc414199-delete_volume'" released by "delete_volume" :: held 12.289s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:18:30.477597 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [req-6a86565e-7ba2-43ec-8e40-b674f19786f2 req-5870244d-8a87-4dd8-b794-f6ad9a1c4480 tempest-LiveAutoBlockMigrationV225Test-1048081752 None] Lock "b'cinder-73a5c123-08b5-4e7a-b93d-aa0e02e78bd2-delete_volume'" released by "delete_volume" :: held 14.282s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:18:47.409069 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:18:47.410235 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:18:47.467281 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:18:47.563259 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:18:49.447360 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:19:09.459792 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=22,cinder:INSERT=1,cinder:UPDATE=27,cinder:DELETE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:19:19.457180 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:19:29.465042 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:19:39.462923 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:19:47.409379 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:19:47.410294 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:19:47.519943 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:19:47.599174 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:19:49.477090 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:19:55.414193 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f35280c-0bc0-4254-9c08-7ed91c0b1168 tempest-TaggedBootDevicesTest_v242-392404299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:19:55.461591 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6f35280c-0bc0-4254-9c08-7ed91c0b1168 tempest-TaggedBootDevicesTest_v242-392404299 None] Flow 'volume_create_manager' (0c3e7624-d995-45ae-b6dd-bd2ce6800626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:19:55.476783 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6f35280c-0bc0-4254-9c08-7ed91c0b1168 tempest-TaggedBootDevicesTest_v242-392404299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c56c330-fc40-449f-84db-99650cd7c474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:19:55.511907 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6f35280c-0bc0-4254-9c08-7ed91c0b1168 tempest-TaggedBootDevicesTest_v242-392404299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c56c330-fc40-449f-84db-99650cd7c474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1698931477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=59b04ab5-47d1-4fb6-b9d8-bcbfbd8bee3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60dca17b0239494f9e8effb6d535311f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:19:55Z,use_quota=True,user_id='3d4f720a68014a829929d6586cd9154d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:19:55.519039 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6f35280c-0bc0-4254-9c08-7ed91c0b1168 tempest-TaggedBootDevicesTest_v242-392404299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbab0c16-ced1-4e89-a4e3-0f40574176d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:19:55.525181 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6f35280c-0bc0-4254-9c08-7ed91c0b1168 tempest-TaggedBootDevicesTest_v242-392404299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbab0c16-ced1-4e89-a4e3-0f40574176d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:19:55.529535 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6f35280c-0bc0-4254-9c08-7ed91c0b1168 tempest-TaggedBootDevicesTest_v242-392404299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6af6e62f-2a3c-4da6-be6d-7240c4f82d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:19:55.655302 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6f35280c-0bc0-4254-9c08-7ed91c0b1168 tempest-TaggedBootDevicesTest_v242-392404299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6af6e62f-2a3c-4da6-be6d-7240c4f82d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '59b04ab5-47d1-4fb6-b9d8-bcbfbd8bee3a', 'volume_name': 'volume-59b04ab5-47d1-4fb6-b9d8-bcbfbd8bee3a', 'volume_size': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5593f8cb452404083dfa177b4ee68b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'created_at': datetime.datetime(2022, 5, 21, 21, 0, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:19:55.670117 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6f35280c-0bc0-4254-9c08-7ed91c0b1168 tempest-TaggedBootDevicesTest_v242-392404299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac29bb8c-bf82-4633-9867-7ec5900ee1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:19:55.674759 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6f35280c-0bc0-4254-9c08-7ed91c0b1168 tempest-TaggedBootDevicesTest_v242-392404299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac29bb8c-bf82-4633-9867-7ec5900ee1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:19:55.687623 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6f35280c-0bc0-4254-9c08-7ed91c0b1168 tempest-TaggedBootDevicesTest_v242-392404299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (def8d753-0af5-40ab-a545-fa80273f7462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:19:55.689138 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-6f35280c-0bc0-4254-9c08-7ed91c0b1168 tempest-TaggedBootDevicesTest_v242-392404299 None] Volume 59b04ab5-47d1-4fb6-b9d8-bcbfbd8bee3a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-59b04ab5-47d1-4fb6-b9d8-bcbfbd8bee3a', 'volume_size': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5593f8cb452404083dfa177b4ee68b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'created_at': datetime.datetime(2022, 5, 21, 21, 0, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } May 21 21:19:55.689907 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f35280c-0bc0-4254-9c08-7ed91c0b1168 tempest-TaggedBootDevicesTest_v242-392404299 None] Cloning 59b04ab5-47d1-4fb6-b9d8-bcbfbd8bee3a from image e570f5eb-6047-4214-a420-fdfdbdf19a4c at location (None, None). {{(pid=124407) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1053}} May 21 21:19:55.702201 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-6f35280c-0bc0-4254-9c08-7ed91c0b1168 tempest-TaggedBootDevicesTest_v242-392404299 None] Lock "b'cinder-e570f5eb-6047-4214-a420-fdfdbdf19a4c'" acquired by "_prepare_image_cache_entry" :: waited 0.011s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:19:55.803361 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-6f35280c-0bc0-4254-9c08-7ed91c0b1168 tempest-TaggedBootDevicesTest_v242-392404299 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'volume_id': '4057e637-23ba-493f-a45d-eb28c07ac60a', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28), 'last_used': datetime.datetime(2022, 5, 21, 21, 19, 55, 706723)}. {{(pid=124407) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 21 21:19:55.803795 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-6f35280c-0bc0-4254-9c08-7ed91c0b1168 tempest-TaggedBootDevicesTest_v242-392404299 None] Image-volume cache entry image_update_at = 2022-05-21 21:00:28+00:00, requested image updated_at = 2022-05-21 21:00:28+00:00. {{(pid=124407) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 21 21:19:55.809603 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f35280c-0bc0-4254-9c08-7ed91c0b1168 tempest-TaggedBootDevicesTest_v242-392404299 None] Found cache entry for image = e570f5eb-6047-4214-a420-fdfdbdf19a4c on host ncdv-master-1@ceph#ceph. {{(pid=124407) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:876}} May 21 21:19:55.810108 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-6f35280c-0bc0-4254-9c08-7ed91c0b1168 tempest-TaggedBootDevicesTest_v242-392404299 None] Lock "b'cinder-e570f5eb-6047-4214-a420-fdfdbdf19a4c'" released by "_prepare_image_cache_entry" :: held 0.107s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:19:55.811222 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f35280c-0bc0-4254-9c08-7ed91c0b1168 tempest-TaggedBootDevicesTest_v242-392404299 None] Attempting to retrieve cache entry for image = e570f5eb-6047-4214-a420-fdfdbdf19a4c on host ncdv-master-1@ceph#ceph. {{(pid=124407) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:817}} May 21 21:19:55.817504 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-6f35280c-0bc0-4254-9c08-7ed91c0b1168 tempest-TaggedBootDevicesTest_v242-392404299 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'volume_id': '4057e637-23ba-493f-a45d-eb28c07ac60a', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28), 'last_used': datetime.datetime(2022, 5, 21, 21, 19, 55, 814985)}. {{(pid=124407) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 21 21:19:55.818156 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-6f35280c-0bc0-4254-9c08-7ed91c0b1168 tempest-TaggedBootDevicesTest_v242-392404299 None] Image-volume cache entry image_update_at = 2022-05-21 21:00:28+00:00, requested image updated_at = 2022-05-21 21:00:28+00:00. {{(pid=124407) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 21 21:19:55.818689 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f35280c-0bc0-4254-9c08-7ed91c0b1168 tempest-TaggedBootDevicesTest_v242-392404299 None] Creating from source image-volume 4057e637-23ba-493f-a45d-eb28c07ac60a {{(pid=124407) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:831}} May 21 21:19:55.833186 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6f35280c-0bc0-4254-9c08-7ed91c0b1168 tempest-TaggedBootDevicesTest_v242-392404299 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:19:56.312734 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6f35280c-0bc0-4254-9c08-7ed91c0b1168 tempest-TaggedBootDevicesTest_v242-392404299 None] creating snapshot='volume-59b04ab5-47d1-4fb6-b9d8-bcbfbd8bee3a.clone_snap' {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 21 21:19:59.553870 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6f35280c-0bc0-4254-9c08-7ed91c0b1168 tempest-TaggedBootDevicesTest_v242-392404299 None] cloning 'volume-4057e637-23ba-493f-a45d-eb28c07ac60a@volume-59b04ab5-47d1-4fb6-b9d8-bcbfbd8bee3a.clone_snap' to 'volume-59b04ab5-47d1-4fb6-b9d8-bcbfbd8bee3a' {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:789}} May 21 21:20:02.272490 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6f35280c-0bc0-4254-9c08-7ed91c0b1168 tempest-TaggedBootDevicesTest_v242-392404299 None] Volume volume-b9ebacac-5f32-42e3-9194-003aee7e2435.deleted is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:20:02.274692 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6f35280c-0bc0-4254-9c08-7ed91c0b1168 tempest-TaggedBootDevicesTest_v242-392404299 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:20:02.275111 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6f35280c-0bc0-4254-9c08-7ed91c0b1168 tempest-TaggedBootDevicesTest_v242-392404299 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:20:03.135341 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6f35280c-0bc0-4254-9c08-7ed91c0b1168 tempest-TaggedBootDevicesTest_v242-392404299 None] clone created successfully {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:862}} May 21 21:20:03.136483 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.volume_utils [None req-6f35280c-0bc0-4254-9c08-7ed91c0b1168 tempest-TaggedBootDevicesTest_v242-392404299 None] Marking volume 59b04ab5-47d1-4fb6-b9d8-bcbfbd8bee3a as bootable. {{(pid=124407) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} May 21 21:20:03.218807 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f35280c-0bc0-4254-9c08-7ed91c0b1168 tempest-TaggedBootDevicesTest_v242-392404299 None] Copying metadata from image e570f5eb-6047-4214-a420-fdfdbdf19a4c to 59b04ab5-47d1-4fb6-b9d8-bcbfbd8bee3a. {{(pid=124407) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} May 21 21:20:03.219221 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f35280c-0bc0-4254-9c08-7ed91c0b1168 tempest-TaggedBootDevicesTest_v242-392404299 None] Creating volume glance metadata for volume 59b04ab5-47d1-4fb6-b9d8-bcbfbd8bee3a backed by image e570f5eb-6047-4214-a420-fdfdbdf19a4c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=124407) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:673}} May 21 21:20:03.371632 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6f35280c-0bc0-4254-9c08-7ed91c0b1168 tempest-TaggedBootDevicesTest_v242-392404299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (def8d753-0af5-40ab-a545-fa80273f7462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59b04ab5-47d1-4fb6-b9d8-bcbfbd8bee3a', 'volume_size': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5593f8cb452404083dfa177b4ee68b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'created_at': datetime.datetime(2022, 5, 21, 21, 0, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:20:03.372651 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6f35280c-0bc0-4254-9c08-7ed91c0b1168 tempest-TaggedBootDevicesTest_v242-392404299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (666b04d2-259b-489a-8dc9-c6cab94f0a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:20:03.460710 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-6f35280c-0bc0-4254-9c08-7ed91c0b1168 tempest-TaggedBootDevicesTest_v242-392404299 None] Volume volume-59b04ab5-47d1-4fb6-b9d8-bcbfbd8bee3a (59b04ab5-47d1-4fb6-b9d8-bcbfbd8bee3a): created successfully May 21 21:20:03.464063 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6f35280c-0bc0-4254-9c08-7ed91c0b1168 tempest-TaggedBootDevicesTest_v242-392404299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (666b04d2-259b-489a-8dc9-c6cab94f0a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:20:03.470814 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6f35280c-0bc0-4254-9c08-7ed91c0b1168 tempest-TaggedBootDevicesTest_v242-392404299 None] Flow 'volume_create_manager' (0c3e7624-d995-45ae-b6dd-bd2ce6800626) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:20:03.683470 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-6f35280c-0bc0-4254-9c08-7ed91c0b1168 tempest-TaggedBootDevicesTest_v242-392404299 None] Created volume successfully. May 21 21:20:04.801125 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-83db3a7b-aa9d-4909-a393-dbec07578caa tempest-TaggedBootDevicesTest_v242-392404299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:20:04.835217 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-83db3a7b-aa9d-4909-a393-dbec07578caa tempest-TaggedBootDevicesTest_v242-392404299 None] Flow 'volume_create_manager' (29ac7b1f-18d6-4f3e-abac-612396a20922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:20:04.844692 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-83db3a7b-aa9d-4909-a393-dbec07578caa tempest-TaggedBootDevicesTest_v242-392404299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92a341a0-717d-486b-b15e-5f2e26d5f39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:20:04.869723 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-83db3a7b-aa9d-4909-a393-dbec07578caa tempest-TaggedBootDevicesTest_v242-392404299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92a341a0-717d-486b-b15e-5f2e26d5f39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1173326776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=fbd362bc-b589-4852-bb3e-750dd5c3fb67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60dca17b0239494f9e8effb6d535311f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:20:05Z,use_quota=True,user_id='3d4f720a68014a829929d6586cd9154d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:20:04.878130 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-83db3a7b-aa9d-4909-a393-dbec07578caa tempest-TaggedBootDevicesTest_v242-392404299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c024c8dc-0191-4640-8714-dc519ee3d0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:20:04.883012 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-83db3a7b-aa9d-4909-a393-dbec07578caa tempest-TaggedBootDevicesTest_v242-392404299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c024c8dc-0191-4640-8714-dc519ee3d0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:20:04.890654 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-83db3a7b-aa9d-4909-a393-dbec07578caa tempest-TaggedBootDevicesTest_v242-392404299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d86d14a-7a8b-4512-8868-80767ee6ad6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:20:04.895149 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-83db3a7b-aa9d-4909-a393-dbec07578caa tempest-TaggedBootDevicesTest_v242-392404299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d86d14a-7a8b-4512-8868-80767ee6ad6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbd362bc-b589-4852-bb3e-750dd5c3fb67', 'volume_name': 'volume-fbd362bc-b589-4852-bb3e-750dd5c3fb67', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:20:04.902688 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-83db3a7b-aa9d-4909-a393-dbec07578caa tempest-TaggedBootDevicesTest_v242-392404299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6165af7-1f0b-4c9a-8f21-48580a65ccb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:20:04.905655 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-83db3a7b-aa9d-4909-a393-dbec07578caa tempest-TaggedBootDevicesTest_v242-392404299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6165af7-1f0b-4c9a-8f21-48580a65ccb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:20:04.911392 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-83db3a7b-aa9d-4909-a393-dbec07578caa tempest-TaggedBootDevicesTest_v242-392404299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (182fcfa7-e36e-4027-a972-f3e788a9d800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:20:04.912739 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-83db3a7b-aa9d-4909-a393-dbec07578caa tempest-TaggedBootDevicesTest_v242-392404299 None] Volume fbd362bc-b589-4852-bb3e-750dd5c3fb67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbd362bc-b589-4852-bb3e-750dd5c3fb67', 'volume_size': 1} May 21 21:20:04.913432 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-83db3a7b-aa9d-4909-a393-dbec07578caa tempest-TaggedBootDevicesTest_v242-392404299 None] creating volume 'volume-fbd362bc-b589-4852-bb3e-750dd5c3fb67' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:20:04.914687 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-83db3a7b-aa9d-4909-a393-dbec07578caa tempest-TaggedBootDevicesTest_v242-392404299 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:20:06.658876 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-83db3a7b-aa9d-4909-a393-dbec07578caa tempest-TaggedBootDevicesTest_v242-392404299 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:20:06.671862 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-83db3a7b-aa9d-4909-a393-dbec07578caa tempest-TaggedBootDevicesTest_v242-392404299 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:20:06.675946 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-83db3a7b-aa9d-4909-a393-dbec07578caa tempest-TaggedBootDevicesTest_v242-392404299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (182fcfa7-e36e-4027-a972-f3e788a9d800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbd362bc-b589-4852-bb3e-750dd5c3fb67', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:20:06.694453 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-83db3a7b-aa9d-4909-a393-dbec07578caa tempest-TaggedBootDevicesTest_v242-392404299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd45c087-4a8e-47eb-92ff-0d0d3848d5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:20:06.833448 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-83db3a7b-aa9d-4909-a393-dbec07578caa tempest-TaggedBootDevicesTest_v242-392404299 None] Volume volume-fbd362bc-b589-4852-bb3e-750dd5c3fb67 (fbd362bc-b589-4852-bb3e-750dd5c3fb67): created successfully May 21 21:20:06.838501 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-83db3a7b-aa9d-4909-a393-dbec07578caa tempest-TaggedBootDevicesTest_v242-392404299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd45c087-4a8e-47eb-92ff-0d0d3848d5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:20:06.865256 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-83db3a7b-aa9d-4909-a393-dbec07578caa tempest-TaggedBootDevicesTest_v242-392404299 None] Flow 'volume_create_manager' (29ac7b1f-18d6-4f3e-abac-612396a20922) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:20:07.000236 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-83db3a7b-aa9d-4909-a393-dbec07578caa tempest-TaggedBootDevicesTest_v242-392404299 None] Created volume successfully. May 21 21:20:09.256324 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c80ccd5-c180-4903-8ffa-0879832df8d9 tempest-TaggedBootDevicesTest_v242-392404299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:20:09.296346 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6c80ccd5-c180-4903-8ffa-0879832df8d9 tempest-TaggedBootDevicesTest_v242-392404299 None] Flow 'volume_create_manager' (4a269e23-d8d2-4216-85a4-0890569f24d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:20:09.314679 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6c80ccd5-c180-4903-8ffa-0879832df8d9 tempest-TaggedBootDevicesTest_v242-392404299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2287547-ea81-42b3-92fb-8bc210a36937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:20:09.361862 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6c80ccd5-c180-4903-8ffa-0879832df8d9 tempest-TaggedBootDevicesTest_v242-392404299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2287547-ea81-42b3-92fb-8bc210a36937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-883384121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=fb3476d9-3053-4b91-b4d4-9120b75e4434,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60dca17b0239494f9e8effb6d535311f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:20:09Z,use_quota=True,user_id='3d4f720a68014a829929d6586cd9154d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:20:09.391602 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6c80ccd5-c180-4903-8ffa-0879832df8d9 tempest-TaggedBootDevicesTest_v242-392404299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d6e347e-c765-4d8e-bed5-74d0483e8930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:20:09.403804 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6c80ccd5-c180-4903-8ffa-0879832df8d9 tempest-TaggedBootDevicesTest_v242-392404299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d6e347e-c765-4d8e-bed5-74d0483e8930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:20:09.420761 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6c80ccd5-c180-4903-8ffa-0879832df8d9 tempest-TaggedBootDevicesTest_v242-392404299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0a272b9-78e5-4c3a-a1d3-247c51d66c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:20:09.435358 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6c80ccd5-c180-4903-8ffa-0879832df8d9 tempest-TaggedBootDevicesTest_v242-392404299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0a272b9-78e5-4c3a-a1d3-247c51d66c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb3476d9-3053-4b91-b4d4-9120b75e4434', 'volume_name': 'volume-fb3476d9-3053-4b91-b4d4-9120b75e4434', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:20:09.440851 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6c80ccd5-c180-4903-8ffa-0879832df8d9 tempest-TaggedBootDevicesTest_v242-392404299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0692a27f-0a01-405c-9367-6bd05835b987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:20:09.470710 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6c80ccd5-c180-4903-8ffa-0879832df8d9 tempest-TaggedBootDevicesTest_v242-392404299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0692a27f-0a01-405c-9367-6bd05835b987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:20:09.485885 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6c80ccd5-c180-4903-8ffa-0879832df8d9 tempest-TaggedBootDevicesTest_v242-392404299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d802dffe-dbd6-491e-8c14-f208013577fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:20:09.497716 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-6c80ccd5-c180-4903-8ffa-0879832df8d9 tempest-TaggedBootDevicesTest_v242-392404299 None] Volume fb3476d9-3053-4b91-b4d4-9120b75e4434: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb3476d9-3053-4b91-b4d4-9120b75e4434', 'volume_size': 1} May 21 21:20:09.498212 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6c80ccd5-c180-4903-8ffa-0879832df8d9 tempest-TaggedBootDevicesTest_v242-392404299 None] creating volume 'volume-fb3476d9-3053-4b91-b4d4-9120b75e4434' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:20:09.498941 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6c80ccd5-c180-4903-8ffa-0879832df8d9 tempest-TaggedBootDevicesTest_v242-392404299 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:20:10.807151 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6c80ccd5-c180-4903-8ffa-0879832df8d9 tempest-TaggedBootDevicesTest_v242-392404299 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:20:10.812870 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6c80ccd5-c180-4903-8ffa-0879832df8d9 tempest-TaggedBootDevicesTest_v242-392404299 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:20:10.817516 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6c80ccd5-c180-4903-8ffa-0879832df8d9 tempest-TaggedBootDevicesTest_v242-392404299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d802dffe-dbd6-491e-8c14-f208013577fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb3476d9-3053-4b91-b4d4-9120b75e4434', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:20:10.837057 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6c80ccd5-c180-4903-8ffa-0879832df8d9 tempest-TaggedBootDevicesTest_v242-392404299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72d2f826-712d-4ec0-9669-a47a82ff37bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:20:10.959893 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-6c80ccd5-c180-4903-8ffa-0879832df8d9 tempest-TaggedBootDevicesTest_v242-392404299 None] Volume volume-fb3476d9-3053-4b91-b4d4-9120b75e4434 (fb3476d9-3053-4b91-b4d4-9120b75e4434): created successfully May 21 21:20:10.966345 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6c80ccd5-c180-4903-8ffa-0879832df8d9 tempest-TaggedBootDevicesTest_v242-392404299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72d2f826-712d-4ec0-9669-a47a82ff37bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:20:10.983029 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6c80ccd5-c180-4903-8ffa-0879832df8d9 tempest-TaggedBootDevicesTest_v242-392404299 None] Flow 'volume_create_manager' (4a269e23-d8d2-4216-85a4-0890569f24d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:20:10.995789 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=28,cinder:UPDATE=6,cinder:INSERT=4,cinder:DELETE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:20:11.111913 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-6c80ccd5-c180-4903-8ffa-0879832df8d9 tempest-TaggedBootDevicesTest_v242-392404299 None] Created volume successfully. May 21 21:20:21.120358 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=27,cinder:UPDATE=9,cinder:INSERT=8,cinder:DELETE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:20:29.569251 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:20:38.278201 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-22f94443-0265-40eb-b3dd-e1e4bd444224 req-ec86d42f-7d11-4a80-b601-46d03deed2b8 tempest-TaggedBootDevicesTest_v242-392404299 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:20:39.098674 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-22f94443-0265-40eb-b3dd-e1e4bd444224 req-ec86d42f-7d11-4a80-b601-46d03deed2b8 tempest-TaggedBootDevicesTest_v242-392404299 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.820s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:20:39.099635 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-22f94443-0265-40eb-b3dd-e1e4bd444224 req-ec86d42f-7d11-4a80-b601-46d03deed2b8 tempest-TaggedBootDevicesTest_v242-392404299 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-59b04ab5-47d1-4fb6-b9d8-bcbfbd8bee3a', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'efef91cd-d8f8-4d93-9ad2-86d0b33251f4', 'volume_id': '59b04ab5-47d1-4fb6-b9d8-bcbfbd8bee3a', 'discard': True}} {{(pid=124407) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} May 21 21:20:39.219585 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-22f94443-0265-40eb-b3dd-e1e4bd444224 req-ec86d42f-7d11-4a80-b601-46d03deed2b8 tempest-TaggedBootDevicesTest_v242-392404299 None] Connection info returned from driver {'name': 'volumes/volume-59b04ab5-47d1-4fb6-b9d8-bcbfbd8bee3a', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '59b04ab5-47d1-4fb6-b9d8-bcbfbd8bee3a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '8d184286-606c-4f7c-8ce1-96ee652c1ecc'} {{(pid=124407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4826}} May 21 21:20:39.366070 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-22f94443-0265-40eb-b3dd-e1e4bd444224 req-ec86d42f-7d11-4a80-b601-46d03deed2b8 tempest-TaggedBootDevicesTest_v242-392404299 None] attachment_update completed successfully. May 21 21:20:40.192060 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-22f94443-0265-40eb-b3dd-e1e4bd444224 req-ab08a4f0-874c-4470-94b6-ad288c5d6ade tempest-TaggedBootDevicesTest_v242-392404299 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:20:40.982998 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-22f94443-0265-40eb-b3dd-e1e4bd444224 req-ab08a4f0-874c-4470-94b6-ad288c5d6ade tempest-TaggedBootDevicesTest_v242-392404299 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.791s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:20:40.983943 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-22f94443-0265-40eb-b3dd-e1e4bd444224 req-ab08a4f0-874c-4470-94b6-ad288c5d6ade tempest-TaggedBootDevicesTest_v242-392404299 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-fbd362bc-b589-4852-bb3e-750dd5c3fb67', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'efef91cd-d8f8-4d93-9ad2-86d0b33251f4', 'volume_id': 'fbd362bc-b589-4852-bb3e-750dd5c3fb67', 'discard': True}} {{(pid=124407) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} May 21 21:20:41.122195 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-22f94443-0265-40eb-b3dd-e1e4bd444224 req-ab08a4f0-874c-4470-94b6-ad288c5d6ade tempest-TaggedBootDevicesTest_v242-392404299 None] Connection info returned from driver {'name': 'volumes/volume-fbd362bc-b589-4852-bb3e-750dd5c3fb67', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'fbd362bc-b589-4852-bb3e-750dd5c3fb67', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '8fb196e1-c832-4c57-8686-e51c8c62a7ea'} {{(pid=124407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4826}} May 21 21:20:41.318028 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-22f94443-0265-40eb-b3dd-e1e4bd444224 req-ab08a4f0-874c-4470-94b6-ad288c5d6ade tempest-TaggedBootDevicesTest_v242-392404299 None] attachment_update completed successfully. May 21 21:20:42.079991 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-22f94443-0265-40eb-b3dd-e1e4bd444224 req-188fb472-a1e8-4a04-9d75-b59bca18d9b2 tempest-TaggedBootDevicesTest_v242-392404299 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:20:43.095473 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-22f94443-0265-40eb-b3dd-e1e4bd444224 req-188fb472-a1e8-4a04-9d75-b59bca18d9b2 tempest-TaggedBootDevicesTest_v242-392404299 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.015s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:20:43.096835 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-22f94443-0265-40eb-b3dd-e1e4bd444224 req-188fb472-a1e8-4a04-9d75-b59bca18d9b2 tempest-TaggedBootDevicesTest_v242-392404299 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-fb3476d9-3053-4b91-b4d4-9120b75e4434', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'efef91cd-d8f8-4d93-9ad2-86d0b33251f4', 'volume_id': 'fb3476d9-3053-4b91-b4d4-9120b75e4434', 'discard': True}} {{(pid=124407) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} May 21 21:20:43.219236 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-22f94443-0265-40eb-b3dd-e1e4bd444224 req-188fb472-a1e8-4a04-9d75-b59bca18d9b2 tempest-TaggedBootDevicesTest_v242-392404299 None] Connection info returned from driver {'name': 'volumes/volume-fb3476d9-3053-4b91-b4d4-9120b75e4434', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'fb3476d9-3053-4b91-b4d4-9120b75e4434', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'fafbe1c1-bdee-4bdb-b0be-8dda6f5c6525'} {{(pid=124407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4826}} May 21 21:20:43.593379 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-22f94443-0265-40eb-b3dd-e1e4bd444224 req-188fb472-a1e8-4a04-9d75-b59bca18d9b2 tempest-TaggedBootDevicesTest_v242-392404299 None] attachment_update completed successfully. May 21 21:20:47.414825 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:20:47.416494 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:20:47.514713 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:20:47.588377 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:20:53.593344 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=39,cinder:UPDATE=5 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:21:09.582768 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=37,cinder:UPDATE=8 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:21:12.563023 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bd6da23-5b93-4371-94b7-253fec528f3c tempest-VolumesTestJSON-1575055885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:21:12.593275 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3bd6da23-5b93-4371-94b7-253fec528f3c tempest-VolumesTestJSON-1575055885 None] Flow 'volume_create_manager' (d16720ce-4529-45ee-a2d2-9a1d1ced4dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:21:12.600341 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3bd6da23-5b93-4371-94b7-253fec528f3c tempest-VolumesTestJSON-1575055885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7391960a-557c-478e-becb-127b66eeb10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:21:12.618177 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3bd6da23-5b93-4371-94b7-253fec528f3c tempest-VolumesTestJSON-1575055885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7391960a-557c-478e-becb-127b66eeb10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-11615016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3b7d520e-3696-4938-889b-84c0b5218515,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d42776500c214ef0afe0dbf96182ef60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:21:12Z,use_quota=True,user_id='711ffe65ffbb4731bd036b3a4a5bd443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:21:12.623570 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3bd6da23-5b93-4371-94b7-253fec528f3c tempest-VolumesTestJSON-1575055885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f483198-4ffc-41a9-8d41-6192efbb48d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:21:12.627652 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3bd6da23-5b93-4371-94b7-253fec528f3c tempest-VolumesTestJSON-1575055885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f483198-4ffc-41a9-8d41-6192efbb48d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:21:12.635718 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3bd6da23-5b93-4371-94b7-253fec528f3c tempest-VolumesTestJSON-1575055885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3c95ada-2433-4cea-8776-ab348227fc77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:21:12.637017 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3bd6da23-5b93-4371-94b7-253fec528f3c tempest-VolumesTestJSON-1575055885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3c95ada-2433-4cea-8776-ab348227fc77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b7d520e-3696-4938-889b-84c0b5218515', 'volume_name': 'volume-3b7d520e-3696-4938-889b-84c0b5218515', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:21:12.641987 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3bd6da23-5b93-4371-94b7-253fec528f3c tempest-VolumesTestJSON-1575055885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14003a29-433e-4ef2-9f81-f7fa21216954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:21:12.646035 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3bd6da23-5b93-4371-94b7-253fec528f3c tempest-VolumesTestJSON-1575055885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14003a29-433e-4ef2-9f81-f7fa21216954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:21:12.650840 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3bd6da23-5b93-4371-94b7-253fec528f3c tempest-VolumesTestJSON-1575055885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9febd952-1872-4560-b810-4057c1c15b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:21:12.651883 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-3bd6da23-5b93-4371-94b7-253fec528f3c tempest-VolumesTestJSON-1575055885 None] Volume 3b7d520e-3696-4938-889b-84c0b5218515: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b7d520e-3696-4938-889b-84c0b5218515', 'volume_size': 1} May 21 21:21:12.652915 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3bd6da23-5b93-4371-94b7-253fec528f3c tempest-VolumesTestJSON-1575055885 None] creating volume 'volume-3b7d520e-3696-4938-889b-84c0b5218515' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:21:12.653011 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3bd6da23-5b93-4371-94b7-253fec528f3c tempest-VolumesTestJSON-1575055885 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:21:14.017802 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3bd6da23-5b93-4371-94b7-253fec528f3c tempest-VolumesTestJSON-1575055885 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:21:14.020540 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3bd6da23-5b93-4371-94b7-253fec528f3c tempest-VolumesTestJSON-1575055885 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:21:14.025776 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3bd6da23-5b93-4371-94b7-253fec528f3c tempest-VolumesTestJSON-1575055885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9febd952-1872-4560-b810-4057c1c15b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b7d520e-3696-4938-889b-84c0b5218515', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:21:14.043101 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3bd6da23-5b93-4371-94b7-253fec528f3c tempest-VolumesTestJSON-1575055885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93485834-4960-47a4-9f8f-79dd1006951d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:21:14.168206 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-3bd6da23-5b93-4371-94b7-253fec528f3c tempest-VolumesTestJSON-1575055885 None] Volume volume-3b7d520e-3696-4938-889b-84c0b5218515 (3b7d520e-3696-4938-889b-84c0b5218515): created successfully May 21 21:21:14.173583 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3bd6da23-5b93-4371-94b7-253fec528f3c tempest-VolumesTestJSON-1575055885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93485834-4960-47a4-9f8f-79dd1006951d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:21:14.180692 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3bd6da23-5b93-4371-94b7-253fec528f3c tempest-VolumesTestJSON-1575055885 None] Flow 'volume_create_manager' (d16720ce-4529-45ee-a2d2-9a1d1ced4dfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:21:14.275130 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-3bd6da23-5b93-4371-94b7-253fec528f3c tempest-VolumesTestJSON-1575055885 None] Created volume successfully. May 21 21:21:15.701078 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3b8177b-189f-4948-b4d2-a0f64c46eda0 tempest-VolumesTestJSON-1575055885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:21:15.732569 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-c3b8177b-189f-4948-b4d2-a0f64c46eda0 tempest-VolumesTestJSON-1575055885 None] Flow 'volume_create_manager' (094f88c5-1bc7-4a54-bd09-c55296e5d417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:21:15.739496 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-c3b8177b-189f-4948-b4d2-a0f64c46eda0 tempest-VolumesTestJSON-1575055885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0d8214c-446e-4445-82aa-d84a8983641f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:21:15.760771 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-c3b8177b-189f-4948-b4d2-a0f64c46eda0 tempest-VolumesTestJSON-1575055885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0d8214c-446e-4445-82aa-d84a8983641f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1548647487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e9c58c21-81f7-4ba4-ad1a-047c07c77a3b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d42776500c214ef0afe0dbf96182ef60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:21:15Z,use_quota=True,user_id='711ffe65ffbb4731bd036b3a4a5bd443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:21:15.767228 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-c3b8177b-189f-4948-b4d2-a0f64c46eda0 tempest-VolumesTestJSON-1575055885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8aed611-c4fb-4d49-bd2d-69b43617e8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:21:15.771292 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-c3b8177b-189f-4948-b4d2-a0f64c46eda0 tempest-VolumesTestJSON-1575055885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8aed611-c4fb-4d49-bd2d-69b43617e8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:21:15.777496 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-c3b8177b-189f-4948-b4d2-a0f64c46eda0 tempest-VolumesTestJSON-1575055885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45dc4c9c-2a4c-42bc-a32b-59827517e0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:21:15.781465 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-c3b8177b-189f-4948-b4d2-a0f64c46eda0 tempest-VolumesTestJSON-1575055885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45dc4c9c-2a4c-42bc-a32b-59827517e0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9c58c21-81f7-4ba4-ad1a-047c07c77a3b', 'volume_name': 'volume-e9c58c21-81f7-4ba4-ad1a-047c07c77a3b', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:21:15.786430 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-c3b8177b-189f-4948-b4d2-a0f64c46eda0 tempest-VolumesTestJSON-1575055885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ae399a3-c684-47e8-a62a-4bccf3c9f4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:21:15.790784 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-c3b8177b-189f-4948-b4d2-a0f64c46eda0 tempest-VolumesTestJSON-1575055885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ae399a3-c684-47e8-a62a-4bccf3c9f4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:21:15.795262 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-c3b8177b-189f-4948-b4d2-a0f64c46eda0 tempest-VolumesTestJSON-1575055885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7173fdb7-22e4-4375-8c56-8d5f45110027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:21:15.796312 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-c3b8177b-189f-4948-b4d2-a0f64c46eda0 tempest-VolumesTestJSON-1575055885 None] Volume e9c58c21-81f7-4ba4-ad1a-047c07c77a3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9c58c21-81f7-4ba4-ad1a-047c07c77a3b', 'volume_size': 1} May 21 21:21:15.796706 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c3b8177b-189f-4948-b4d2-a0f64c46eda0 tempest-VolumesTestJSON-1575055885 None] creating volume 'volume-e9c58c21-81f7-4ba4-ad1a-047c07c77a3b' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:21:15.797358 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c3b8177b-189f-4948-b4d2-a0f64c46eda0 tempest-VolumesTestJSON-1575055885 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:21:16.958515 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c3b8177b-189f-4948-b4d2-a0f64c46eda0 tempest-VolumesTestJSON-1575055885 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:21:16.959195 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c3b8177b-189f-4948-b4d2-a0f64c46eda0 tempest-VolumesTestJSON-1575055885 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:21:16.970426 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-c3b8177b-189f-4948-b4d2-a0f64c46eda0 tempest-VolumesTestJSON-1575055885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7173fdb7-22e4-4375-8c56-8d5f45110027) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9c58c21-81f7-4ba4-ad1a-047c07c77a3b', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:21:16.974940 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-c3b8177b-189f-4948-b4d2-a0f64c46eda0 tempest-VolumesTestJSON-1575055885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f37245f-7958-44e4-bb48-e7832d14b0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:21:17.070307 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-c3b8177b-189f-4948-b4d2-a0f64c46eda0 tempest-VolumesTestJSON-1575055885 None] Volume volume-e9c58c21-81f7-4ba4-ad1a-047c07c77a3b (e9c58c21-81f7-4ba4-ad1a-047c07c77a3b): created successfully May 21 21:21:17.073961 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-c3b8177b-189f-4948-b4d2-a0f64c46eda0 tempest-VolumesTestJSON-1575055885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f37245f-7958-44e4-bb48-e7832d14b0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:21:17.079444 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-c3b8177b-189f-4948-b4d2-a0f64c46eda0 tempest-VolumesTestJSON-1575055885 None] Flow 'volume_create_manager' (094f88c5-1bc7-4a54-bd09-c55296e5d417) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:21:17.152118 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-c3b8177b-189f-4948-b4d2-a0f64c46eda0 tempest-VolumesTestJSON-1575055885 None] Created volume successfully. May 21 21:21:18.915179 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-2be93795-8fa4-45b7-a876-aaf62d3589fb tempest-VolumesTestJSON-1575055885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:21:18.944134 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-2be93795-8fa4-45b7-a876-aaf62d3589fb tempest-VolumesTestJSON-1575055885 None] Flow 'volume_create_manager' (e5f37bb9-32da-4e94-90ac-fb6d22708375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:21:18.951260 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-2be93795-8fa4-45b7-a876-aaf62d3589fb tempest-VolumesTestJSON-1575055885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (231239a3-8ad0-4727-9d71-a2cb738ef7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:21:18.981734 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-2be93795-8fa4-45b7-a876-aaf62d3589fb tempest-VolumesTestJSON-1575055885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (231239a3-8ad0-4727-9d71-a2cb738ef7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:21:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-52478874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=59322661-c94f-4319-9ddc-f03dd1d6b786,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d42776500c214ef0afe0dbf96182ef60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:21:19Z,use_quota=True,user_id='711ffe65ffbb4731bd036b3a4a5bd443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:21:18.991057 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-2be93795-8fa4-45b7-a876-aaf62d3589fb tempest-VolumesTestJSON-1575055885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6c0675f-8db4-4909-a6da-dd06ede48dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:21:19.001212 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-2be93795-8fa4-45b7-a876-aaf62d3589fb tempest-VolumesTestJSON-1575055885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6c0675f-8db4-4909-a6da-dd06ede48dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:21:19.014962 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-2be93795-8fa4-45b7-a876-aaf62d3589fb tempest-VolumesTestJSON-1575055885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be565e89-2f07-419d-b437-a2b4de5d967b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:21:19.019019 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-2be93795-8fa4-45b7-a876-aaf62d3589fb tempest-VolumesTestJSON-1575055885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be565e89-2f07-419d-b437-a2b4de5d967b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59322661-c94f-4319-9ddc-f03dd1d6b786', 'volume_name': 'volume-59322661-c94f-4319-9ddc-f03dd1d6b786', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:21:19.037810 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-2be93795-8fa4-45b7-a876-aaf62d3589fb tempest-VolumesTestJSON-1575055885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9da80757-fdeb-4c16-b211-1fd522399308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:21:19.043130 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-2be93795-8fa4-45b7-a876-aaf62d3589fb tempest-VolumesTestJSON-1575055885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9da80757-fdeb-4c16-b211-1fd522399308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:21:19.047907 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-2be93795-8fa4-45b7-a876-aaf62d3589fb tempest-VolumesTestJSON-1575055885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17606878-6a9e-475d-b61f-0be327bd9993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:21:19.049816 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-2be93795-8fa4-45b7-a876-aaf62d3589fb tempest-VolumesTestJSON-1575055885 None] Volume 59322661-c94f-4319-9ddc-f03dd1d6b786: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59322661-c94f-4319-9ddc-f03dd1d6b786', 'volume_size': 1} May 21 21:21:19.050497 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-2be93795-8fa4-45b7-a876-aaf62d3589fb tempest-VolumesTestJSON-1575055885 None] creating volume 'volume-59322661-c94f-4319-9ddc-f03dd1d6b786' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:21:19.051312 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-2be93795-8fa4-45b7-a876-aaf62d3589fb tempest-VolumesTestJSON-1575055885 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:21:20.285947 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-2be93795-8fa4-45b7-a876-aaf62d3589fb tempest-VolumesTestJSON-1575055885 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:21:20.287379 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-2be93795-8fa4-45b7-a876-aaf62d3589fb tempest-VolumesTestJSON-1575055885 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:21:20.293742 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-2be93795-8fa4-45b7-a876-aaf62d3589fb tempest-VolumesTestJSON-1575055885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17606878-6a9e-475d-b61f-0be327bd9993) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59322661-c94f-4319-9ddc-f03dd1d6b786', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:21:20.309018 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-2be93795-8fa4-45b7-a876-aaf62d3589fb tempest-VolumesTestJSON-1575055885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c050df37-3535-4474-9a92-52611580509c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:21:20.452362 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-2be93795-8fa4-45b7-a876-aaf62d3589fb tempest-VolumesTestJSON-1575055885 None] Volume volume-59322661-c94f-4319-9ddc-f03dd1d6b786 (59322661-c94f-4319-9ddc-f03dd1d6b786): created successfully May 21 21:21:20.458088 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-2be93795-8fa4-45b7-a876-aaf62d3589fb tempest-VolumesTestJSON-1575055885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c050df37-3535-4474-9a92-52611580509c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:21:20.464572 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-2be93795-8fa4-45b7-a876-aaf62d3589fb tempest-VolumesTestJSON-1575055885 None] Flow 'volume_create_manager' (e5f37bb9-32da-4e94-90ac-fb6d22708375) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:21:20.555774 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-2be93795-8fa4-45b7-a876-aaf62d3589fb tempest-VolumesTestJSON-1575055885 None] Created volume successfully. May 21 21:21:22.270077 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-6c6836b1-582e-4dbf-a6ce-d3005852da80 tempest-VolumesTestJSON-1575055885 None] Lock "b'cinder-59322661-c94f-4319-9ddc-f03dd1d6b786-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:21:22.407819 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6c6836b1-582e-4dbf-a6ce-d3005852da80 tempest-VolumesTestJSON-1575055885 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:21:22.651593 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6c6836b1-582e-4dbf-a6ce-d3005852da80 tempest-VolumesTestJSON-1575055885 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:21:22.652174 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6c6836b1-582e-4dbf-a6ce-d3005852da80 tempest-VolumesTestJSON-1575055885 None] Volume volume-59322661-c94f-4319-9ddc-f03dd1d6b786 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:21:22.889682 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6c6836b1-582e-4dbf-a6ce-d3005852da80 tempest-VolumesTestJSON-1575055885 None] deleting rbd volume volume-59322661-c94f-4319-9ddc-f03dd1d6b786 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:21:31.051452 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-6c6836b1-582e-4dbf-a6ce-d3005852da80 tempest-VolumesTestJSON-1575055885 None] Created reservations ['2071b73b-7344-4fe1-abc2-17a86659e833', '67ce4965-9558-4243-b169-688a46fc247c', 'faa63fa8-5887-4329-9cda-e0e646242e0b', '71ae3870-31c2-4cad-a5d9-648481ff9795'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:21:31.252257 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6c6836b1-582e-4dbf-a6ce-d3005852da80 tempest-VolumesTestJSON-1575055885 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:21:31.318316 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6c6836b1-582e-4dbf-a6ce-d3005852da80 tempest-VolumesTestJSON-1575055885 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:21:31.376496 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-6c6836b1-582e-4dbf-a6ce-d3005852da80 tempest-VolumesTestJSON-1575055885 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:21:31.383433 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-6c6836b1-582e-4dbf-a6ce-d3005852da80 tempest-VolumesTestJSON-1575055885 None] Deleted volume successfully. May 21 21:21:31.469421 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-6c6836b1-582e-4dbf-a6ce-d3005852da80 tempest-VolumesTestJSON-1575055885 None] Lock "b'cinder-59322661-c94f-4319-9ddc-f03dd1d6b786-delete_volume'" released by "delete_volume" :: held 9.204s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:21:32.280644 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-c8440740-bac9-47e3-9b93-4dbd8514bdf3 tempest-VolumesTestJSON-1575055885 None] Lock "b'cinder-e9c58c21-81f7-4ba4-ad1a-047c07c77a3b-delete_volume'" acquired by "delete_volume" :: waited 0.026s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:21:32.428386 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c8440740-bac9-47e3-9b93-4dbd8514bdf3 tempest-VolumesTestJSON-1575055885 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:21:32.697923 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c8440740-bac9-47e3-9b93-4dbd8514bdf3 tempest-VolumesTestJSON-1575055885 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:21:32.698709 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c8440740-bac9-47e3-9b93-4dbd8514bdf3 tempest-VolumesTestJSON-1575055885 None] Volume volume-e9c58c21-81f7-4ba4-ad1a-047c07c77a3b is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:21:33.007564 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c8440740-bac9-47e3-9b93-4dbd8514bdf3 tempest-VolumesTestJSON-1575055885 None] deleting rbd volume volume-e9c58c21-81f7-4ba4-ad1a-047c07c77a3b {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:21:39.578830 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=41,cinder:UPDATE=11,cinder:DELETE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:21:41.311552 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=29,cinder:UPDATE=19,cinder:DELETE=2,cinder:INSERT=4 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:21:41.399842 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-c8440740-bac9-47e3-9b93-4dbd8514bdf3 tempest-VolumesTestJSON-1575055885 None] Created reservations ['1fbfa6e0-2d39-4f3b-8fb1-2a74eec10d36', 'd2037e6c-5238-4074-b1ce-ef5d35ab83d6', '8c11cef8-9548-48f8-a4b7-e7deab1f2938', '0e24178b-7f7c-436b-a6b1-2f8f409bdcb5'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:21:41.596219 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c8440740-bac9-47e3-9b93-4dbd8514bdf3 tempest-VolumesTestJSON-1575055885 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:21:41.673380 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c8440740-bac9-47e3-9b93-4dbd8514bdf3 tempest-VolumesTestJSON-1575055885 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:21:41.747019 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-c8440740-bac9-47e3-9b93-4dbd8514bdf3 tempest-VolumesTestJSON-1575055885 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:21:41.753095 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-c8440740-bac9-47e3-9b93-4dbd8514bdf3 tempest-VolumesTestJSON-1575055885 None] Deleted volume successfully. May 21 21:21:41.861773 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-c8440740-bac9-47e3-9b93-4dbd8514bdf3 tempest-VolumesTestJSON-1575055885 None] Lock "b'cinder-e9c58c21-81f7-4ba4-ad1a-047c07c77a3b-delete_volume'" released by "delete_volume" :: held 9.581s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:21:42.189646 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-c8f21bf8-456d-4dc9-9259-e48e219b6099 tempest-VolumesTestJSON-1575055885 None] Lock "b'cinder-3b7d520e-3696-4938-889b-84c0b5218515-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:21:42.317950 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c8f21bf8-456d-4dc9-9259-e48e219b6099 tempest-VolumesTestJSON-1575055885 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:21:42.525651 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c8f21bf8-456d-4dc9-9259-e48e219b6099 tempest-VolumesTestJSON-1575055885 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:21:42.526330 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c8f21bf8-456d-4dc9-9259-e48e219b6099 tempest-VolumesTestJSON-1575055885 None] Volume volume-3b7d520e-3696-4938-889b-84c0b5218515 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:21:42.800481 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c8f21bf8-456d-4dc9-9259-e48e219b6099 tempest-VolumesTestJSON-1575055885 None] deleting rbd volume volume-3b7d520e-3696-4938-889b-84c0b5218515 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:21:47.413557 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:21:47.415413 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:21:47.472065 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:21:47.510014 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:21:50.693995 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-c8f21bf8-456d-4dc9-9259-e48e219b6099 tempest-VolumesTestJSON-1575055885 None] Created reservations ['7df854df-dcbf-4d01-907a-86e2bbc9615c', '8d0c172c-020c-4638-82cc-041c9a9b56ac', '5baa709b-1f27-4ced-9e2e-da2e32dd4a20', 'b0627fa0-d4a4-4201-afad-fd1821c76f73'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:21:50.913907 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c8f21bf8-456d-4dc9-9259-e48e219b6099 tempest-VolumesTestJSON-1575055885 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:21:51.014249 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c8f21bf8-456d-4dc9-9259-e48e219b6099 tempest-VolumesTestJSON-1575055885 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:21:51.044025 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-c8f21bf8-456d-4dc9-9259-e48e219b6099 tempest-VolumesTestJSON-1575055885 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:21:51.048627 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-c8f21bf8-456d-4dc9-9259-e48e219b6099 tempest-VolumesTestJSON-1575055885 None] Deleted volume successfully. May 21 21:21:51.117346 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-c8f21bf8-456d-4dc9-9259-e48e219b6099 tempest-VolumesTestJSON-1575055885 None] Lock "b'cinder-3b7d520e-3696-4938-889b-84c0b5218515-delete_volume'" released by "delete_volume" :: held 8.926s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:21:58.193221 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-ae975bf8-588f-4964-b51e-4eb7770f193c tempest-DeleteServersTestJSON-232394369 None] Lock "b'cinder-10da5ce0-93b8-4d63-ac54-7c0b2e6dc51f-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:21:58.320598 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ae975bf8-588f-4964-b51e-4eb7770f193c tempest-DeleteServersTestJSON-232394369 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:21:58.606027 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ae975bf8-588f-4964-b51e-4eb7770f193c tempest-DeleteServersTestJSON-232394369 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:21:58.607159 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ae975bf8-588f-4964-b51e-4eb7770f193c tempest-DeleteServersTestJSON-232394369 None] Volume volume-10da5ce0-93b8-4d63-ac54-7c0b2e6dc51f is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:21:58.845600 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ae975bf8-588f-4964-b51e-4eb7770f193c tempest-DeleteServersTestJSON-232394369 None] deleting rbd volume volume-10da5ce0-93b8-4d63-ac54-7c0b2e6dc51f {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:22:08.019068 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-ae975bf8-588f-4964-b51e-4eb7770f193c tempest-DeleteServersTestJSON-232394369 None] Created reservations ['0cb0bdb2-874c-4a58-9e0c-6c238588c796', '964e5e7d-301d-4c73-8e5e-a88ef07e7b69', '10a694be-1104-49cf-976a-20e7398a9dee', '3cfd06cb-68e3-4407-8187-2235abe6730f'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:22:08.342742 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ae975bf8-588f-4964-b51e-4eb7770f193c tempest-DeleteServersTestJSON-232394369 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:22:08.389619 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ae975bf8-588f-4964-b51e-4eb7770f193c tempest-DeleteServersTestJSON-232394369 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:22:08.445097 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-ae975bf8-588f-4964-b51e-4eb7770f193c tempest-DeleteServersTestJSON-232394369 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:22:08.449897 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-ae975bf8-588f-4964-b51e-4eb7770f193c tempest-DeleteServersTestJSON-232394369 None] Deleted volume successfully. May 21 21:22:08.530370 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-ae975bf8-588f-4964-b51e-4eb7770f193c tempest-DeleteServersTestJSON-232394369 None] Lock "b'cinder-10da5ce0-93b8-4d63-ac54-7c0b2e6dc51f-delete_volume'" released by "delete_volume" :: held 10.337s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:22:18.455527 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=42,cinder:INSERT=8,cinder:UPDATE=32,cinder:DELETE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:22:19.586444 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=33,cinder:UPDATE=18,cinder:INSERT=4,cinder:DELETE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:22:47.420544 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:22:47.420544 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:22:47.466226 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:22:47.527820 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:22:59.581521 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:22:59.583439 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:23:19.587298 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:23:39.601199 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=8,cinder:UPDATE=4 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:23:47.416503 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:23:47.417231 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:23:47.458852 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:23:47.494351 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:23:59.592243 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:24:09.595182 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:24:29.592043 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:24:39.598323 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:24:47.419342 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:24:47.420131 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:24:47.449038 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:24:47.473448 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:24:56.259737 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-b8d894b7-395b-43f4-b250-e89f251bce3d req-b8cbf2f2-6206-433a-8d88-009ac8e45708 tempest-ServersTestBootFromVolume-614856547 None] Terminate volume connection completed successfully. May 21 21:24:56.265306 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-b8d894b7-395b-43f4-b250-e89f251bce3d req-b8cbf2f2-6206-433a-8d88-009ac8e45708 tempest-ServersTestBootFromVolume-614856547 None] Deleting attachment c5bf0d04-bae2-4c77-a41c-038d12fd67a9. {{(pid=124407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4957}} May 21 21:24:56.778366 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [req-b8d894b7-395b-43f4-b250-e89f251bce3d req-1b4b636f-334b-4c90-84cf-266fa9ba2bda tempest-ServersTestBootFromVolume-614856547 None] Lock "b'cinder-a5550cbf-3582-4751-9f41-ccd248d7de61-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:24:56.953226 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-b8d894b7-395b-43f4-b250-e89f251bce3d req-1b4b636f-334b-4c90-84cf-266fa9ba2bda tempest-ServersTestBootFromVolume-614856547 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:24:57.455889 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-b8d894b7-395b-43f4-b250-e89f251bce3d req-1b4b636f-334b-4c90-84cf-266fa9ba2bda tempest-ServersTestBootFromVolume-614856547 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:24:57.845795 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-b8d894b7-395b-43f4-b250-e89f251bce3d req-1b4b636f-334b-4c90-84cf-266fa9ba2bda tempest-ServersTestBootFromVolume-614856547 None] deleting rbd volume volume-a5550cbf-3582-4751-9f41-ccd248d7de61 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:25:07.155618 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-b8d894b7-395b-43f4-b250-e89f251bce3d req-1b4b636f-334b-4c90-84cf-266fa9ba2bda tempest-ServersTestBootFromVolume-614856547 None] volume is a clone so cleaning references {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1352}} May 21 21:25:07.423181 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-b8d894b7-395b-43f4-b250-e89f251bce3d req-1b4b636f-334b-4c90-84cf-266fa9ba2bda tempest-ServersTestBootFromVolume-614856547 None] deleting parent snapshot volume-a5550cbf-3582-4751-9f41-ccd248d7de61.clone_snap {{(pid=124407) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1243}} May 21 21:25:11.788733 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=11,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:25:11.794041 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=10,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:25:11.961242 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [req-b8d894b7-395b-43f4-b250-e89f251bce3d req-1b4b636f-334b-4c90-84cf-266fa9ba2bda tempest-ServersTestBootFromVolume-614856547 None] Created reservations ['5b322b77-4d16-4c8d-b5b1-c78cb7f8365f', 'c47b88af-e4eb-41eb-8666-218dcdf20cf3', '5244783e-aceb-4e66-9abd-dafdb8496174', 'bbf3fb49-74c4-4f17-bbdd-4441ba866fc0'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:25:12.028133 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2d3abdd-6fba-49b4-82ff-29bcf7177b1b tempest-VolumesAdminNegativeTest-1430965486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:25:12.059359 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d2d3abdd-6fba-49b4-82ff-29bcf7177b1b tempest-VolumesAdminNegativeTest-1430965486 None] Flow 'volume_create_manager' (b1b8184a-2d07-4ea8-88fc-4d2d5eab0c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:25:12.067801 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d2d3abdd-6fba-49b4-82ff-29bcf7177b1b tempest-VolumesAdminNegativeTest-1430965486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13b63fd4-8a3e-4468-bd23-1e49250f785d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:25:12.086887 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d2d3abdd-6fba-49b4-82ff-29bcf7177b1b tempest-VolumesAdminNegativeTest-1430965486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13b63fd4-8a3e-4468-bd23-1e49250f785d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1129708272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5d57ce02-37f5-4d5e-b99e-ce11caefd4c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='960f5f98c8d64ac384c86350b29ee9ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:25:09Z,use_quota=True,user_id='1ec7dadaea104c4498cd8bf98ceea738',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:25:12.092995 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d2d3abdd-6fba-49b4-82ff-29bcf7177b1b tempest-VolumesAdminNegativeTest-1430965486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02436a1b-ed2f-4734-8a9d-46f31132ea42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:25:12.098577 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d2d3abdd-6fba-49b4-82ff-29bcf7177b1b tempest-VolumesAdminNegativeTest-1430965486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02436a1b-ed2f-4734-8a9d-46f31132ea42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:25:12.105546 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d2d3abdd-6fba-49b4-82ff-29bcf7177b1b tempest-VolumesAdminNegativeTest-1430965486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8326d47-5071-498d-97fd-f1afd86313b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:25:12.110489 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d2d3abdd-6fba-49b4-82ff-29bcf7177b1b tempest-VolumesAdminNegativeTest-1430965486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8326d47-5071-498d-97fd-f1afd86313b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d57ce02-37f5-4d5e-b99e-ce11caefd4c6', 'volume_name': 'volume-5d57ce02-37f5-4d5e-b99e-ce11caefd4c6', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:25:12.115335 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d2d3abdd-6fba-49b4-82ff-29bcf7177b1b tempest-VolumesAdminNegativeTest-1430965486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f46dabed-83f9-4a8b-a516-7b0fbab469f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:25:12.119151 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d2d3abdd-6fba-49b4-82ff-29bcf7177b1b tempest-VolumesAdminNegativeTest-1430965486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f46dabed-83f9-4a8b-a516-7b0fbab469f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:25:12.123933 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d2d3abdd-6fba-49b4-82ff-29bcf7177b1b tempest-VolumesAdminNegativeTest-1430965486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32da2b1e-e69a-4d1d-a009-6186f7a3bef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:25:12.125384 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-d2d3abdd-6fba-49b4-82ff-29bcf7177b1b tempest-VolumesAdminNegativeTest-1430965486 None] Volume 5d57ce02-37f5-4d5e-b99e-ce11caefd4c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d57ce02-37f5-4d5e-b99e-ce11caefd4c6', 'volume_size': 1} May 21 21:25:12.125936 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d2d3abdd-6fba-49b4-82ff-29bcf7177b1b tempest-VolumesAdminNegativeTest-1430965486 None] creating volume 'volume-5d57ce02-37f5-4d5e-b99e-ce11caefd4c6' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:25:12.126963 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d2d3abdd-6fba-49b4-82ff-29bcf7177b1b tempest-VolumesAdminNegativeTest-1430965486 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:25:12.340051 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-b8d894b7-395b-43f4-b250-e89f251bce3d req-1b4b636f-334b-4c90-84cf-266fa9ba2bda tempest-ServersTestBootFromVolume-614856547 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:25:12.402618 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-b8d894b7-395b-43f4-b250-e89f251bce3d req-1b4b636f-334b-4c90-84cf-266fa9ba2bda tempest-ServersTestBootFromVolume-614856547 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:25:12.456206 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [req-b8d894b7-395b-43f4-b250-e89f251bce3d req-1b4b636f-334b-4c90-84cf-266fa9ba2bda tempest-ServersTestBootFromVolume-614856547 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:25:12.470808 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-b8d894b7-395b-43f4-b250-e89f251bce3d req-1b4b636f-334b-4c90-84cf-266fa9ba2bda tempest-ServersTestBootFromVolume-614856547 None] Deleted volume successfully. May 21 21:25:12.604661 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [req-b8d894b7-395b-43f4-b250-e89f251bce3d req-1b4b636f-334b-4c90-84cf-266fa9ba2bda tempest-ServersTestBootFromVolume-614856547 None] Lock "b'cinder-a5550cbf-3582-4751-9f41-ccd248d7de61-delete_volume'" released by "delete_volume" :: held 15.826s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:25:13.738088 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d2d3abdd-6fba-49b4-82ff-29bcf7177b1b tempest-VolumesAdminNegativeTest-1430965486 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:25:13.739355 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d2d3abdd-6fba-49b4-82ff-29bcf7177b1b tempest-VolumesAdminNegativeTest-1430965486 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:25:13.749883 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d2d3abdd-6fba-49b4-82ff-29bcf7177b1b tempest-VolumesAdminNegativeTest-1430965486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32da2b1e-e69a-4d1d-a009-6186f7a3bef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d57ce02-37f5-4d5e-b99e-ce11caefd4c6', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:25:13.760378 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d2d3abdd-6fba-49b4-82ff-29bcf7177b1b tempest-VolumesAdminNegativeTest-1430965486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c36c3710-74ce-4d5c-896f-12312cd38f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:25:13.894604 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-d2d3abdd-6fba-49b4-82ff-29bcf7177b1b tempest-VolumesAdminNegativeTest-1430965486 None] Volume volume-5d57ce02-37f5-4d5e-b99e-ce11caefd4c6 (5d57ce02-37f5-4d5e-b99e-ce11caefd4c6): created successfully May 21 21:25:13.903600 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d2d3abdd-6fba-49b4-82ff-29bcf7177b1b tempest-VolumesAdminNegativeTest-1430965486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c36c3710-74ce-4d5c-896f-12312cd38f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:25:13.918437 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d2d3abdd-6fba-49b4-82ff-29bcf7177b1b tempest-VolumesAdminNegativeTest-1430965486 None] Flow 'volume_create_manager' (b1b8184a-2d07-4ea8-88fc-4d2d5eab0c42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:25:14.033463 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-d2d3abdd-6fba-49b4-82ff-29bcf7177b1b tempest-VolumesAdminNegativeTest-1430965486 None] Created volume successfully. May 21 21:25:15.515970 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-7c8a3d45-13da-4b04-950c-c8ba740f90f0 req-a12a57c5-621e-463c-ac10-1b15a9a46bf8 tempest-VolumesAdminNegativeTest-1430965486 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:25:16.364846 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-7c8a3d45-13da-4b04-950c-c8ba740f90f0 req-a12a57c5-621e-463c-ac10-1b15a9a46bf8 tempest-VolumesAdminNegativeTest-1430965486 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.848s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:25:16.365914 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-7c8a3d45-13da-4b04-950c-c8ba740f90f0 req-a12a57c5-621e-463c-ac10-1b15a9a46bf8 tempest-VolumesAdminNegativeTest-1430965486 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-5d57ce02-37f5-4d5e-b99e-ce11caefd4c6', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'efef91cd-d8f8-4d93-9ad2-86d0b33251f4', 'volume_id': '5d57ce02-37f5-4d5e-b99e-ce11caefd4c6', 'discard': True}} {{(pid=124407) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} May 21 21:25:16.501355 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-7c8a3d45-13da-4b04-950c-c8ba740f90f0 req-a12a57c5-621e-463c-ac10-1b15a9a46bf8 tempest-VolumesAdminNegativeTest-1430965486 None] Connection info returned from driver {'name': 'volumes/volume-5d57ce02-37f5-4d5e-b99e-ce11caefd4c6', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '5d57ce02-37f5-4d5e-b99e-ce11caefd4c6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '49050134-37b3-47de-b2c3-e2e54fa317d4'} {{(pid=124407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4826}} May 21 21:25:16.689621 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-7c8a3d45-13da-4b04-950c-c8ba740f90f0 req-a12a57c5-621e-463c-ac10-1b15a9a46bf8 tempest-VolumesAdminNegativeTest-1430965486 None] attachment_update completed successfully. May 21 21:25:21.456109 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-00794f53-0aea-4e9c-80e7-b0c97e816224 req-5d1ac56c-6ff9-41d0-b2ff-87d8536007a5 tempest-VolumesAdminNegativeTest-1430965486 None] Terminate volume connection completed successfully. May 21 21:25:21.457220 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-00794f53-0aea-4e9c-80e7-b0c97e816224 req-5d1ac56c-6ff9-41d0-b2ff-87d8536007a5 tempest-VolumesAdminNegativeTest-1430965486 None] Deleting attachment 49050134-37b3-47de-b2c3-e2e54fa317d4. {{(pid=124407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4957}} May 21 21:25:23.966494 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eb3f815-c0d8-428c-9f72-3a62577654c4 tempest-VolumesAdminNegativeTest-1430965486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:25:23.993826 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-0eb3f815-c0d8-428c-9f72-3a62577654c4 tempest-VolumesAdminNegativeTest-1430965486 None] Flow 'volume_create_manager' (7908b937-0bae-4975-b37f-be9ed59362d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:25:24.006196 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-0eb3f815-c0d8-428c-9f72-3a62577654c4 tempest-VolumesAdminNegativeTest-1430965486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b33858b1-9e95-449b-819b-91a0433f3d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:25:24.025555 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-0eb3f815-c0d8-428c-9f72-3a62577654c4 tempest-VolumesAdminNegativeTest-1430965486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b33858b1-9e95-449b-819b-91a0433f3d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1965596649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0b9f4fb4-d73a-45d0-851e-6cf568466b6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='960f5f98c8d64ac384c86350b29ee9ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:25:24Z,use_quota=True,user_id='1ec7dadaea104c4498cd8bf98ceea738',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:25:24.033030 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-0eb3f815-c0d8-428c-9f72-3a62577654c4 tempest-VolumesAdminNegativeTest-1430965486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a970fb-d75d-4335-b00b-66eab30aac4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:25:24.037775 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-0eb3f815-c0d8-428c-9f72-3a62577654c4 tempest-VolumesAdminNegativeTest-1430965486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a970fb-d75d-4335-b00b-66eab30aac4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:25:24.048390 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-0eb3f815-c0d8-428c-9f72-3a62577654c4 tempest-VolumesAdminNegativeTest-1430965486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b60b8202-36e9-4157-9343-913c8befc536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:25:24.049796 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-0eb3f815-c0d8-428c-9f72-3a62577654c4 tempest-VolumesAdminNegativeTest-1430965486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b60b8202-36e9-4157-9343-913c8befc536) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b9f4fb4-d73a-45d0-851e-6cf568466b6a', 'volume_name': 'volume-0b9f4fb4-d73a-45d0-851e-6cf568466b6a', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:25:24.054752 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-0eb3f815-c0d8-428c-9f72-3a62577654c4 tempest-VolumesAdminNegativeTest-1430965486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31b873be-687c-4681-8fbb-80ec675048c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:25:24.058765 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-0eb3f815-c0d8-428c-9f72-3a62577654c4 tempest-VolumesAdminNegativeTest-1430965486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31b873be-687c-4681-8fbb-80ec675048c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:25:24.064080 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-0eb3f815-c0d8-428c-9f72-3a62577654c4 tempest-VolumesAdminNegativeTest-1430965486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edf1fab1-2c26-420b-ba8a-b04ff56a328d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:25:24.065438 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-0eb3f815-c0d8-428c-9f72-3a62577654c4 tempest-VolumesAdminNegativeTest-1430965486 None] Volume 0b9f4fb4-d73a-45d0-851e-6cf568466b6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b9f4fb4-d73a-45d0-851e-6cf568466b6a', 'volume_size': 1} May 21 21:25:24.072059 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-0eb3f815-c0d8-428c-9f72-3a62577654c4 tempest-VolumesAdminNegativeTest-1430965486 None] creating volume 'volume-0b9f4fb4-d73a-45d0-851e-6cf568466b6a' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:25:24.072059 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-0eb3f815-c0d8-428c-9f72-3a62577654c4 tempest-VolumesAdminNegativeTest-1430965486 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:25:24.974379 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-0eb3f815-c0d8-428c-9f72-3a62577654c4 tempest-VolumesAdminNegativeTest-1430965486 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:25:24.974379 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-0eb3f815-c0d8-428c-9f72-3a62577654c4 tempest-VolumesAdminNegativeTest-1430965486 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:25:24.976924 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-0eb3f815-c0d8-428c-9f72-3a62577654c4 tempest-VolumesAdminNegativeTest-1430965486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edf1fab1-2c26-420b-ba8a-b04ff56a328d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b9f4fb4-d73a-45d0-851e-6cf568466b6a', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:25:24.986209 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-0eb3f815-c0d8-428c-9f72-3a62577654c4 tempest-VolumesAdminNegativeTest-1430965486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9c12d8d-9d5c-4914-8a31-0c4918082421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:25:25.077684 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-0eb3f815-c0d8-428c-9f72-3a62577654c4 tempest-VolumesAdminNegativeTest-1430965486 None] Volume volume-0b9f4fb4-d73a-45d0-851e-6cf568466b6a (0b9f4fb4-d73a-45d0-851e-6cf568466b6a): created successfully May 21 21:25:25.081565 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-0eb3f815-c0d8-428c-9f72-3a62577654c4 tempest-VolumesAdminNegativeTest-1430965486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9c12d8d-9d5c-4914-8a31-0c4918082421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:25:25.087141 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-0eb3f815-c0d8-428c-9f72-3a62577654c4 tempest-VolumesAdminNegativeTest-1430965486 None] Flow 'volume_create_manager' (7908b937-0bae-4975-b37f-be9ed59362d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:25:25.198392 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-0eb3f815-c0d8-428c-9f72-3a62577654c4 tempest-VolumesAdminNegativeTest-1430965486 None] Created volume successfully. May 21 21:25:26.035067 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-62df1718-733c-445b-a7b5-50bddb5f4548 tempest-VolumesAdminNegativeTest-1430965486 None] Lock "b'cinder-0b9f4fb4-d73a-45d0-851e-6cf568466b6a-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:25:26.159470 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-62df1718-733c-445b-a7b5-50bddb5f4548 tempest-VolumesAdminNegativeTest-1430965486 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:25:26.478160 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-62df1718-733c-445b-a7b5-50bddb5f4548 tempest-VolumesAdminNegativeTest-1430965486 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:25:26.478816 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-62df1718-733c-445b-a7b5-50bddb5f4548 tempest-VolumesAdminNegativeTest-1430965486 None] Volume volume-0b9f4fb4-d73a-45d0-851e-6cf568466b6a is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:25:26.852676 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-62df1718-733c-445b-a7b5-50bddb5f4548 tempest-VolumesAdminNegativeTest-1430965486 None] deleting rbd volume volume-0b9f4fb4-d73a-45d0-851e-6cf568466b6a {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:25:35.473442 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-b49cb11c-b8ef-445e-9f15-55ef99d9974e tempest-VolumeQuotasAdminTestJSON-1683648975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:25:35.493740 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b49cb11c-b8ef-445e-9f15-55ef99d9974e tempest-VolumeQuotasAdminTestJSON-1683648975 None] Flow 'volume_create_manager' (23762aba-c486-4f56-8d42-6b070493230f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:25:35.501746 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b49cb11c-b8ef-445e-9f15-55ef99d9974e tempest-VolumeQuotasAdminTestJSON-1683648975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ece2baa5-2245-46b7-83e9-464cee77bad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:25:35.519401 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b49cb11c-b8ef-445e-9f15-55ef99d9974e tempest-VolumeQuotasAdminTestJSON-1683648975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ece2baa5-2245-46b7-83e9-464cee77bad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1438738786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e9bef329-23be-4252-b9e3-a64f3a1694d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6acd2cb5d0404e8fbe95c495799cf373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:25:35Z,use_quota=True,user_id='e20ab48ec9534bf6aceb9bbc31262686',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:25:35.526627 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b49cb11c-b8ef-445e-9f15-55ef99d9974e tempest-VolumeQuotasAdminTestJSON-1683648975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (590e8a91-7812-4167-a198-cd59ced3fa67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:25:35.531882 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b49cb11c-b8ef-445e-9f15-55ef99d9974e tempest-VolumeQuotasAdminTestJSON-1683648975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (590e8a91-7812-4167-a198-cd59ced3fa67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:25:35.537561 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b49cb11c-b8ef-445e-9f15-55ef99d9974e tempest-VolumeQuotasAdminTestJSON-1683648975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c56c479-f681-4075-98bf-92b386d20cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:25:35.542709 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b49cb11c-b8ef-445e-9f15-55ef99d9974e tempest-VolumeQuotasAdminTestJSON-1683648975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c56c479-f681-4075-98bf-92b386d20cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9bef329-23be-4252-b9e3-a64f3a1694d9', 'volume_name': 'volume-e9bef329-23be-4252-b9e3-a64f3a1694d9', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:25:35.550882 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b49cb11c-b8ef-445e-9f15-55ef99d9974e tempest-VolumeQuotasAdminTestJSON-1683648975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64a7ef6a-351c-40b6-b6c2-deea6db59b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:25:35.555664 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b49cb11c-b8ef-445e-9f15-55ef99d9974e tempest-VolumeQuotasAdminTestJSON-1683648975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64a7ef6a-351c-40b6-b6c2-deea6db59b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:25:35.561750 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b49cb11c-b8ef-445e-9f15-55ef99d9974e tempest-VolumeQuotasAdminTestJSON-1683648975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00d38359-fa0e-4e46-83f4-33668dfe5b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:25:35.562854 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-b49cb11c-b8ef-445e-9f15-55ef99d9974e tempest-VolumeQuotasAdminTestJSON-1683648975 None] Volume e9bef329-23be-4252-b9e3-a64f3a1694d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9bef329-23be-4252-b9e3-a64f3a1694d9', 'volume_size': 1} May 21 21:25:35.563241 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b49cb11c-b8ef-445e-9f15-55ef99d9974e tempest-VolumeQuotasAdminTestJSON-1683648975 None] creating volume 'volume-e9bef329-23be-4252-b9e3-a64f3a1694d9' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:25:35.563897 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b49cb11c-b8ef-445e-9f15-55ef99d9974e tempest-VolumeQuotasAdminTestJSON-1683648975 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:25:35.824273 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-62df1718-733c-445b-a7b5-50bddb5f4548 tempest-VolumesAdminNegativeTest-1430965486 None] Created reservations ['900d753c-033e-4582-be22-f46c13a07e12', '71e7cc4a-9415-4e9c-b373-963a1dae7c37', '3588fa51-46da-4151-8331-f8879d37a03d', 'd1208c0b-681c-4508-934f-91d55978e340'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:25:35.943136 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=66,cinder:UPDATE=28,cinder:INSERT=5,cinder:DELETE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:25:36.044763 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-62df1718-733c-445b-a7b5-50bddb5f4548 tempest-VolumesAdminNegativeTest-1430965486 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:25:36.113587 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-62df1718-733c-445b-a7b5-50bddb5f4548 tempest-VolumesAdminNegativeTest-1430965486 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:25:36.148952 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-62df1718-733c-445b-a7b5-50bddb5f4548 tempest-VolumesAdminNegativeTest-1430965486 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:25:36.154957 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-62df1718-733c-445b-a7b5-50bddb5f4548 tempest-VolumesAdminNegativeTest-1430965486 None] Deleted volume successfully. May 21 21:25:36.286807 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-62df1718-733c-445b-a7b5-50bddb5f4548 tempest-VolumesAdminNegativeTest-1430965486 None] Lock "b'cinder-0b9f4fb4-d73a-45d0-851e-6cf568466b6a-delete_volume'" released by "delete_volume" :: held 10.258s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:25:36.589043 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b49cb11c-b8ef-445e-9f15-55ef99d9974e tempest-VolumeQuotasAdminTestJSON-1683648975 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:25:36.589619 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b49cb11c-b8ef-445e-9f15-55ef99d9974e tempest-VolumeQuotasAdminTestJSON-1683648975 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:25:36.593775 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b49cb11c-b8ef-445e-9f15-55ef99d9974e tempest-VolumeQuotasAdminTestJSON-1683648975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00d38359-fa0e-4e46-83f4-33668dfe5b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9bef329-23be-4252-b9e3-a64f3a1694d9', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:25:36.598526 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b49cb11c-b8ef-445e-9f15-55ef99d9974e tempest-VolumeQuotasAdminTestJSON-1683648975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a98b207-1495-4d66-bd29-ff069a95fa39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:25:36.688777 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-b49cb11c-b8ef-445e-9f15-55ef99d9974e tempest-VolumeQuotasAdminTestJSON-1683648975 None] Volume volume-e9bef329-23be-4252-b9e3-a64f3a1694d9 (e9bef329-23be-4252-b9e3-a64f3a1694d9): created successfully May 21 21:25:36.693825 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b49cb11c-b8ef-445e-9f15-55ef99d9974e tempest-VolumeQuotasAdminTestJSON-1683648975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a98b207-1495-4d66-bd29-ff069a95fa39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:25:36.705376 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b49cb11c-b8ef-445e-9f15-55ef99d9974e tempest-VolumeQuotasAdminTestJSON-1683648975 None] Flow 'volume_create_manager' (23762aba-c486-4f56-8d42-6b070493230f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:25:36.782123 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-b49cb11c-b8ef-445e-9f15-55ef99d9974e tempest-VolumeQuotasAdminTestJSON-1683648975 None] Created volume successfully. May 21 21:25:36.979942 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-1cd0b3c5-738b-4ce0-ad42-dbeb71c5b019 tempest-VolumesAdminNegativeTest-1430965486 None] Lock "b'cinder-5d57ce02-37f5-4d5e-b99e-ce11caefd4c6-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:25:37.113218 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-1cd0b3c5-738b-4ce0-ad42-dbeb71c5b019 tempest-VolumesAdminNegativeTest-1430965486 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:25:37.431574 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-1cd0b3c5-738b-4ce0-ad42-dbeb71c5b019 tempest-VolumesAdminNegativeTest-1430965486 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:25:37.431989 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-1cd0b3c5-738b-4ce0-ad42-dbeb71c5b019 tempest-VolumesAdminNegativeTest-1430965486 None] Volume volume-5d57ce02-37f5-4d5e-b99e-ce11caefd4c6 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:25:37.860785 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-1cd0b3c5-738b-4ce0-ad42-dbeb71c5b019 tempest-VolumesAdminNegativeTest-1430965486 None] deleting rbd volume volume-5d57ce02-37f5-4d5e-b99e-ce11caefd4c6 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:25:37.875996 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-5aab519b-74cb-45ca-9c87-f1f33b960352 tempest-VolumeQuotasAdminTestJSON-1683648975 None] Lock "b'cinder-e9bef329-23be-4252-b9e3-a64f3a1694d9-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:25:37.994742 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-5aab519b-74cb-45ca-9c87-f1f33b960352 tempest-VolumeQuotasAdminTestJSON-1683648975 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:25:38.254372 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-5aab519b-74cb-45ca-9c87-f1f33b960352 tempest-VolumeQuotasAdminTestJSON-1683648975 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:25:38.254817 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-5aab519b-74cb-45ca-9c87-f1f33b960352 tempest-VolumeQuotasAdminTestJSON-1683648975 None] Volume volume-e9bef329-23be-4252-b9e3-a64f3a1694d9 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:25:38.702752 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-5aab519b-74cb-45ca-9c87-f1f33b960352 tempest-VolumeQuotasAdminTestJSON-1683648975 None] deleting rbd volume volume-e9bef329-23be-4252-b9e3-a64f3a1694d9 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:25:47.422360 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:25:47.423774 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:25:47.492795 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:25:47.551591 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:25:47.572991 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=53,cinder:DELETE=4,cinder:UPDATE=21,cinder:INSERT=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:25:47.688143 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-1cd0b3c5-738b-4ce0-ad42-dbeb71c5b019 tempest-VolumesAdminNegativeTest-1430965486 None] Created reservations ['a724d2fa-b7c2-40e2-a194-d719679faeb5', 'd4074357-e0af-4776-83f7-67bad9e39eff', 'ec96ae0d-26d8-48c4-beb9-b6d5e364a4c3', '8e364ae3-b607-4df7-8b3f-bfdb16f04558'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:25:47.861484 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-5aab519b-74cb-45ca-9c87-f1f33b960352 tempest-VolumeQuotasAdminTestJSON-1683648975 None] Created reservations ['fe49c566-c70a-4149-95bf-2dfa7bbdcbcc', '20af3da5-1528-4784-8c9e-d4ac0aae7b12', 'c1822665-b328-4cda-9d86-56a959bddc2e', '522827d9-c656-45a2-bd30-bc9ffea7f846'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:25:48.010883 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-1cd0b3c5-738b-4ce0-ad42-dbeb71c5b019 tempest-VolumesAdminNegativeTest-1430965486 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:25:48.048387 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-1cd0b3c5-738b-4ce0-ad42-dbeb71c5b019 tempest-VolumesAdminNegativeTest-1430965486 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:25:48.084551 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-1cd0b3c5-738b-4ce0-ad42-dbeb71c5b019 tempest-VolumesAdminNegativeTest-1430965486 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:25:48.095360 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-1cd0b3c5-738b-4ce0-ad42-dbeb71c5b019 tempest-VolumesAdminNegativeTest-1430965486 None] Deleted volume successfully. May 21 21:25:48.219160 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-1cd0b3c5-738b-4ce0-ad42-dbeb71c5b019 tempest-VolumesAdminNegativeTest-1430965486 None] Lock "b'cinder-5d57ce02-37f5-4d5e-b99e-ce11caefd4c6-delete_volume'" released by "delete_volume" :: held 11.239s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:25:48.272045 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-5aab519b-74cb-45ca-9c87-f1f33b960352 tempest-VolumeQuotasAdminTestJSON-1683648975 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:25:48.318267 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-5aab519b-74cb-45ca-9c87-f1f33b960352 tempest-VolumeQuotasAdminTestJSON-1683648975 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:25:48.445727 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-5aab519b-74cb-45ca-9c87-f1f33b960352 tempest-VolumeQuotasAdminTestJSON-1683648975 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:25:48.450611 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-5aab519b-74cb-45ca-9c87-f1f33b960352 tempest-VolumeQuotasAdminTestJSON-1683648975 None] Deleted volume successfully. May 21 21:25:48.584464 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-5aab519b-74cb-45ca-9c87-f1f33b960352 tempest-VolumeQuotasAdminTestJSON-1683648975 None] Lock "b'cinder-e9bef329-23be-4252-b9e3-a64f3a1694d9-delete_volume'" released by "delete_volume" :: held 10.708s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:25:49.224744 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-24e055f7-9ece-4146-b949-5855806f5693 tempest-VolumeQuotasAdminTestJSON-1683648975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:25:49.244751 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-24e055f7-9ece-4146-b949-5855806f5693 tempest-VolumeQuotasAdminTestJSON-1683648975 None] Flow 'volume_create_manager' (be48a85b-5660-4a57-a66d-7d50ed178dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:25:49.251941 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-24e055f7-9ece-4146-b949-5855806f5693 tempest-VolumeQuotasAdminTestJSON-1683648975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17818d1b-0b60-473d-954f-0f42424ccda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:25:49.268759 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-24e055f7-9ece-4146-b949-5855806f5693 tempest-VolumeQuotasAdminTestJSON-1683648975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17818d1b-0b60-473d-954f-0f42424ccda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:25:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1579000182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=334165de-bef7-47e8-bd97-fbf6c1eccad6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6acd2cb5d0404e8fbe95c495799cf373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:25:49Z,use_quota=True,user_id='e20ab48ec9534bf6aceb9bbc31262686',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:25:49.274177 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-24e055f7-9ece-4146-b949-5855806f5693 tempest-VolumeQuotasAdminTestJSON-1683648975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b170b5c2-3bb7-43f1-9e90-483e1c00806e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:25:49.279104 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-24e055f7-9ece-4146-b949-5855806f5693 tempest-VolumeQuotasAdminTestJSON-1683648975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b170b5c2-3bb7-43f1-9e90-483e1c00806e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:25:49.284938 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-24e055f7-9ece-4146-b949-5855806f5693 tempest-VolumeQuotasAdminTestJSON-1683648975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a342a255-47b9-44da-84f2-223067535d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:25:49.292154 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-24e055f7-9ece-4146-b949-5855806f5693 tempest-VolumeQuotasAdminTestJSON-1683648975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a342a255-47b9-44da-84f2-223067535d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '334165de-bef7-47e8-bd97-fbf6c1eccad6', 'volume_name': 'volume-334165de-bef7-47e8-bd97-fbf6c1eccad6', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:25:49.298532 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-24e055f7-9ece-4146-b949-5855806f5693 tempest-VolumeQuotasAdminTestJSON-1683648975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50c3b853-cc42-4287-8cc2-b67569d5ff55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:25:49.303734 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-24e055f7-9ece-4146-b949-5855806f5693 tempest-VolumeQuotasAdminTestJSON-1683648975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50c3b853-cc42-4287-8cc2-b67569d5ff55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:25:49.310398 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-24e055f7-9ece-4146-b949-5855806f5693 tempest-VolumeQuotasAdminTestJSON-1683648975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bb35f21-412a-42a5-9621-a625c0766e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:25:49.311519 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-24e055f7-9ece-4146-b949-5855806f5693 tempest-VolumeQuotasAdminTestJSON-1683648975 None] Volume 334165de-bef7-47e8-bd97-fbf6c1eccad6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-334165de-bef7-47e8-bd97-fbf6c1eccad6', 'volume_size': 1} May 21 21:25:49.312107 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-24e055f7-9ece-4146-b949-5855806f5693 tempest-VolumeQuotasAdminTestJSON-1683648975 None] creating volume 'volume-334165de-bef7-47e8-bd97-fbf6c1eccad6' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:25:49.312973 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-24e055f7-9ece-4146-b949-5855806f5693 tempest-VolumeQuotasAdminTestJSON-1683648975 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:25:50.672749 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-24e055f7-9ece-4146-b949-5855806f5693 tempest-VolumeQuotasAdminTestJSON-1683648975 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:25:50.673401 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-24e055f7-9ece-4146-b949-5855806f5693 tempest-VolumeQuotasAdminTestJSON-1683648975 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:25:50.676770 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-24e055f7-9ece-4146-b949-5855806f5693 tempest-VolumeQuotasAdminTestJSON-1683648975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bb35f21-412a-42a5-9621-a625c0766e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-334165de-bef7-47e8-bd97-fbf6c1eccad6', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:25:50.682320 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-24e055f7-9ece-4146-b949-5855806f5693 tempest-VolumeQuotasAdminTestJSON-1683648975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (591ccabf-2dff-48ff-a085-b496e7560161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:25:50.774480 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-24e055f7-9ece-4146-b949-5855806f5693 tempest-VolumeQuotasAdminTestJSON-1683648975 None] Volume volume-334165de-bef7-47e8-bd97-fbf6c1eccad6 (334165de-bef7-47e8-bd97-fbf6c1eccad6): created successfully May 21 21:25:50.779200 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-24e055f7-9ece-4146-b949-5855806f5693 tempest-VolumeQuotasAdminTestJSON-1683648975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (591ccabf-2dff-48ff-a085-b496e7560161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:25:50.784809 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-24e055f7-9ece-4146-b949-5855806f5693 tempest-VolumeQuotasAdminTestJSON-1683648975 None] Flow 'volume_create_manager' (be48a85b-5660-4a57-a66d-7d50ed178dea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:25:50.893383 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-24e055f7-9ece-4146-b949-5855806f5693 tempest-VolumeQuotasAdminTestJSON-1683648975 None] Created volume successfully. May 21 21:25:52.686116 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-60894792-2e6a-4830-b575-fbbdbbf2e7b3 tempest-VolumeQuotasAdminTestJSON-1166724195 None] Transfer volume completed successfully. May 21 21:25:54.005934 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-d54d3bc5-fe6f-4479-9320-3ec114b987f4 tempest-VolumeQuotasAdminTestJSON-745901178 None] Lock "b'cinder-334165de-bef7-47e8-bd97-fbf6c1eccad6-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:25:54.195176 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d54d3bc5-fe6f-4479-9320-3ec114b987f4 tempest-VolumeQuotasAdminTestJSON-745901178 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:25:54.591434 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d54d3bc5-fe6f-4479-9320-3ec114b987f4 tempest-VolumeQuotasAdminTestJSON-745901178 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:25:54.591855 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d54d3bc5-fe6f-4479-9320-3ec114b987f4 tempest-VolumeQuotasAdminTestJSON-745901178 None] Volume volume-334165de-bef7-47e8-bd97-fbf6c1eccad6 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:25:54.906553 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d54d3bc5-fe6f-4479-9320-3ec114b987f4 tempest-VolumeQuotasAdminTestJSON-745901178 None] deleting rbd volume volume-334165de-bef7-47e8-bd97-fbf6c1eccad6 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:26:02.613929 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=54,cinder:INSERT=8,cinder:UPDATE=35,cinder:DELETE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:26:02.772677 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-d54d3bc5-fe6f-4479-9320-3ec114b987f4 tempest-VolumeQuotasAdminTestJSON-745901178 None] Created reservations ['b6addaad-c999-4d0c-baa1-d72dece05425', '185085f5-0176-4c9c-8d7f-d561b67995d1', '081a1976-4089-41f7-b2e1-0d1790fd07c2', '2f345575-8f69-43e9-b49f-fcfcd6ca5b3f'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:26:02.997507 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d54d3bc5-fe6f-4479-9320-3ec114b987f4 tempest-VolumeQuotasAdminTestJSON-745901178 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:26:03.044271 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d54d3bc5-fe6f-4479-9320-3ec114b987f4 tempest-VolumeQuotasAdminTestJSON-745901178 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:26:03.164123 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-d54d3bc5-fe6f-4479-9320-3ec114b987f4 tempest-VolumeQuotasAdminTestJSON-745901178 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:26:03.169311 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-d54d3bc5-fe6f-4479-9320-3ec114b987f4 tempest-VolumeQuotasAdminTestJSON-745901178 None] Deleted volume successfully. May 21 21:26:03.254258 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-d54d3bc5-fe6f-4479-9320-3ec114b987f4 tempest-VolumeQuotasAdminTestJSON-745901178 None] Lock "b'cinder-334165de-bef7-47e8-bd97-fbf6c1eccad6-delete_volume'" released by "delete_volume" :: held 9.248s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:26:13.176376 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=16,cinder:UPDATE=16,cinder:INSERT=4,cinder:DELETE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:26:14.363627 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9c27085-0a63-4aa7-88cc-58cec79d10c1 tempest-VolumeTypesTest-1565797321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:26:14.386499 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a9c27085-0a63-4aa7-88cc-58cec79d10c1 tempest-VolumeTypesTest-1565797321 None] Flow 'volume_create_manager' (cdb5a59b-7fa1-415a-9fa2-27ab954fec78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:26:14.389996 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a9c27085-0a63-4aa7-88cc-58cec79d10c1 tempest-VolumeTypesTest-1565797321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94dde5c7-edb6-42d4-857c-179e4ebb3855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:26:14.413636 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a9c27085-0a63-4aa7-88cc-58cec79d10c1 tempest-VolumeTypesTest-1565797321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94dde5c7-edb6-42d4-857c-179e4ebb3855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesTest-volume-685004623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d4a51ae6-e41a-45c1-8da3-a25f3720a9c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abc6dbe3a20d45de8da2ca5830215a13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:26:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:26:14Z,use_quota=True,user_id='3428be50f176411694b7ebb81d3ad6dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9195e76f-a53f-4250-9baf-9df964cc0a8f),volume_type_id=9195e76f-a53f-4250-9baf-9df964cc0a8f)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:26:14.419523 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a9c27085-0a63-4aa7-88cc-58cec79d10c1 tempest-VolumeTypesTest-1565797321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (822bf166-6e3c-440a-aec2-88810c1c3d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:26:14.424003 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a9c27085-0a63-4aa7-88cc-58cec79d10c1 tempest-VolumeTypesTest-1565797321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (822bf166-6e3c-440a-aec2-88810c1c3d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:26:14.428917 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a9c27085-0a63-4aa7-88cc-58cec79d10c1 tempest-VolumeTypesTest-1565797321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa5469dc-bd09-47e6-a876-66e0650336bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:26:14.433443 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a9c27085-0a63-4aa7-88cc-58cec79d10c1 tempest-VolumeTypesTest-1565797321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa5469dc-bd09-47e6-a876-66e0650336bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4a51ae6-e41a-45c1-8da3-a25f3720a9c1', 'volume_name': 'volume-d4a51ae6-e41a-45c1-8da3-a25f3720a9c1', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:26:14.438095 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a9c27085-0a63-4aa7-88cc-58cec79d10c1 tempest-VolumeTypesTest-1565797321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cf82672-3084-4f72-8424-43f50ea2a81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:26:14.441845 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a9c27085-0a63-4aa7-88cc-58cec79d10c1 tempest-VolumeTypesTest-1565797321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cf82672-3084-4f72-8424-43f50ea2a81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:26:14.446420 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a9c27085-0a63-4aa7-88cc-58cec79d10c1 tempest-VolumeTypesTest-1565797321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5517c8cf-a878-45fc-9524-b8b34541381d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:26:14.447592 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-a9c27085-0a63-4aa7-88cc-58cec79d10c1 tempest-VolumeTypesTest-1565797321 None] Volume d4a51ae6-e41a-45c1-8da3-a25f3720a9c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4a51ae6-e41a-45c1-8da3-a25f3720a9c1', 'volume_size': 1} May 21 21:26:14.447902 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a9c27085-0a63-4aa7-88cc-58cec79d10c1 tempest-VolumeTypesTest-1565797321 None] creating volume 'volume-d4a51ae6-e41a-45c1-8da3-a25f3720a9c1' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:26:14.448694 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a9c27085-0a63-4aa7-88cc-58cec79d10c1 tempest-VolumeTypesTest-1565797321 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:26:15.546984 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a9c27085-0a63-4aa7-88cc-58cec79d10c1 tempest-VolumeTypesTest-1565797321 None] extra_specs: {'vendor_name': 'Open Source', 'storage_protocol': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:26:15.547541 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a9c27085-0a63-4aa7-88cc-58cec79d10c1 tempest-VolumeTypesTest-1565797321 None] extra_specs: {'vendor_name': 'Open Source', 'storage_protocol': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:26:15.551557 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a9c27085-0a63-4aa7-88cc-58cec79d10c1 tempest-VolumeTypesTest-1565797321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5517c8cf-a878-45fc-9524-b8b34541381d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4a51ae6-e41a-45c1-8da3-a25f3720a9c1', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:26:15.556151 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a9c27085-0a63-4aa7-88cc-58cec79d10c1 tempest-VolumeTypesTest-1565797321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (530d98e0-b134-4d5d-b3f5-d29aa258dec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:26:15.646990 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-a9c27085-0a63-4aa7-88cc-58cec79d10c1 tempest-VolumeTypesTest-1565797321 None] Volume volume-d4a51ae6-e41a-45c1-8da3-a25f3720a9c1 (d4a51ae6-e41a-45c1-8da3-a25f3720a9c1): created successfully May 21 21:26:15.650625 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a9c27085-0a63-4aa7-88cc-58cec79d10c1 tempest-VolumeTypesTest-1565797321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (530d98e0-b134-4d5d-b3f5-d29aa258dec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:26:15.656345 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a9c27085-0a63-4aa7-88cc-58cec79d10c1 tempest-VolumeTypesTest-1565797321 None] Flow 'volume_create_manager' (cdb5a59b-7fa1-415a-9fa2-27ab954fec78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:26:15.784256 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-a9c27085-0a63-4aa7-88cc-58cec79d10c1 tempest-VolumeTypesTest-1565797321 None] Created volume successfully. May 21 21:26:17.209978 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b38324ab-4f4b-4707-b4c9-de2c19c7bbd2 tempest-VolumeTypesTest-1565797321 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:26:17.261649 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b38324ab-4f4b-4707-b4c9-de2c19c7bbd2 tempest-VolumeTypesTest-1565797321 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:26:17.316654 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-b38324ab-4f4b-4707-b4c9-de2c19c7bbd2 tempest-VolumeTypesTest-1565797321 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:26:17.320736 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-b38324ab-4f4b-4707-b4c9-de2c19c7bbd2 tempest-VolumeTypesTest-1565797321 None] Retype volume completed successfully. May 21 21:26:20.155752 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-91ae03d6-5d83-4232-972a-5da5fad08240 tempest-VolumeTypesTest-1565797321 None] Lock "b'cinder-d4a51ae6-e41a-45c1-8da3-a25f3720a9c1-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:26:20.263970 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-91ae03d6-5d83-4232-972a-5da5fad08240 tempest-VolumeTypesTest-1565797321 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:26:20.527172 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-91ae03d6-5d83-4232-972a-5da5fad08240 tempest-VolumeTypesTest-1565797321 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:26:20.531173 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-91ae03d6-5d83-4232-972a-5da5fad08240 tempest-VolumeTypesTest-1565797321 None] Volume volume-d4a51ae6-e41a-45c1-8da3-a25f3720a9c1 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:26:20.779440 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-91ae03d6-5d83-4232-972a-5da5fad08240 tempest-VolumeTypesTest-1565797321 None] deleting rbd volume volume-d4a51ae6-e41a-45c1-8da3-a25f3720a9c1 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:26:28.908768 ncdv-master-1 cinder-volume[124407]: WARNING cinder.quota [None req-91ae03d6-5d83-4232-972a-5da5fad08240 tempest-VolumeTypesTest-1565797321 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesTest-volume-type-653275624 is set by the default quota flag: quota_volumes_tempest-VolumeTypesTest-volume-type-653275624, it is now deprecated. Please use the default quota class for default quota. May 21 21:26:28.914975 ncdv-master-1 cinder-volume[124407]: WARNING cinder.quota [None req-91ae03d6-5d83-4232-972a-5da5fad08240 tempest-VolumeTypesTest-1565797321 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesTest-volume-type-653275624 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesTest-volume-type-653275624, it is now deprecated. Please use the default quota class for default quota. May 21 21:26:29.081378 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-91ae03d6-5d83-4232-972a-5da5fad08240 tempest-VolumeTypesTest-1565797321 None] Created reservations ['b4bee880-6579-48b5-a98f-8b5599b3620c', 'a6e89c49-2044-4e94-93bd-c1c9ccb974c7', '0e506b7a-4952-405e-95cb-1b26a1555a6b', '329fa607-75e0-4660-80bd-0f1658275179'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:26:29.361885 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-91ae03d6-5d83-4232-972a-5da5fad08240 tempest-VolumeTypesTest-1565797321 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:26:29.438460 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-91ae03d6-5d83-4232-972a-5da5fad08240 tempest-VolumeTypesTest-1565797321 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:26:29.509703 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-91ae03d6-5d83-4232-972a-5da5fad08240 tempest-VolumeTypesTest-1565797321 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:26:29.514256 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-91ae03d6-5d83-4232-972a-5da5fad08240 tempest-VolumeTypesTest-1565797321 None] Deleted volume successfully. May 21 21:26:29.582343 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-91ae03d6-5d83-4232-972a-5da5fad08240 tempest-VolumeTypesTest-1565797321 None] Lock "b'cinder-d4a51ae6-e41a-45c1-8da3-a25f3720a9c1-delete_volume'" released by "delete_volume" :: held 9.427s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:26:33.895408 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-a3b3178d-c3e7-4130-a1bb-f7e45e7e11a0 req-be597f5d-8281-4f30-97ea-9c96cd53ece7 tempest-TaggedBootDevicesTest-674948933 None] Terminate volume connection completed successfully. May 21 21:26:33.896628 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-a3b3178d-c3e7-4130-a1bb-f7e45e7e11a0 req-be597f5d-8281-4f30-97ea-9c96cd53ece7 tempest-TaggedBootDevicesTest-674948933 None] Deleting attachment 02b155a0-d576-418d-b20a-aa20d8552225. {{(pid=124407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4957}} May 21 21:26:34.124503 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-a3b3178d-c3e7-4130-a1bb-f7e45e7e11a0 req-3f68d52f-27fe-411f-abca-4b0d1f6e8b92 tempest-TaggedBootDevicesTest-674948933 None] Terminate volume connection completed successfully. May 21 21:26:34.125192 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-a3b3178d-c3e7-4130-a1bb-f7e45e7e11a0 req-3f68d52f-27fe-411f-abca-4b0d1f6e8b92 tempest-TaggedBootDevicesTest-674948933 None] Deleting attachment 5b9eb899-9589-4b7a-a3ee-09054dcdd06c. {{(pid=124407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4957}} May 21 21:26:34.349833 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-a3b3178d-c3e7-4130-a1bb-f7e45e7e11a0 req-7e14e9e2-1f91-4c7a-8789-dc6f1ea0c58c tempest-TaggedBootDevicesTest-674948933 None] Terminate volume connection completed successfully. May 21 21:26:34.350539 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-a3b3178d-c3e7-4130-a1bb-f7e45e7e11a0 req-7e14e9e2-1f91-4c7a-8789-dc6f1ea0c58c tempest-TaggedBootDevicesTest-674948933 None] Deleting attachment 032ff396-de32-4eb1-af55-e4e7aa97dd6d. {{(pid=124407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4957}} May 21 21:26:40.480433 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=41,cinder:UPDATE=17,cinder:DELETE=2,cinder:INSERT=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:26:40.574778 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-97759fb0-9d51-43a8-b0f0-215fb34c9413 tempest-AbsoluteLimitsTests-1250552726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:26:40.617047 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-97759fb0-9d51-43a8-b0f0-215fb34c9413 tempest-AbsoluteLimitsTests-1250552726 None] Flow 'volume_create_manager' (06075caf-5f81-403d-ae5a-73a90f29332e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:26:40.635033 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-97759fb0-9d51-43a8-b0f0-215fb34c9413 tempest-AbsoluteLimitsTests-1250552726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52186352-1691-4788-9720-365a89840b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:26:40.679326 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-97759fb0-9d51-43a8-b0f0-215fb34c9413 tempest-AbsoluteLimitsTests-1250552726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52186352-1691-4788-9720-365a89840b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1559272727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a6eca41d-7e75-4507-a33c-db2c2902fb95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f68d9d2c094482e8f960bdf7aad2781',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:26:40Z,use_quota=True,user_id='a48cb063a7c34b6fa5fc5cdbadc3fc92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:26:40.691905 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-97759fb0-9d51-43a8-b0f0-215fb34c9413 tempest-AbsoluteLimitsTests-1250552726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bda24f5-d7bd-4c48-a737-6e109ebf5c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:26:40.699684 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-97759fb0-9d51-43a8-b0f0-215fb34c9413 tempest-AbsoluteLimitsTests-1250552726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bda24f5-d7bd-4c48-a737-6e109ebf5c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:26:40.715111 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-97759fb0-9d51-43a8-b0f0-215fb34c9413 tempest-AbsoluteLimitsTests-1250552726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b66a29e7-2a6e-4cf0-89e5-46085e6cdf16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:26:40.728806 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-97759fb0-9d51-43a8-b0f0-215fb34c9413 tempest-AbsoluteLimitsTests-1250552726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b66a29e7-2a6e-4cf0-89e5-46085e6cdf16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6eca41d-7e75-4507-a33c-db2c2902fb95', 'volume_name': 'volume-a6eca41d-7e75-4507-a33c-db2c2902fb95', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:26:40.735194 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-97759fb0-9d51-43a8-b0f0-215fb34c9413 tempest-AbsoluteLimitsTests-1250552726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fbcf33c-24ee-44d9-b193-090d1ee1a12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:26:40.739440 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-97759fb0-9d51-43a8-b0f0-215fb34c9413 tempest-AbsoluteLimitsTests-1250552726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fbcf33c-24ee-44d9-b193-090d1ee1a12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:26:40.745274 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-97759fb0-9d51-43a8-b0f0-215fb34c9413 tempest-AbsoluteLimitsTests-1250552726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1614712c-840c-46fb-9ac0-6941b0cdddf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:26:40.746599 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-97759fb0-9d51-43a8-b0f0-215fb34c9413 tempest-AbsoluteLimitsTests-1250552726 None] Volume a6eca41d-7e75-4507-a33c-db2c2902fb95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6eca41d-7e75-4507-a33c-db2c2902fb95', 'volume_size': 1} May 21 21:26:40.747164 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-97759fb0-9d51-43a8-b0f0-215fb34c9413 tempest-AbsoluteLimitsTests-1250552726 None] creating volume 'volume-a6eca41d-7e75-4507-a33c-db2c2902fb95' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:26:40.747943 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-97759fb0-9d51-43a8-b0f0-215fb34c9413 tempest-AbsoluteLimitsTests-1250552726 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:26:41.880408 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-97759fb0-9d51-43a8-b0f0-215fb34c9413 tempest-AbsoluteLimitsTests-1250552726 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:26:41.882561 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-97759fb0-9d51-43a8-b0f0-215fb34c9413 tempest-AbsoluteLimitsTests-1250552726 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:26:41.889581 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-97759fb0-9d51-43a8-b0f0-215fb34c9413 tempest-AbsoluteLimitsTests-1250552726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1614712c-840c-46fb-9ac0-6941b0cdddf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6eca41d-7e75-4507-a33c-db2c2902fb95', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:26:41.896880 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-97759fb0-9d51-43a8-b0f0-215fb34c9413 tempest-AbsoluteLimitsTests-1250552726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e6b57aa-9405-4c2c-bc74-0f9ddf80d7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:26:42.059453 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-97759fb0-9d51-43a8-b0f0-215fb34c9413 tempest-AbsoluteLimitsTests-1250552726 None] Volume volume-a6eca41d-7e75-4507-a33c-db2c2902fb95 (a6eca41d-7e75-4507-a33c-db2c2902fb95): created successfully May 21 21:26:42.064266 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-97759fb0-9d51-43a8-b0f0-215fb34c9413 tempest-AbsoluteLimitsTests-1250552726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e6b57aa-9405-4c2c-bc74-0f9ddf80d7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:26:42.070280 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-97759fb0-9d51-43a8-b0f0-215fb34c9413 tempest-AbsoluteLimitsTests-1250552726 None] Flow 'volume_create_manager' (06075caf-5f81-403d-ae5a-73a90f29332e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:26:42.105191 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-6e3051d1-50f9-407c-b163-8feb8c892ff1 tempest-TaggedBootDevicesTest-674948933 None] Lock "b'cinder-bdba9bc9-a60d-4ef9-b90d-a73d75b3bf73-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:26:42.205486 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-97759fb0-9d51-43a8-b0f0-215fb34c9413 tempest-AbsoluteLimitsTests-1250552726 None] Created volume successfully. May 21 21:26:42.306924 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6e3051d1-50f9-407c-b163-8feb8c892ff1 tempest-TaggedBootDevicesTest-674948933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:26:42.577633 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6e3051d1-50f9-407c-b163-8feb8c892ff1 tempest-TaggedBootDevicesTest-674948933 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:26:42.578074 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6e3051d1-50f9-407c-b163-8feb8c892ff1 tempest-TaggedBootDevicesTest-674948933 None] Volume volume-bdba9bc9-a60d-4ef9-b90d-a73d75b3bf73 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:26:42.822932 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6e3051d1-50f9-407c-b163-8feb8c892ff1 tempest-TaggedBootDevicesTest-674948933 None] deleting rbd volume volume-bdba9bc9-a60d-4ef9-b90d-a73d75b3bf73 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:26:42.840801 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-1bd489c4-eb0e-4eb8-aa1d-b7acd5e0b86e tempest-AbsoluteLimitsTests-1250552726 None] Lock "b'cinder-a6eca41d-7e75-4507-a33c-db2c2902fb95-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:26:42.962705 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-1bd489c4-eb0e-4eb8-aa1d-b7acd5e0b86e tempest-AbsoluteLimitsTests-1250552726 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:26:43.891596 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-1bd489c4-eb0e-4eb8-aa1d-b7acd5e0b86e tempest-AbsoluteLimitsTests-1250552726 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:26:43.892021 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-1bd489c4-eb0e-4eb8-aa1d-b7acd5e0b86e tempest-AbsoluteLimitsTests-1250552726 None] Volume volume-a6eca41d-7e75-4507-a33c-db2c2902fb95 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:26:44.122851 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-1bd489c4-eb0e-4eb8-aa1d-b7acd5e0b86e tempest-AbsoluteLimitsTests-1250552726 None] deleting rbd volume volume-a6eca41d-7e75-4507-a33c-db2c2902fb95 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:26:47.428546 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:26:47.428546 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:26:47.449235 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:26:47.477945 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:26:49.601386 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=60,cinder:UPDATE=19,cinder:INSERT=3,cinder:DELETE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:26:49.737701 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-6e3051d1-50f9-407c-b163-8feb8c892ff1 tempest-TaggedBootDevicesTest-674948933 None] Created reservations ['1e7a464f-2e55-4efe-a356-6d5c27400a34', '8f1a8f14-0baa-4eca-9d9d-ea382708bf96', '3e411812-f4c7-49d1-9fba-789b58b07514', 'fdb5ea4a-d1c5-44a0-866f-c987f3d5d32e'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:26:49.969708 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6e3051d1-50f9-407c-b163-8feb8c892ff1 tempest-TaggedBootDevicesTest-674948933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:26:49.994497 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6e3051d1-50f9-407c-b163-8feb8c892ff1 tempest-TaggedBootDevicesTest-674948933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:26:50.018199 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-6e3051d1-50f9-407c-b163-8feb8c892ff1 tempest-TaggedBootDevicesTest-674948933 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:26:50.024549 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-6e3051d1-50f9-407c-b163-8feb8c892ff1 tempest-TaggedBootDevicesTest-674948933 None] Deleted volume successfully. May 21 21:26:50.129243 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-1bd489c4-eb0e-4eb8-aa1d-b7acd5e0b86e tempest-AbsoluteLimitsTests-1250552726 None] Created reservations ['7986030c-72ac-4d6e-a841-9db290051023', '77535408-b169-486d-b5d8-5579bb9aaaee', '46643cd8-492e-416b-9403-f3b8b4ab007c', '03887670-2933-4cb6-b4f4-7c207ba2970d'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:26:50.143672 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-6e3051d1-50f9-407c-b163-8feb8c892ff1 tempest-TaggedBootDevicesTest-674948933 None] Lock "b'cinder-bdba9bc9-a60d-4ef9-b90d-a73d75b3bf73-delete_volume'" released by "delete_volume" :: held 8.038s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:26:50.336693 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-1bd489c4-eb0e-4eb8-aa1d-b7acd5e0b86e tempest-AbsoluteLimitsTests-1250552726 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:26:50.371302 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-1bd489c4-eb0e-4eb8-aa1d-b7acd5e0b86e tempest-AbsoluteLimitsTests-1250552726 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:26:50.408313 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-1bd489c4-eb0e-4eb8-aa1d-b7acd5e0b86e tempest-AbsoluteLimitsTests-1250552726 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:26:50.412914 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-1bd489c4-eb0e-4eb8-aa1d-b7acd5e0b86e tempest-AbsoluteLimitsTests-1250552726 None] Deleted volume successfully. May 21 21:26:50.495397 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-1bd489c4-eb0e-4eb8-aa1d-b7acd5e0b86e tempest-AbsoluteLimitsTests-1250552726 None] Lock "b'cinder-a6eca41d-7e75-4507-a33c-db2c2902fb95-delete_volume'" released by "delete_volume" :: held 7.655s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:26:50.866095 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-4324d23a-fdb2-4d1a-95f0-6b8fb463bfda tempest-TaggedBootDevicesTest-674948933 None] Lock "b'cinder-2ec648c5-31f0-4665-a957-6a17147b791e-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:26:51.002804 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-4324d23a-fdb2-4d1a-95f0-6b8fb463bfda tempest-TaggedBootDevicesTest-674948933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:26:51.097317 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-4324d23a-fdb2-4d1a-95f0-6b8fb463bfda tempest-TaggedBootDevicesTest-674948933 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:26:51.097745 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-4324d23a-fdb2-4d1a-95f0-6b8fb463bfda tempest-TaggedBootDevicesTest-674948933 None] Volume volume-2ec648c5-31f0-4665-a957-6a17147b791e is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:26:51.218075 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-4324d23a-fdb2-4d1a-95f0-6b8fb463bfda tempest-TaggedBootDevicesTest-674948933 None] deleting rbd volume volume-2ec648c5-31f0-4665-a957-6a17147b791e {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:26:56.144027 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-4324d23a-fdb2-4d1a-95f0-6b8fb463bfda tempest-TaggedBootDevicesTest-674948933 None] Created reservations ['f4a30ff5-e8ed-4ac3-ac1d-3d0a2b3a04f4', '1142c22a-cb1f-47fd-9dcd-6537a8f2d236', 'd14e00a9-41cb-4d60-8e43-7fd04f1ef5b0', '15696fdd-fb71-4395-bacd-16e9be5df78c'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:26:56.174601 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=48,cinder:UPDATE=39,cinder:INSERT=11,cinder:DELETE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:26:56.417894 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-4324d23a-fdb2-4d1a-95f0-6b8fb463bfda tempest-TaggedBootDevicesTest-674948933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:26:56.455052 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-4324d23a-fdb2-4d1a-95f0-6b8fb463bfda tempest-TaggedBootDevicesTest-674948933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:26:56.488184 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-4324d23a-fdb2-4d1a-95f0-6b8fb463bfda tempest-TaggedBootDevicesTest-674948933 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:26:56.493656 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-4324d23a-fdb2-4d1a-95f0-6b8fb463bfda tempest-TaggedBootDevicesTest-674948933 None] Deleted volume successfully. May 21 21:26:56.586980 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-4324d23a-fdb2-4d1a-95f0-6b8fb463bfda tempest-TaggedBootDevicesTest-674948933 None] Lock "b'cinder-2ec648c5-31f0-4665-a957-6a17147b791e-delete_volume'" released by "delete_volume" :: held 5.722s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:26:57.440676 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-8d539299-8704-4c93-876f-b79792aade9e tempest-TaggedBootDevicesTest-674948933 None] Lock "b'cinder-827936d3-46db-437b-a044-b86ceba4daab-delete_volume'" acquired by "delete_volume" :: waited 0.033s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:26:57.580216 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8d539299-8704-4c93-876f-b79792aade9e tempest-TaggedBootDevicesTest-674948933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:26:57.790481 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8d539299-8704-4c93-876f-b79792aade9e tempest-TaggedBootDevicesTest-674948933 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:26:57.952472 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8d539299-8704-4c93-876f-b79792aade9e tempest-TaggedBootDevicesTest-674948933 None] deleting rbd volume volume-827936d3-46db-437b-a044-b86ceba4daab {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:26:58.537811 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-98b33642-dc99-4575-bb71-9a67504e979a tempest-VolumesSnapshotListTestJSON-1467822845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:26:58.559075 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-98b33642-dc99-4575-bb71-9a67504e979a tempest-VolumesSnapshotListTestJSON-1467822845 None] Flow 'volume_create_manager' (7db4940d-0a08-444b-ad07-93cff5e6e140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:26:58.569586 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-98b33642-dc99-4575-bb71-9a67504e979a tempest-VolumesSnapshotListTestJSON-1467822845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b0c3535-cf14-4b74-a250-0bfb4c9ac238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:26:58.591494 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-98b33642-dc99-4575-bb71-9a67504e979a tempest-VolumesSnapshotListTestJSON-1467822845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b0c3535-cf14-4b74-a250-0bfb4c9ac238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-707122780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=efdb7dfe-eb97-42fb-80e9-71b12892eb9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42df37972cb24387b93604689f2c1646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:26:58Z,use_quota=True,user_id='015198a5724d4829982e56b1c88def98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:26:58.597236 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-98b33642-dc99-4575-bb71-9a67504e979a tempest-VolumesSnapshotListTestJSON-1467822845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df70d3a4-f6c5-45d0-96e9-6a7953d9f04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:26:58.601250 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-98b33642-dc99-4575-bb71-9a67504e979a tempest-VolumesSnapshotListTestJSON-1467822845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df70d3a4-f6c5-45d0-96e9-6a7953d9f04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:26:58.606425 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-98b33642-dc99-4575-bb71-9a67504e979a tempest-VolumesSnapshotListTestJSON-1467822845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e0d350b-4549-4e82-b6c7-febbc4571f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:26:58.610634 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-98b33642-dc99-4575-bb71-9a67504e979a tempest-VolumesSnapshotListTestJSON-1467822845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e0d350b-4549-4e82-b6c7-febbc4571f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efdb7dfe-eb97-42fb-80e9-71b12892eb9a', 'volume_name': 'volume-efdb7dfe-eb97-42fb-80e9-71b12892eb9a', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:26:58.615399 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-98b33642-dc99-4575-bb71-9a67504e979a tempest-VolumesSnapshotListTestJSON-1467822845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf3c056e-341a-4ff3-8abd-f574de53bb33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:26:58.619783 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-98b33642-dc99-4575-bb71-9a67504e979a tempest-VolumesSnapshotListTestJSON-1467822845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf3c056e-341a-4ff3-8abd-f574de53bb33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:26:58.624522 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-98b33642-dc99-4575-bb71-9a67504e979a tempest-VolumesSnapshotListTestJSON-1467822845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90e739e0-d317-4f38-826d-a06c0388021f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:26:58.628411 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-98b33642-dc99-4575-bb71-9a67504e979a tempest-VolumesSnapshotListTestJSON-1467822845 None] Volume efdb7dfe-eb97-42fb-80e9-71b12892eb9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efdb7dfe-eb97-42fb-80e9-71b12892eb9a', 'volume_size': 1} May 21 21:26:58.628411 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-98b33642-dc99-4575-bb71-9a67504e979a tempest-VolumesSnapshotListTestJSON-1467822845 None] creating volume 'volume-efdb7dfe-eb97-42fb-80e9-71b12892eb9a' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:26:58.628411 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-98b33642-dc99-4575-bb71-9a67504e979a tempest-VolumesSnapshotListTestJSON-1467822845 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:26:59.522429 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-98b33642-dc99-4575-bb71-9a67504e979a tempest-VolumesSnapshotListTestJSON-1467822845 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:26:59.522733 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-98b33642-dc99-4575-bb71-9a67504e979a tempest-VolumesSnapshotListTestJSON-1467822845 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:26:59.526564 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-98b33642-dc99-4575-bb71-9a67504e979a tempest-VolumesSnapshotListTestJSON-1467822845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90e739e0-d317-4f38-826d-a06c0388021f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efdb7dfe-eb97-42fb-80e9-71b12892eb9a', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:26:59.531505 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-98b33642-dc99-4575-bb71-9a67504e979a tempest-VolumesSnapshotListTestJSON-1467822845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcd38263-624c-4d84-b221-e75c41b5c402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:26:59.628660 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-98b33642-dc99-4575-bb71-9a67504e979a tempest-VolumesSnapshotListTestJSON-1467822845 None] Volume volume-efdb7dfe-eb97-42fb-80e9-71b12892eb9a (efdb7dfe-eb97-42fb-80e9-71b12892eb9a): created successfully May 21 21:26:59.633901 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-98b33642-dc99-4575-bb71-9a67504e979a tempest-VolumesSnapshotListTestJSON-1467822845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcd38263-624c-4d84-b221-e75c41b5c402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:26:59.642068 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-98b33642-dc99-4575-bb71-9a67504e979a tempest-VolumesSnapshotListTestJSON-1467822845 None] Flow 'volume_create_manager' (7db4940d-0a08-444b-ad07-93cff5e6e140) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:26:59.743848 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-98b33642-dc99-4575-bb71-9a67504e979a tempest-VolumesSnapshotListTestJSON-1467822845 None] Created volume successfully. May 21 21:27:01.258511 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-fc00eae7-0896-4aa2-985e-d129571cab9a tempest-VolumesSnapshotListTestJSON-1467822845 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:27:04.622694 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-fc00eae7-0896-4aa2-985e-d129571cab9a tempest-VolumesSnapshotListTestJSON-1467822845 None] Create snapshot completed successfully May 21 21:27:05.367999 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8d539299-8704-4c93-876f-b79792aade9e tempest-TaggedBootDevicesTest-674948933 None] volume is a clone so cleaning references {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1352}} May 21 21:27:05.594909 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8d539299-8704-4c93-876f-b79792aade9e tempest-TaggedBootDevicesTest-674948933 None] deleting parent snapshot volume-827936d3-46db-437b-a044-b86ceba4daab.clone_snap {{(pid=124407) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1243}} May 21 21:27:08.618352 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d27111b2-017b-4a98-b64a-49ac1850b485 tempest-VolumesSnapshotListTestJSON-1467822845 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:27:08.954748 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-8d539299-8704-4c93-876f-b79792aade9e tempest-TaggedBootDevicesTest-674948933 None] Created reservations ['765b576b-7a57-4bd5-9851-032bbe024c6e', 'd1126515-60fa-41a1-8367-f2372f0e8b99', '7f6df7a1-1eb1-49e3-b341-512acf49f70d', '2ed211c9-4cb5-48f7-ac20-287aba2c5489'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:27:09.131462 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8d539299-8704-4c93-876f-b79792aade9e tempest-TaggedBootDevicesTest-674948933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:27:09.171032 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8d539299-8704-4c93-876f-b79792aade9e tempest-TaggedBootDevicesTest-674948933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:27:09.240043 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-8d539299-8704-4c93-876f-b79792aade9e tempest-TaggedBootDevicesTest-674948933 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:27:09.250074 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-8d539299-8704-4c93-876f-b79792aade9e tempest-TaggedBootDevicesTest-674948933 None] Deleted volume successfully. May 21 21:27:09.326062 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-8d539299-8704-4c93-876f-b79792aade9e tempest-TaggedBootDevicesTest-674948933 None] Lock "b'cinder-827936d3-46db-437b-a044-b86ceba4daab-delete_volume'" released by "delete_volume" :: held 11.885s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:27:12.321425 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-d27111b2-017b-4a98-b64a-49ac1850b485 tempest-VolumesSnapshotListTestJSON-1467822845 None] Create snapshot completed successfully May 21 21:27:13.965284 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d2c2cc88-a8ac-4ace-90a1-6e651b2f639f tempest-VolumesSnapshotListTestJSON-1467822845 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:27:18.017609 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-d2c2cc88-a8ac-4ace-90a1-6e651b2f639f tempest-VolumesSnapshotListTestJSON-1467822845 None] Create snapshot completed successfully May 21 21:27:19.968960 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-8078e632-87bd-400b-994d-866ab5a5ca2a tempest-VolumesSnapshotListTestJSON-1467822845 None] Lock "b'cinder-6e7edad8-fe7b-4dbf-9654-7f5089079964-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.027s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:27:19.983504 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8078e632-87bd-400b-994d-866ab5a5ca2a tempest-VolumesSnapshotListTestJSON-1467822845 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:27:21.788752 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=50,cinder:INSERT=3,cinder:UPDATE=24,cinder:DELETE=5 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:27:23.906898 ncdv-master-1 cinder-volume[124407]: WARNING cinder.quota [None req-8078e632-87bd-400b-994d-866ab5a5ca2a tempest-VolumesSnapshotListTestJSON-1467822845 None] Deprecated: Default quota for resource: snapshots_ceph is set by the default quota flag: quota_snapshots_ceph, it is now deprecated. Please use the default quota class for default quota. May 21 21:27:24.039678 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-8078e632-87bd-400b-994d-866ab5a5ca2a tempest-VolumesSnapshotListTestJSON-1467822845 None] Created reservations ['8f3be8ec-a0dc-49d9-9c4b-7581e815a1a6', 'a046f52f-75f1-48f8-8584-5a3efd24b63c', '2d8ca203-6440-41cc-9731-8f6a7abdffb8', '046b21f0-f588-4878-b1c7-b37aa9da1f39'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:27:24.331307 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-8078e632-87bd-400b-994d-866ab5a5ca2a tempest-VolumesSnapshotListTestJSON-1467822845 None] Delete snapshot completed successfully. May 21 21:27:24.336668 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-8078e632-87bd-400b-994d-866ab5a5ca2a tempest-VolumesSnapshotListTestJSON-1467822845 None] Lock "b'cinder-6e7edad8-fe7b-4dbf-9654-7f5089079964-delete_snapshot'" released by "delete_snapshot" :: held 4.368s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:27:24.467320 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-161fe71b-8588-4af9-9ee1-0ed9de42c400 tempest-VolumesSnapshotListTestJSON-1467822845 None] Lock "b'cinder-092ff9d6-e98c-4cb8-9baa-69b48504c8d0-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:27:24.469195 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-161fe71b-8588-4af9-9ee1-0ed9de42c400 tempest-VolumesSnapshotListTestJSON-1467822845 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:27:28.023605 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=55,cinder:UPDATE=24,cinder:DELETE=1,cinder:INSERT=6 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:27:28.188131 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-161fe71b-8588-4af9-9ee1-0ed9de42c400 tempest-VolumesSnapshotListTestJSON-1467822845 None] Created reservations ['99ac6b62-2d16-41a2-868c-78d324fdfc46', '42509230-d993-46ad-9db4-eadc6e417242', '2c9eec67-cb7b-4cdf-8685-e73fa13f5c4b', 'faa6e392-4549-4084-bac5-fe0ff090b523'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:27:28.612190 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-161fe71b-8588-4af9-9ee1-0ed9de42c400 tempest-VolumesSnapshotListTestJSON-1467822845 None] Delete snapshot completed successfully. May 21 21:27:28.644609 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-161fe71b-8588-4af9-9ee1-0ed9de42c400 tempest-VolumesSnapshotListTestJSON-1467822845 None] Lock "b'cinder-092ff9d6-e98c-4cb8-9baa-69b48504c8d0-delete_snapshot'" released by "delete_snapshot" :: held 4.172s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:27:28.823482 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-b65d2583-ed8b-4afe-812e-740aca8a538d tempest-VolumesSnapshotListTestJSON-1467822845 None] Lock "b'cinder-c2e91616-4439-4ad8-9809-ecf4c9f60deb-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.018s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:27:28.825309 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b65d2583-ed8b-4afe-812e-740aca8a538d tempest-VolumesSnapshotListTestJSON-1467822845 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:27:33.045382 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-b65d2583-ed8b-4afe-812e-740aca8a538d tempest-VolumesSnapshotListTestJSON-1467822845 None] Created reservations ['29a96425-6192-4f19-876c-61183deb6d06', 'c6d2bc1d-393b-471a-afe8-e39841af5b4e', '0fd3fbd1-8d36-46bf-8e1a-c2334956f1fa', '1a468c5e-4c19-494c-84da-7bf8fe9843df'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:27:33.293365 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-b65d2583-ed8b-4afe-812e-740aca8a538d tempest-VolumesSnapshotListTestJSON-1467822845 None] Delete snapshot completed successfully. May 21 21:27:33.305462 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-b65d2583-ed8b-4afe-812e-740aca8a538d tempest-VolumesSnapshotListTestJSON-1467822845 None] Lock "b'cinder-c2e91616-4439-4ad8-9809-ecf4c9f60deb-delete_snapshot'" released by "delete_snapshot" :: held 4.482s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:27:34.358837 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-0bc1c210-d50a-4dfd-8e0d-2b3280fff678 tempest-VolumesSnapshotListTestJSON-1467822845 None] Lock "b'cinder-efdb7dfe-eb97-42fb-80e9-71b12892eb9a-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:27:34.516168 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-0bc1c210-d50a-4dfd-8e0d-2b3280fff678 tempest-VolumesSnapshotListTestJSON-1467822845 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:27:34.753283 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-0bc1c210-d50a-4dfd-8e0d-2b3280fff678 tempest-VolumesSnapshotListTestJSON-1467822845 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:27:34.754024 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-0bc1c210-d50a-4dfd-8e0d-2b3280fff678 tempest-VolumesSnapshotListTestJSON-1467822845 None] Volume volume-efdb7dfe-eb97-42fb-80e9-71b12892eb9a is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:27:34.947155 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-0bc1c210-d50a-4dfd-8e0d-2b3280fff678 tempest-VolumesSnapshotListTestJSON-1467822845 None] deleting rbd volume volume-efdb7dfe-eb97-42fb-80e9-71b12892eb9a {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:27:41.427931 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-0bc1c210-d50a-4dfd-8e0d-2b3280fff678 tempest-VolumesSnapshotListTestJSON-1467822845 None] Created reservations ['5fc070a5-417e-45d2-8d4a-455d5e7b0f88', 'ab9a3402-caf7-4b9b-98ac-e8a6e26122ef', '5061f6e4-2eca-4ee1-80b5-a76198b1240e', '343f82b0-9da3-43b5-9ab0-eca8aac6b95a'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:27:41.754111 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-0bc1c210-d50a-4dfd-8e0d-2b3280fff678 tempest-VolumesSnapshotListTestJSON-1467822845 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:27:41.827695 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-0bc1c210-d50a-4dfd-8e0d-2b3280fff678 tempest-VolumesSnapshotListTestJSON-1467822845 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:27:42.030093 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-0bc1c210-d50a-4dfd-8e0d-2b3280fff678 tempest-VolumesSnapshotListTestJSON-1467822845 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:27:42.052221 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-0bc1c210-d50a-4dfd-8e0d-2b3280fff678 tempest-VolumesSnapshotListTestJSON-1467822845 None] Deleted volume successfully. May 21 21:27:42.303562 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-0bc1c210-d50a-4dfd-8e0d-2b3280fff678 tempest-VolumesSnapshotListTestJSON-1467822845 None] Lock "b'cinder-efdb7dfe-eb97-42fb-80e9-71b12892eb9a-delete_volume'" released by "delete_volume" :: held 7.945s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:27:47.434049 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:27:47.435421 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:27:47.502116 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:27:47.593198 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:27:50.225840 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6bdf44e-c7b8-4871-8a98-a2247cd83553 tempest-VolumesSnapshotNegativeTestJSON-2062866177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:27:50.291046 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d6bdf44e-c7b8-4871-8a98-a2247cd83553 tempest-VolumesSnapshotNegativeTestJSON-2062866177 None] Flow 'volume_create_manager' (d3893550-476f-42d8-bb53-765dba7c6931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:27:50.297957 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d6bdf44e-c7b8-4871-8a98-a2247cd83553 tempest-VolumesSnapshotNegativeTestJSON-2062866177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (873d31e1-3026-4607-8d20-7feb9fe8acc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:27:50.323198 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d6bdf44e-c7b8-4871-8a98-a2247cd83553 tempest-VolumesSnapshotNegativeTestJSON-2062866177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (873d31e1-3026-4607-8d20-7feb9fe8acc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1704172166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9fd6be17-d2ba-450d-91f8-f6c4beec4e3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d40d047d8fb4f72bb6abffd62e30d3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:27:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:27:50Z,use_quota=True,user_id='a25a6600c4a541af8547ff0b28652fb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:27:50.333765 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d6bdf44e-c7b8-4871-8a98-a2247cd83553 tempest-VolumesSnapshotNegativeTestJSON-2062866177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b5bbcea-dead-44b1-8258-e86f5432f078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:27:50.339298 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d6bdf44e-c7b8-4871-8a98-a2247cd83553 tempest-VolumesSnapshotNegativeTestJSON-2062866177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b5bbcea-dead-44b1-8258-e86f5432f078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:27:50.349328 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d6bdf44e-c7b8-4871-8a98-a2247cd83553 tempest-VolumesSnapshotNegativeTestJSON-2062866177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0409ccf7-7d56-4904-ad05-7a14efa7bbd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:27:50.354309 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d6bdf44e-c7b8-4871-8a98-a2247cd83553 tempest-VolumesSnapshotNegativeTestJSON-2062866177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0409ccf7-7d56-4904-ad05-7a14efa7bbd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fd6be17-d2ba-450d-91f8-f6c4beec4e3c', 'volume_name': 'volume-9fd6be17-d2ba-450d-91f8-f6c4beec4e3c', 'volume_size': 2}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:27:50.360043 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d6bdf44e-c7b8-4871-8a98-a2247cd83553 tempest-VolumesSnapshotNegativeTestJSON-2062866177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c6f0cdc-140c-49dd-98fe-630f5e6fb6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:27:50.364124 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d6bdf44e-c7b8-4871-8a98-a2247cd83553 tempest-VolumesSnapshotNegativeTestJSON-2062866177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c6f0cdc-140c-49dd-98fe-630f5e6fb6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:27:50.369987 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d6bdf44e-c7b8-4871-8a98-a2247cd83553 tempest-VolumesSnapshotNegativeTestJSON-2062866177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac80b13e-0e14-4343-8c72-888e62210727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:27:50.371188 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-d6bdf44e-c7b8-4871-8a98-a2247cd83553 tempest-VolumesSnapshotNegativeTestJSON-2062866177 None] Volume 9fd6be17-d2ba-450d-91f8-f6c4beec4e3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fd6be17-d2ba-450d-91f8-f6c4beec4e3c', 'volume_size': 2} May 21 21:27:50.371667 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d6bdf44e-c7b8-4871-8a98-a2247cd83553 tempest-VolumesSnapshotNegativeTestJSON-2062866177 None] creating volume 'volume-9fd6be17-d2ba-450d-91f8-f6c4beec4e3c' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:27:50.372461 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d6bdf44e-c7b8-4871-8a98-a2247cd83553 tempest-VolumesSnapshotNegativeTestJSON-2062866177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:27:51.249106 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d6bdf44e-c7b8-4871-8a98-a2247cd83553 tempest-VolumesSnapshotNegativeTestJSON-2062866177 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:27:51.250118 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d6bdf44e-c7b8-4871-8a98-a2247cd83553 tempest-VolumesSnapshotNegativeTestJSON-2062866177 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:27:51.254658 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d6bdf44e-c7b8-4871-8a98-a2247cd83553 tempest-VolumesSnapshotNegativeTestJSON-2062866177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac80b13e-0e14-4343-8c72-888e62210727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fd6be17-d2ba-450d-91f8-f6c4beec4e3c', 'volume_size': 2}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:27:51.259559 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d6bdf44e-c7b8-4871-8a98-a2247cd83553 tempest-VolumesSnapshotNegativeTestJSON-2062866177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc6e3b78-af7a-4b6c-93a2-05fe5d2d114b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:27:51.404524 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-d6bdf44e-c7b8-4871-8a98-a2247cd83553 tempest-VolumesSnapshotNegativeTestJSON-2062866177 None] Volume volume-9fd6be17-d2ba-450d-91f8-f6c4beec4e3c (9fd6be17-d2ba-450d-91f8-f6c4beec4e3c): created successfully May 21 21:27:51.408608 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d6bdf44e-c7b8-4871-8a98-a2247cd83553 tempest-VolumesSnapshotNegativeTestJSON-2062866177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc6e3b78-af7a-4b6c-93a2-05fe5d2d114b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:27:51.414210 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d6bdf44e-c7b8-4871-8a98-a2247cd83553 tempest-VolumesSnapshotNegativeTestJSON-2062866177 None] Flow 'volume_create_manager' (d3893550-476f-42d8-bb53-765dba7c6931) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:27:51.575855 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-d6bdf44e-c7b8-4871-8a98-a2247cd83553 tempest-VolumesSnapshotNegativeTestJSON-2062866177 None] Created volume successfully. May 21 21:27:52.919426 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b92110c8-bda7-415e-b3eb-bcba5ec3a104 tempest-VolumesSnapshotNegativeTestJSON-2062866177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:27:56.182276 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=50,cinder:INSERT=5,cinder:UPDATE=34,cinder:DELETE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:27:56.300979 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-b92110c8-bda7-415e-b3eb-bcba5ec3a104 tempest-VolumesSnapshotNegativeTestJSON-2062866177 None] Create snapshot completed successfully May 21 21:27:57.138696 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-0833a330-6b19-4c42-9678-292b102bb4f5 tempest-VolumesSnapshotNegativeTestJSON-2062866177 None] Lock "b'cinder-fff33505-5b89-41d9-9ea0-0809ae9a8149-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.019s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:27:57.140809 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-0833a330-6b19-4c42-9678-292b102bb4f5 tempest-VolumesSnapshotNegativeTestJSON-2062866177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:28:00.717661 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-0833a330-6b19-4c42-9678-292b102bb4f5 tempest-VolumesSnapshotNegativeTestJSON-2062866177 None] Created reservations ['3946ded7-a4fe-4d28-95fa-9706bedaa5a7', '254ebb93-3b38-4721-871b-7f55d82fa3f6', '07bf97f7-675a-4ef7-859e-61d626e893fd', '714bf540-94cb-40e9-a45d-422ed55a2f5f'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:28:01.033286 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-0833a330-6b19-4c42-9678-292b102bb4f5 tempest-VolumesSnapshotNegativeTestJSON-2062866177 None] Delete snapshot completed successfully. May 21 21:28:01.042193 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-0833a330-6b19-4c42-9678-292b102bb4f5 tempest-VolumesSnapshotNegativeTestJSON-2062866177 None] Lock "b'cinder-fff33505-5b89-41d9-9ea0-0809ae9a8149-delete_snapshot'" released by "delete_snapshot" :: held 3.902s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:28:01.661876 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-7c825afb-68c2-44c4-9ea1-79b5f47a83e7 tempest-VolumesSnapshotNegativeTestJSON-2062866177 None] Lock "b'cinder-9fd6be17-d2ba-450d-91f8-f6c4beec4e3c-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:28:01.830864 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=56,cinder:INSERT=10,cinder:UPDATE=23,cinder:DELETE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:28:01.835144 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-7c825afb-68c2-44c4-9ea1-79b5f47a83e7 tempest-VolumesSnapshotNegativeTestJSON-2062866177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:28:01.963440 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-7c825afb-68c2-44c4-9ea1-79b5f47a83e7 tempest-VolumesSnapshotNegativeTestJSON-2062866177 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:28:01.964534 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-7c825afb-68c2-44c4-9ea1-79b5f47a83e7 tempest-VolumesSnapshotNegativeTestJSON-2062866177 None] Volume volume-9fd6be17-d2ba-450d-91f8-f6c4beec4e3c is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:28:02.129929 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-7c825afb-68c2-44c4-9ea1-79b5f47a83e7 tempest-VolumesSnapshotNegativeTestJSON-2062866177 None] deleting rbd volume volume-9fd6be17-d2ba-450d-91f8-f6c4beec4e3c {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:28:08.952487 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-7c825afb-68c2-44c4-9ea1-79b5f47a83e7 tempest-VolumesSnapshotNegativeTestJSON-2062866177 None] Created reservations ['75385d41-31f3-4445-a2bf-b7d5805e105c', '3f4ca62c-7dc9-49d9-b884-14b92a384eb6', '2ff64bf1-e764-4cf7-9f54-dfcf75ed2ffd', '8f21de52-41cc-4609-985a-25ca4b1abaf6'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:28:09.187331 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-7c825afb-68c2-44c4-9ea1-79b5f47a83e7 tempest-VolumesSnapshotNegativeTestJSON-2062866177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:28:09.306450 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-7c825afb-68c2-44c4-9ea1-79b5f47a83e7 tempest-VolumesSnapshotNegativeTestJSON-2062866177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:28:09.453939 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-7c825afb-68c2-44c4-9ea1-79b5f47a83e7 tempest-VolumesSnapshotNegativeTestJSON-2062866177 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:28:09.475314 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-7c825afb-68c2-44c4-9ea1-79b5f47a83e7 tempest-VolumesSnapshotNegativeTestJSON-2062866177 None] Deleted volume successfully. May 21 21:28:09.592883 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-7c825afb-68c2-44c4-9ea1-79b5f47a83e7 tempest-VolumesSnapshotNegativeTestJSON-2062866177 None] Lock "b'cinder-9fd6be17-d2ba-450d-91f8-f6c4beec4e3c-delete_volume'" released by "delete_volume" :: held 7.931s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:28:22.145697 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=8,cinder:INSERT=2,cinder:UPDATE=11 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:28:32.143364 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:INSERT=3,cinder:SELECT=25,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:28:38.899567 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-50825891-8824-4f6b-b249-f1910ed94d80 tempest-GroupsTest-8017832 None] Group tempest-Group1-1403611714: creating May 21 21:28:39.048198 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-50825891-8824-4f6b-b249-f1910ed94d80 tempest-GroupsTest-8017832 None] Group tempest-Group1-1403611714: created successfully May 21 21:28:39.074025 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-50825891-8824-4f6b-b249-f1910ed94d80 tempest-GroupsTest-8017832 None] Create group completed successfully. May 21 21:28:40.490619 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-2713fd54-1174-4f10-95ad-20d0b0654600 tempest-GroupsTest-8017832 None] Group tempest-Group2-306146606: creating May 21 21:28:40.630780 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-2713fd54-1174-4f10-95ad-20d0b0654600 tempest-GroupsTest-8017832 None] Group tempest-Group2-306146606: created successfully May 21 21:28:40.649905 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-2713fd54-1174-4f10-95ad-20d0b0654600 tempest-GroupsTest-8017832 None] Create group completed successfully. May 21 21:28:43.026168 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2419e73-d786-461c-ba41-9c6b9d5a3183 tempest-GroupsTest-8017832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:28:43.059885 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-f2419e73-d786-461c-ba41-9c6b9d5a3183 tempest-GroupsTest-8017832 None] Flow 'volume_create_manager' (a182f608-6ec1-4062-8776-a29c96539cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:28:43.071508 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-f2419e73-d786-461c-ba41-9c6b9d5a3183 tempest-GroupsTest-8017832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fe30198-e6b4-4e30-83b1-9aabf4837b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:28:43.095975 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-f2419e73-d786-461c-ba41-9c6b9d5a3183 tempest-GroupsTest-8017832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fe30198-e6b4-4e30-83b1-9aabf4837b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:28:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1835761570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fdc7523a-3e9b-4fb2-b4fc-77c43654f611,host='ncdv-master-1@ceph#ceph',id=4ea8dabb-bf32-459d-a572-218a7fb651bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8d5971459d2493bb8685c6c7c0968a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:28:43Z,use_quota=True,user_id='664eefd2fc034855a368ba75e91fd70b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bf633dc-c042-4860-8ba0-73c34ff80ad6),volume_type_id=5bf633dc-c042-4860-8ba0-73c34ff80ad6)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:28:43.110163 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-f2419e73-d786-461c-ba41-9c6b9d5a3183 tempest-GroupsTest-8017832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6df55c54-7f60-43c4-84eb-dddc8d5ed056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:28:43.117538 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-f2419e73-d786-461c-ba41-9c6b9d5a3183 tempest-GroupsTest-8017832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6df55c54-7f60-43c4-84eb-dddc8d5ed056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:28:43.125150 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-f2419e73-d786-461c-ba41-9c6b9d5a3183 tempest-GroupsTest-8017832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a18bee21-b582-4d41-b26d-d3f2adabca16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:28:43.131013 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-f2419e73-d786-461c-ba41-9c6b9d5a3183 tempest-GroupsTest-8017832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a18bee21-b582-4d41-b26d-d3f2adabca16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ea8dabb-bf32-459d-a572-218a7fb651bd', 'volume_name': 'volume-4ea8dabb-bf32-459d-a572-218a7fb651bd', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:28:43.137399 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-f2419e73-d786-461c-ba41-9c6b9d5a3183 tempest-GroupsTest-8017832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (868ad647-051b-4a0d-9f94-264c45c5446c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:28:43.144178 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-f2419e73-d786-461c-ba41-9c6b9d5a3183 tempest-GroupsTest-8017832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (868ad647-051b-4a0d-9f94-264c45c5446c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:28:43.151352 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-f2419e73-d786-461c-ba41-9c6b9d5a3183 tempest-GroupsTest-8017832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d59f828-c053-4e15-a5d2-49f8d159ba91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:28:43.154196 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-f2419e73-d786-461c-ba41-9c6b9d5a3183 tempest-GroupsTest-8017832 None] Volume 4ea8dabb-bf32-459d-a572-218a7fb651bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ea8dabb-bf32-459d-a572-218a7fb651bd', 'volume_size': 1} May 21 21:28:43.154788 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-f2419e73-d786-461c-ba41-9c6b9d5a3183 tempest-GroupsTest-8017832 None] creating volume 'volume-4ea8dabb-bf32-459d-a572-218a7fb651bd' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:28:43.166484 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-f2419e73-d786-461c-ba41-9c6b9d5a3183 tempest-GroupsTest-8017832 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:28:43.793311 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-f2419e73-d786-461c-ba41-9c6b9d5a3183 tempest-GroupsTest-8017832 None] extra_specs: {} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:28:43.794273 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-f2419e73-d786-461c-ba41-9c6b9d5a3183 tempest-GroupsTest-8017832 None] extra_specs: {} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:28:43.799530 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-f2419e73-d786-461c-ba41-9c6b9d5a3183 tempest-GroupsTest-8017832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d59f828-c053-4e15-a5d2-49f8d159ba91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ea8dabb-bf32-459d-a572-218a7fb651bd', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:28:43.812031 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-f2419e73-d786-461c-ba41-9c6b9d5a3183 tempest-GroupsTest-8017832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1389c0d7-4f1b-4145-88b1-75e5b9efd921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:28:43.952130 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-f2419e73-d786-461c-ba41-9c6b9d5a3183 tempest-GroupsTest-8017832 None] Volume volume-4ea8dabb-bf32-459d-a572-218a7fb651bd (4ea8dabb-bf32-459d-a572-218a7fb651bd): created successfully May 21 21:28:43.958409 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-f2419e73-d786-461c-ba41-9c6b9d5a3183 tempest-GroupsTest-8017832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1389c0d7-4f1b-4145-88b1-75e5b9efd921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:28:43.964880 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-f2419e73-d786-461c-ba41-9c6b9d5a3183 tempest-GroupsTest-8017832 None] Flow 'volume_create_manager' (a182f608-6ec1-4062-8776-a29c96539cad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:28:44.082382 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-f2419e73-d786-461c-ba41-9c6b9d5a3183 tempest-GroupsTest-8017832 None] Created volume successfully. May 21 21:28:46.093203 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-decbd592-a1a4-4c61-9291-ca56e130e4bb tempest-GroupsTest-8017832 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:28:46.339480 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-decbd592-a1a4-4c61-9291-ca56e130e4bb tempest-GroupsTest-8017832 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:28:46.345565 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-decbd592-a1a4-4c61-9291-ca56e130e4bb tempest-GroupsTest-8017832 None] Volume volume-4ea8dabb-bf32-459d-a572-218a7fb651bd is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:28:46.436536 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-decbd592-a1a4-4c61-9291-ca56e130e4bb tempest-GroupsTest-8017832 None] deleting rbd volume volume-4ea8dabb-bf32-459d-a572-218a7fb651bd {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:28:47.439281 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:28:47.443049 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:28:47.542163 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:28:47.615870 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:28:50.013281 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-decbd592-a1a4-4c61-9291-ca56e130e4bb tempest-GroupsTest-8017832 None] Created reservations ['4cf31f51-a901-45de-8d57-ca4b43253148'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:28:50.045118 ncdv-master-1 cinder-volume[124407]: WARNING cinder.quota [None req-decbd592-a1a4-4c61-9291-ca56e130e4bb tempest-GroupsTest-8017832 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1666462429 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1666462429, it is now deprecated. Please use the default quota class for default quota. May 21 21:28:50.046220 ncdv-master-1 cinder-volume[124407]: WARNING cinder.quota [None req-decbd592-a1a4-4c61-9291-ca56e130e4bb tempest-GroupsTest-8017832 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1666462429 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1666462429, it is now deprecated. Please use the default quota class for default quota. May 21 21:28:50.130329 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-decbd592-a1a4-4c61-9291-ca56e130e4bb tempest-GroupsTest-8017832 None] Created reservations ['3725c004-e4d7-4608-8e7b-65c83ebf670b', '2693c93d-86e0-449d-a4a6-3119da8cfd68', '5ac16368-f6ea-4507-ae3b-cf13840ea06b', '3bec5a57-674e-4806-ba77-8276b41db321'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:28:50.672069 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-decbd592-a1a4-4c61-9291-ca56e130e4bb tempest-GroupsTest-8017832 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:28:50.749750 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-decbd592-a1a4-4c61-9291-ca56e130e4bb tempest-GroupsTest-8017832 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:28:50.830228 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-decbd592-a1a4-4c61-9291-ca56e130e4bb tempest-GroupsTest-8017832 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:28:50.837672 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-decbd592-a1a4-4c61-9291-ca56e130e4bb tempest-GroupsTest-8017832 None] Delete group completed successfully. May 21 21:28:51.162160 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-4ecc0c21-ce0c-4532-9987-72d6c0aa5129 tempest-GroupsTest-8017832 None] Created reservations ['4dea8831-0776-4a2f-8703-0338ca17b410'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:28:51.384044 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-4ecc0c21-ce0c-4532-9987-72d6c0aa5129 tempest-GroupsTest-8017832 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:28:51.427508 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-4ecc0c21-ce0c-4532-9987-72d6c0aa5129 tempest-GroupsTest-8017832 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:28:51.465069 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-4ecc0c21-ce0c-4532-9987-72d6c0aa5129 tempest-GroupsTest-8017832 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:28:51.476509 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-4ecc0c21-ce0c-4532-9987-72d6c0aa5129 tempest-GroupsTest-8017832 None] Delete group completed successfully. May 21 21:28:52.245475 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-800a5194-e511-478a-829d-fa1ed42f832f req-34e3cfc0-072c-4dee-b7fa-a30421d757a3 tempest-TaggedBootDevicesTest_v242-392404299 None] Terminate volume connection completed successfully. May 21 21:28:52.246080 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-800a5194-e511-478a-829d-fa1ed42f832f req-34e3cfc0-072c-4dee-b7fa-a30421d757a3 tempest-TaggedBootDevicesTest_v242-392404299 None] Deleting attachment 8d184286-606c-4f7c-8ce1-96ee652c1ecc. {{(pid=124407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4957}} May 21 21:28:52.528159 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-800a5194-e511-478a-829d-fa1ed42f832f req-ca2af449-37fa-452b-9b44-f21cac129562 tempest-TaggedBootDevicesTest_v242-392404299 None] Terminate volume connection completed successfully. May 21 21:28:52.530802 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-800a5194-e511-478a-829d-fa1ed42f832f req-ca2af449-37fa-452b-9b44-f21cac129562 tempest-TaggedBootDevicesTest_v242-392404299 None] Deleting attachment 8fb196e1-c832-4c57-8686-e51c8c62a7ea. {{(pid=124407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4957}} May 21 21:28:52.806030 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-800a5194-e511-478a-829d-fa1ed42f832f req-570e776a-9197-4df6-bcd3-6f784ae36475 tempest-TaggedBootDevicesTest_v242-392404299 None] Terminate volume connection completed successfully. May 21 21:28:52.806829 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-800a5194-e511-478a-829d-fa1ed42f832f req-570e776a-9197-4df6-bcd3-6f784ae36475 tempest-TaggedBootDevicesTest_v242-392404299 None] Deleting attachment fafbe1c1-bdee-4bdb-b0be-8dda6f5c6525. {{(pid=124407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4957}} May 21 21:28:53.583899 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-d57eb640-a596-4789-97bf-de688be6dd79 tempest-GroupsTest-8017832 None] Group tempest-GroupsTest-Group-830606319: creating May 21 21:28:53.667013 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-d57eb640-a596-4789-97bf-de688be6dd79 tempest-GroupsTest-8017832 None] Group tempest-GroupsTest-Group-830606319: created successfully May 21 21:28:53.694446 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-d57eb640-a596-4789-97bf-de688be6dd79 tempest-GroupsTest-8017832 None] Create group completed successfully. May 21 21:28:56.041253 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=52,cinder:UPDATE=19,cinder:DELETE=1,cinder:INSERT=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:28:56.140172 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fecf8e2-ee40-4a01-a01d-da5ae45835fa tempest-GroupsTest-8017832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:28:56.179599 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-4fecf8e2-ee40-4a01-a01d-da5ae45835fa tempest-GroupsTest-8017832 None] Flow 'volume_create_manager' (afcec7a8-0bdf-423d-a6dc-9d236746eded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:28:56.188377 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-4fecf8e2-ee40-4a01-a01d-da5ae45835fa tempest-GroupsTest-8017832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (323a0314-67a5-499f-9274-9946f186a7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:28:56.228979 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-4fecf8e2-ee40-4a01-a01d-da5ae45835fa tempest-GroupsTest-8017832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (323a0314-67a5-499f-9274-9946f186a7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-1322068181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=79891f1b-e884-456d-93ae-dd526ae58591,host='ncdv-master-1@ceph#ceph',id=efadc0d9-68ba-449c-b41b-2c3c58ec4f6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8d5971459d2493bb8685c6c7c0968a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:28:56Z,use_quota=True,user_id='664eefd2fc034855a368ba75e91fd70b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ef521c8-1141-42a0-8e4b-9aeb9f14118f),volume_type_id=9ef521c8-1141-42a0-8e4b-9aeb9f14118f)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:28:56.257139 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-4fecf8e2-ee40-4a01-a01d-da5ae45835fa tempest-GroupsTest-8017832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a70af5-d95f-4b85-9580-f0570b1862a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:28:56.265731 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-4fecf8e2-ee40-4a01-a01d-da5ae45835fa tempest-GroupsTest-8017832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a70af5-d95f-4b85-9580-f0570b1862a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:28:56.294563 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-4fecf8e2-ee40-4a01-a01d-da5ae45835fa tempest-GroupsTest-8017832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c7e6235-1a39-46e4-a4d5-6f5c0e3f2a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:28:56.308656 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-4fecf8e2-ee40-4a01-a01d-da5ae45835fa tempest-GroupsTest-8017832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c7e6235-1a39-46e4-a4d5-6f5c0e3f2a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efadc0d9-68ba-449c-b41b-2c3c58ec4f6e', 'volume_name': 'volume-efadc0d9-68ba-449c-b41b-2c3c58ec4f6e', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:28:56.312852 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-4fecf8e2-ee40-4a01-a01d-da5ae45835fa tempest-GroupsTest-8017832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3a8d38b-49d7-4bcf-917d-fb987d9b23db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:28:56.318954 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-4fecf8e2-ee40-4a01-a01d-da5ae45835fa tempest-GroupsTest-8017832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3a8d38b-49d7-4bcf-917d-fb987d9b23db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:28:56.324309 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-4fecf8e2-ee40-4a01-a01d-da5ae45835fa tempest-GroupsTest-8017832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53a5b18c-3dec-4cea-a4fe-0d13ac4c2670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:28:56.325706 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-4fecf8e2-ee40-4a01-a01d-da5ae45835fa tempest-GroupsTest-8017832 None] Volume efadc0d9-68ba-449c-b41b-2c3c58ec4f6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efadc0d9-68ba-449c-b41b-2c3c58ec4f6e', 'volume_size': 1} May 21 21:28:56.326297 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-4fecf8e2-ee40-4a01-a01d-da5ae45835fa tempest-GroupsTest-8017832 None] creating volume 'volume-efadc0d9-68ba-449c-b41b-2c3c58ec4f6e' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:28:56.327230 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-4fecf8e2-ee40-4a01-a01d-da5ae45835fa tempest-GroupsTest-8017832 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:28:56.782185 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-4fecf8e2-ee40-4a01-a01d-da5ae45835fa tempest-GroupsTest-8017832 None] extra_specs: {} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:28:56.782632 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-4fecf8e2-ee40-4a01-a01d-da5ae45835fa tempest-GroupsTest-8017832 None] extra_specs: {} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:28:56.786455 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-4fecf8e2-ee40-4a01-a01d-da5ae45835fa tempest-GroupsTest-8017832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53a5b18c-3dec-4cea-a4fe-0d13ac4c2670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efadc0d9-68ba-449c-b41b-2c3c58ec4f6e', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:28:56.791928 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-4fecf8e2-ee40-4a01-a01d-da5ae45835fa tempest-GroupsTest-8017832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d63f9833-8cb9-4204-900f-26d1bab911dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:28:56.859433 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-4fecf8e2-ee40-4a01-a01d-da5ae45835fa tempest-GroupsTest-8017832 None] Volume volume-efadc0d9-68ba-449c-b41b-2c3c58ec4f6e (efadc0d9-68ba-449c-b41b-2c3c58ec4f6e): created successfully May 21 21:28:56.864146 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-4fecf8e2-ee40-4a01-a01d-da5ae45835fa tempest-GroupsTest-8017832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d63f9833-8cb9-4204-900f-26d1bab911dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:28:56.869595 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-4fecf8e2-ee40-4a01-a01d-da5ae45835fa tempest-GroupsTest-8017832 None] Flow 'volume_create_manager' (afcec7a8-0bdf-423d-a6dc-9d236746eded) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:28:56.944458 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-4fecf8e2-ee40-4a01-a01d-da5ae45835fa tempest-GroupsTest-8017832 None] Created volume successfully. May 21 21:28:59.023089 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-27e27c82-ab55-4ff9-a7f1-150f567b56d0 tempest-GroupsTest-8017832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:28:59.080613 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-27e27c82-ab55-4ff9-a7f1-150f567b56d0 tempest-GroupsTest-8017832 None] Flow 'volume_create_manager' (0b403544-d187-40ba-8474-9d5a469794c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:28:59.113387 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-27e27c82-ab55-4ff9-a7f1-150f567b56d0 tempest-GroupsTest-8017832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9024048-d2af-4a53-87ea-de424e4199d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:28:59.159235 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-27e27c82-ab55-4ff9-a7f1-150f567b56d0 tempest-GroupsTest-8017832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9024048-d2af-4a53-87ea-de424e4199d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-213632484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=79891f1b-e884-456d-93ae-dd526ae58591,host='ncdv-master-1@ceph#ceph',id=28b25b7c-78e4-4a3f-a27b-6d1f611bd536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8d5971459d2493bb8685c6c7c0968a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:28:59Z,use_quota=True,user_id='664eefd2fc034855a368ba75e91fd70b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ef521c8-1141-42a0-8e4b-9aeb9f14118f),volume_type_id=9ef521c8-1141-42a0-8e4b-9aeb9f14118f)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:28:59.174702 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-27e27c82-ab55-4ff9-a7f1-150f567b56d0 tempest-GroupsTest-8017832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8328b4bc-ef12-43a4-bded-b4902f3ad629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:28:59.198107 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-27e27c82-ab55-4ff9-a7f1-150f567b56d0 tempest-GroupsTest-8017832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8328b4bc-ef12-43a4-bded-b4902f3ad629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:28:59.216643 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-27e27c82-ab55-4ff9-a7f1-150f567b56d0 tempest-GroupsTest-8017832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4c232c5-777c-4a40-bb57-f6f92b0e6d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:28:59.227438 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-27e27c82-ab55-4ff9-a7f1-150f567b56d0 tempest-GroupsTest-8017832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4c232c5-777c-4a40-bb57-f6f92b0e6d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28b25b7c-78e4-4a3f-a27b-6d1f611bd536', 'volume_name': 'volume-28b25b7c-78e4-4a3f-a27b-6d1f611bd536', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:28:59.247571 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-27e27c82-ab55-4ff9-a7f1-150f567b56d0 tempest-GroupsTest-8017832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8dfdfc2-a320-4924-a297-d4d21b9d580a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:28:59.263112 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-27e27c82-ab55-4ff9-a7f1-150f567b56d0 tempest-GroupsTest-8017832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8dfdfc2-a320-4924-a297-d4d21b9d580a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:28:59.269939 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-27e27c82-ab55-4ff9-a7f1-150f567b56d0 tempest-GroupsTest-8017832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5801a9e-bdc3-4821-8195-2b0fd5dc51c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:28:59.274343 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-27e27c82-ab55-4ff9-a7f1-150f567b56d0 tempest-GroupsTest-8017832 None] Volume 28b25b7c-78e4-4a3f-a27b-6d1f611bd536: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28b25b7c-78e4-4a3f-a27b-6d1f611bd536', 'volume_size': 1} May 21 21:28:59.274761 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-27e27c82-ab55-4ff9-a7f1-150f567b56d0 tempest-GroupsTest-8017832 None] creating volume 'volume-28b25b7c-78e4-4a3f-a27b-6d1f611bd536' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:28:59.277221 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-27e27c82-ab55-4ff9-a7f1-150f567b56d0 tempest-GroupsTest-8017832 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:28:59.868358 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-27e27c82-ab55-4ff9-a7f1-150f567b56d0 tempest-GroupsTest-8017832 None] extra_specs: {} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:28:59.872357 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-27e27c82-ab55-4ff9-a7f1-150f567b56d0 tempest-GroupsTest-8017832 None] extra_specs: {} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:28:59.875879 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-27e27c82-ab55-4ff9-a7f1-150f567b56d0 tempest-GroupsTest-8017832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5801a9e-bdc3-4821-8195-2b0fd5dc51c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28b25b7c-78e4-4a3f-a27b-6d1f611bd536', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:28:59.884635 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-27e27c82-ab55-4ff9-a7f1-150f567b56d0 tempest-GroupsTest-8017832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fa0ebeb-49ba-4cb6-a699-69ddb5135000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:28:59.983338 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-27e27c82-ab55-4ff9-a7f1-150f567b56d0 tempest-GroupsTest-8017832 None] Volume volume-28b25b7c-78e4-4a3f-a27b-6d1f611bd536 (28b25b7c-78e4-4a3f-a27b-6d1f611bd536): created successfully May 21 21:28:59.992991 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-27e27c82-ab55-4ff9-a7f1-150f567b56d0 tempest-GroupsTest-8017832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fa0ebeb-49ba-4cb6-a699-69ddb5135000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:29:00.008000 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-27e27c82-ab55-4ff9-a7f1-150f567b56d0 tempest-GroupsTest-8017832 None] Flow 'volume_create_manager' (0b403544-d187-40ba-8474-9d5a469794c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:29:00.013494 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=72,cinder:UPDATE=24,cinder:INSERT=3,cinder:DELETE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:29:00.136249 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-27e27c82-ab55-4ff9-a7f1-150f567b56d0 tempest-GroupsTest-8017832 None] Created volume successfully. May 21 21:29:01.744089 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-79f1a548-cc02-4d95-8c92-7ea3894304e5 tempest-GroupsTest-8017832 None] Update group completed successfully. May 21 21:29:03.359175 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-d8ed9fcc-a0ff-4f12-9109-5bc990304e5c tempest-GroupsTest-8017832 None] Update group completed successfully. May 21 21:29:04.071440 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-bf4cdbc0-b353-45b1-9dba-f98a639078f6 tempest-TaggedBootDevicesTest_v242-392404299 None] Lock "b'cinder-fb3476d9-3053-4b91-b4d4-9120b75e4434-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:29:04.242459 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-bf4cdbc0-b353-45b1-9dba-f98a639078f6 tempest-TaggedBootDevicesTest_v242-392404299 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:29:04.452756 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-bf4cdbc0-b353-45b1-9dba-f98a639078f6 tempest-TaggedBootDevicesTest_v242-392404299 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:29:04.453356 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-bf4cdbc0-b353-45b1-9dba-f98a639078f6 tempest-TaggedBootDevicesTest_v242-392404299 None] Volume volume-fb3476d9-3053-4b91-b4d4-9120b75e4434 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:29:04.550651 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-bf4cdbc0-b353-45b1-9dba-f98a639078f6 tempest-TaggedBootDevicesTest_v242-392404299 None] deleting rbd volume volume-fb3476d9-3053-4b91-b4d4-9120b75e4434 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:29:04.927840 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-32f14ff1-675f-4bca-bef5-f9cee2739ade tempest-GroupsTest-8017832 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:29:05.189827 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-32f14ff1-675f-4bca-bef5-f9cee2739ade tempest-GroupsTest-8017832 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:29:05.190473 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-32f14ff1-675f-4bca-bef5-f9cee2739ade tempest-GroupsTest-8017832 None] Volume volume-28b25b7c-78e4-4a3f-a27b-6d1f611bd536 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:29:05.331024 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-32f14ff1-675f-4bca-bef5-f9cee2739ade tempest-GroupsTest-8017832 None] deleting rbd volume volume-28b25b7c-78e4-4a3f-a27b-6d1f611bd536 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:29:08.931111 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-bf4cdbc0-b353-45b1-9dba-f98a639078f6 tempest-TaggedBootDevicesTest_v242-392404299 None] Created reservations ['a46665cb-bfb6-4b55-a5ad-e8f324241b65', 'bdfddd71-d6d4-4120-a10f-46524ed55b59', 'a10c7830-815a-4fdd-b7a1-9562a9cafdd4', '3f7412f6-ef5c-4793-af6a-80929cde1be3'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:29:09.180260 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-bf4cdbc0-b353-45b1-9dba-f98a639078f6 tempest-TaggedBootDevicesTest_v242-392404299 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:29:09.300516 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-bf4cdbc0-b353-45b1-9dba-f98a639078f6 tempest-TaggedBootDevicesTest_v242-392404299 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:29:09.365651 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-bf4cdbc0-b353-45b1-9dba-f98a639078f6 tempest-TaggedBootDevicesTest_v242-392404299 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:29:09.370164 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-bf4cdbc0-b353-45b1-9dba-f98a639078f6 tempest-TaggedBootDevicesTest_v242-392404299 None] Deleted volume successfully. May 21 21:29:09.542306 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-bf4cdbc0-b353-45b1-9dba-f98a639078f6 tempest-TaggedBootDevicesTest_v242-392404299 None] Lock "b'cinder-fb3476d9-3053-4b91-b4d4-9120b75e4434-delete_volume'" released by "delete_volume" :: held 5.471s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:29:09.721125 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-32f14ff1-675f-4bca-bef5-f9cee2739ade tempest-GroupsTest-8017832 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:29:09.921049 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-32f14ff1-675f-4bca-bef5-f9cee2739ade tempest-GroupsTest-8017832 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:29:09.921477 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-32f14ff1-675f-4bca-bef5-f9cee2739ade tempest-GroupsTest-8017832 None] Volume volume-efadc0d9-68ba-449c-b41b-2c3c58ec4f6e is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:29:10.024990 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-32f14ff1-675f-4bca-bef5-f9cee2739ade tempest-GroupsTest-8017832 None] deleting rbd volume volume-efadc0d9-68ba-449c-b41b-2c3c58ec4f6e {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:29:10.057251 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-026f0b00-2887-4d13-86ae-941c7e7faaae tempest-TaggedBootDevicesTest_v242-392404299 None] Lock "b'cinder-fbd362bc-b589-4852-bb3e-750dd5c3fb67-delete_volume'" acquired by "delete_volume" :: waited 0.027s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:29:10.232456 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-026f0b00-2887-4d13-86ae-941c7e7faaae tempest-TaggedBootDevicesTest_v242-392404299 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:29:10.538907 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-026f0b00-2887-4d13-86ae-941c7e7faaae tempest-TaggedBootDevicesTest_v242-392404299 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:29:10.539486 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-026f0b00-2887-4d13-86ae-941c7e7faaae tempest-TaggedBootDevicesTest_v242-392404299 None] Volume volume-fbd362bc-b589-4852-bb3e-750dd5c3fb67 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:29:10.639695 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-026f0b00-2887-4d13-86ae-941c7e7faaae tempest-TaggedBootDevicesTest_v242-392404299 None] deleting rbd volume volume-fbd362bc-b589-4852-bb3e-750dd5c3fb67 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:29:15.080124 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-32f14ff1-675f-4bca-bef5-f9cee2739ade tempest-GroupsTest-8017832 None] Created reservations ['83f65aeb-9f6e-46bf-9f4c-52558336c007'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:29:15.118819 ncdv-master-1 cinder-volume[124407]: WARNING cinder.quota [None req-32f14ff1-675f-4bca-bef5-f9cee2739ade tempest-GroupsTest-8017832 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1950132649 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1950132649, it is now deprecated. Please use the default quota class for default quota. May 21 21:29:15.119911 ncdv-master-1 cinder-volume[124407]: WARNING cinder.quota [None req-32f14ff1-675f-4bca-bef5-f9cee2739ade tempest-GroupsTest-8017832 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1950132649 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1950132649, it is now deprecated. Please use the default quota class for default quota. May 21 21:29:15.207532 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-32f14ff1-675f-4bca-bef5-f9cee2739ade tempest-GroupsTest-8017832 None] Created reservations ['2d751caa-6ab0-4f2e-9588-08208f6fd0ff', 'b3999afd-09e5-4da0-b9dc-e7951313721c', '8cbf29c8-031f-4c5a-91e9-0621e0569597', '822ad751-497c-4684-8788-d749f6f484ad'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:29:15.710266 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-026f0b00-2887-4d13-86ae-941c7e7faaae tempest-TaggedBootDevicesTest_v242-392404299 None] Created reservations ['ded3f10a-b56a-4579-a422-a7e44a469ffd', '3fb2c332-a2a5-4477-a83e-dd3d1f6f8ce3', '4645e9fd-6389-4313-8e5f-aa6e18f873f2', 'ef35f836-d4d7-4c38-977b-99123efaea5e'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:29:15.714108 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-32f14ff1-675f-4bca-bef5-f9cee2739ade tempest-GroupsTest-8017832 None] Created reservations ['88373b67-52ff-4d78-a04b-e329ff427e08', '5b39d95e-4c5c-46dc-b009-2b4db6adb2dd', '7827728c-6046-41ce-bf0f-e6f21834abcb', '23b8e8b9-46c8-4663-81b8-838454928900'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:29:15.787651 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:UPDATE=28,cinder:SELECT=64,cinder:DELETE=1,cinder:INSERT=7 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:29:15.880723 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=54,cinder:UPDATE=35,cinder:INSERT=10,cinder:DELETE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:29:16.033355 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-026f0b00-2887-4d13-86ae-941c7e7faaae tempest-TaggedBootDevicesTest_v242-392404299 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:29:16.099834 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-026f0b00-2887-4d13-86ae-941c7e7faaae tempest-TaggedBootDevicesTest_v242-392404299 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:29:16.167381 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-026f0b00-2887-4d13-86ae-941c7e7faaae tempest-TaggedBootDevicesTest_v242-392404299 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:29:16.176756 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-026f0b00-2887-4d13-86ae-941c7e7faaae tempest-TaggedBootDevicesTest_v242-392404299 None] Deleted volume successfully. May 21 21:29:16.259177 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-026f0b00-2887-4d13-86ae-941c7e7faaae tempest-TaggedBootDevicesTest_v242-392404299 None] Lock "b'cinder-fbd362bc-b589-4852-bb3e-750dd5c3fb67-delete_volume'" released by "delete_volume" :: held 6.201s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:29:16.383270 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-32f14ff1-675f-4bca-bef5-f9cee2739ade tempest-GroupsTest-8017832 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:29:16.450440 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-32f14ff1-675f-4bca-bef5-f9cee2739ade tempest-GroupsTest-8017832 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:29:16.516459 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-32f14ff1-675f-4bca-bef5-f9cee2739ade tempest-GroupsTest-8017832 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:29:16.521732 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-32f14ff1-675f-4bca-bef5-f9cee2739ade tempest-GroupsTest-8017832 None] Delete group completed successfully. May 21 21:29:16.633822 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-f8cabdcf-aa13-45f6-ad99-d3c77415bc02 tempest-TaggedBootDevicesTest_v242-392404299 None] Lock "b'cinder-59b04ab5-47d1-4fb6-b9d8-bcbfbd8bee3a-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:29:16.817417 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-f8cabdcf-aa13-45f6-ad99-d3c77415bc02 tempest-TaggedBootDevicesTest_v242-392404299 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:29:17.023143 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-f8cabdcf-aa13-45f6-ad99-d3c77415bc02 tempest-TaggedBootDevicesTest_v242-392404299 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:29:17.106436 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-f8cabdcf-aa13-45f6-ad99-d3c77415bc02 tempest-TaggedBootDevicesTest_v242-392404299 None] deleting rbd volume volume-59b04ab5-47d1-4fb6-b9d8-bcbfbd8bee3a {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:29:20.767763 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-f8cabdcf-aa13-45f6-ad99-d3c77415bc02 tempest-TaggedBootDevicesTest_v242-392404299 None] volume is a clone so cleaning references {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1352}} May 21 21:29:20.892978 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-f8cabdcf-aa13-45f6-ad99-d3c77415bc02 tempest-TaggedBootDevicesTest_v242-392404299 None] deleting parent snapshot volume-59b04ab5-47d1-4fb6-b9d8-bcbfbd8bee3a.clone_snap {{(pid=124407) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1243}} May 21 21:29:23.506228 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-f8cabdcf-aa13-45f6-ad99-d3c77415bc02 tempest-TaggedBootDevicesTest_v242-392404299 None] Created reservations ['34a78c01-1a4e-49e9-9b0f-c7a670dc77f4', 'd0b708ed-50f7-47aa-a3f0-f6e2eaa8c43b', '5464f9f3-82c2-41f1-9d9a-35b4c51e3057', '58abc991-beac-4aea-a027-d99b2d5d9083'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:29:23.869700 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-f8cabdcf-aa13-45f6-ad99-d3c77415bc02 tempest-TaggedBootDevicesTest_v242-392404299 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:29:23.916733 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-f8cabdcf-aa13-45f6-ad99-d3c77415bc02 tempest-TaggedBootDevicesTest_v242-392404299 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:29:23.986614 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-f8cabdcf-aa13-45f6-ad99-d3c77415bc02 tempest-TaggedBootDevicesTest_v242-392404299 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:29:23.991827 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-f8cabdcf-aa13-45f6-ad99-d3c77415bc02 tempest-TaggedBootDevicesTest_v242-392404299 None] Deleted volume successfully. May 21 21:29:24.093775 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-f8cabdcf-aa13-45f6-ad99-d3c77415bc02 tempest-TaggedBootDevicesTest_v242-392404299 None] Lock "b'cinder-59b04ab5-47d1-4fb6-b9d8-bcbfbd8bee3a-delete_volume'" released by "delete_volume" :: held 7.459s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:29:38.074374 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-caba36ff-e483-4025-b476-c0adb6331478 tempest-SnapshotsActionsTest-946009927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:29:38.126462 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-caba36ff-e483-4025-b476-c0adb6331478 tempest-SnapshotsActionsTest-946009927 None] Flow 'volume_create_manager' (1c314fe5-2a69-4836-85e2-ab0b2d4c7e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:29:38.133599 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-caba36ff-e483-4025-b476-c0adb6331478 tempest-SnapshotsActionsTest-946009927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21b7458b-043a-445b-9860-edf6ba05f63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:29:38.178249 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-caba36ff-e483-4025-b476-c0adb6331478 tempest-SnapshotsActionsTest-946009927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21b7458b-043a-445b-9860-edf6ba05f63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:29:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-584645627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b85ef5bc-fee1-4f20-ac0c-e72f5e65617a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d13cd998a614433b56b2085ef9bcd24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:29:38Z,use_quota=True,user_id='3b3e72c306a54b8a9ab5de8fa47e7248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:29:38.185993 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-caba36ff-e483-4025-b476-c0adb6331478 tempest-SnapshotsActionsTest-946009927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d23d9613-de29-4b3f-b6d4-dcfd7e9624e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:29:38.191082 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-caba36ff-e483-4025-b476-c0adb6331478 tempest-SnapshotsActionsTest-946009927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d23d9613-de29-4b3f-b6d4-dcfd7e9624e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:29:38.201830 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-caba36ff-e483-4025-b476-c0adb6331478 tempest-SnapshotsActionsTest-946009927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (869e1880-9320-4945-ba63-0231a1c0219f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:29:38.208559 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-caba36ff-e483-4025-b476-c0adb6331478 tempest-SnapshotsActionsTest-946009927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (869e1880-9320-4945-ba63-0231a1c0219f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b85ef5bc-fee1-4f20-ac0c-e72f5e65617a', 'volume_name': 'volume-b85ef5bc-fee1-4f20-ac0c-e72f5e65617a', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:29:38.213709 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-caba36ff-e483-4025-b476-c0adb6331478 tempest-SnapshotsActionsTest-946009927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86769f3a-7f7b-418d-bbbc-be70132c63cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:29:38.218443 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-caba36ff-e483-4025-b476-c0adb6331478 tempest-SnapshotsActionsTest-946009927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86769f3a-7f7b-418d-bbbc-be70132c63cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:29:38.230107 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-caba36ff-e483-4025-b476-c0adb6331478 tempest-SnapshotsActionsTest-946009927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b4fc13e-e51c-4e28-9559-53d336f1ba23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:29:38.232116 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-caba36ff-e483-4025-b476-c0adb6331478 tempest-SnapshotsActionsTest-946009927 None] Volume b85ef5bc-fee1-4f20-ac0c-e72f5e65617a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b85ef5bc-fee1-4f20-ac0c-e72f5e65617a', 'volume_size': 1} May 21 21:29:38.233404 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-caba36ff-e483-4025-b476-c0adb6331478 tempest-SnapshotsActionsTest-946009927 None] creating volume 'volume-b85ef5bc-fee1-4f20-ac0c-e72f5e65617a' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:29:38.236449 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-caba36ff-e483-4025-b476-c0adb6331478 tempest-SnapshotsActionsTest-946009927 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:29:38.711304 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-caba36ff-e483-4025-b476-c0adb6331478 tempest-SnapshotsActionsTest-946009927 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:29:38.711925 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-caba36ff-e483-4025-b476-c0adb6331478 tempest-SnapshotsActionsTest-946009927 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:29:38.717604 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-caba36ff-e483-4025-b476-c0adb6331478 tempest-SnapshotsActionsTest-946009927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b4fc13e-e51c-4e28-9559-53d336f1ba23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b85ef5bc-fee1-4f20-ac0c-e72f5e65617a', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:29:38.730972 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-caba36ff-e483-4025-b476-c0adb6331478 tempest-SnapshotsActionsTest-946009927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8d74493-c1fa-4c0a-9d2a-cc7578fa4c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:29:38.826809 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-caba36ff-e483-4025-b476-c0adb6331478 tempest-SnapshotsActionsTest-946009927 None] Volume volume-b85ef5bc-fee1-4f20-ac0c-e72f5e65617a (b85ef5bc-fee1-4f20-ac0c-e72f5e65617a): created successfully May 21 21:29:38.833954 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-caba36ff-e483-4025-b476-c0adb6331478 tempest-SnapshotsActionsTest-946009927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8d74493-c1fa-4c0a-9d2a-cc7578fa4c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:29:38.851707 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-caba36ff-e483-4025-b476-c0adb6331478 tempest-SnapshotsActionsTest-946009927 None] Flow 'volume_create_manager' (1c314fe5-2a69-4836-85e2-ab0b2d4c7e0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:29:38.937308 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-caba36ff-e483-4025-b476-c0adb6331478 tempest-SnapshotsActionsTest-946009927 None] Created volume successfully. May 21 21:29:40.816017 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d325fce9-62ef-4921-99fc-d78e799a724c tempest-SnapshotsActionsTest-946009927 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:29:43.302880 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-d325fce9-62ef-4921-99fc-d78e799a724c tempest-SnapshotsActionsTest-946009927 None] Create snapshot completed successfully May 21 21:29:45.465290 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-5591df7d-a0d3-47a1-a8c6-8f1bc54d1d46 tempest-SnapshotsActionsTest-946009927 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:29:47.425947 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-5591df7d-a0d3-47a1-a8c6-8f1bc54d1d46 tempest-SnapshotsActionsTest-946009927 None] Create snapshot completed successfully May 21 21:29:47.440618 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:29:47.441704 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:29:47.522728 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:29:47.561225 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:29:48.739709 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-7a29e512-05c5-46bc-9b90-626d5b65511d tempest-SnapshotsActionsTest-1746481083 None] Lock "b'cinder-d8bf9f5d-79bf-4923-b256-c908c03b7d1a-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:29:48.742235 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-7a29e512-05c5-46bc-9b90-626d5b65511d tempest-SnapshotsActionsTest-1746481083 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:29:50.902528 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-7a29e512-05c5-46bc-9b90-626d5b65511d tempest-SnapshotsActionsTest-1746481083 None] Created reservations ['85c17968-2880-402d-8ddd-d34c036ed8aa', '8e6bb0f3-bf16-4884-b848-06e0b4c50ac0', '5596ac90-cb18-4161-808d-b45e91ff66ef', 'd63a525a-4b49-417f-a758-58a983983255'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:29:51.078112 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-7a29e512-05c5-46bc-9b90-626d5b65511d tempest-SnapshotsActionsTest-1746481083 None] Delete snapshot completed successfully. May 21 21:29:51.086935 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-7a29e512-05c5-46bc-9b90-626d5b65511d tempest-SnapshotsActionsTest-1746481083 None] Lock "b'cinder-d8bf9f5d-79bf-4923-b256-c908c03b7d1a-delete_snapshot'" released by "delete_snapshot" :: held 2.345s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:29:52.858017 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a89a880a-fd58-4ace-ab9b-d0fb361a87b8 tempest-SnapshotsActionsTest-946009927 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:29:53.354993 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=36,cinder:UPDATE=24,cinder:INSERT=6,cinder:DELETE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:29:53.356596 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:UPDATE=28,cinder:SELECT=62,cinder:DELETE=2,cinder:INSERT=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:29:54.850845 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-a89a880a-fd58-4ace-ab9b-d0fb361a87b8 tempest-SnapshotsActionsTest-946009927 None] Create snapshot completed successfully May 21 21:29:55.999640 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-19bf4cc9-3fff-430a-b4d4-23f9c7908be1 tempest-SnapshotsActionsTest-1746481083 None] Lock "b'cinder-10d79ad3-6717-46fe-af40-9f15e1533886-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.015s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:29:56.002315 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-19bf4cc9-3fff-430a-b4d4-23f9c7908be1 tempest-SnapshotsActionsTest-1746481083 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:29:58.043960 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-19bf4cc9-3fff-430a-b4d4-23f9c7908be1 tempest-SnapshotsActionsTest-1746481083 None] Created reservations ['7d3092b3-f584-4272-82b1-13e16bd16a0d', '8fbaa5f2-21cb-4639-b679-909b97d8af14', '68d3527e-3fb2-43ae-b8e1-d1b6d8747fb3', '7ad580b4-cd20-4c7b-830f-d8ef15b07e2c'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:29:58.302432 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-19bf4cc9-3fff-430a-b4d4-23f9c7908be1 tempest-SnapshotsActionsTest-1746481083 None] Delete snapshot completed successfully. May 21 21:29:58.307990 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-19bf4cc9-3fff-430a-b4d4-23f9c7908be1 tempest-SnapshotsActionsTest-1746481083 None] Lock "b'cinder-10d79ad3-6717-46fe-af40-9f15e1533886-delete_snapshot'" released by "delete_snapshot" :: held 2.308s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:30:00.135642 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a6362937-1921-4877-847f-1634a6550e65 tempest-SnapshotsActionsTest-946009927 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:30:02.161876 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-a6362937-1921-4877-847f-1634a6550e65 tempest-SnapshotsActionsTest-946009927 None] Create snapshot completed successfully May 21 21:30:03.636044 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-b029d45e-d642-41c6-bd62-e14b4bfc615a tempest-SnapshotsActionsTest-1746481083 None] Lock "b'cinder-36413354-f703-4d4c-9ce9-f67a57349060-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.024s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:30:03.638205 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b029d45e-d642-41c6-bd62-e14b4bfc615a tempest-SnapshotsActionsTest-1746481083 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:30:06.039584 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-b029d45e-d642-41c6-bd62-e14b4bfc615a tempest-SnapshotsActionsTest-1746481083 None] Created reservations ['4f0c4e40-c3c3-445a-8b1e-6308d37371ef', '8d81b2d9-67c7-4c0e-af72-dca8b173596b', '1c535341-56c9-41f7-adbe-875aa450cada', '48a70be2-2cb2-4b3c-8fd5-fd96b6d5bafb'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:30:06.319396 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-b029d45e-d642-41c6-bd62-e14b4bfc615a tempest-SnapshotsActionsTest-1746481083 None] Delete snapshot completed successfully. May 21 21:30:06.329010 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-b029d45e-d642-41c6-bd62-e14b4bfc615a tempest-SnapshotsActionsTest-1746481083 None] Lock "b'cinder-36413354-f703-4d4c-9ce9-f67a57349060-delete_snapshot'" released by "delete_snapshot" :: held 2.693s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:30:08.047465 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b18c06be-2aae-4c71-b2b0-8af08533288b tempest-SnapshotsActionsTest-946009927 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:30:10.565837 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-b18c06be-2aae-4c71-b2b0-8af08533288b tempest-SnapshotsActionsTest-946009927 None] Create snapshot completed successfully May 21 21:30:11.323121 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-4fd481e8-0e12-4d4c-8b0d-7e5856e14b94 tempest-SnapshotsActionsTest-1746481083 None] Lock "b'cinder-dfddbe1d-d6ed-4b48-87b3-49d6c3870641-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.025s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:30:11.328349 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-4fd481e8-0e12-4d4c-8b0d-7e5856e14b94 tempest-SnapshotsActionsTest-1746481083 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:30:14.410577 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-4fd481e8-0e12-4d4c-8b0d-7e5856e14b94 tempest-SnapshotsActionsTest-1746481083 None] Created reservations ['c4eeb248-0f40-4348-9cc7-fdcfdf5cb39c', 'acb1edea-10d6-43d4-93c2-34301501829e', 'ca43c063-e73c-4aa3-bdbf-d1445d1207d0', '19aef097-2850-4bd4-8911-36bec575cc27'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:30:14.646031 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-4fd481e8-0e12-4d4c-8b0d-7e5856e14b94 tempest-SnapshotsActionsTest-1746481083 None] Delete snapshot completed successfully. May 21 21:30:14.652540 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-4fd481e8-0e12-4d4c-8b0d-7e5856e14b94 tempest-SnapshotsActionsTest-1746481083 None] Lock "b'cinder-dfddbe1d-d6ed-4b48-87b3-49d6c3870641-delete_snapshot'" released by "delete_snapshot" :: held 3.330s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:30:14.969849 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [req-6ce293ff-dc6d-4836-bfbe-6ec1b1205ade req-c227a1da-2602-488d-9bc3-6bf7660070b9 tempest-VolumesGetTestJSON-1744833942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:30:15.018739 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-6ce293ff-dc6d-4836-bfbe-6ec1b1205ade req-c227a1da-2602-488d-9bc3-6bf7660070b9 tempest-VolumesGetTestJSON-1744833942 None] Flow 'volume_create_manager' (6d4285c3-94ea-4dba-a7e9-79237b855930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:30:15.050808 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-6ce293ff-dc6d-4836-bfbe-6ec1b1205ade req-c227a1da-2602-488d-9bc3-6bf7660070b9 tempest-VolumesGetTestJSON-1744833942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (091add34-2ff6-41cf-8247-8eaded6fe856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:30:15.088148 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-6ce293ff-dc6d-4836-bfbe-6ec1b1205ade req-c227a1da-2602-488d-9bc3-6bf7660070b9 tempest-VolumesGetTestJSON-1744833942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (091add34-2ff6-41cf-8247-8eaded6fe856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:30:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-336976503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=809a63e9-9319-4026-8c3e-f3e0dd7d67d7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6e882e47915f4e728e8da5a38062dd42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:30:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:30:15Z,use_quota=True,user_id='107fa7bc4f11461cb4000411af2e3968',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:30:15.106219 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-6ce293ff-dc6d-4836-bfbe-6ec1b1205ade req-c227a1da-2602-488d-9bc3-6bf7660070b9 tempest-VolumesGetTestJSON-1744833942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (103a9330-96a0-4399-9240-0bf53bb6e9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:30:15.134229 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-6ce293ff-dc6d-4836-bfbe-6ec1b1205ade req-c227a1da-2602-488d-9bc3-6bf7660070b9 tempest-VolumesGetTestJSON-1744833942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (103a9330-96a0-4399-9240-0bf53bb6e9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:30:15.142685 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-6ce293ff-dc6d-4836-bfbe-6ec1b1205ade req-c227a1da-2602-488d-9bc3-6bf7660070b9 tempest-VolumesGetTestJSON-1744833942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebd7a586-4d48-442a-a3eb-09b598a66802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:30:15.156629 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-6ce293ff-dc6d-4836-bfbe-6ec1b1205ade req-c227a1da-2602-488d-9bc3-6bf7660070b9 tempest-VolumesGetTestJSON-1744833942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebd7a586-4d48-442a-a3eb-09b598a66802) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '809a63e9-9319-4026-8c3e-f3e0dd7d67d7', 'volume_name': 'volume-809a63e9-9319-4026-8c3e-f3e0dd7d67d7', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:30:15.162861 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-6ce293ff-dc6d-4836-bfbe-6ec1b1205ade req-c227a1da-2602-488d-9bc3-6bf7660070b9 tempest-VolumesGetTestJSON-1744833942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73d824dd-c7a3-46bc-a4cd-7f1ea965b5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:30:15.166750 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-6ce293ff-dc6d-4836-bfbe-6ec1b1205ade req-c227a1da-2602-488d-9bc3-6bf7660070b9 tempest-VolumesGetTestJSON-1744833942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73d824dd-c7a3-46bc-a4cd-7f1ea965b5c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:30:15.192456 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-6ce293ff-dc6d-4836-bfbe-6ec1b1205ade req-c227a1da-2602-488d-9bc3-6bf7660070b9 tempest-VolumesGetTestJSON-1744833942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34dae2b7-3104-45ff-ae3e-14463aff686e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:30:15.193564 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [req-6ce293ff-dc6d-4836-bfbe-6ec1b1205ade req-c227a1da-2602-488d-9bc3-6bf7660070b9 tempest-VolumesGetTestJSON-1744833942 None] Volume 809a63e9-9319-4026-8c3e-f3e0dd7d67d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-809a63e9-9319-4026-8c3e-f3e0dd7d67d7', 'volume_size': 1} May 21 21:30:15.193953 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-6ce293ff-dc6d-4836-bfbe-6ec1b1205ade req-c227a1da-2602-488d-9bc3-6bf7660070b9 tempest-VolumesGetTestJSON-1744833942 None] creating volume 'volume-809a63e9-9319-4026-8c3e-f3e0dd7d67d7' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:30:15.195349 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-6ce293ff-dc6d-4836-bfbe-6ec1b1205ade req-c227a1da-2602-488d-9bc3-6bf7660070b9 tempest-VolumesGetTestJSON-1744833942 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:30:15.786319 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-6ce293ff-dc6d-4836-bfbe-6ec1b1205ade req-c227a1da-2602-488d-9bc3-6bf7660070b9 tempest-VolumesGetTestJSON-1744833942 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:30:15.786936 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-6ce293ff-dc6d-4836-bfbe-6ec1b1205ade req-c227a1da-2602-488d-9bc3-6bf7660070b9 tempest-VolumesGetTestJSON-1744833942 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:30:15.806814 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-6ce293ff-dc6d-4836-bfbe-6ec1b1205ade req-c227a1da-2602-488d-9bc3-6bf7660070b9 tempest-VolumesGetTestJSON-1744833942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34dae2b7-3104-45ff-ae3e-14463aff686e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-809a63e9-9319-4026-8c3e-f3e0dd7d67d7', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:30:15.818034 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-6ce293ff-dc6d-4836-bfbe-6ec1b1205ade req-c227a1da-2602-488d-9bc3-6bf7660070b9 tempest-VolumesGetTestJSON-1744833942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46bbbce3-1d38-4e86-937c-7678b01c61ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:30:15.956768 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [req-6ce293ff-dc6d-4836-bfbe-6ec1b1205ade req-c227a1da-2602-488d-9bc3-6bf7660070b9 tempest-VolumesGetTestJSON-1744833942 None] Volume volume-809a63e9-9319-4026-8c3e-f3e0dd7d67d7 (809a63e9-9319-4026-8c3e-f3e0dd7d67d7): created successfully May 21 21:30:15.962307 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-6ce293ff-dc6d-4836-bfbe-6ec1b1205ade req-c227a1da-2602-488d-9bc3-6bf7660070b9 tempest-VolumesGetTestJSON-1744833942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46bbbce3-1d38-4e86-937c-7678b01c61ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:30:15.973212 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-6ce293ff-dc6d-4836-bfbe-6ec1b1205ade req-c227a1da-2602-488d-9bc3-6bf7660070b9 tempest-VolumesGetTestJSON-1744833942 None] Flow 'volume_create_manager' (6d4285c3-94ea-4dba-a7e9-79237b855930) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:30:16.119790 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-6ce293ff-dc6d-4836-bfbe-6ec1b1205ade req-c227a1da-2602-488d-9bc3-6bf7660070b9 tempest-VolumesGetTestJSON-1744833942 None] Created volume successfully. May 21 21:30:16.794920 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-c6ada75d-3eed-45a1-a17d-0f9b9bf0a9ce tempest-SnapshotsActionsTest-946009927 None] Lock "b'cinder-f7d986b1-4413-4326-a11f-478f3596e1a0-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:30:16.797058 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c6ada75d-3eed-45a1-a17d-0f9b9bf0a9ce tempest-SnapshotsActionsTest-946009927 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:30:17.943910 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [req-c4a07975-8e3b-471e-9fde-25a9e8c94886 req-28b888b4-6749-47bb-8dcd-15ef73669651 tempest-VolumesGetTestJSON-1744833942 None] Lock "b'cinder-809a63e9-9319-4026-8c3e-f3e0dd7d67d7-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:30:18.054387 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-c4a07975-8e3b-471e-9fde-25a9e8c94886 req-28b888b4-6749-47bb-8dcd-15ef73669651 tempest-VolumesGetTestJSON-1744833942 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:30:18.297335 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-c4a07975-8e3b-471e-9fde-25a9e8c94886 req-28b888b4-6749-47bb-8dcd-15ef73669651 tempest-VolumesGetTestJSON-1744833942 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:30:18.298552 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-c4a07975-8e3b-471e-9fde-25a9e8c94886 req-28b888b4-6749-47bb-8dcd-15ef73669651 tempest-VolumesGetTestJSON-1744833942 None] Volume volume-809a63e9-9319-4026-8c3e-f3e0dd7d67d7 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:30:18.589789 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-c4a07975-8e3b-471e-9fde-25a9e8c94886 req-28b888b4-6749-47bb-8dcd-15ef73669651 tempest-VolumesGetTestJSON-1744833942 None] deleting rbd volume volume-809a63e9-9319-4026-8c3e-f3e0dd7d67d7 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:30:19.668196 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-c6ada75d-3eed-45a1-a17d-0f9b9bf0a9ce tempest-SnapshotsActionsTest-946009927 None] Created reservations ['40edf94f-fe45-49f5-8814-1b22caa52c62', 'db3602eb-d603-4b03-8d90-769b50b0b552', 'c80bc035-4828-45a4-aa01-cb054c8c113a', 'ba043fe5-ada1-4413-8a9e-ecf57e1458ef'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:30:19.848104 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=58,cinder:UPDATE=33,cinder:DELETE=2,cinder:INSERT=7 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:30:19.991428 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-c6ada75d-3eed-45a1-a17d-0f9b9bf0a9ce tempest-SnapshotsActionsTest-946009927 None] Delete snapshot completed successfully. May 21 21:30:19.997258 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-c6ada75d-3eed-45a1-a17d-0f9b9bf0a9ce tempest-SnapshotsActionsTest-946009927 None] Lock "b'cinder-f7d986b1-4413-4326-a11f-478f3596e1a0-delete_snapshot'" released by "delete_snapshot" :: held 3.202s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:30:20.338479 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-6477adee-c48e-4f34-ab8e-fac060f9fd3a tempest-SnapshotsActionsTest-946009927 None] Lock "b'cinder-b85ef5bc-fee1-4f20-ac0c-e72f5e65617a-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:30:20.467463 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=66,cinder:INSERT=9,cinder:UPDATE=23,cinder:DELETE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:30:20.474790 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6477adee-c48e-4f34-ab8e-fac060f9fd3a tempest-SnapshotsActionsTest-946009927 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:30:20.739757 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6477adee-c48e-4f34-ab8e-fac060f9fd3a tempest-SnapshotsActionsTest-946009927 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:30:20.743282 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6477adee-c48e-4f34-ab8e-fac060f9fd3a tempest-SnapshotsActionsTest-946009927 None] Volume volume-b85ef5bc-fee1-4f20-ac0c-e72f5e65617a is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:30:20.882772 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6477adee-c48e-4f34-ab8e-fac060f9fd3a tempest-SnapshotsActionsTest-946009927 None] deleting rbd volume volume-b85ef5bc-fee1-4f20-ac0c-e72f5e65617a {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:30:23.543502 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [req-c4a07975-8e3b-471e-9fde-25a9e8c94886 req-28b888b4-6749-47bb-8dcd-15ef73669651 tempest-VolumesGetTestJSON-1744833942 None] Created reservations ['66e2cbcc-d405-4904-a940-54f9f0f6957d', 'efe90fba-ac6f-4e2c-874c-8b2829294acf', 'b4192d74-3a9e-42f9-b0aa-a417c133c273', 'c3b63b2c-f80b-477c-9cd6-c9fe92502a82'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:30:23.737623 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-c4a07975-8e3b-471e-9fde-25a9e8c94886 req-28b888b4-6749-47bb-8dcd-15ef73669651 tempest-VolumesGetTestJSON-1744833942 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:30:23.786908 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-c4a07975-8e3b-471e-9fde-25a9e8c94886 req-28b888b4-6749-47bb-8dcd-15ef73669651 tempest-VolumesGetTestJSON-1744833942 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:30:23.848585 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [req-c4a07975-8e3b-471e-9fde-25a9e8c94886 req-28b888b4-6749-47bb-8dcd-15ef73669651 tempest-VolumesGetTestJSON-1744833942 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:30:23.853842 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-c4a07975-8e3b-471e-9fde-25a9e8c94886 req-28b888b4-6749-47bb-8dcd-15ef73669651 tempest-VolumesGetTestJSON-1744833942 None] Deleted volume successfully. May 21 21:30:23.937314 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [req-c4a07975-8e3b-471e-9fde-25a9e8c94886 req-28b888b4-6749-47bb-8dcd-15ef73669651 tempest-VolumesGetTestJSON-1744833942 None] Lock "b'cinder-809a63e9-9319-4026-8c3e-f3e0dd7d67d7-delete_volume'" released by "delete_volume" :: held 5.989s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:30:24.928304 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-6477adee-c48e-4f34-ab8e-fac060f9fd3a tempest-SnapshotsActionsTest-946009927 None] Created reservations ['9a6f70c9-66e5-4ae6-bf6b-9b3be48743e4', '8b561e64-2583-4701-a79b-acac17bee3a2', '9e367b82-8413-4f84-a255-1f81a6644031', '2ff93fbd-e8c5-40e3-a8a7-7825d99f2359'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:30:25.183807 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6477adee-c48e-4f34-ab8e-fac060f9fd3a tempest-SnapshotsActionsTest-946009927 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:30:25.225809 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6477adee-c48e-4f34-ab8e-fac060f9fd3a tempest-SnapshotsActionsTest-946009927 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:30:25.263553 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-6477adee-c48e-4f34-ab8e-fac060f9fd3a tempest-SnapshotsActionsTest-946009927 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:30:25.268393 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-6477adee-c48e-4f34-ab8e-fac060f9fd3a tempest-SnapshotsActionsTest-946009927 None] Deleted volume successfully. May 21 21:30:25.340732 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-6477adee-c48e-4f34-ab8e-fac060f9fd3a tempest-SnapshotsActionsTest-946009927 None] Lock "b'cinder-b85ef5bc-fee1-4f20-ac0c-e72f5e65617a-delete_volume'" released by "delete_volume" :: held 5.002s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:30:47.452097 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:30:47.454634 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:30:47.532878 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:30:47.600400 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:30:50.033686 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc337ac4-81de-48d8-b0c7-9f9e4991ab6c tempest-VolumeRetypeWithoutMigrationTest-1615027832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:30:50.064648 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-dc337ac4-81de-48d8-b0c7-9f9e4991ab6c tempest-VolumeRetypeWithoutMigrationTest-1615027832 None] Flow 'volume_create_manager' (6946dea7-676b-4a52-be89-f6e27c30f3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:30:50.085787 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-dc337ac4-81de-48d8-b0c7-9f9e4991ab6c tempest-VolumeRetypeWithoutMigrationTest-1615027832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80d5f4fa-722d-480b-a81c-4bcf5c144510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:30:50.122476 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-dc337ac4-81de-48d8-b0c7-9f9e4991ab6c tempest-VolumeRetypeWithoutMigrationTest-1615027832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80d5f4fa-722d-480b-a81c-4bcf5c144510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1120021232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=49ce0c7b-0687-4666-8feb-06673ecc3a1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce6af33bf7b5452a8886c032d52b8c88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:30:50Z,use_quota=True,user_id='7c089381963744efbd601fd578857565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42726340-e3dc-4f55-b2ef-c03a0058713e),volume_type_id=42726340-e3dc-4f55-b2ef-c03a0058713e)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:30:50.154409 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-dc337ac4-81de-48d8-b0c7-9f9e4991ab6c tempest-VolumeRetypeWithoutMigrationTest-1615027832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af2e235f-f7f2-4fc3-bda6-3b2d9c302d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:30:50.158860 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-dc337ac4-81de-48d8-b0c7-9f9e4991ab6c tempest-VolumeRetypeWithoutMigrationTest-1615027832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af2e235f-f7f2-4fc3-bda6-3b2d9c302d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:30:50.189976 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-dc337ac4-81de-48d8-b0c7-9f9e4991ab6c tempest-VolumeRetypeWithoutMigrationTest-1615027832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7b171da-dfba-44a5-a550-456a19cfcfca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:30:50.204511 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-dc337ac4-81de-48d8-b0c7-9f9e4991ab6c tempest-VolumeRetypeWithoutMigrationTest-1615027832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7b171da-dfba-44a5-a550-456a19cfcfca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49ce0c7b-0687-4666-8feb-06673ecc3a1f', 'volume_name': 'volume-49ce0c7b-0687-4666-8feb-06673ecc3a1f', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:30:50.210641 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-dc337ac4-81de-48d8-b0c7-9f9e4991ab6c tempest-VolumeRetypeWithoutMigrationTest-1615027832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6865d8c1-e20c-4978-92fd-6add98728927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:30:50.223731 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-dc337ac4-81de-48d8-b0c7-9f9e4991ab6c tempest-VolumeRetypeWithoutMigrationTest-1615027832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6865d8c1-e20c-4978-92fd-6add98728927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:30:50.237724 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-dc337ac4-81de-48d8-b0c7-9f9e4991ab6c tempest-VolumeRetypeWithoutMigrationTest-1615027832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9025e820-2266-4886-9a9b-5eb09337d5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:30:50.243716 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-dc337ac4-81de-48d8-b0c7-9f9e4991ab6c tempest-VolumeRetypeWithoutMigrationTest-1615027832 None] Volume 49ce0c7b-0687-4666-8feb-06673ecc3a1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49ce0c7b-0687-4666-8feb-06673ecc3a1f', 'volume_size': 1} May 21 21:30:50.244129 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-dc337ac4-81de-48d8-b0c7-9f9e4991ab6c tempest-VolumeRetypeWithoutMigrationTest-1615027832 None] creating volume 'volume-49ce0c7b-0687-4666-8feb-06673ecc3a1f' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:30:50.245159 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-dc337ac4-81de-48d8-b0c7-9f9e4991ab6c tempest-VolumeRetypeWithoutMigrationTest-1615027832 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:30:50.806333 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-dc337ac4-81de-48d8-b0c7-9f9e4991ab6c tempest-VolumeRetypeWithoutMigrationTest-1615027832 None] extra_specs: {} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:30:50.806776 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-dc337ac4-81de-48d8-b0c7-9f9e4991ab6c tempest-VolumeRetypeWithoutMigrationTest-1615027832 None] extra_specs: {} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:30:50.810469 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-dc337ac4-81de-48d8-b0c7-9f9e4991ab6c tempest-VolumeRetypeWithoutMigrationTest-1615027832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9025e820-2266-4886-9a9b-5eb09337d5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49ce0c7b-0687-4666-8feb-06673ecc3a1f', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:30:50.819576 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-dc337ac4-81de-48d8-b0c7-9f9e4991ab6c tempest-VolumeRetypeWithoutMigrationTest-1615027832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87449bef-494d-4efe-a593-727373a6382a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:30:50.960498 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-dc337ac4-81de-48d8-b0c7-9f9e4991ab6c tempest-VolumeRetypeWithoutMigrationTest-1615027832 None] Volume volume-49ce0c7b-0687-4666-8feb-06673ecc3a1f (49ce0c7b-0687-4666-8feb-06673ecc3a1f): created successfully May 21 21:30:50.964007 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-dc337ac4-81de-48d8-b0c7-9f9e4991ab6c tempest-VolumeRetypeWithoutMigrationTest-1615027832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87449bef-494d-4efe-a593-727373a6382a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:30:50.990200 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-dc337ac4-81de-48d8-b0c7-9f9e4991ab6c tempest-VolumeRetypeWithoutMigrationTest-1615027832 None] Flow 'volume_create_manager' (6946dea7-676b-4a52-be89-f6e27c30f3c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:30:51.109517 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-dc337ac4-81de-48d8-b0c7-9f9e4991ab6c tempest-VolumeRetypeWithoutMigrationTest-1615027832 None] Created volume successfully. May 21 21:30:52.940360 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=55,cinder:UPDATE=34,cinder:INSERT=8,cinder:DELETE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:30:53.043883 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a905745d-d38d-462c-84a3-cfc20515a2a6 tempest-VolumeRetypeWithoutMigrationTest-1615027832 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:30:53.116409 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a905745d-d38d-462c-84a3-cfc20515a2a6 tempest-VolumeRetypeWithoutMigrationTest-1615027832 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:30:53.222580 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-a905745d-d38d-462c-84a3-cfc20515a2a6 tempest-VolumeRetypeWithoutMigrationTest-1615027832 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:30:53.235629 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-a905745d-d38d-462c-84a3-cfc20515a2a6 tempest-VolumeRetypeWithoutMigrationTest-1615027832 None] Retype volume completed successfully. May 21 21:30:54.376017 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-30e0a32b-3792-456c-8101-49fc8211930e tempest-VolumeRetypeWithoutMigrationTest-1615027832 None] Lock "b'cinder-49ce0c7b-0687-4666-8feb-06673ecc3a1f-delete_volume'" acquired by "delete_volume" :: waited 0.057s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:30:54.552937 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-30e0a32b-3792-456c-8101-49fc8211930e tempest-VolumeRetypeWithoutMigrationTest-1615027832 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:30:54.720476 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-30e0a32b-3792-456c-8101-49fc8211930e tempest-VolumeRetypeWithoutMigrationTest-1615027832 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:30:54.721159 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-30e0a32b-3792-456c-8101-49fc8211930e tempest-VolumeRetypeWithoutMigrationTest-1615027832 None] Volume volume-49ce0c7b-0687-4666-8feb-06673ecc3a1f is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:30:54.787091 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-30e0a32b-3792-456c-8101-49fc8211930e tempest-VolumeRetypeWithoutMigrationTest-1615027832 None] deleting rbd volume volume-49ce0c7b-0687-4666-8feb-06673ecc3a1f {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:30:57.616910 ncdv-master-1 cinder-volume[124407]: WARNING cinder.quota [None req-30e0a32b-3792-456c-8101-49fc8211930e tempest-VolumeRetypeWithoutMigrationTest-1615027832 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. May 21 21:30:57.617815 ncdv-master-1 cinder-volume[124407]: WARNING cinder.quota [None req-30e0a32b-3792-456c-8101-49fc8211930e tempest-VolumeRetypeWithoutMigrationTest-1615027832 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. May 21 21:30:57.749269 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-30e0a32b-3792-456c-8101-49fc8211930e tempest-VolumeRetypeWithoutMigrationTest-1615027832 None] Created reservations ['5f6cae55-46bc-460d-9791-9473935f63fd', 'e1878a9d-e252-4633-966a-1149b446df04', 'cb3913c9-7b03-4665-86f9-fadd34373294', '10a26d0d-0014-42ff-b8cb-1b10aa1bc426'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:30:58.003641 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-30e0a32b-3792-456c-8101-49fc8211930e tempest-VolumeRetypeWithoutMigrationTest-1615027832 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:30:58.039229 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-30e0a32b-3792-456c-8101-49fc8211930e tempest-VolumeRetypeWithoutMigrationTest-1615027832 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:30:58.086818 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-30e0a32b-3792-456c-8101-49fc8211930e tempest-VolumeRetypeWithoutMigrationTest-1615027832 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:30:58.093507 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-30e0a32b-3792-456c-8101-49fc8211930e tempest-VolumeRetypeWithoutMigrationTest-1615027832 None] Deleted volume successfully. May 21 21:30:58.179048 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-30e0a32b-3792-456c-8101-49fc8211930e tempest-VolumeRetypeWithoutMigrationTest-1615027832 None] Lock "b'cinder-49ce0c7b-0687-4666-8feb-06673ecc3a1f-delete_volume'" released by "delete_volume" :: held 3.807s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:31:02.034983 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-44b00b4e-3725-4488-9366-a9d6d7f8a7dd tempest-ServerRescueNegativeTestJSON-1981617934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:31:02.056683 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-44b00b4e-3725-4488-9366-a9d6d7f8a7dd tempest-ServerRescueNegativeTestJSON-1981617934 None] Flow 'volume_create_manager' (33517da5-48a0-4538-b386-70139640addf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:31:02.063571 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-44b00b4e-3725-4488-9366-a9d6d7f8a7dd tempest-ServerRescueNegativeTestJSON-1981617934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5937f874-e8e5-4813-b42d-7a9ba28bb221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:02.082854 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-44b00b4e-3725-4488-9366-a9d6d7f8a7dd tempest-ServerRescueNegativeTestJSON-1981617934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5937f874-e8e5-4813-b42d-7a9ba28bb221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1712195069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=05d70c6a-b739-4ca4-96bd-e8a3338bb914,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e6d59483dc54fe4a558186055068419',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:31:02Z,use_quota=True,user_id='9a0ccfb5c9a04ec0831a0bfe987bb659',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:02.088408 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-44b00b4e-3725-4488-9366-a9d6d7f8a7dd tempest-ServerRescueNegativeTestJSON-1981617934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfeca7d3-57f4-428a-b342-255a196ebd08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:02.093167 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-44b00b4e-3725-4488-9366-a9d6d7f8a7dd tempest-ServerRescueNegativeTestJSON-1981617934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfeca7d3-57f4-428a-b342-255a196ebd08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:02.098354 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-44b00b4e-3725-4488-9366-a9d6d7f8a7dd tempest-ServerRescueNegativeTestJSON-1981617934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8e75c4f-09a5-4312-97a8-f06b559d980e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:02.102555 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-44b00b4e-3725-4488-9366-a9d6d7f8a7dd tempest-ServerRescueNegativeTestJSON-1981617934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8e75c4f-09a5-4312-97a8-f06b559d980e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05d70c6a-b739-4ca4-96bd-e8a3338bb914', 'volume_name': 'volume-05d70c6a-b739-4ca4-96bd-e8a3338bb914', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:02.107364 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-44b00b4e-3725-4488-9366-a9d6d7f8a7dd tempest-ServerRescueNegativeTestJSON-1981617934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0d708c2-00ca-4cf6-888a-4358461c2daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:02.111874 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-44b00b4e-3725-4488-9366-a9d6d7f8a7dd tempest-ServerRescueNegativeTestJSON-1981617934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0d708c2-00ca-4cf6-888a-4358461c2daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:02.116895 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-44b00b4e-3725-4488-9366-a9d6d7f8a7dd tempest-ServerRescueNegativeTestJSON-1981617934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f49f339-f7ef-4e5c-b124-714af4a3544d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:02.117955 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-44b00b4e-3725-4488-9366-a9d6d7f8a7dd tempest-ServerRescueNegativeTestJSON-1981617934 None] Volume 05d70c6a-b739-4ca4-96bd-e8a3338bb914: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05d70c6a-b739-4ca4-96bd-e8a3338bb914', 'volume_size': 1} May 21 21:31:02.118338 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-44b00b4e-3725-4488-9366-a9d6d7f8a7dd tempest-ServerRescueNegativeTestJSON-1981617934 None] creating volume 'volume-05d70c6a-b739-4ca4-96bd-e8a3338bb914' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:31:02.119090 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-44b00b4e-3725-4488-9366-a9d6d7f8a7dd tempest-ServerRescueNegativeTestJSON-1981617934 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:31:02.543244 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-44b00b4e-3725-4488-9366-a9d6d7f8a7dd tempest-ServerRescueNegativeTestJSON-1981617934 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:31:02.543626 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-44b00b4e-3725-4488-9366-a9d6d7f8a7dd tempest-ServerRescueNegativeTestJSON-1981617934 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:31:02.551882 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-44b00b4e-3725-4488-9366-a9d6d7f8a7dd tempest-ServerRescueNegativeTestJSON-1981617934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f49f339-f7ef-4e5c-b124-714af4a3544d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05d70c6a-b739-4ca4-96bd-e8a3338bb914', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:02.555823 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-44b00b4e-3725-4488-9366-a9d6d7f8a7dd tempest-ServerRescueNegativeTestJSON-1981617934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af666ca4-73f7-4319-9da8-84a0b4b1d567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:02.634576 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-44b00b4e-3725-4488-9366-a9d6d7f8a7dd tempest-ServerRescueNegativeTestJSON-1981617934 None] Volume volume-05d70c6a-b739-4ca4-96bd-e8a3338bb914 (05d70c6a-b739-4ca4-96bd-e8a3338bb914): created successfully May 21 21:31:02.640756 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-44b00b4e-3725-4488-9366-a9d6d7f8a7dd tempest-ServerRescueNegativeTestJSON-1981617934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af666ca4-73f7-4319-9da8-84a0b4b1d567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:02.648575 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-44b00b4e-3725-4488-9366-a9d6d7f8a7dd tempest-ServerRescueNegativeTestJSON-1981617934 None] Flow 'volume_create_manager' (33517da5-48a0-4538-b386-70139640addf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:31:02.762738 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-44b00b4e-3725-4488-9366-a9d6d7f8a7dd tempest-ServerRescueNegativeTestJSON-1981617934 None] Created volume successfully. May 21 21:31:12.772392 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=44,cinder:UPDATE=22,cinder:INSERT=2,cinder:DELETE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:31:15.855817 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bcb2fc9-77de-4402-9dae-36bb1818469a tempest-VolumesImageMetadata-765795266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:31:15.903863 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6bcb2fc9-77de-4402-9dae-36bb1818469a tempest-VolumesImageMetadata-765795266 None] Flow 'volume_create_manager' (3252c371-dba0-4be0-b565-15796af8e225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:31:15.916523 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6bcb2fc9-77de-4402-9dae-36bb1818469a tempest-VolumesImageMetadata-765795266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc73936d-6c8b-4b10-bee3-14642ea7caa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:15.953279 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6bcb2fc9-77de-4402-9dae-36bb1818469a tempest-VolumesImageMetadata-765795266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc73936d-6c8b-4b10-bee3-14642ea7caa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:31:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-203027163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1166628c-92ab-4cb4-85c6-ad28b4533b94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d94ca925cdd4ffbad352431ed637be2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:31:16Z,use_quota=True,user_id='3d7bbde8ccf744108e2345082644367f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:15.964972 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6bcb2fc9-77de-4402-9dae-36bb1818469a tempest-VolumesImageMetadata-765795266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46a4ed7e-35d7-458c-8066-4158426e7c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:15.976497 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6bcb2fc9-77de-4402-9dae-36bb1818469a tempest-VolumesImageMetadata-765795266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46a4ed7e-35d7-458c-8066-4158426e7c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:15.983819 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6bcb2fc9-77de-4402-9dae-36bb1818469a tempest-VolumesImageMetadata-765795266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ea38cf2-f3d7-4200-a13e-11685309be34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:16.187833 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6bcb2fc9-77de-4402-9dae-36bb1818469a tempest-VolumesImageMetadata-765795266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ea38cf2-f3d7-4200-a13e-11685309be34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1166628c-92ab-4cb4-85c6-ad28b4533b94', 'volume_name': 'volume-1166628c-92ab-4cb4-85c6-ad28b4533b94', 'volume_size': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5593f8cb452404083dfa177b4ee68b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'created_at': datetime.datetime(2022, 5, 21, 21, 0, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:16.198793 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6bcb2fc9-77de-4402-9dae-36bb1818469a tempest-VolumesImageMetadata-765795266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4edd2770-d7b2-4761-bd60-ebdd1eb09076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:16.214944 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6bcb2fc9-77de-4402-9dae-36bb1818469a tempest-VolumesImageMetadata-765795266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4edd2770-d7b2-4761-bd60-ebdd1eb09076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:16.245221 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6bcb2fc9-77de-4402-9dae-36bb1818469a tempest-VolumesImageMetadata-765795266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d02dc1db-5d81-43b6-a38f-15911680bd26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:16.253468 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-6bcb2fc9-77de-4402-9dae-36bb1818469a tempest-VolumesImageMetadata-765795266 None] Volume 1166628c-92ab-4cb4-85c6-ad28b4533b94: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1166628c-92ab-4cb4-85c6-ad28b4533b94', 'volume_size': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5593f8cb452404083dfa177b4ee68b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'created_at': datetime.datetime(2022, 5, 21, 21, 0, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } May 21 21:31:16.255050 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bcb2fc9-77de-4402-9dae-36bb1818469a tempest-VolumesImageMetadata-765795266 None] Cloning 1166628c-92ab-4cb4-85c6-ad28b4533b94 from image e570f5eb-6047-4214-a420-fdfdbdf19a4c at location (None, None). {{(pid=124407) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1053}} May 21 21:31:16.269831 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-6bcb2fc9-77de-4402-9dae-36bb1818469a tempest-VolumesImageMetadata-765795266 None] Lock "b'cinder-e570f5eb-6047-4214-a420-fdfdbdf19a4c'" acquired by "_prepare_image_cache_entry" :: waited 0.014s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:31:16.378298 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-6bcb2fc9-77de-4402-9dae-36bb1818469a tempest-VolumesImageMetadata-765795266 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'volume_id': '4057e637-23ba-493f-a45d-eb28c07ac60a', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28), 'last_used': datetime.datetime(2022, 5, 21, 21, 31, 16, 282543)}. {{(pid=124407) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 21 21:31:16.379315 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-6bcb2fc9-77de-4402-9dae-36bb1818469a tempest-VolumesImageMetadata-765795266 None] Image-volume cache entry image_update_at = 2022-05-21 21:00:28+00:00, requested image updated_at = 2022-05-21 21:00:28+00:00. {{(pid=124407) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 21 21:31:16.379983 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bcb2fc9-77de-4402-9dae-36bb1818469a tempest-VolumesImageMetadata-765795266 None] Found cache entry for image = e570f5eb-6047-4214-a420-fdfdbdf19a4c on host ncdv-master-1@ceph#ceph. {{(pid=124407) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:876}} May 21 21:31:16.385186 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-6bcb2fc9-77de-4402-9dae-36bb1818469a tempest-VolumesImageMetadata-765795266 None] Lock "b'cinder-e570f5eb-6047-4214-a420-fdfdbdf19a4c'" released by "_prepare_image_cache_entry" :: held 0.115s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:31:16.386343 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bcb2fc9-77de-4402-9dae-36bb1818469a tempest-VolumesImageMetadata-765795266 None] Attempting to retrieve cache entry for image = e570f5eb-6047-4214-a420-fdfdbdf19a4c on host ncdv-master-1@ceph#ceph. {{(pid=124407) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:817}} May 21 21:31:16.403164 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-6bcb2fc9-77de-4402-9dae-36bb1818469a tempest-VolumesImageMetadata-765795266 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'volume_id': '4057e637-23ba-493f-a45d-eb28c07ac60a', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28), 'last_used': datetime.datetime(2022, 5, 21, 21, 31, 16, 395850)}. {{(pid=124407) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 21 21:31:16.403879 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-6bcb2fc9-77de-4402-9dae-36bb1818469a tempest-VolumesImageMetadata-765795266 None] Image-volume cache entry image_update_at = 2022-05-21 21:00:28+00:00, requested image updated_at = 2022-05-21 21:00:28+00:00. {{(pid=124407) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 21 21:31:16.405468 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bcb2fc9-77de-4402-9dae-36bb1818469a tempest-VolumesImageMetadata-765795266 None] Creating from source image-volume 4057e637-23ba-493f-a45d-eb28c07ac60a {{(pid=124407) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:831}} May 21 21:31:16.432412 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6bcb2fc9-77de-4402-9dae-36bb1818469a tempest-VolumesImageMetadata-765795266 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:31:16.757456 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6bcb2fc9-77de-4402-9dae-36bb1818469a tempest-VolumesImageMetadata-765795266 None] creating snapshot='volume-1166628c-92ab-4cb4-85c6-ad28b4533b94.clone_snap' {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 21 21:31:17.889221 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6bcb2fc9-77de-4402-9dae-36bb1818469a tempest-VolumesImageMetadata-765795266 None] cloning 'volume-4057e637-23ba-493f-a45d-eb28c07ac60a@volume-1166628c-92ab-4cb4-85c6-ad28b4533b94.clone_snap' to 'volume-1166628c-92ab-4cb4-85c6-ad28b4533b94' {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:789}} May 21 21:31:18.929811 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6bcb2fc9-77de-4402-9dae-36bb1818469a tempest-VolumesImageMetadata-765795266 None] Volume volume-b9ebacac-5f32-42e3-9194-003aee7e2435.deleted is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:31:18.931687 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6bcb2fc9-77de-4402-9dae-36bb1818469a tempest-VolumesImageMetadata-765795266 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:31:18.932235 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6bcb2fc9-77de-4402-9dae-36bb1818469a tempest-VolumesImageMetadata-765795266 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:31:19.242101 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6bcb2fc9-77de-4402-9dae-36bb1818469a tempest-VolumesImageMetadata-765795266 None] clone created successfully {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:862}} May 21 21:31:19.243665 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.volume_utils [None req-6bcb2fc9-77de-4402-9dae-36bb1818469a tempest-VolumesImageMetadata-765795266 None] Marking volume 1166628c-92ab-4cb4-85c6-ad28b4533b94 as bootable. {{(pid=124407) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} May 21 21:31:19.333289 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bcb2fc9-77de-4402-9dae-36bb1818469a tempest-VolumesImageMetadata-765795266 None] Copying metadata from image e570f5eb-6047-4214-a420-fdfdbdf19a4c to 1166628c-92ab-4cb4-85c6-ad28b4533b94. {{(pid=124407) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} May 21 21:31:19.333775 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bcb2fc9-77de-4402-9dae-36bb1818469a tempest-VolumesImageMetadata-765795266 None] Creating volume glance metadata for volume 1166628c-92ab-4cb4-85c6-ad28b4533b94 backed by image e570f5eb-6047-4214-a420-fdfdbdf19a4c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=124407) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:673}} May 21 21:31:19.749514 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6bcb2fc9-77de-4402-9dae-36bb1818469a tempest-VolumesImageMetadata-765795266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d02dc1db-5d81-43b6-a38f-15911680bd26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1166628c-92ab-4cb4-85c6-ad28b4533b94', 'volume_size': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5593f8cb452404083dfa177b4ee68b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'created_at': datetime.datetime(2022, 5, 21, 21, 0, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:19.754382 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6bcb2fc9-77de-4402-9dae-36bb1818469a tempest-VolumesImageMetadata-765795266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ecb9578-a1e5-4ae0-9460-2aa7332a8de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:19.898366 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-6bcb2fc9-77de-4402-9dae-36bb1818469a tempest-VolumesImageMetadata-765795266 None] Volume volume-1166628c-92ab-4cb4-85c6-ad28b4533b94 (1166628c-92ab-4cb4-85c6-ad28b4533b94): created successfully May 21 21:31:19.905015 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6bcb2fc9-77de-4402-9dae-36bb1818469a tempest-VolumesImageMetadata-765795266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ecb9578-a1e5-4ae0-9460-2aa7332a8de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:19.910678 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6bcb2fc9-77de-4402-9dae-36bb1818469a tempest-VolumesImageMetadata-765795266 None] Flow 'volume_create_manager' (3252c371-dba0-4be0-b565-15796af8e225) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:31:20.034232 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-6bcb2fc9-77de-4402-9dae-36bb1818469a tempest-VolumesImageMetadata-765795266 None] Created volume successfully. May 21 21:31:21.869886 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-b77ce01e-6408-4a2b-8050-db195e625563 tempest-VolumesImageMetadata-765795266 None] Lock "b'cinder-1166628c-92ab-4cb4-85c6-ad28b4533b94-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:31:21.999045 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b77ce01e-6408-4a2b-8050-db195e625563 tempest-VolumesImageMetadata-765795266 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:31:22.194549 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b77ce01e-6408-4a2b-8050-db195e625563 tempest-VolumesImageMetadata-765795266 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:31:22.252837 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b77ce01e-6408-4a2b-8050-db195e625563 tempest-VolumesImageMetadata-765795266 None] deleting rbd volume volume-1166628c-92ab-4cb4-85c6-ad28b4533b94 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:31:25.357517 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b77ce01e-6408-4a2b-8050-db195e625563 tempest-VolumesImageMetadata-765795266 None] volume is a clone so cleaning references {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1352}} May 21 21:31:25.523222 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b77ce01e-6408-4a2b-8050-db195e625563 tempest-VolumesImageMetadata-765795266 None] deleting parent snapshot volume-1166628c-92ab-4cb4-85c6-ad28b4533b94.clone_snap {{(pid=124407) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1243}} May 21 21:31:28.148729 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=50,cinder:INSERT=6,cinder:UPDATE=13,cinder:DELETE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:31:28.304629 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-b77ce01e-6408-4a2b-8050-db195e625563 tempest-VolumesImageMetadata-765795266 None] Created reservations ['474ff85a-0424-4d1e-8abd-6b626e3e01ae', '3a7000fb-46de-4c21-88c6-4eee97ef7c65', '3d117862-2c00-47bd-8ba3-3b9b3da3be38', '896fc4d3-eb9b-4892-9775-218936baa1ce'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:31:28.539190 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b77ce01e-6408-4a2b-8050-db195e625563 tempest-VolumesImageMetadata-765795266 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:31:28.605404 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b77ce01e-6408-4a2b-8050-db195e625563 tempest-VolumesImageMetadata-765795266 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:31:28.674949 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-b77ce01e-6408-4a2b-8050-db195e625563 tempest-VolumesImageMetadata-765795266 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:31:28.690422 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-b77ce01e-6408-4a2b-8050-db195e625563 tempest-VolumesImageMetadata-765795266 None] Deleted volume successfully. May 21 21:31:28.771006 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-b77ce01e-6408-4a2b-8050-db195e625563 tempest-VolumesImageMetadata-765795266 None] Lock "b'cinder-1166628c-92ab-4cb4-85c6-ad28b4533b94-delete_volume'" released by "delete_volume" :: held 6.901s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:31:29.572407 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b061526-38c2-4790-8679-8921bdd503b1 tempest-ServerRescueNegativeTestJSON-1981617934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:31:29.603463 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-5b061526-38c2-4790-8679-8921bdd503b1 tempest-ServerRescueNegativeTestJSON-1981617934 None] Flow 'volume_create_manager' (a270c64b-e4d2-4c08-9c33-946f57b1b9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:31:29.610759 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-5b061526-38c2-4790-8679-8921bdd503b1 tempest-ServerRescueNegativeTestJSON-1981617934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13528fbb-e94b-4eb3-9e72-e85da48d6204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:29.627608 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-5b061526-38c2-4790-8679-8921bdd503b1 tempest-ServerRescueNegativeTestJSON-1981617934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13528fbb-e94b-4eb3-9e72-e85da48d6204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-605123864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b0b1920b-8151-4e90-ac66-f993da5e7e8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e6d59483dc54fe4a558186055068419',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:31:29Z,use_quota=True,user_id='9a0ccfb5c9a04ec0831a0bfe987bb659',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:29.633067 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-5b061526-38c2-4790-8679-8921bdd503b1 tempest-ServerRescueNegativeTestJSON-1981617934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51803dff-6cd2-487c-a9f6-f1e49993e00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:29.637820 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-5b061526-38c2-4790-8679-8921bdd503b1 tempest-ServerRescueNegativeTestJSON-1981617934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51803dff-6cd2-487c-a9f6-f1e49993e00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:29.643148 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-5b061526-38c2-4790-8679-8921bdd503b1 tempest-ServerRescueNegativeTestJSON-1981617934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f959dad-c50d-4c1b-89ed-d381cf4c3f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:29.647215 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-5b061526-38c2-4790-8679-8921bdd503b1 tempest-ServerRescueNegativeTestJSON-1981617934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f959dad-c50d-4c1b-89ed-d381cf4c3f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0b1920b-8151-4e90-ac66-f993da5e7e8e', 'volume_name': 'volume-b0b1920b-8151-4e90-ac66-f993da5e7e8e', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:29.652417 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-5b061526-38c2-4790-8679-8921bdd503b1 tempest-ServerRescueNegativeTestJSON-1981617934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (533db8f1-a3d5-463a-9adc-d3c36d298794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:29.656626 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-5b061526-38c2-4790-8679-8921bdd503b1 tempest-ServerRescueNegativeTestJSON-1981617934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (533db8f1-a3d5-463a-9adc-d3c36d298794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:29.661324 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-5b061526-38c2-4790-8679-8921bdd503b1 tempest-ServerRescueNegativeTestJSON-1981617934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8beeab1f-15f2-4ee0-b69c-f5d7ba339c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:29.662405 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-5b061526-38c2-4790-8679-8921bdd503b1 tempest-ServerRescueNegativeTestJSON-1981617934 None] Volume b0b1920b-8151-4e90-ac66-f993da5e7e8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0b1920b-8151-4e90-ac66-f993da5e7e8e', 'volume_size': 1} May 21 21:31:29.662799 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-5b061526-38c2-4790-8679-8921bdd503b1 tempest-ServerRescueNegativeTestJSON-1981617934 None] creating volume 'volume-b0b1920b-8151-4e90-ac66-f993da5e7e8e' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:31:29.663571 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-5b061526-38c2-4790-8679-8921bdd503b1 tempest-ServerRescueNegativeTestJSON-1981617934 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:31:30.261282 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-5b061526-38c2-4790-8679-8921bdd503b1 tempest-ServerRescueNegativeTestJSON-1981617934 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:31:30.261946 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-5b061526-38c2-4790-8679-8921bdd503b1 tempest-ServerRescueNegativeTestJSON-1981617934 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:31:30.266376 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-5b061526-38c2-4790-8679-8921bdd503b1 tempest-ServerRescueNegativeTestJSON-1981617934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8beeab1f-15f2-4ee0-b69c-f5d7ba339c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0b1920b-8151-4e90-ac66-f993da5e7e8e', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:30.271187 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-5b061526-38c2-4790-8679-8921bdd503b1 tempest-ServerRescueNegativeTestJSON-1981617934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27ffd011-0355-4986-b4b4-11bcb94e0b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:30.361829 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-5b061526-38c2-4790-8679-8921bdd503b1 tempest-ServerRescueNegativeTestJSON-1981617934 None] Volume volume-b0b1920b-8151-4e90-ac66-f993da5e7e8e (b0b1920b-8151-4e90-ac66-f993da5e7e8e): created successfully May 21 21:31:30.365556 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-5b061526-38c2-4790-8679-8921bdd503b1 tempest-ServerRescueNegativeTestJSON-1981617934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27ffd011-0355-4986-b4b4-11bcb94e0b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:30.379472 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-5b061526-38c2-4790-8679-8921bdd503b1 tempest-ServerRescueNegativeTestJSON-1981617934 None] Flow 'volume_create_manager' (a270c64b-e4d2-4c08-9c33-946f57b1b9e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:31:30.513255 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-5b061526-38c2-4790-8679-8921bdd503b1 tempest-ServerRescueNegativeTestJSON-1981617934 None] Created volume successfully. May 21 21:31:33.730059 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-561f7a50-d2e5-4711-aed3-19298b99e9cf tempest-VolumesGetTest-1374660785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:31:33.785038 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-561f7a50-d2e5-4711-aed3-19298b99e9cf tempest-VolumesGetTest-1374660785 None] Flow 'volume_create_manager' (a28961a1-4cae-44b7-8cf6-bf5bab8a1a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:31:33.795194 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-561f7a50-d2e5-4711-aed3-19298b99e9cf tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5af11f4a-5c03-4ff5-963b-9e94e163fef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:33.814010 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-561f7a50-d2e5-4711-aed3-19298b99e9cf tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5af11f4a-5c03-4ff5-963b-9e94e163fef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:31:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1393902169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=562255cd-e9ae-4f0b-be0a-f6a490eea0a6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b839655bdad144ffac8d9efc51f89b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:31:34Z,use_quota=True,user_id='738d894cbd8044cb86afbac450c704d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:33.821596 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-561f7a50-d2e5-4711-aed3-19298b99e9cf tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a119304-67c2-4c77-9575-060d566402ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:33.826987 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-561f7a50-d2e5-4711-aed3-19298b99e9cf tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a119304-67c2-4c77-9575-060d566402ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:33.832686 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-561f7a50-d2e5-4711-aed3-19298b99e9cf tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea985eb6-26fd-4eec-a6c9-7ce84b8dc83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:33.837933 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-561f7a50-d2e5-4711-aed3-19298b99e9cf tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea985eb6-26fd-4eec-a6c9-7ce84b8dc83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '562255cd-e9ae-4f0b-be0a-f6a490eea0a6', 'volume_name': 'volume-562255cd-e9ae-4f0b-be0a-f6a490eea0a6', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:33.843774 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-561f7a50-d2e5-4711-aed3-19298b99e9cf tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75cd2aea-1d59-4d9c-adb5-ff528a91f3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:33.848768 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-561f7a50-d2e5-4711-aed3-19298b99e9cf tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75cd2aea-1d59-4d9c-adb5-ff528a91f3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:33.853696 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-561f7a50-d2e5-4711-aed3-19298b99e9cf tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d143797f-28db-4100-97b0-b94fc49bb2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:33.854990 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-561f7a50-d2e5-4711-aed3-19298b99e9cf tempest-VolumesGetTest-1374660785 None] Volume 562255cd-e9ae-4f0b-be0a-f6a490eea0a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-562255cd-e9ae-4f0b-be0a-f6a490eea0a6', 'volume_size': 1} May 21 21:31:33.855614 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-561f7a50-d2e5-4711-aed3-19298b99e9cf tempest-VolumesGetTest-1374660785 None] creating volume 'volume-562255cd-e9ae-4f0b-be0a-f6a490eea0a6' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:31:33.857283 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-561f7a50-d2e5-4711-aed3-19298b99e9cf tempest-VolumesGetTest-1374660785 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:31:34.151587 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-47da56b0-1b8a-482b-b46f-adc812ea1a9f tempest-ServersNegativeTestJSON-1080286652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:31:34.179458 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-47da56b0-1b8a-482b-b46f-adc812ea1a9f tempest-ServersNegativeTestJSON-1080286652 None] Flow 'volume_create_manager' (dbd472f5-d34a-402d-8092-56cda2044063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:31:34.189329 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-47da56b0-1b8a-482b-b46f-adc812ea1a9f tempest-ServersNegativeTestJSON-1080286652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eac0a5aa-cc89-42a1-bf1c-4cd7a736b467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:34.224373 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-47da56b0-1b8a-482b-b46f-adc812ea1a9f tempest-ServersNegativeTestJSON-1080286652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eac0a5aa-cc89-42a1-bf1c-4cd7a736b467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:31:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1276124744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1443538c-c5ec-49af-ae97-c3dd6e72198e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27f0db8b0958479990724993361c0a51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:31:34Z,use_quota=True,user_id='411af27147894e999b4242c5b9991c98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:34.232091 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-47da56b0-1b8a-482b-b46f-adc812ea1a9f tempest-ServersNegativeTestJSON-1080286652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cea4388-e2c1-49b4-8c36-ea3a384f308f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:34.237322 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-47da56b0-1b8a-482b-b46f-adc812ea1a9f tempest-ServersNegativeTestJSON-1080286652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cea4388-e2c1-49b4-8c36-ea3a384f308f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:34.243565 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-47da56b0-1b8a-482b-b46f-adc812ea1a9f tempest-ServersNegativeTestJSON-1080286652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (319dd6f2-3aca-4d19-8f88-fd8744a1734a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:34.249649 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-47da56b0-1b8a-482b-b46f-adc812ea1a9f tempest-ServersNegativeTestJSON-1080286652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (319dd6f2-3aca-4d19-8f88-fd8744a1734a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1443538c-c5ec-49af-ae97-c3dd6e72198e', 'volume_name': 'volume-1443538c-c5ec-49af-ae97-c3dd6e72198e', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:34.254773 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-47da56b0-1b8a-482b-b46f-adc812ea1a9f tempest-ServersNegativeTestJSON-1080286652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29119ae2-7d85-4978-9f38-7350affb4275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:34.260053 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-47da56b0-1b8a-482b-b46f-adc812ea1a9f tempest-ServersNegativeTestJSON-1080286652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29119ae2-7d85-4978-9f38-7350affb4275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:34.266012 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-47da56b0-1b8a-482b-b46f-adc812ea1a9f tempest-ServersNegativeTestJSON-1080286652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11dc11bb-87eb-430b-826e-85ced1f61e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:34.268967 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-47da56b0-1b8a-482b-b46f-adc812ea1a9f tempest-ServersNegativeTestJSON-1080286652 None] Volume 1443538c-c5ec-49af-ae97-c3dd6e72198e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1443538c-c5ec-49af-ae97-c3dd6e72198e', 'volume_size': 1} May 21 21:31:34.268967 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-47da56b0-1b8a-482b-b46f-adc812ea1a9f tempest-ServersNegativeTestJSON-1080286652 None] creating volume 'volume-1443538c-c5ec-49af-ae97-c3dd6e72198e' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:31:34.268967 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-47da56b0-1b8a-482b-b46f-adc812ea1a9f tempest-ServersNegativeTestJSON-1080286652 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:31:34.348624 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-561f7a50-d2e5-4711-aed3-19298b99e9cf tempest-VolumesGetTest-1374660785 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:31:34.349138 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-561f7a50-d2e5-4711-aed3-19298b99e9cf tempest-VolumesGetTest-1374660785 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:31:34.354497 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-561f7a50-d2e5-4711-aed3-19298b99e9cf tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d143797f-28db-4100-97b0-b94fc49bb2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-562255cd-e9ae-4f0b-be0a-f6a490eea0a6', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:34.363906 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-561f7a50-d2e5-4711-aed3-19298b99e9cf tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3e57be6-a405-4784-b84e-8366bed5b30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:34.475580 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-561f7a50-d2e5-4711-aed3-19298b99e9cf tempest-VolumesGetTest-1374660785 None] Volume volume-562255cd-e9ae-4f0b-be0a-f6a490eea0a6 (562255cd-e9ae-4f0b-be0a-f6a490eea0a6): created successfully May 21 21:31:34.479226 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-561f7a50-d2e5-4711-aed3-19298b99e9cf tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3e57be6-a405-4784-b84e-8366bed5b30b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:34.485304 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-561f7a50-d2e5-4711-aed3-19298b99e9cf tempest-VolumesGetTest-1374660785 None] Flow 'volume_create_manager' (a28961a1-4cae-44b7-8cf6-bf5bab8a1a70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:31:34.623134 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-561f7a50-d2e5-4711-aed3-19298b99e9cf tempest-VolumesGetTest-1374660785 None] Created volume successfully. May 21 21:31:34.876990 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-47da56b0-1b8a-482b-b46f-adc812ea1a9f tempest-ServersNegativeTestJSON-1080286652 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:31:34.884275 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-47da56b0-1b8a-482b-b46f-adc812ea1a9f tempest-ServersNegativeTestJSON-1080286652 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:31:34.884275 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-47da56b0-1b8a-482b-b46f-adc812ea1a9f tempest-ServersNegativeTestJSON-1080286652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11dc11bb-87eb-430b-826e-85ced1f61e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1443538c-c5ec-49af-ae97-c3dd6e72198e', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:34.887616 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-47da56b0-1b8a-482b-b46f-adc812ea1a9f tempest-ServersNegativeTestJSON-1080286652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ad1f053-865d-43bd-8eef-1b9020393554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:34.990168 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-47da56b0-1b8a-482b-b46f-adc812ea1a9f tempest-ServersNegativeTestJSON-1080286652 None] Volume volume-1443538c-c5ec-49af-ae97-c3dd6e72198e (1443538c-c5ec-49af-ae97-c3dd6e72198e): created successfully May 21 21:31:34.994432 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-47da56b0-1b8a-482b-b46f-adc812ea1a9f tempest-ServersNegativeTestJSON-1080286652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ad1f053-865d-43bd-8eef-1b9020393554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:35.003039 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-47da56b0-1b8a-482b-b46f-adc812ea1a9f tempest-ServersNegativeTestJSON-1080286652 None] Flow 'volume_create_manager' (dbd472f5-d34a-402d-8092-56cda2044063) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:31:35.118244 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-47da56b0-1b8a-482b-b46f-adc812ea1a9f tempest-ServersNegativeTestJSON-1080286652 None] Created volume successfully. May 21 21:31:36.998732 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0e758a5-2249-4812-a083-030878d32ea2 tempest-VolumesGetTest-1374660785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:31:37.022367 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d0e758a5-2249-4812-a083-030878d32ea2 tempest-VolumesGetTest-1374660785 None] Flow 'volume_create_manager' (7351dc54-f755-4e4a-9bb6-884166cd32e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:31:37.031222 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d0e758a5-2249-4812-a083-030878d32ea2 tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d671fa64-138f-4c3c-bb2c-9ea84d5fcd00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:37.051691 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d0e758a5-2249-4812-a083-030878d32ea2 tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d671fa64-138f-4c3c-bb2c-9ea84d5fcd00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:31:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1741074278',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9969cd84-b135-4a0a-bb9d-3b3d02b54562,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b839655bdad144ffac8d9efc51f89b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:31:37Z,use_quota=True,user_id='738d894cbd8044cb86afbac450c704d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:37.053354 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d0e758a5-2249-4812-a083-030878d32ea2 tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea7eae05-9d07-4dee-80fe-ee75f4464c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:37.057647 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d0e758a5-2249-4812-a083-030878d32ea2 tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea7eae05-9d07-4dee-80fe-ee75f4464c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:37.063212 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d0e758a5-2249-4812-a083-030878d32ea2 tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b49c9580-fc8d-4ff1-92c1-f35c04842d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:37.067259 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d0e758a5-2249-4812-a083-030878d32ea2 tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b49c9580-fc8d-4ff1-92c1-f35c04842d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9969cd84-b135-4a0a-bb9d-3b3d02b54562', 'volume_name': 'volume-9969cd84-b135-4a0a-bb9d-3b3d02b54562', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:37.074536 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d0e758a5-2249-4812-a083-030878d32ea2 tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f806569-56a1-4fe1-b939-ad21fe2aa4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:37.079198 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d0e758a5-2249-4812-a083-030878d32ea2 tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f806569-56a1-4fe1-b939-ad21fe2aa4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:37.085003 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d0e758a5-2249-4812-a083-030878d32ea2 tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47955ed5-6d55-4826-ace0-8a75ed281253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:37.086480 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-d0e758a5-2249-4812-a083-030878d32ea2 tempest-VolumesGetTest-1374660785 None] Volume 9969cd84-b135-4a0a-bb9d-3b3d02b54562: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9969cd84-b135-4a0a-bb9d-3b3d02b54562', 'volume_size': 1} May 21 21:31:37.087082 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d0e758a5-2249-4812-a083-030878d32ea2 tempest-VolumesGetTest-1374660785 None] creating volume 'volume-9969cd84-b135-4a0a-bb9d-3b3d02b54562' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:31:37.087938 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d0e758a5-2249-4812-a083-030878d32ea2 tempest-VolumesGetTest-1374660785 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:31:37.538914 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d0e758a5-2249-4812-a083-030878d32ea2 tempest-VolumesGetTest-1374660785 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:31:37.540950 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d0e758a5-2249-4812-a083-030878d32ea2 tempest-VolumesGetTest-1374660785 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:31:37.545367 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d0e758a5-2249-4812-a083-030878d32ea2 tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47955ed5-6d55-4826-ace0-8a75ed281253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9969cd84-b135-4a0a-bb9d-3b3d02b54562', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:37.557767 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d0e758a5-2249-4812-a083-030878d32ea2 tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2b3747c-3781-49b6-86e3-231d3e161a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:37.658215 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-d0e758a5-2249-4812-a083-030878d32ea2 tempest-VolumesGetTest-1374660785 None] Volume volume-9969cd84-b135-4a0a-bb9d-3b3d02b54562 (9969cd84-b135-4a0a-bb9d-3b3d02b54562): created successfully May 21 21:31:37.662330 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d0e758a5-2249-4812-a083-030878d32ea2 tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2b3747c-3781-49b6-86e3-231d3e161a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:37.672053 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d0e758a5-2249-4812-a083-030878d32ea2 tempest-VolumesGetTest-1374660785 None] Flow 'volume_create_manager' (7351dc54-f755-4e4a-9bb6-884166cd32e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:31:37.748004 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-d0e758a5-2249-4812-a083-030878d32ea2 tempest-VolumesGetTest-1374660785 None] Created volume successfully. May 21 21:31:38.105501 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-495a143c-eba5-4e52-87f9-7b0b23e3de6f tempest-VolumesGetTest-1374660785 None] Lock "b'cinder-9969cd84-b135-4a0a-bb9d-3b3d02b54562-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:31:38.229161 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-495a143c-eba5-4e52-87f9-7b0b23e3de6f tempest-VolumesGetTest-1374660785 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:31:38.320983 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-495a143c-eba5-4e52-87f9-7b0b23e3de6f tempest-VolumesGetTest-1374660785 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:31:38.321410 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-495a143c-eba5-4e52-87f9-7b0b23e3de6f tempest-VolumesGetTest-1374660785 None] Volume volume-9969cd84-b135-4a0a-bb9d-3b3d02b54562 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:31:38.401625 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-495a143c-eba5-4e52-87f9-7b0b23e3de6f tempest-VolumesGetTest-1374660785 None] deleting rbd volume volume-9969cd84-b135-4a0a-bb9d-3b3d02b54562 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:31:39.134896 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-053431e1-1ed4-45a7-b09b-1737235a7b12 tempest-ServersNegativeTestJSON-1080286652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:31:39.158222 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-053431e1-1ed4-45a7-b09b-1737235a7b12 tempest-ServersNegativeTestJSON-1080286652 None] Flow 'volume_create_manager' (bb240a54-d3ac-44f2-a1c6-7ca15b1f67cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:31:39.174220 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-053431e1-1ed4-45a7-b09b-1737235a7b12 tempest-ServersNegativeTestJSON-1080286652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e06b81ef-7bf4-4df4-8123-2b627a955013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:39.193000 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-053431e1-1ed4-45a7-b09b-1737235a7b12 tempest-ServersNegativeTestJSON-1080286652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e06b81ef-7bf4-4df4-8123-2b627a955013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2046384750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=843d6fda-b12c-470a-8f8c-5d3bbce1dede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27f0db8b0958479990724993361c0a51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:31:39Z,use_quota=True,user_id='411af27147894e999b4242c5b9991c98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:39.200273 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-053431e1-1ed4-45a7-b09b-1737235a7b12 tempest-ServersNegativeTestJSON-1080286652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06e8430d-e494-4d2a-9618-013ce19f2fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:39.206160 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-053431e1-1ed4-45a7-b09b-1737235a7b12 tempest-ServersNegativeTestJSON-1080286652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06e8430d-e494-4d2a-9618-013ce19f2fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:39.223784 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-053431e1-1ed4-45a7-b09b-1737235a7b12 tempest-ServersNegativeTestJSON-1080286652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3605fb0-6f86-4a6f-809f-32dcb7e4e5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:39.223784 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-053431e1-1ed4-45a7-b09b-1737235a7b12 tempest-ServersNegativeTestJSON-1080286652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3605fb0-6f86-4a6f-809f-32dcb7e4e5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '843d6fda-b12c-470a-8f8c-5d3bbce1dede', 'volume_name': 'volume-843d6fda-b12c-470a-8f8c-5d3bbce1dede', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:39.227754 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-053431e1-1ed4-45a7-b09b-1737235a7b12 tempest-ServersNegativeTestJSON-1080286652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdea7f53-1805-495f-accb-aa139f732c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:39.232464 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-053431e1-1ed4-45a7-b09b-1737235a7b12 tempest-ServersNegativeTestJSON-1080286652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdea7f53-1805-495f-accb-aa139f732c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:39.237264 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-053431e1-1ed4-45a7-b09b-1737235a7b12 tempest-ServersNegativeTestJSON-1080286652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eba5ef7-ed41-4c28-81ef-654f2d9cb441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:39.238333 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-053431e1-1ed4-45a7-b09b-1737235a7b12 tempest-ServersNegativeTestJSON-1080286652 None] Volume 843d6fda-b12c-470a-8f8c-5d3bbce1dede: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-843d6fda-b12c-470a-8f8c-5d3bbce1dede', 'volume_size': 1} May 21 21:31:39.238727 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-053431e1-1ed4-45a7-b09b-1737235a7b12 tempest-ServersNegativeTestJSON-1080286652 None] creating volume 'volume-843d6fda-b12c-470a-8f8c-5d3bbce1dede' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:31:39.239448 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-053431e1-1ed4-45a7-b09b-1737235a7b12 tempest-ServersNegativeTestJSON-1080286652 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:31:40.082362 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-053431e1-1ed4-45a7-b09b-1737235a7b12 tempest-ServersNegativeTestJSON-1080286652 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:31:40.082733 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-053431e1-1ed4-45a7-b09b-1737235a7b12 tempest-ServersNegativeTestJSON-1080286652 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:31:40.086886 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-053431e1-1ed4-45a7-b09b-1737235a7b12 tempest-ServersNegativeTestJSON-1080286652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eba5ef7-ed41-4c28-81ef-654f2d9cb441) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-843d6fda-b12c-470a-8f8c-5d3bbce1dede', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:40.093907 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-053431e1-1ed4-45a7-b09b-1737235a7b12 tempest-ServersNegativeTestJSON-1080286652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff527c29-db47-421f-bf9d-ff3653a6937b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:40.099848 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:UPDATE=27,cinder:SELECT=57,cinder:INSERT=12,cinder:DELETE=4 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:31:40.200372 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-053431e1-1ed4-45a7-b09b-1737235a7b12 tempest-ServersNegativeTestJSON-1080286652 None] Volume volume-843d6fda-b12c-470a-8f8c-5d3bbce1dede (843d6fda-b12c-470a-8f8c-5d3bbce1dede): created successfully May 21 21:31:40.213204 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-053431e1-1ed4-45a7-b09b-1737235a7b12 tempest-ServersNegativeTestJSON-1080286652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff527c29-db47-421f-bf9d-ff3653a6937b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:40.224467 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-053431e1-1ed4-45a7-b09b-1737235a7b12 tempest-ServersNegativeTestJSON-1080286652 None] Flow 'volume_create_manager' (bb240a54-d3ac-44f2-a1c6-7ca15b1f67cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:31:40.321502 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-053431e1-1ed4-45a7-b09b-1737235a7b12 tempest-ServersNegativeTestJSON-1080286652 None] Created volume successfully. May 21 21:31:41.647832 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-495a143c-eba5-4e52-87f9-7b0b23e3de6f tempest-VolumesGetTest-1374660785 None] Created reservations ['b7026dd2-302b-4bb1-a200-2adec0851287', '5b86017d-4c51-43b8-b0bd-cb6aef9ea034', 'c49f4d49-f47f-4e6a-88ae-32a5b27989e3', 'dc2b4cd5-1b01-4c2b-aafa-ef3b974b5831'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:31:41.890894 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-495a143c-eba5-4e52-87f9-7b0b23e3de6f tempest-VolumesGetTest-1374660785 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:31:41.948011 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-495a143c-eba5-4e52-87f9-7b0b23e3de6f tempest-VolumesGetTest-1374660785 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:31:41.994424 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-495a143c-eba5-4e52-87f9-7b0b23e3de6f tempest-VolumesGetTest-1374660785 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:31:41.999822 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-495a143c-eba5-4e52-87f9-7b0b23e3de6f tempest-VolumesGetTest-1374660785 None] Deleted volume successfully. May 21 21:31:42.091337 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-495a143c-eba5-4e52-87f9-7b0b23e3de6f tempest-VolumesGetTest-1374660785 None] Lock "b'cinder-9969cd84-b135-4a0a-bb9d-3b3d02b54562-delete_volume'" released by "delete_volume" :: held 3.990s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:31:42.703615 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-9f783964-366a-4fac-a240-a95061235884 tempest-VolumesGetTest-1374660785 None] Lock "b'cinder-562255cd-e9ae-4f0b-be0a-f6a490eea0a6-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:31:42.818585 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-9f783964-366a-4fac-a240-a95061235884 tempest-VolumesGetTest-1374660785 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:31:43.012758 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-9f783964-366a-4fac-a240-a95061235884 tempest-VolumesGetTest-1374660785 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:31:43.016348 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-9f783964-366a-4fac-a240-a95061235884 tempest-VolumesGetTest-1374660785 None] Volume volume-562255cd-e9ae-4f0b-be0a-f6a490eea0a6 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:31:43.151067 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-9f783964-366a-4fac-a240-a95061235884 tempest-VolumesGetTest-1374660785 None] deleting rbd volume volume-562255cd-e9ae-4f0b-be0a-f6a490eea0a6 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:31:45.884220 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-9f783964-366a-4fac-a240-a95061235884 tempest-VolumesGetTest-1374660785 None] Created reservations ['036f7f80-6203-4cb7-a38e-da9923c5bd3d', '97fe6c27-07b9-4b8c-a66d-3af579fb3df1', '6a7bf89f-dbe7-45ff-8012-21df266812d5', 'bf83c289-b1c1-4235-8988-0f540a58f742'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:31:46.164946 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-9f783964-366a-4fac-a240-a95061235884 tempest-VolumesGetTest-1374660785 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:31:46.223477 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-9f783964-366a-4fac-a240-a95061235884 tempest-VolumesGetTest-1374660785 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:31:46.296650 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-9f783964-366a-4fac-a240-a95061235884 tempest-VolumesGetTest-1374660785 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:31:46.302931 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-9f783964-366a-4fac-a240-a95061235884 tempest-VolumesGetTest-1374660785 None] Deleted volume successfully. May 21 21:31:46.413640 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-9f783964-366a-4fac-a240-a95061235884 tempest-VolumesGetTest-1374660785 None] Lock "b'cinder-562255cd-e9ae-4f0b-be0a-f6a490eea0a6-delete_volume'" released by "delete_volume" :: held 3.705s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:31:47.457225 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:31:47.458122 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:31:47.560954 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:31:47.640257 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:31:47.650534 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-55fc5d80-9c9d-4a60-b305-c08598afa753 tempest-VolumesGetTest-1374660785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:31:47.678495 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-55fc5d80-9c9d-4a60-b305-c08598afa753 tempest-VolumesGetTest-1374660785 None] Flow 'volume_create_manager' (e99c8bd9-a196-4bc8-9ddb-e5b16df2b21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:31:47.687991 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-55fc5d80-9c9d-4a60-b305-c08598afa753 tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c985deef-146a-4d40-83df-3c2f037091ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:47.694366 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=55,cinder:UPDATE=37,cinder:DELETE=3,cinder:INSERT=5 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:31:47.707421 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-55fc5d80-9c9d-4a60-b305-c08598afa753 tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c985deef-146a-4d40-83df-3c2f037091ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2114271015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0e50bcd1-cd33-4bfc-932b-ee69599ece68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b839655bdad144ffac8d9efc51f89b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:31:47Z,use_quota=True,user_id='738d894cbd8044cb86afbac450c704d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:47.712848 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-55fc5d80-9c9d-4a60-b305-c08598afa753 tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7bd724a-8259-4b2d-bef1-2597627bef2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:47.718044 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-55fc5d80-9c9d-4a60-b305-c08598afa753 tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7bd724a-8259-4b2d-bef1-2597627bef2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:47.727682 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-55fc5d80-9c9d-4a60-b305-c08598afa753 tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9badcfa-c53e-4d51-96f3-39a45b066c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:47.728065 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-55fc5d80-9c9d-4a60-b305-c08598afa753 tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9badcfa-c53e-4d51-96f3-39a45b066c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e50bcd1-cd33-4bfc-932b-ee69599ece68', 'volume_name': 'volume-0e50bcd1-cd33-4bfc-932b-ee69599ece68', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:47.733448 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-55fc5d80-9c9d-4a60-b305-c08598afa753 tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (928bce83-f21a-46cf-a1e7-df42bff2163f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:47.738240 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-55fc5d80-9c9d-4a60-b305-c08598afa753 tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (928bce83-f21a-46cf-a1e7-df42bff2163f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:47.744650 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-55fc5d80-9c9d-4a60-b305-c08598afa753 tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ec72789-77dc-476d-9fd5-8f213557c9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:47.746824 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-55fc5d80-9c9d-4a60-b305-c08598afa753 tempest-VolumesGetTest-1374660785 None] Volume 0e50bcd1-cd33-4bfc-932b-ee69599ece68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e50bcd1-cd33-4bfc-932b-ee69599ece68', 'volume_size': 1} May 21 21:31:47.747431 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-55fc5d80-9c9d-4a60-b305-c08598afa753 tempest-VolumesGetTest-1374660785 None] creating volume 'volume-0e50bcd1-cd33-4bfc-932b-ee69599ece68' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:31:47.748516 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-55fc5d80-9c9d-4a60-b305-c08598afa753 tempest-VolumesGetTest-1374660785 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:31:48.293389 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-55fc5d80-9c9d-4a60-b305-c08598afa753 tempest-VolumesGetTest-1374660785 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:31:48.294980 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-55fc5d80-9c9d-4a60-b305-c08598afa753 tempest-VolumesGetTest-1374660785 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:31:48.301961 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-55fc5d80-9c9d-4a60-b305-c08598afa753 tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ec72789-77dc-476d-9fd5-8f213557c9e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e50bcd1-cd33-4bfc-932b-ee69599ece68', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:48.310085 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-55fc5d80-9c9d-4a60-b305-c08598afa753 tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca8da498-4319-48d1-b7d4-dab48f627b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:48.406840 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-55fc5d80-9c9d-4a60-b305-c08598afa753 tempest-VolumesGetTest-1374660785 None] Volume volume-0e50bcd1-cd33-4bfc-932b-ee69599ece68 (0e50bcd1-cd33-4bfc-932b-ee69599ece68): created successfully May 21 21:31:48.411110 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-55fc5d80-9c9d-4a60-b305-c08598afa753 tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca8da498-4319-48d1-b7d4-dab48f627b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:48.417078 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-55fc5d80-9c9d-4a60-b305-c08598afa753 tempest-VolumesGetTest-1374660785 None] Flow 'volume_create_manager' (e99c8bd9-a196-4bc8-9ddb-e5b16df2b21b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:31:48.502087 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-55fc5d80-9c9d-4a60-b305-c08598afa753 tempest-VolumesGetTest-1374660785 None] Created volume successfully. May 21 21:31:50.559453 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7e38773-880b-4a15-8ced-2035b1c4570c tempest-VolumesGetTest-1374660785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:31:50.622352 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b7e38773-880b-4a15-8ced-2035b1c4570c tempest-VolumesGetTest-1374660785 None] Flow 'volume_create_manager' (f9ade097-bd46-4739-bd29-68614beb3b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:31:50.622352 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b7e38773-880b-4a15-8ced-2035b1c4570c tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b09b052-d69d-4f6e-a56d-37fb73a5cca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:50.661948 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b7e38773-880b-4a15-8ced-2035b1c4570c tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b09b052-d69d-4f6e-a56d-37fb73a5cca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:31:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1428371460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=68201205-6bc5-4490-9823-86dcad33a47e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b839655bdad144ffac8d9efc51f89b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:31:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=0e50bcd1-cd33-4bfc-932b-ee69599ece68,status='creating',terminated_at=None,updated_at=2022-05-21T21:31:50Z,use_quota=True,user_id='738d894cbd8044cb86afbac450c704d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:50.669504 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b7e38773-880b-4a15-8ced-2035b1c4570c tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1553dde9-478b-447b-82c3-efa907123438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:50.673630 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b7e38773-880b-4a15-8ced-2035b1c4570c tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1553dde9-478b-447b-82c3-efa907123438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:50.692440 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b7e38773-880b-4a15-8ced-2035b1c4570c tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97b4a851-afd5-4ecb-9ec7-1fc87a3e2b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:50.712680 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b7e38773-880b-4a15-8ced-2035b1c4570c tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97b4a851-afd5-4ecb-9ec7-1fc87a3e2b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '68201205-6bc5-4490-9823-86dcad33a47e', 'volume_name': 'volume-68201205-6bc5-4490-9823-86dcad33a47e', 'volume_size': 1, 'source_volid': '0e50bcd1-cd33-4bfc-932b-ee69599ece68', 'source_volstatus': 'available'}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:50.719717 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b7e38773-880b-4a15-8ced-2035b1c4570c tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cf97d10-362d-4a03-be5b-83ba34ba252c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:50.724500 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b7e38773-880b-4a15-8ced-2035b1c4570c tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cf97d10-362d-4a03-be5b-83ba34ba252c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:50.730220 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b7e38773-880b-4a15-8ced-2035b1c4570c tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c4c0b6e-e958-4011-b4fe-2834507e7d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:50.731719 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-b7e38773-880b-4a15-8ced-2035b1c4570c tempest-VolumesGetTest-1374660785 None] Volume 68201205-6bc5-4490-9823-86dcad33a47e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-68201205-6bc5-4490-9823-86dcad33a47e', 'volume_size': 1, 'source_volid': '0e50bcd1-cd33-4bfc-932b-ee69599ece68', 'source_volstatus': 'available'} May 21 21:31:50.744807 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b7e38773-880b-4a15-8ced-2035b1c4570c tempest-VolumesGetTest-1374660785 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:31:50.927195 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b7e38773-880b-4a15-8ced-2035b1c4570c tempest-VolumesGetTest-1374660785 None] creating snapshot='volume-68201205-6bc5-4490-9823-86dcad33a47e.clone_snap' {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 21 21:31:52.854543 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b7e38773-880b-4a15-8ced-2035b1c4570c tempest-VolumesGetTest-1374660785 None] cloning 'volume-0e50bcd1-cd33-4bfc-932b-ee69599ece68@volume-68201205-6bc5-4490-9823-86dcad33a47e.clone_snap' to 'volume-68201205-6bc5-4490-9823-86dcad33a47e' {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:789}} May 21 21:31:53.021839 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b43908b-4bb7-44e6-be2d-f74181e0c0ab tempest-AttachVolumeTestJSON-105426157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:31:53.041273 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-2b43908b-4bb7-44e6-be2d-f74181e0c0ab tempest-AttachVolumeTestJSON-105426157 None] Flow 'volume_create_manager' (ae45d502-9c46-47af-a771-1452e7a7a483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:31:53.048848 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-2b43908b-4bb7-44e6-be2d-f74181e0c0ab tempest-AttachVolumeTestJSON-105426157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9449d8a4-20bc-42e6-b86e-a4ca00023d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:53.067947 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-2b43908b-4bb7-44e6-be2d-f74181e0c0ab tempest-AttachVolumeTestJSON-105426157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9449d8a4-20bc-42e6-b86e-a4ca00023d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:31:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-422514739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8d62796e-2b52-4323-9da6-17210b1a2dfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbeaf54409d44d0abe3cd6c176fa7ea4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:31:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:31:52Z,use_quota=True,user_id='66b6501f7543485db27a33dd1a1a8400',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:53.073916 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-2b43908b-4bb7-44e6-be2d-f74181e0c0ab tempest-AttachVolumeTestJSON-105426157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70d51778-dbb8-4efc-bf22-2be2258bfb36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:53.078406 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-2b43908b-4bb7-44e6-be2d-f74181e0c0ab tempest-AttachVolumeTestJSON-105426157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70d51778-dbb8-4efc-bf22-2be2258bfb36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:53.086401 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-2b43908b-4bb7-44e6-be2d-f74181e0c0ab tempest-AttachVolumeTestJSON-105426157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f86fc6b-6939-4881-b1c5-595bfe5e81aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:53.088640 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-2b43908b-4bb7-44e6-be2d-f74181e0c0ab tempest-AttachVolumeTestJSON-105426157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f86fc6b-6939-4881-b1c5-595bfe5e81aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d62796e-2b52-4323-9da6-17210b1a2dfc', 'volume_name': 'volume-8d62796e-2b52-4323-9da6-17210b1a2dfc', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:53.094956 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-2b43908b-4bb7-44e6-be2d-f74181e0c0ab tempest-AttachVolumeTestJSON-105426157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d097b528-0118-4490-beae-a8d84d457c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:53.099405 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-2b43908b-4bb7-44e6-be2d-f74181e0c0ab tempest-AttachVolumeTestJSON-105426157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d097b528-0118-4490-beae-a8d84d457c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:53.104947 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-2b43908b-4bb7-44e6-be2d-f74181e0c0ab tempest-AttachVolumeTestJSON-105426157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c90de275-a475-4c48-8827-38d421d59cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:53.107066 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-2b43908b-4bb7-44e6-be2d-f74181e0c0ab tempest-AttachVolumeTestJSON-105426157 None] Volume 8d62796e-2b52-4323-9da6-17210b1a2dfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d62796e-2b52-4323-9da6-17210b1a2dfc', 'volume_size': 1} May 21 21:31:53.107638 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-2b43908b-4bb7-44e6-be2d-f74181e0c0ab tempest-AttachVolumeTestJSON-105426157 None] creating volume 'volume-8d62796e-2b52-4323-9da6-17210b1a2dfc' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:31:53.108494 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-2b43908b-4bb7-44e6-be2d-f74181e0c0ab tempest-AttachVolumeTestJSON-105426157 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:31:54.077612 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-2b43908b-4bb7-44e6-be2d-f74181e0c0ab tempest-AttachVolumeTestJSON-105426157 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:31:54.078179 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-2b43908b-4bb7-44e6-be2d-f74181e0c0ab tempest-AttachVolumeTestJSON-105426157 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:31:54.083320 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-2b43908b-4bb7-44e6-be2d-f74181e0c0ab tempest-AttachVolumeTestJSON-105426157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c90de275-a475-4c48-8827-38d421d59cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d62796e-2b52-4323-9da6-17210b1a2dfc', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:54.088227 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-2b43908b-4bb7-44e6-be2d-f74181e0c0ab tempest-AttachVolumeTestJSON-105426157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdb5f7b5-2e12-408c-881d-37e51192b908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:54.224252 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-2b43908b-4bb7-44e6-be2d-f74181e0c0ab tempest-AttachVolumeTestJSON-105426157 None] Volume volume-8d62796e-2b52-4323-9da6-17210b1a2dfc (8d62796e-2b52-4323-9da6-17210b1a2dfc): created successfully May 21 21:31:54.230389 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-2b43908b-4bb7-44e6-be2d-f74181e0c0ab tempest-AttachVolumeTestJSON-105426157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdb5f7b5-2e12-408c-881d-37e51192b908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:54.242470 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-2b43908b-4bb7-44e6-be2d-f74181e0c0ab tempest-AttachVolumeTestJSON-105426157 None] Flow 'volume_create_manager' (ae45d502-9c46-47af-a771-1452e7a7a483) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:31:54.412365 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-2b43908b-4bb7-44e6-be2d-f74181e0c0ab tempest-AttachVolumeTestJSON-105426157 None] Created volume successfully. May 21 21:31:54.433501 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b7e38773-880b-4a15-8ced-2035b1c4570c tempest-VolumesGetTest-1374660785 None] Volume volume-0e50bcd1-cd33-4bfc-932b-ee69599ece68 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:31:54.436104 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b7e38773-880b-4a15-8ced-2035b1c4570c tempest-VolumesGetTest-1374660785 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:31:54.436884 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b7e38773-880b-4a15-8ced-2035b1c4570c tempest-VolumesGetTest-1374660785 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:31:54.729963 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b7e38773-880b-4a15-8ced-2035b1c4570c tempest-VolumesGetTest-1374660785 None] clone created successfully {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:862}} May 21 21:31:54.732080 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b7e38773-880b-4a15-8ced-2035b1c4570c tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c4c0b6e-e958-4011-b4fe-2834507e7d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68201205-6bc5-4490-9823-86dcad33a47e', 'volume_size': 1, 'source_volid': '0e50bcd1-cd33-4bfc-932b-ee69599ece68', 'source_volstatus': 'available'}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:54.738947 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b7e38773-880b-4a15-8ced-2035b1c4570c tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbef5f29-d1c1-473b-9a6f-521529a751c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:54.868143 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-b7e38773-880b-4a15-8ced-2035b1c4570c tempest-VolumesGetTest-1374660785 None] Volume volume-68201205-6bc5-4490-9823-86dcad33a47e (68201205-6bc5-4490-9823-86dcad33a47e): created successfully May 21 21:31:54.904295 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b7e38773-880b-4a15-8ced-2035b1c4570c tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbef5f29-d1c1-473b-9a6f-521529a751c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:54.939135 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b7e38773-880b-4a15-8ced-2035b1c4570c tempest-VolumesGetTest-1374660785 None] Flow 'volume_create_manager' (f9ade097-bd46-4739-bd29-68614beb3b0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:31:55.049921 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-b7e38773-880b-4a15-8ced-2035b1c4570c tempest-VolumesGetTest-1374660785 None] Created volume successfully. May 21 21:31:55.878649 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-a4f2619b-e5b4-46f1-a202-a4a298be942a req-ea217442-ea7e-4468-b79a-690ed8dfd093 tempest-AttachVolumeTestJSON-105426157 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:31:57.009873 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-a4f2619b-e5b4-46f1-a202-a4a298be942a req-ea217442-ea7e-4468-b79a-690ed8dfd093 tempest-AttachVolumeTestJSON-105426157 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.130s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:31:57.013535 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-a4f2619b-e5b4-46f1-a202-a4a298be942a req-ea217442-ea7e-4468-b79a-690ed8dfd093 tempest-AttachVolumeTestJSON-105426157 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-8d62796e-2b52-4323-9da6-17210b1a2dfc', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'efef91cd-d8f8-4d93-9ad2-86d0b33251f4', 'volume_id': '8d62796e-2b52-4323-9da6-17210b1a2dfc', 'discard': True}} {{(pid=124407) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} May 21 21:31:57.198625 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-a4f2619b-e5b4-46f1-a202-a4a298be942a req-ea217442-ea7e-4468-b79a-690ed8dfd093 tempest-AttachVolumeTestJSON-105426157 None] Connection info returned from driver {'name': 'volumes/volume-8d62796e-2b52-4323-9da6-17210b1a2dfc', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '8d62796e-2b52-4323-9da6-17210b1a2dfc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '5b235408-a21a-40bd-984e-82a8ac2dce4f'} {{(pid=124407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4826}} May 21 21:31:57.366970 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-a4f2619b-e5b4-46f1-a202-a4a298be942a req-ea217442-ea7e-4468-b79a-690ed8dfd093 tempest-AttachVolumeTestJSON-105426157 None] attachment_update completed successfully. May 21 21:31:57.569681 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-60243adc-2a5d-45f7-aacd-836864993c82 tempest-VolumesGetTest-1374660785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:31:57.642107 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-60243adc-2a5d-45f7-aacd-836864993c82 tempest-VolumesGetTest-1374660785 None] Flow 'volume_create_manager' (10315811-ddf2-4cb1-a37b-0f9234d782c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:31:57.662070 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-60243adc-2a5d-45f7-aacd-836864993c82 tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3128c8aa-31b9-450f-9edf-a40c2c620ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:57.700619 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-60243adc-2a5d-45f7-aacd-836864993c82 tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3128c8aa-31b9-450f-9edf-a40c2c620ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:31:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-725337682',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8e4a26e4-509f-4883-bef1-94d31cca7c07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b839655bdad144ffac8d9efc51f89b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:31:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:31:57Z,use_quota=True,user_id='738d894cbd8044cb86afbac450c704d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:57.708253 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-60243adc-2a5d-45f7-aacd-836864993c82 tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc392778-869f-4045-aaa8-595a8523c813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:57.714374 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-60243adc-2a5d-45f7-aacd-836864993c82 tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc392778-869f-4045-aaa8-595a8523c813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:57.720494 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-60243adc-2a5d-45f7-aacd-836864993c82 tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57c785f3-e593-4afc-86d2-5cad00af6573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:57.725677 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-60243adc-2a5d-45f7-aacd-836864993c82 tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57c785f3-e593-4afc-86d2-5cad00af6573) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e4a26e4-509f-4883-bef1-94d31cca7c07', 'volume_name': 'volume-8e4a26e4-509f-4883-bef1-94d31cca7c07', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:57.737811 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-60243adc-2a5d-45f7-aacd-836864993c82 tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79fda63f-20ed-4921-a17c-4d9b43ac8510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:57.752975 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-60243adc-2a5d-45f7-aacd-836864993c82 tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79fda63f-20ed-4921-a17c-4d9b43ac8510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:57.758323 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-60243adc-2a5d-45f7-aacd-836864993c82 tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23f2f1d9-422c-49fc-9f5e-deb3bf57b44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:57.759654 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-60243adc-2a5d-45f7-aacd-836864993c82 tempest-VolumesGetTest-1374660785 None] Volume 8e4a26e4-509f-4883-bef1-94d31cca7c07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e4a26e4-509f-4883-bef1-94d31cca7c07', 'volume_size': 1} May 21 21:31:57.760229 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-60243adc-2a5d-45f7-aacd-836864993c82 tempest-VolumesGetTest-1374660785 None] creating volume 'volume-8e4a26e4-509f-4883-bef1-94d31cca7c07' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:31:57.761237 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-60243adc-2a5d-45f7-aacd-836864993c82 tempest-VolumesGetTest-1374660785 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:31:58.426625 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-60243adc-2a5d-45f7-aacd-836864993c82 tempest-VolumesGetTest-1374660785 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:31:58.427964 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-60243adc-2a5d-45f7-aacd-836864993c82 tempest-VolumesGetTest-1374660785 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:31:58.433305 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-60243adc-2a5d-45f7-aacd-836864993c82 tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23f2f1d9-422c-49fc-9f5e-deb3bf57b44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e4a26e4-509f-4883-bef1-94d31cca7c07', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:58.438942 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-60243adc-2a5d-45f7-aacd-836864993c82 tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa515f25-35d3-4284-b3f7-4be9342bd914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:31:58.518110 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-60243adc-2a5d-45f7-aacd-836864993c82 tempest-VolumesGetTest-1374660785 None] Volume volume-8e4a26e4-509f-4883-bef1-94d31cca7c07 (8e4a26e4-509f-4883-bef1-94d31cca7c07): created successfully May 21 21:31:58.523134 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-60243adc-2a5d-45f7-aacd-836864993c82 tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa515f25-35d3-4284-b3f7-4be9342bd914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:31:58.533288 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-60243adc-2a5d-45f7-aacd-836864993c82 tempest-VolumesGetTest-1374660785 None] Flow 'volume_create_manager' (10315811-ddf2-4cb1-a37b-0f9234d782c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:31:58.663378 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-60243adc-2a5d-45f7-aacd-836864993c82 tempest-VolumesGetTest-1374660785 None] Created volume successfully. May 21 21:32:00.024432 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-26bd8c30-ac50-4992-96aa-606fb3e88c95 tempest-VolumesGetTest-1374660785 None] Lock "b'cinder-8e4a26e4-509f-4883-bef1-94d31cca7c07-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:32:00.200633 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-26bd8c30-ac50-4992-96aa-606fb3e88c95 tempest-VolumesGetTest-1374660785 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:32:00.512640 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-26bd8c30-ac50-4992-96aa-606fb3e88c95 tempest-VolumesGetTest-1374660785 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:32:00.513267 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-26bd8c30-ac50-4992-96aa-606fb3e88c95 tempest-VolumesGetTest-1374660785 None] Volume volume-8e4a26e4-509f-4883-bef1-94d31cca7c07 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:32:00.646885 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-26bd8c30-ac50-4992-96aa-606fb3e88c95 tempest-VolumesGetTest-1374660785 None] deleting rbd volume volume-8e4a26e4-509f-4883-bef1-94d31cca7c07 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:32:04.112766 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-26bd8c30-ac50-4992-96aa-606fb3e88c95 tempest-VolumesGetTest-1374660785 None] Created reservations ['20528b86-7b65-49d7-ab33-4927ff9c37b4', 'a8e4e7a2-2d27-425a-88b2-6e33cb6a25e7', '3b0e2c32-60eb-49b1-ae05-4bfbe20bd0c5', '1ebb372e-662e-498b-baa9-9f8218c1b6d3'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:32:04.320510 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=67,cinder:INSERT=4,cinder:UPDATE=25,cinder:DELETE=4 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:32:04.479463 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-26bd8c30-ac50-4992-96aa-606fb3e88c95 tempest-VolumesGetTest-1374660785 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:32:04.575184 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-26bd8c30-ac50-4992-96aa-606fb3e88c95 tempest-VolumesGetTest-1374660785 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:32:04.645512 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-26bd8c30-ac50-4992-96aa-606fb3e88c95 tempest-VolumesGetTest-1374660785 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:32:04.657566 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-26bd8c30-ac50-4992-96aa-606fb3e88c95 tempest-VolumesGetTest-1374660785 None] Deleted volume successfully. May 21 21:32:04.754979 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-0c4eb850-3631-4116-a63d-39eb881d7f10 tempest-VolumesGetTest-1374660785 None] Lock "b'cinder-68201205-6bc5-4490-9823-86dcad33a47e-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:32:04.821618 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-26bd8c30-ac50-4992-96aa-606fb3e88c95 tempest-VolumesGetTest-1374660785 None] Lock "b'cinder-8e4a26e4-509f-4883-bef1-94d31cca7c07-delete_volume'" released by "delete_volume" :: held 4.798s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:32:04.919537 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-0c4eb850-3631-4116-a63d-39eb881d7f10 tempest-VolumesGetTest-1374660785 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:32:05.101210 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-0c4eb850-3631-4116-a63d-39eb881d7f10 tempest-VolumesGetTest-1374660785 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:32:05.169756 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-0c4eb850-3631-4116-a63d-39eb881d7f10 tempest-VolumesGetTest-1374660785 None] deleting rbd volume volume-68201205-6bc5-4490-9823-86dcad33a47e {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:32:08.289841 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-0c4eb850-3631-4116-a63d-39eb881d7f10 tempest-VolumesGetTest-1374660785 None] volume is a clone so cleaning references {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1352}} May 21 21:32:08.452927 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-0c4eb850-3631-4116-a63d-39eb881d7f10 tempest-VolumesGetTest-1374660785 None] Volume volume-0e50bcd1-cd33-4bfc-932b-ee69599ece68 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:32:08.456838 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-0c4eb850-3631-4116-a63d-39eb881d7f10 tempest-VolumesGetTest-1374660785 None] deleting parent snapshot volume-68201205-6bc5-4490-9823-86dcad33a47e.clone_snap {{(pid=124407) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1243}} May 21 21:32:11.403352 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-810037b0-2019-4c20-80c4-38c5938267b5 tempest-GroupSnapshotsTest-448284547 None] Group tempest-GroupSnapshotsTest-Group-1905073525: creating May 21 21:32:11.524017 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-0c4eb850-3631-4116-a63d-39eb881d7f10 tempest-VolumesGetTest-1374660785 None] Created reservations ['26a924e8-876e-4aac-9d28-eab96fc1cfe3', '9ed2c89e-61a0-4d59-8821-35712236db1f', '23374934-feae-414e-847f-e3cbc49777ee', '55225284-2541-4de8-a6f3-535ecae5005e'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:32:11.631924 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-810037b0-2019-4c20-80c4-38c5938267b5 tempest-GroupSnapshotsTest-448284547 None] Group tempest-GroupSnapshotsTest-Group-1905073525: created successfully May 21 21:32:11.644106 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-810037b0-2019-4c20-80c4-38c5938267b5 tempest-GroupSnapshotsTest-448284547 None] Create group completed successfully. May 21 21:32:11.794829 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-0c4eb850-3631-4116-a63d-39eb881d7f10 tempest-VolumesGetTest-1374660785 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:32:11.891072 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-0c4eb850-3631-4116-a63d-39eb881d7f10 tempest-VolumesGetTest-1374660785 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:32:11.955028 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-0c4eb850-3631-4116-a63d-39eb881d7f10 tempest-VolumesGetTest-1374660785 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:32:11.960094 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-0c4eb850-3631-4116-a63d-39eb881d7f10 tempest-VolumesGetTest-1374660785 None] Deleted volume successfully. May 21 21:32:12.054881 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-0c4eb850-3631-4116-a63d-39eb881d7f10 tempest-VolumesGetTest-1374660785 None] Lock "b'cinder-68201205-6bc5-4490-9823-86dcad33a47e-delete_volume'" released by "delete_volume" :: held 7.300s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:32:13.698167 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-65ac6645-0b66-4049-b82a-cfe2208826ae tempest-VolumesGetTest-1374660785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:32:13.719337 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-65ac6645-0b66-4049-b82a-cfe2208826ae tempest-VolumesGetTest-1374660785 None] Flow 'volume_create_manager' (5691897e-32cc-4bbc-a176-7a2b8384f99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:32:13.727530 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-65ac6645-0b66-4049-b82a-cfe2208826ae tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24f0db1f-c1d4-4554-bbe3-ec093a5e5050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:32:13.748111 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-65ac6645-0b66-4049-b82a-cfe2208826ae tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24f0db1f-c1d4-4554-bbe3-ec093a5e5050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1619340480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3dfe5435-15ed-490a-93ef-4b0688394373,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b839655bdad144ffac8d9efc51f89b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:32:13Z,use_quota=True,user_id='738d894cbd8044cb86afbac450c704d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:32:13.754319 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-65ac6645-0b66-4049-b82a-cfe2208826ae tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c6251b7-0a0c-4cb1-8924-bc36cb7c4e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:32:13.759488 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-65ac6645-0b66-4049-b82a-cfe2208826ae tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c6251b7-0a0c-4cb1-8924-bc36cb7c4e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:32:13.764692 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-65ac6645-0b66-4049-b82a-cfe2208826ae tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fc5d672-dbd9-4bf7-a2af-11f8af490112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:32:13.865951 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-65ac6645-0b66-4049-b82a-cfe2208826ae tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fc5d672-dbd9-4bf7-a2af-11f8af490112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3dfe5435-15ed-490a-93ef-4b0688394373', 'volume_name': 'volume-3dfe5435-15ed-490a-93ef-4b0688394373', 'volume_size': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5593f8cb452404083dfa177b4ee68b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'created_at': datetime.datetime(2022, 5, 21, 21, 0, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:32:13.872815 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-65ac6645-0b66-4049-b82a-cfe2208826ae tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (166f47e5-eba3-46e3-9248-5f54cdb06b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:32:13.876766 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-65ac6645-0b66-4049-b82a-cfe2208826ae tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (166f47e5-eba3-46e3-9248-5f54cdb06b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:32:13.881733 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-65ac6645-0b66-4049-b82a-cfe2208826ae tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d563a38-e8c1-4c30-84f7-cb1f06e4513e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:32:13.883033 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-65ac6645-0b66-4049-b82a-cfe2208826ae tempest-VolumesGetTest-1374660785 None] Volume 3dfe5435-15ed-490a-93ef-4b0688394373: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3dfe5435-15ed-490a-93ef-4b0688394373', 'volume_size': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5593f8cb452404083dfa177b4ee68b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'created_at': datetime.datetime(2022, 5, 21, 21, 0, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } May 21 21:32:13.883823 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-65ac6645-0b66-4049-b82a-cfe2208826ae tempest-VolumesGetTest-1374660785 None] Cloning 3dfe5435-15ed-490a-93ef-4b0688394373 from image e570f5eb-6047-4214-a420-fdfdbdf19a4c at location (None, None). {{(pid=124407) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1053}} May 21 21:32:13.889845 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-d81c78f1-4045-42ba-91cb-818e021b7a3a tempest-GroupSnapshotsTest-448284547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:32:13.912775 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d81c78f1-4045-42ba-91cb-818e021b7a3a tempest-GroupSnapshotsTest-448284547 None] Flow 'volume_create_manager' (a773fcae-9126-4ab1-95c1-dc061630c5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:32:13.919747 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d81c78f1-4045-42ba-91cb-818e021b7a3a tempest-GroupSnapshotsTest-448284547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce62a3b9-eafa-4ca9-9e63-41cc5f876938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:32:13.944577 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d81c78f1-4045-42ba-91cb-818e021b7a3a tempest-GroupSnapshotsTest-448284547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce62a3b9-eafa-4ca9-9e63-41cc5f876938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1550031623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=44fc4c88-edfc-48ed-bf49-7f56673a0067,host='ncdv-master-1@ceph#ceph',id=15a798c7-107d-4206-a670-e7da3df319d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f7b1be2c0614c328c07dd9a6a073233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:32:14Z,use_quota=True,user_id='daaee62d4ee44dd0b1d096d367a41017',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c242878-ffcc-4c85-bf64-fa8e119e7e83),volume_type_id=3c242878-ffcc-4c85-bf64-fa8e119e7e83)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:32:13.950168 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d81c78f1-4045-42ba-91cb-818e021b7a3a tempest-GroupSnapshotsTest-448284547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9ed2c78-1185-4ab1-8ddf-796fe5080f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:32:13.955225 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d81c78f1-4045-42ba-91cb-818e021b7a3a tempest-GroupSnapshotsTest-448284547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9ed2c78-1185-4ab1-8ddf-796fe5080f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:32:13.960387 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d81c78f1-4045-42ba-91cb-818e021b7a3a tempest-GroupSnapshotsTest-448284547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06cd29e8-2e43-437f-b994-0c08fd2ef50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:32:13.965019 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d81c78f1-4045-42ba-91cb-818e021b7a3a tempest-GroupSnapshotsTest-448284547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06cd29e8-2e43-437f-b994-0c08fd2ef50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15a798c7-107d-4206-a670-e7da3df319d4', 'volume_name': 'volume-15a798c7-107d-4206-a670-e7da3df319d4', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:32:13.969934 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d81c78f1-4045-42ba-91cb-818e021b7a3a tempest-GroupSnapshotsTest-448284547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aebe4895-b0ca-4837-8aa6-eeeedb3686c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:32:13.973725 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d81c78f1-4045-42ba-91cb-818e021b7a3a tempest-GroupSnapshotsTest-448284547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aebe4895-b0ca-4837-8aa6-eeeedb3686c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:32:13.979185 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d81c78f1-4045-42ba-91cb-818e021b7a3a tempest-GroupSnapshotsTest-448284547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3d16fa1-4ecb-42fb-b0cf-8306111c25fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:32:13.980153 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-d81c78f1-4045-42ba-91cb-818e021b7a3a tempest-GroupSnapshotsTest-448284547 None] Volume 15a798c7-107d-4206-a670-e7da3df319d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15a798c7-107d-4206-a670-e7da3df319d4', 'volume_size': 1} May 21 21:32:13.980571 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d81c78f1-4045-42ba-91cb-818e021b7a3a tempest-GroupSnapshotsTest-448284547 None] creating volume 'volume-15a798c7-107d-4206-a670-e7da3df319d4' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:32:13.981334 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d81c78f1-4045-42ba-91cb-818e021b7a3a tempest-GroupSnapshotsTest-448284547 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:32:14.029491 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-65ac6645-0b66-4049-b82a-cfe2208826ae tempest-VolumesGetTest-1374660785 None] Lock "b'cinder-e570f5eb-6047-4214-a420-fdfdbdf19a4c'" acquired by "_prepare_image_cache_entry" :: waited 0.144s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:32:14.121984 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-65ac6645-0b66-4049-b82a-cfe2208826ae tempest-VolumesGetTest-1374660785 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'volume_id': '4057e637-23ba-493f-a45d-eb28c07ac60a', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28), 'last_used': datetime.datetime(2022, 5, 21, 21, 32, 14, 37357)}. {{(pid=124407) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 21 21:32:14.122403 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-65ac6645-0b66-4049-b82a-cfe2208826ae tempest-VolumesGetTest-1374660785 None] Image-volume cache entry image_update_at = 2022-05-21 21:00:28+00:00, requested image updated_at = 2022-05-21 21:00:28+00:00. {{(pid=124407) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 21 21:32:14.122808 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-65ac6645-0b66-4049-b82a-cfe2208826ae tempest-VolumesGetTest-1374660785 None] Found cache entry for image = e570f5eb-6047-4214-a420-fdfdbdf19a4c on host ncdv-master-1@ceph#ceph. {{(pid=124407) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:876}} May 21 21:32:14.134240 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-65ac6645-0b66-4049-b82a-cfe2208826ae tempest-VolumesGetTest-1374660785 None] Lock "b'cinder-e570f5eb-6047-4214-a420-fdfdbdf19a4c'" released by "_prepare_image_cache_entry" :: held 0.103s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:32:14.136161 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-65ac6645-0b66-4049-b82a-cfe2208826ae tempest-VolumesGetTest-1374660785 None] Attempting to retrieve cache entry for image = e570f5eb-6047-4214-a420-fdfdbdf19a4c on host ncdv-master-1@ceph#ceph. {{(pid=124407) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:817}} May 21 21:32:14.146979 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-65ac6645-0b66-4049-b82a-cfe2208826ae tempest-VolumesGetTest-1374660785 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'volume_id': '4057e637-23ba-493f-a45d-eb28c07ac60a', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28), 'last_used': datetime.datetime(2022, 5, 21, 21, 32, 14, 142047)}. {{(pid=124407) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 21 21:32:14.147916 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-65ac6645-0b66-4049-b82a-cfe2208826ae tempest-VolumesGetTest-1374660785 None] Image-volume cache entry image_update_at = 2022-05-21 21:00:28+00:00, requested image updated_at = 2022-05-21 21:00:28+00:00. {{(pid=124407) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 21 21:32:14.149018 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-65ac6645-0b66-4049-b82a-cfe2208826ae tempest-VolumesGetTest-1374660785 None] Creating from source image-volume 4057e637-23ba-493f-a45d-eb28c07ac60a {{(pid=124407) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:831}} May 21 21:32:14.164831 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-65ac6645-0b66-4049-b82a-cfe2208826ae tempest-VolumesGetTest-1374660785 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:32:14.472212 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-65ac6645-0b66-4049-b82a-cfe2208826ae tempest-VolumesGetTest-1374660785 None] creating snapshot='volume-3dfe5435-15ed-490a-93ef-4b0688394373.clone_snap' {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 21 21:32:15.960828 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-65ac6645-0b66-4049-b82a-cfe2208826ae tempest-VolumesGetTest-1374660785 None] cloning 'volume-4057e637-23ba-493f-a45d-eb28c07ac60a@volume-3dfe5435-15ed-490a-93ef-4b0688394373.clone_snap' to 'volume-3dfe5435-15ed-490a-93ef-4b0688394373' {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:789}} May 21 21:32:15.970867 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d81c78f1-4045-42ba-91cb-818e021b7a3a tempest-GroupSnapshotsTest-448284547 None] extra_specs: {} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:32:15.971453 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d81c78f1-4045-42ba-91cb-818e021b7a3a tempest-GroupSnapshotsTest-448284547 None] extra_specs: {} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:32:15.975625 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d81c78f1-4045-42ba-91cb-818e021b7a3a tempest-GroupSnapshotsTest-448284547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3d16fa1-4ecb-42fb-b0cf-8306111c25fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15a798c7-107d-4206-a670-e7da3df319d4', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:32:15.981804 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d81c78f1-4045-42ba-91cb-818e021b7a3a tempest-GroupSnapshotsTest-448284547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1381e295-0675-4859-8fa0-9b39b4b9cd9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:32:16.114749 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-d81c78f1-4045-42ba-91cb-818e021b7a3a tempest-GroupSnapshotsTest-448284547 None] Volume volume-15a798c7-107d-4206-a670-e7da3df319d4 (15a798c7-107d-4206-a670-e7da3df319d4): created successfully May 21 21:32:16.129552 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d81c78f1-4045-42ba-91cb-818e021b7a3a tempest-GroupSnapshotsTest-448284547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1381e295-0675-4859-8fa0-9b39b4b9cd9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:32:16.136254 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d81c78f1-4045-42ba-91cb-818e021b7a3a tempest-GroupSnapshotsTest-448284547 None] Flow 'volume_create_manager' (a773fcae-9126-4ab1-95c1-dc061630c5a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:32:16.245986 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-d81c78f1-4045-42ba-91cb-818e021b7a3a tempest-GroupSnapshotsTest-448284547 None] Created volume successfully. May 21 21:32:16.249396 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=61,cinder:UPDATE=31,cinder:DELETE=3,cinder:INSERT=5 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:32:16.891182 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-65ac6645-0b66-4049-b82a-cfe2208826ae tempest-VolumesGetTest-1374660785 None] Volume volume-b9ebacac-5f32-42e3-9194-003aee7e2435.deleted is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:32:16.893525 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-65ac6645-0b66-4049-b82a-cfe2208826ae tempest-VolumesGetTest-1374660785 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:32:16.894099 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-65ac6645-0b66-4049-b82a-cfe2208826ae tempest-VolumesGetTest-1374660785 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:32:17.199372 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-65ac6645-0b66-4049-b82a-cfe2208826ae tempest-VolumesGetTest-1374660785 None] clone created successfully {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:862}} May 21 21:32:17.200431 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.volume_utils [None req-65ac6645-0b66-4049-b82a-cfe2208826ae tempest-VolumesGetTest-1374660785 None] Marking volume 3dfe5435-15ed-490a-93ef-4b0688394373 as bootable. {{(pid=124407) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} May 21 21:32:17.318318 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-65ac6645-0b66-4049-b82a-cfe2208826ae tempest-VolumesGetTest-1374660785 None] Copying metadata from image e570f5eb-6047-4214-a420-fdfdbdf19a4c to 3dfe5435-15ed-490a-93ef-4b0688394373. {{(pid=124407) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} May 21 21:32:17.318824 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-65ac6645-0b66-4049-b82a-cfe2208826ae tempest-VolumesGetTest-1374660785 None] Creating volume glance metadata for volume 3dfe5435-15ed-490a-93ef-4b0688394373 backed by image e570f5eb-6047-4214-a420-fdfdbdf19a4c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=124407) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:673}} May 21 21:32:17.340632 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-8dabc995-64cf-4afb-a606-4f6c6c738026 tempest-GroupSnapshotsTest-448284547 None] GroupSnapshot c569199a-c7dc-44d4-bf2b-6d57a2460d5e: creating. May 21 21:32:17.399018 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8dabc995-64cf-4afb-a606-4f6c6c738026 tempest-GroupSnapshotsTest-448284547 None] Group snapshot c569199a-c7dc-44d4-bf2b-6d57a2460d5e: creating. {{(pid=124407) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4080}} May 21 21:32:17.428892 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8dabc995-64cf-4afb-a606-4f6c6c738026 tempest-GroupSnapshotsTest-448284547 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:32:17.796804 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-65ac6645-0b66-4049-b82a-cfe2208826ae tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d563a38-e8c1-4c30-84f7-cb1f06e4513e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dfe5435-15ed-490a-93ef-4b0688394373', 'volume_size': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5593f8cb452404083dfa177b4ee68b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'created_at': datetime.datetime(2022, 5, 21, 21, 0, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:32:17.801764 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-65ac6645-0b66-4049-b82a-cfe2208826ae tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed94a015-51bd-429e-9e81-6d64afd00e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:32:17.905706 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-65ac6645-0b66-4049-b82a-cfe2208826ae tempest-VolumesGetTest-1374660785 None] Volume volume-3dfe5435-15ed-490a-93ef-4b0688394373 (3dfe5435-15ed-490a-93ef-4b0688394373): created successfully May 21 21:32:17.909243 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-65ac6645-0b66-4049-b82a-cfe2208826ae tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed94a015-51bd-429e-9e81-6d64afd00e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:32:17.914546 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-65ac6645-0b66-4049-b82a-cfe2208826ae tempest-VolumesGetTest-1374660785 None] Flow 'volume_create_manager' (5691897e-32cc-4bbc-a176-7a2b8384f99f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:32:18.041935 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-65ac6645-0b66-4049-b82a-cfe2208826ae tempest-VolumesGetTest-1374660785 None] Created volume successfully. May 21 21:32:19.632399 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-8dabc995-64cf-4afb-a606-4f6c6c738026 tempest-GroupSnapshotsTest-448284547 None] group_snapshot c569199a-c7dc-44d4-bf2b-6d57a2460d5e: created successfully May 21 21:32:19.895824 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-507e60fc-65b1-4544-9a6c-1869b300bc2c tempest-VolumesGetTest-1374660785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:32:19.917825 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-507e60fc-65b1-4544-9a6c-1869b300bc2c tempest-VolumesGetTest-1374660785 None] Flow 'volume_create_manager' (2714afa8-b4d0-46cb-822c-e8f5087eb406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:32:19.927306 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-507e60fc-65b1-4544-9a6c-1869b300bc2c tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e322800f-173e-43fd-b101-53cc278738fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:32:19.971806 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-507e60fc-65b1-4544-9a6c-1869b300bc2c tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e322800f-173e-43fd-b101-53cc278738fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:32:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1243422737',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=aa33f06a-8d73-404d-98b1-5331dc22a31d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b839655bdad144ffac8d9efc51f89b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:32:20Z,use_quota=True,user_id='738d894cbd8044cb86afbac450c704d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:32:19.979254 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-507e60fc-65b1-4544-9a6c-1869b300bc2c tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb0bdd39-9bf5-4ee5-a818-8247d9b4cf5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:32:19.984806 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-507e60fc-65b1-4544-9a6c-1869b300bc2c tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb0bdd39-9bf5-4ee5-a818-8247d9b4cf5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:32:20.016605 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-507e60fc-65b1-4544-9a6c-1869b300bc2c tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b424ad5d-c00d-4a9c-859a-2e7923d7c8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:32:20.028635 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-507e60fc-65b1-4544-9a6c-1869b300bc2c tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b424ad5d-c00d-4a9c-859a-2e7923d7c8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa33f06a-8d73-404d-98b1-5331dc22a31d', 'volume_name': 'volume-aa33f06a-8d73-404d-98b1-5331dc22a31d', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:32:20.037041 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-507e60fc-65b1-4544-9a6c-1869b300bc2c tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51368c43-123b-47fd-91c5-e26defaa78f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:32:20.049290 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-507e60fc-65b1-4544-9a6c-1869b300bc2c tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51368c43-123b-47fd-91c5-e26defaa78f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:32:20.055627 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-507e60fc-65b1-4544-9a6c-1869b300bc2c tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0487117c-6a80-425f-b443-b8ab6982c756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:32:20.055627 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-507e60fc-65b1-4544-9a6c-1869b300bc2c tempest-VolumesGetTest-1374660785 None] Volume aa33f06a-8d73-404d-98b1-5331dc22a31d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa33f06a-8d73-404d-98b1-5331dc22a31d', 'volume_size': 1} May 21 21:32:20.055627 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-507e60fc-65b1-4544-9a6c-1869b300bc2c tempest-VolumesGetTest-1374660785 None] creating volume 'volume-aa33f06a-8d73-404d-98b1-5331dc22a31d' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:32:20.056770 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-507e60fc-65b1-4544-9a6c-1869b300bc2c tempest-VolumesGetTest-1374660785 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:32:20.674313 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-507e60fc-65b1-4544-9a6c-1869b300bc2c tempest-VolumesGetTest-1374660785 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:32:20.676426 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-507e60fc-65b1-4544-9a6c-1869b300bc2c tempest-VolumesGetTest-1374660785 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:32:20.695906 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-507e60fc-65b1-4544-9a6c-1869b300bc2c tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0487117c-6a80-425f-b443-b8ab6982c756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa33f06a-8d73-404d-98b1-5331dc22a31d', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:32:20.702943 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-507e60fc-65b1-4544-9a6c-1869b300bc2c tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (915a0fa2-2575-4d14-aaad-9d2929465bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:32:21.061453 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=70,cinder:INSERT=14,cinder:UPDATE=14,cinder:DELETE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:32:21.061453 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-2130ba0d-a2b9-4956-b348-8bf64300f6fe tempest-GroupSnapshotsTest-448284547 None] cloning volumes/volume-15a798c7-107d-4206-a670-e7da3df319d4@snapshot-459e3437-25bc-43f0-9e78-b93d026a6446 to volume-74e83ba2-a1e1-4efd-85bb-97bbfc9f5d5f {{(pid=124407) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1098}} May 21 21:32:21.061453 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-2130ba0d-a2b9-4956-b348-8bf64300f6fe tempest-GroupSnapshotsTest-448284547 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:32:21.061453 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-2130ba0d-a2b9-4956-b348-8bf64300f6fe tempest-GroupSnapshotsTest-448284547 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:32:21.061453 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-507e60fc-65b1-4544-9a6c-1869b300bc2c tempest-VolumesGetTest-1374660785 None] Volume volume-aa33f06a-8d73-404d-98b1-5331dc22a31d (aa33f06a-8d73-404d-98b1-5331dc22a31d): created successfully May 21 21:32:21.064795 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-507e60fc-65b1-4544-9a6c-1869b300bc2c tempest-VolumesGetTest-1374660785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (915a0fa2-2575-4d14-aaad-9d2929465bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:32:21.064795 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-507e60fc-65b1-4544-9a6c-1869b300bc2c tempest-VolumesGetTest-1374660785 None] Flow 'volume_create_manager' (2714afa8-b4d0-46cb-822c-e8f5087eb406) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:32:21.103744 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-507e60fc-65b1-4544-9a6c-1869b300bc2c tempest-VolumesGetTest-1374660785 None] Created volume successfully. May 21 21:32:22.100013 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-2130ba0d-a2b9-4956-b348-8bf64300f6fe tempest-GroupSnapshotsTest-448284547 None] extra_specs: {} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:32:22.100738 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-2130ba0d-a2b9-4956-b348-8bf64300f6fe tempest-GroupSnapshotsTest-448284547 None] extra_specs: {} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:32:22.107625 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-2130ba0d-a2b9-4956-b348-8bf64300f6fe tempest-GroupSnapshotsTest-448284547 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:32:22.184847 ncdv-master-1 cinder-volume[124407]: WARNING cinder.volume.drivers.rbd [None req-2130ba0d-a2b9-4956-b348-8bf64300f6fe tempest-GroupSnapshotsTest-448284547 None] Not using v2 clone API, please upgrade to mimic+ and set the OSD minimum client compat version to mimic for better performance, fewer deletion issues: NotImplementedError May 21 21:32:22.203438 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-ef0abb16-fc7b-4eb5-b061-b4822576b21b tempest-VolumesGetTest-1374660785 None] Lock "b'cinder-aa33f06a-8d73-404d-98b1-5331dc22a31d-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:32:22.308519 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ef0abb16-fc7b-4eb5-b061-b4822576b21b tempest-VolumesGetTest-1374660785 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:32:22.430559 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ef0abb16-fc7b-4eb5-b061-b4822576b21b tempest-VolumesGetTest-1374660785 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:32:22.431245 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ef0abb16-fc7b-4eb5-b061-b4822576b21b tempest-VolumesGetTest-1374660785 None] Volume volume-aa33f06a-8d73-404d-98b1-5331dc22a31d is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:32:22.551452 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ef0abb16-fc7b-4eb5-b061-b4822576b21b tempest-VolumesGetTest-1374660785 None] deleting rbd volume volume-aa33f06a-8d73-404d-98b1-5331dc22a31d {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:32:22.851857 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-2130ba0d-a2b9-4956-b348-8bf64300f6fe tempest-GroupSnapshotsTest-448284547 None] Create group from source-snapshot-c569199a-c7dc-44d4-bf2b-6d57a2460d5e completed successfully. May 21 21:32:23.695741 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-4cce82a7-b46d-4fa4-a79e-179690dc450e tempest-GroupSnapshotsTest-448284547 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:32:23.859166 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-4cce82a7-b46d-4fa4-a79e-179690dc450e tempest-GroupSnapshotsTest-448284547 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:32:24.249776 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-4cce82a7-b46d-4fa4-a79e-179690dc450e tempest-GroupSnapshotsTest-448284547 None] deleting rbd volume volume-74e83ba2-a1e1-4efd-85bb-97bbfc9f5d5f {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:32:27.414706 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-ef0abb16-fc7b-4eb5-b061-b4822576b21b tempest-VolumesGetTest-1374660785 None] Created reservations ['482345de-23ec-433e-afde-656f543f020e', '71aea476-9f02-4901-891c-adcf96a71cde', '68afeece-61c9-439e-aed3-55a18492eb58', '2b29b72b-fec5-4368-88e5-854d81b3d06e'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:32:27.679829 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ef0abb16-fc7b-4eb5-b061-b4822576b21b tempest-VolumesGetTest-1374660785 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:32:27.702524 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ef0abb16-fc7b-4eb5-b061-b4822576b21b tempest-VolumesGetTest-1374660785 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:32:27.749486 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-ef0abb16-fc7b-4eb5-b061-b4822576b21b tempest-VolumesGetTest-1374660785 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:32:27.753702 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-ef0abb16-fc7b-4eb5-b061-b4822576b21b tempest-VolumesGetTest-1374660785 None] Deleted volume successfully. May 21 21:32:27.829608 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-ef0abb16-fc7b-4eb5-b061-b4822576b21b tempest-VolumesGetTest-1374660785 None] Lock "b'cinder-aa33f06a-8d73-404d-98b1-5331dc22a31d-delete_volume'" released by "delete_volume" :: held 5.626s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:32:28.819923 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-7d2969c7-fff0-4cdc-875b-4d12aa53c10d tempest-VolumesGetTest-1374660785 None] Lock "b'cinder-3dfe5435-15ed-490a-93ef-4b0688394373-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:32:28.938534 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-7d2969c7-fff0-4cdc-875b-4d12aa53c10d tempest-VolumesGetTest-1374660785 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:32:29.087906 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-7d2969c7-fff0-4cdc-875b-4d12aa53c10d tempest-VolumesGetTest-1374660785 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:32:29.150014 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-7d2969c7-fff0-4cdc-875b-4d12aa53c10d tempest-VolumesGetTest-1374660785 None] deleting rbd volume volume-3dfe5435-15ed-490a-93ef-4b0688394373 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:32:29.299194 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-4cce82a7-b46d-4fa4-a79e-179690dc450e tempest-GroupSnapshotsTest-448284547 None] Created reservations ['a32a6cca-464e-4734-99f9-4321a1d80fea'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:32:29.317682 ncdv-master-1 cinder-volume[124407]: WARNING cinder.quota [None req-4cce82a7-b46d-4fa4-a79e-179690dc450e tempest-GroupSnapshotsTest-448284547 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1163695695 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1163695695, it is now deprecated. Please use the default quota class for default quota. May 21 21:32:29.318507 ncdv-master-1 cinder-volume[124407]: WARNING cinder.quota [None req-4cce82a7-b46d-4fa4-a79e-179690dc450e tempest-GroupSnapshotsTest-448284547 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1163695695 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1163695695, it is now deprecated. Please use the default quota class for default quota. May 21 21:32:29.420049 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-4cce82a7-b46d-4fa4-a79e-179690dc450e tempest-GroupSnapshotsTest-448284547 None] Created reservations ['68fc54f2-7634-4f24-85cc-d6e8116e0aaf', '15ffaa82-abe0-4021-b90f-0fc8c3d08b0f', '14b19db0-9c1a-4b59-91f2-266836762b34', '19203d17-52b5-4817-b895-aaf0edb83bb4'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:32:29.516755 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=72,cinder:UPDATE=23,cinder:DELETE=2,cinder:INSERT=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:32:29.827239 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-4cce82a7-b46d-4fa4-a79e-179690dc450e tempest-GroupSnapshotsTest-448284547 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:32:29.907480 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-4cce82a7-b46d-4fa4-a79e-179690dc450e tempest-GroupSnapshotsTest-448284547 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:32:29.967766 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-4cce82a7-b46d-4fa4-a79e-179690dc450e tempest-GroupSnapshotsTest-448284547 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:32:29.972874 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-4cce82a7-b46d-4fa4-a79e-179690dc450e tempest-GroupSnapshotsTest-448284547 None] Delete group completed successfully. May 21 21:32:30.451730 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-b6e6cca4-a12f-436d-b721-373ec9f2117f tempest-GroupSnapshotsTest-448284547 None] group_snapshot c569199a-c7dc-44d4-bf2b-6d57a2460d5e: deleting May 21 21:32:30.487145 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b6e6cca4-a12f-436d-b721-373ec9f2117f tempest-GroupSnapshotsTest-448284547 None] group_snapshot c569199a-c7dc-44d4-bf2b-6d57a2460d5e: deleting {{(pid=124407) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4255}} May 21 21:32:30.511588 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b6e6cca4-a12f-436d-b721-373ec9f2117f tempest-GroupSnapshotsTest-448284547 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:32:31.629655 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-b60ba2a7-5094-4b5f-90f2-4e0de1cec76c req-4b3fde4a-dac9-43cf-9c04-71fecc212372 tempest-ServerRescueNegativeTestJSON-1981617934 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:32:32.558565 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-b60ba2a7-5094-4b5f-90f2-4e0de1cec76c req-4b3fde4a-dac9-43cf-9c04-71fecc212372 tempest-ServerRescueNegativeTestJSON-1981617934 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.929s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:32:32.559442 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-b60ba2a7-5094-4b5f-90f2-4e0de1cec76c req-4b3fde4a-dac9-43cf-9c04-71fecc212372 tempest-ServerRescueNegativeTestJSON-1981617934 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b0b1920b-8151-4e90-ac66-f993da5e7e8e', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'efef91cd-d8f8-4d93-9ad2-86d0b33251f4', 'volume_id': 'b0b1920b-8151-4e90-ac66-f993da5e7e8e', 'discard': True}} {{(pid=124407) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} May 21 21:32:32.639740 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-b60ba2a7-5094-4b5f-90f2-4e0de1cec76c req-4b3fde4a-dac9-43cf-9c04-71fecc212372 tempest-ServerRescueNegativeTestJSON-1981617934 None] Connection info returned from driver {'name': 'volumes/volume-b0b1920b-8151-4e90-ac66-f993da5e7e8e', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'b0b1920b-8151-4e90-ac66-f993da5e7e8e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ba7db391-a8c7-4f5f-9c18-1f98e431e05f'} {{(pid=124407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4826}} May 21 21:32:32.771067 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-b60ba2a7-5094-4b5f-90f2-4e0de1cec76c req-4b3fde4a-dac9-43cf-9c04-71fecc212372 tempest-ServerRescueNegativeTestJSON-1981617934 None] attachment_update completed successfully. May 21 21:32:33.013382 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-7d2969c7-fff0-4cdc-875b-4d12aa53c10d tempest-VolumesGetTest-1374660785 None] volume is a clone so cleaning references {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1352}} May 21 21:32:33.101500 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-7d2969c7-fff0-4cdc-875b-4d12aa53c10d tempest-VolumesGetTest-1374660785 None] deleting parent snapshot volume-3dfe5435-15ed-490a-93ef-4b0688394373.clone_snap {{(pid=124407) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1243}} May 21 21:32:35.859571 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-7d2969c7-fff0-4cdc-875b-4d12aa53c10d tempest-VolumesGetTest-1374660785 None] Created reservations ['11210716-2bab-41eb-b004-c58b3d9a8edd', '05f813ab-762c-4179-a23f-e9776ade31ad', '64bf378d-fc54-4975-a8be-7ce55ae5fb09', '05a552d9-578f-459b-8306-29f3966f2d00'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:32:36.142221 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=61,cinder:INSERT=7,cinder:UPDATE=32 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:32:36.174782 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-7d2969c7-fff0-4cdc-875b-4d12aa53c10d tempest-VolumesGetTest-1374660785 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:32:36.239028 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-7d2969c7-fff0-4cdc-875b-4d12aa53c10d tempest-VolumesGetTest-1374660785 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:32:36.300811 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-7d2969c7-fff0-4cdc-875b-4d12aa53c10d tempest-VolumesGetTest-1374660785 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:32:36.316101 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-7d2969c7-fff0-4cdc-875b-4d12aa53c10d tempest-VolumesGetTest-1374660785 None] Deleted volume successfully. May 21 21:32:36.333764 ncdv-master-1 cinder-volume[124407]: WARNING cinder.quota [None req-b6e6cca4-a12f-436d-b721-373ec9f2117f tempest-GroupSnapshotsTest-448284547 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1163695695 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1163695695, it is now deprecated. Please use the default quota class for default quota. May 21 21:32:36.436811 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-7d2969c7-fff0-4cdc-875b-4d12aa53c10d tempest-VolumesGetTest-1374660785 None] Lock "b'cinder-3dfe5435-15ed-490a-93ef-4b0688394373-delete_volume'" released by "delete_volume" :: held 7.617s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:32:36.459440 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-b6e6cca4-a12f-436d-b721-373ec9f2117f tempest-GroupSnapshotsTest-448284547 None] Created reservations ['771fcf60-2823-415c-8f3b-d6a9b4e13ffd', '17ec7118-ce2a-4cf2-8c02-69dfc174f7cb', '7c06a47a-08ca-4ee1-bb09-4aabdcde4e3a', '3c82fd65-642c-47a2-9a7e-8ffe9fe194e2'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:32:36.739496 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-442ab69f-e8ec-4114-9de9-f5b4d3124f49 tempest-VolumesGetTest-1374660785 None] Lock "b'cinder-0e50bcd1-cd33-4bfc-932b-ee69599ece68-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:32:36.820067 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-b6e6cca4-a12f-436d-b721-373ec9f2117f tempest-GroupSnapshotsTest-448284547 None] group_snapshot c569199a-c7dc-44d4-bf2b-6d57a2460d5e: deleted successfully May 21 21:32:36.850108 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-442ab69f-e8ec-4114-9de9-f5b4d3124f49 tempest-VolumesGetTest-1374660785 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:32:37.016697 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-442ab69f-e8ec-4114-9de9-f5b4d3124f49 tempest-VolumesGetTest-1374660785 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:32:37.017367 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-442ab69f-e8ec-4114-9de9-f5b4d3124f49 tempest-VolumesGetTest-1374660785 None] Volume volume-0e50bcd1-cd33-4bfc-932b-ee69599ece68 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:32:37.085318 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-442ab69f-e8ec-4114-9de9-f5b4d3124f49 tempest-VolumesGetTest-1374660785 None] deleting rbd volume volume-0e50bcd1-cd33-4bfc-932b-ee69599ece68 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:32:37.495462 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-35fcbfea-028e-4338-9349-a90edf3c8e95 tempest-GroupSnapshotsTest-448284547 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:32:37.942644 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-35fcbfea-028e-4338-9349-a90edf3c8e95 tempest-GroupSnapshotsTest-448284547 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:32:37.943065 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-35fcbfea-028e-4338-9349-a90edf3c8e95 tempest-GroupSnapshotsTest-448284547 None] Volume volume-15a798c7-107d-4206-a670-e7da3df319d4 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:32:38.067866 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-35fcbfea-028e-4338-9349-a90edf3c8e95 tempest-GroupSnapshotsTest-448284547 None] deleting rbd volume volume-15a798c7-107d-4206-a670-e7da3df319d4 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:32:42.987777 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-442ab69f-e8ec-4114-9de9-f5b4d3124f49 tempest-VolumesGetTest-1374660785 None] Created reservations ['bb508696-2994-4d13-8c7d-14f43a60131b', '5a6f79b9-24c4-4869-a09e-dd2faa99f096', 'af4b752c-0ceb-460f-ac71-2f3a027a0960', '216e4a73-4cbe-453a-a054-54635468e3f9'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:32:43.109727 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=63,cinder:UPDATE=28,cinder:INSERT=8,cinder:DELETE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:32:43.197319 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-442ab69f-e8ec-4114-9de9-f5b4d3124f49 tempest-VolumesGetTest-1374660785 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:32:43.280311 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-442ab69f-e8ec-4114-9de9-f5b4d3124f49 tempest-VolumesGetTest-1374660785 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:32:43.355212 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-442ab69f-e8ec-4114-9de9-f5b4d3124f49 tempest-VolumesGetTest-1374660785 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:32:43.370933 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-442ab69f-e8ec-4114-9de9-f5b4d3124f49 tempest-VolumesGetTest-1374660785 None] Deleted volume successfully. May 21 21:32:43.517954 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-442ab69f-e8ec-4114-9de9-f5b4d3124f49 tempest-VolumesGetTest-1374660785 None] Lock "b'cinder-0e50bcd1-cd33-4bfc-932b-ee69599ece68-delete_volume'" released by "delete_volume" :: held 6.778s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:32:43.709981 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-35fcbfea-028e-4338-9349-a90edf3c8e95 tempest-GroupSnapshotsTest-448284547 None] Created reservations ['52a37613-9edb-43cc-9e2d-e907f814dcec'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:32:43.755063 ncdv-master-1 cinder-volume[124407]: WARNING cinder.db.sqlalchemy.api [None req-35fcbfea-028e-4338-9349-a90edf3c8e95 tempest-GroupSnapshotsTest-448284547 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1163695695'] May 21 21:32:43.833301 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-35fcbfea-028e-4338-9349-a90edf3c8e95 tempest-GroupSnapshotsTest-448284547 None] Created reservations ['92bf519a-8aa9-4d57-8a6a-47c74e397834', '25103f70-75e4-4458-aed7-0fa203cfca6f', '14105887-b5f7-4dda-9b1a-ba4e11968323', '9aa5a899-2307-4491-92f4-97c52e52d2ba'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:32:44.240637 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-35fcbfea-028e-4338-9349-a90edf3c8e95 tempest-GroupSnapshotsTest-448284547 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:32:44.305780 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-35fcbfea-028e-4338-9349-a90edf3c8e95 tempest-GroupSnapshotsTest-448284547 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:32:44.447124 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-35fcbfea-028e-4338-9349-a90edf3c8e95 tempest-GroupSnapshotsTest-448284547 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:32:44.452636 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-35fcbfea-028e-4338-9349-a90edf3c8e95 tempest-GroupSnapshotsTest-448284547 None] Delete group completed successfully. May 21 21:32:46.349138 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-8fd3507d-0484-4e23-a236-2c394dd07afd tempest-GroupSnapshotsTest-448284547 None] Group tempest-GroupSnapshotsTest-Group-1767457034: creating May 21 21:32:46.429150 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-8fd3507d-0484-4e23-a236-2c394dd07afd tempest-GroupSnapshotsTest-448284547 None] Group tempest-GroupSnapshotsTest-Group-1767457034: created successfully May 21 21:32:46.439923 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-8fd3507d-0484-4e23-a236-2c394dd07afd tempest-GroupSnapshotsTest-448284547 None] Create group completed successfully. May 21 21:32:47.457052 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:32:47.459251 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:32:47.526143 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:32:47.592425 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:32:47.611690 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-28aeb8ef-85d7-41ee-ad5c-45a1cf1db772 req-eefa14fc-317f-418a-a89a-bb39ca22ac00 tempest-AttachVolumeTestJSON-105426157 None] Terminate volume connection completed successfully. May 21 21:32:47.612102 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-28aeb8ef-85d7-41ee-ad5c-45a1cf1db772 req-eefa14fc-317f-418a-a89a-bb39ca22ac00 tempest-AttachVolumeTestJSON-105426157 None] Deleting attachment 5b235408-a21a-40bd-984e-82a8ac2dce4f. {{(pid=124407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4957}} May 21 21:32:48.520780 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-1be2eccd-6d88-4a66-9047-309f7a82e1a6 tempest-GroupSnapshotsTest-448284547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:32:48.559729 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-1be2eccd-6d88-4a66-9047-309f7a82e1a6 tempest-GroupSnapshotsTest-448284547 None] Flow 'volume_create_manager' (22c56b46-5b7e-447c-abc9-61852185abe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:32:48.566814 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-1be2eccd-6d88-4a66-9047-309f7a82e1a6 tempest-GroupSnapshotsTest-448284547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ec2fe5d-623d-455e-a9d5-6af68c1c826e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:32:48.585527 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-1be2eccd-6d88-4a66-9047-309f7a82e1a6 tempest-GroupSnapshotsTest-448284547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ec2fe5d-623d-455e-a9d5-6af68c1c826e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-964177741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=529d6892-9753-4c94-b0ba-98a29fa1c515,host='ncdv-master-1@ceph#ceph',id=70bfc472-83ce-4485-bd5f-9de268ddfa42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f7b1be2c0614c328c07dd9a6a073233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:32:48Z,use_quota=True,user_id='daaee62d4ee44dd0b1d096d367a41017',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee5cb71e-f5e1-4c32-80b9-848323435842),volume_type_id=ee5cb71e-f5e1-4c32-80b9-848323435842)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:32:48.591509 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-1be2eccd-6d88-4a66-9047-309f7a82e1a6 tempest-GroupSnapshotsTest-448284547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfcef270-489d-4447-8207-c5777dff9a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:32:48.595947 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-1be2eccd-6d88-4a66-9047-309f7a82e1a6 tempest-GroupSnapshotsTest-448284547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfcef270-489d-4447-8207-c5777dff9a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:32:48.601111 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-1be2eccd-6d88-4a66-9047-309f7a82e1a6 tempest-GroupSnapshotsTest-448284547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a150b37e-4c65-4ba8-9f09-e510369d4925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:32:48.606083 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-1be2eccd-6d88-4a66-9047-309f7a82e1a6 tempest-GroupSnapshotsTest-448284547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a150b37e-4c65-4ba8-9f09-e510369d4925) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70bfc472-83ce-4485-bd5f-9de268ddfa42', 'volume_name': 'volume-70bfc472-83ce-4485-bd5f-9de268ddfa42', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:32:48.611390 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-1be2eccd-6d88-4a66-9047-309f7a82e1a6 tempest-GroupSnapshotsTest-448284547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cdeb17e-1cc9-422d-9c4b-e1bc1ee31108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:32:48.615601 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-1be2eccd-6d88-4a66-9047-309f7a82e1a6 tempest-GroupSnapshotsTest-448284547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cdeb17e-1cc9-422d-9c4b-e1bc1ee31108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:32:48.622215 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-1be2eccd-6d88-4a66-9047-309f7a82e1a6 tempest-GroupSnapshotsTest-448284547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a4f3118-3e2a-40b2-960e-c191bb2f83dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:32:48.623799 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-1be2eccd-6d88-4a66-9047-309f7a82e1a6 tempest-GroupSnapshotsTest-448284547 None] Volume 70bfc472-83ce-4485-bd5f-9de268ddfa42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70bfc472-83ce-4485-bd5f-9de268ddfa42', 'volume_size': 1} May 21 21:32:48.624421 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-1be2eccd-6d88-4a66-9047-309f7a82e1a6 tempest-GroupSnapshotsTest-448284547 None] creating volume 'volume-70bfc472-83ce-4485-bd5f-9de268ddfa42' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:32:48.626571 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-1be2eccd-6d88-4a66-9047-309f7a82e1a6 tempest-GroupSnapshotsTest-448284547 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:32:49.182704 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-1be2eccd-6d88-4a66-9047-309f7a82e1a6 tempest-GroupSnapshotsTest-448284547 None] extra_specs: {} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:32:49.183435 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-1be2eccd-6d88-4a66-9047-309f7a82e1a6 tempest-GroupSnapshotsTest-448284547 None] extra_specs: {} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:32:49.187199 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-1be2eccd-6d88-4a66-9047-309f7a82e1a6 tempest-GroupSnapshotsTest-448284547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a4f3118-3e2a-40b2-960e-c191bb2f83dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70bfc472-83ce-4485-bd5f-9de268ddfa42', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:32:49.192672 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-1be2eccd-6d88-4a66-9047-309f7a82e1a6 tempest-GroupSnapshotsTest-448284547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71f6c827-4a18-465f-a584-3a12ae0254c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:32:49.252202 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-1be2eccd-6d88-4a66-9047-309f7a82e1a6 tempest-GroupSnapshotsTest-448284547 None] Volume volume-70bfc472-83ce-4485-bd5f-9de268ddfa42 (70bfc472-83ce-4485-bd5f-9de268ddfa42): created successfully May 21 21:32:49.260664 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-1be2eccd-6d88-4a66-9047-309f7a82e1a6 tempest-GroupSnapshotsTest-448284547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71f6c827-4a18-465f-a584-3a12ae0254c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:32:49.268963 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-1be2eccd-6d88-4a66-9047-309f7a82e1a6 tempest-GroupSnapshotsTest-448284547 None] Flow 'volume_create_manager' (22c56b46-5b7e-447c-abc9-61852185abe6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:32:49.412904 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-1be2eccd-6d88-4a66-9047-309f7a82e1a6 tempest-GroupSnapshotsTest-448284547 None] Created volume successfully. May 21 21:32:50.320553 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-39d8b8d7-fae5-4c7e-9f3c-b145cd058ca0 tempest-GroupSnapshotsTest-448284547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:32:50.341613 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-39d8b8d7-fae5-4c7e-9f3c-b145cd058ca0 tempest-GroupSnapshotsTest-448284547 None] Flow 'volume_create_manager' (e0381b2b-6945-45a8-a4d6-2e13cc60a795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:32:50.347678 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-39d8b8d7-fae5-4c7e-9f3c-b145cd058ca0 tempest-GroupSnapshotsTest-448284547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a9e0a21-4fc4-4f71-92f7-720c936f9b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:32:50.364055 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-39d8b8d7-fae5-4c7e-9f3c-b145cd058ca0 tempest-GroupSnapshotsTest-448284547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a9e0a21-4fc4-4f71-92f7-720c936f9b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:32:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1600670129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=529d6892-9753-4c94-b0ba-98a29fa1c515,host='ncdv-master-1@ceph#ceph',id=5524754a-f3d6-473b-87b2-2133bc91a534,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f7b1be2c0614c328c07dd9a6a073233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:32:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:32:50Z,use_quota=True,user_id='daaee62d4ee44dd0b1d096d367a41017',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee5cb71e-f5e1-4c32-80b9-848323435842),volume_type_id=ee5cb71e-f5e1-4c32-80b9-848323435842)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:32:50.369612 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-39d8b8d7-fae5-4c7e-9f3c-b145cd058ca0 tempest-GroupSnapshotsTest-448284547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c14d840-ef46-44c7-88e0-1ff71365174c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:32:50.372969 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-39d8b8d7-fae5-4c7e-9f3c-b145cd058ca0 tempest-GroupSnapshotsTest-448284547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c14d840-ef46-44c7-88e0-1ff71365174c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:32:50.377962 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-39d8b8d7-fae5-4c7e-9f3c-b145cd058ca0 tempest-GroupSnapshotsTest-448284547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e93cd44-1e44-4611-baa2-5fe8038e3d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:32:50.381945 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-39d8b8d7-fae5-4c7e-9f3c-b145cd058ca0 tempest-GroupSnapshotsTest-448284547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e93cd44-1e44-4611-baa2-5fe8038e3d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5524754a-f3d6-473b-87b2-2133bc91a534', 'volume_name': 'volume-5524754a-f3d6-473b-87b2-2133bc91a534', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:32:50.387431 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-39d8b8d7-fae5-4c7e-9f3c-b145cd058ca0 tempest-GroupSnapshotsTest-448284547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15c8f479-0451-416e-9589-da5138850673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:32:50.393323 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-39d8b8d7-fae5-4c7e-9f3c-b145cd058ca0 tempest-GroupSnapshotsTest-448284547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15c8f479-0451-416e-9589-da5138850673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:32:50.396116 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-39d8b8d7-fae5-4c7e-9f3c-b145cd058ca0 tempest-GroupSnapshotsTest-448284547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d13814c-8afa-4b96-a24b-97990022e98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:32:50.397308 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-39d8b8d7-fae5-4c7e-9f3c-b145cd058ca0 tempest-GroupSnapshotsTest-448284547 None] Volume 5524754a-f3d6-473b-87b2-2133bc91a534: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5524754a-f3d6-473b-87b2-2133bc91a534', 'volume_size': 1} May 21 21:32:50.397672 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-39d8b8d7-fae5-4c7e-9f3c-b145cd058ca0 tempest-GroupSnapshotsTest-448284547 None] creating volume 'volume-5524754a-f3d6-473b-87b2-2133bc91a534' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:32:50.398581 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-39d8b8d7-fae5-4c7e-9f3c-b145cd058ca0 tempest-GroupSnapshotsTest-448284547 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:32:51.044928 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-39d8b8d7-fae5-4c7e-9f3c-b145cd058ca0 tempest-GroupSnapshotsTest-448284547 None] extra_specs: {} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:32:51.046114 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-39d8b8d7-fae5-4c7e-9f3c-b145cd058ca0 tempest-GroupSnapshotsTest-448284547 None] extra_specs: {} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:32:51.050097 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-39d8b8d7-fae5-4c7e-9f3c-b145cd058ca0 tempest-GroupSnapshotsTest-448284547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d13814c-8afa-4b96-a24b-97990022e98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5524754a-f3d6-473b-87b2-2133bc91a534', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:32:51.054752 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-39d8b8d7-fae5-4c7e-9f3c-b145cd058ca0 tempest-GroupSnapshotsTest-448284547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef4e62d-4214-4a5c-ad98-acab6f5b6717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:32:51.190318 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-39d8b8d7-fae5-4c7e-9f3c-b145cd058ca0 tempest-GroupSnapshotsTest-448284547 None] Volume volume-5524754a-f3d6-473b-87b2-2133bc91a534 (5524754a-f3d6-473b-87b2-2133bc91a534): created successfully May 21 21:32:51.194584 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-39d8b8d7-fae5-4c7e-9f3c-b145cd058ca0 tempest-GroupSnapshotsTest-448284547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef4e62d-4214-4a5c-ad98-acab6f5b6717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:32:51.200870 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-39d8b8d7-fae5-4c7e-9f3c-b145cd058ca0 tempest-GroupSnapshotsTest-448284547 None] Flow 'volume_create_manager' (e0381b2b-6945-45a8-a4d6-2e13cc60a795) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:32:51.269903 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-39d8b8d7-fae5-4c7e-9f3c-b145cd058ca0 tempest-GroupSnapshotsTest-448284547 None] Created volume successfully. May 21 21:32:51.282010 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=54,cinder:INSERT=8,cinder:UPDATE=35,cinder:DELETE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:32:52.668649 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-58d57590-d851-4b48-ad50-7338f9373466 tempest-GroupSnapshotsTest-448284547 None] Update group completed successfully. May 21 21:32:53.867512 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-8d82d92b-d164-4ccd-a10f-fba9f0025c65 tempest-GroupSnapshotsTest-448284547 None] Update group completed successfully. May 21 21:32:55.154296 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-e49c924e-3181-4e80-8f48-de18b026054b tempest-GroupSnapshotsTest-448284547 None] Update group completed successfully. May 21 21:32:56.409747 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-bb3cabff-fdf4-40f0-8628-a986f8b59c09 tempest-GroupSnapshotsTest-448284547 None] Update group completed successfully. May 21 21:32:58.270100 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-83ed45cc-081a-48d8-9266-67d342473e5b tempest-GroupSnapshotsTest-448284547 None] GroupSnapshot 07a9e3a6-bb4d-4496-8b37-58b51b433ef0: creating. May 21 21:32:58.292734 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-83ed45cc-081a-48d8-9266-67d342473e5b tempest-GroupSnapshotsTest-448284547 None] Group snapshot 07a9e3a6-bb4d-4496-8b37-58b51b433ef0: creating. {{(pid=124407) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4080}} May 21 21:32:58.319052 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-83ed45cc-081a-48d8-9266-67d342473e5b tempest-GroupSnapshotsTest-448284547 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:32:59.883005 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-83ed45cc-081a-48d8-9266-67d342473e5b tempest-GroupSnapshotsTest-448284547 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:33:03.063315 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-83ed45cc-081a-48d8-9266-67d342473e5b tempest-GroupSnapshotsTest-448284547 None] group_snapshot 07a9e3a6-bb4d-4496-8b37-58b51b433ef0: created successfully May 21 21:33:03.796688 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-d706801a-f1bc-4ae8-b4f1-79db3715a9ef tempest-AttachVolumeShelveTestJSON-418539187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:33:03.824942 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d706801a-f1bc-4ae8-b4f1-79db3715a9ef tempest-AttachVolumeShelveTestJSON-418539187 None] Flow 'volume_create_manager' (a28d87f3-e224-470a-8d00-1b40aff35b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:33:03.833142 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d706801a-f1bc-4ae8-b4f1-79db3715a9ef tempest-AttachVolumeShelveTestJSON-418539187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b682246a-ea34-493a-b8a8-42e3de960d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:33:03.872405 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d706801a-f1bc-4ae8-b4f1-79db3715a9ef tempest-AttachVolumeShelveTestJSON-418539187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b682246a-ea34-493a-b8a8-42e3de960d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:33:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1035599299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=fc38d82a-c55c-417b-ad9e-028de27fde5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28972bcc37da4f9188ffca6bd1a9a3b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:33:04Z,use_quota=True,user_id='b29c0c0fb03c46838f3efe58b16c68d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:33:03.881708 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d706801a-f1bc-4ae8-b4f1-79db3715a9ef tempest-AttachVolumeShelveTestJSON-418539187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c55de10-aea8-4e22-8609-a029f8116e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:33:03.890940 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d706801a-f1bc-4ae8-b4f1-79db3715a9ef tempest-AttachVolumeShelveTestJSON-418539187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c55de10-aea8-4e22-8609-a029f8116e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:33:03.899310 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d706801a-f1bc-4ae8-b4f1-79db3715a9ef tempest-AttachVolumeShelveTestJSON-418539187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce3d5e32-d13b-48cd-86b8-94ec00f8f515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:33:03.907240 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d706801a-f1bc-4ae8-b4f1-79db3715a9ef tempest-AttachVolumeShelveTestJSON-418539187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce3d5e32-d13b-48cd-86b8-94ec00f8f515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc38d82a-c55c-417b-ad9e-028de27fde5a', 'volume_name': 'volume-fc38d82a-c55c-417b-ad9e-028de27fde5a', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:33:03.936614 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d706801a-f1bc-4ae8-b4f1-79db3715a9ef tempest-AttachVolumeShelveTestJSON-418539187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be268a54-fcd5-4470-9a1e-f003ced2cb9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:33:03.947877 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d706801a-f1bc-4ae8-b4f1-79db3715a9ef tempest-AttachVolumeShelveTestJSON-418539187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be268a54-fcd5-4470-9a1e-f003ced2cb9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:33:03.957966 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d706801a-f1bc-4ae8-b4f1-79db3715a9ef tempest-AttachVolumeShelveTestJSON-418539187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4be61683-8ce7-4faf-8585-93e120549d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:33:03.959442 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-d706801a-f1bc-4ae8-b4f1-79db3715a9ef tempest-AttachVolumeShelveTestJSON-418539187 None] Volume fc38d82a-c55c-417b-ad9e-028de27fde5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc38d82a-c55c-417b-ad9e-028de27fde5a', 'volume_size': 1} May 21 21:33:03.960033 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d706801a-f1bc-4ae8-b4f1-79db3715a9ef tempest-AttachVolumeShelveTestJSON-418539187 None] creating volume 'volume-fc38d82a-c55c-417b-ad9e-028de27fde5a' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:33:03.960925 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d706801a-f1bc-4ae8-b4f1-79db3715a9ef tempest-AttachVolumeShelveTestJSON-418539187 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:33:04.078231 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-1d764e85-a731-4e4e-b950-2a739cf31858 tempest-GroupSnapshotsTest-448284547 None] group_snapshot 07a9e3a6-bb4d-4496-8b37-58b51b433ef0: deleting May 21 21:33:04.105329 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-1d764e85-a731-4e4e-b950-2a739cf31858 tempest-GroupSnapshotsTest-448284547 None] group_snapshot 07a9e3a6-bb4d-4496-8b37-58b51b433ef0: deleting {{(pid=124407) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4255}} May 21 21:33:04.127786 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-1d764e85-a731-4e4e-b950-2a739cf31858 tempest-GroupSnapshotsTest-448284547 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:33:04.712110 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d706801a-f1bc-4ae8-b4f1-79db3715a9ef tempest-AttachVolumeShelveTestJSON-418539187 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:33:04.712110 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d706801a-f1bc-4ae8-b4f1-79db3715a9ef tempest-AttachVolumeShelveTestJSON-418539187 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:33:04.715043 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d706801a-f1bc-4ae8-b4f1-79db3715a9ef tempest-AttachVolumeShelveTestJSON-418539187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4be61683-8ce7-4faf-8585-93e120549d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc38d82a-c55c-417b-ad9e-028de27fde5a', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:33:04.728078 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d706801a-f1bc-4ae8-b4f1-79db3715a9ef tempest-AttachVolumeShelveTestJSON-418539187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54e75f10-9fbc-4aa9-81ee-35bece488ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:33:04.832272 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-d706801a-f1bc-4ae8-b4f1-79db3715a9ef tempest-AttachVolumeShelveTestJSON-418539187 None] Volume volume-fc38d82a-c55c-417b-ad9e-028de27fde5a (fc38d82a-c55c-417b-ad9e-028de27fde5a): created successfully May 21 21:33:04.836008 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d706801a-f1bc-4ae8-b4f1-79db3715a9ef tempest-AttachVolumeShelveTestJSON-418539187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54e75f10-9fbc-4aa9-81ee-35bece488ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:33:04.842266 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d706801a-f1bc-4ae8-b4f1-79db3715a9ef tempest-AttachVolumeShelveTestJSON-418539187 None] Flow 'volume_create_manager' (a28d87f3-e224-470a-8d00-1b40aff35b2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:33:05.206566 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-d706801a-f1bc-4ae8-b4f1-79db3715a9ef tempest-AttachVolumeShelveTestJSON-418539187 None] Created volume successfully. May 21 21:33:07.684049 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-1d764e85-a731-4e4e-b950-2a739cf31858 tempest-GroupSnapshotsTest-448284547 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:33:11.848115 ncdv-master-1 cinder-volume[124407]: WARNING cinder.quota [None req-1d764e85-a731-4e4e-b950-2a739cf31858 tempest-GroupSnapshotsTest-448284547 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-227564091 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-227564091, it is now deprecated. Please use the default quota class for default quota. May 21 21:33:11.849115 ncdv-master-1 cinder-volume[124407]: WARNING cinder.quota [None req-1d764e85-a731-4e4e-b950-2a739cf31858 tempest-GroupSnapshotsTest-448284547 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-227564091 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-227564091, it is now deprecated. Please use the default quota class for default quota. May 21 21:33:11.957623 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-1d764e85-a731-4e4e-b950-2a739cf31858 tempest-GroupSnapshotsTest-448284547 None] Created reservations ['cc5cf0b5-9e49-4082-ab67-105857eda4c2', 'ebdbad93-5e7a-4300-80a3-ef7033b65de9', '2cd4ae91-763b-4325-ae37-c637bea46f6f', '0094e56c-a706-4396-bcdc-d25f9700876d'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:33:12.364516 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-1d764e85-a731-4e4e-b950-2a739cf31858 tempest-GroupSnapshotsTest-448284547 None] Created reservations ['425a387b-2de2-4358-9f8f-6f170e5fa2b6', 'a519f631-494b-4b8f-aa6a-3b74233ca579', 'd5677ca6-b5f3-4c7b-a5a1-b4b5d7b7ffa2', '675c880d-a9ae-4774-84de-15002059e0e7'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:33:12.490818 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=76,cinder:UPDATE=20,cinder:DELETE=1,cinder:INSERT=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:33:12.498826 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=74,cinder:UPDATE=21,cinder:INSERT=5 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:33:12.661350 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-1d764e85-a731-4e4e-b950-2a739cf31858 tempest-GroupSnapshotsTest-448284547 None] group_snapshot 07a9e3a6-bb4d-4496-8b37-58b51b433ef0: deleted successfully May 21 21:33:13.218860 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-7585bd92-bd2a-4911-927a-23ea6d3e8a4a tempest-GroupSnapshotsTest-448284547 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:33:13.403461 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-7585bd92-bd2a-4911-927a-23ea6d3e8a4a tempest-GroupSnapshotsTest-448284547 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:33:13.404400 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-7585bd92-bd2a-4911-927a-23ea6d3e8a4a tempest-GroupSnapshotsTest-448284547 None] Volume volume-5524754a-f3d6-473b-87b2-2133bc91a534 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:33:13.495351 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-7585bd92-bd2a-4911-927a-23ea6d3e8a4a tempest-GroupSnapshotsTest-448284547 None] deleting rbd volume volume-5524754a-f3d6-473b-87b2-2133bc91a534 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:33:16.257496 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-7585bd92-bd2a-4911-927a-23ea6d3e8a4a tempest-GroupSnapshotsTest-448284547 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:33:16.345612 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-7585bd92-bd2a-4911-927a-23ea6d3e8a4a tempest-GroupSnapshotsTest-448284547 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:33:16.346353 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-7585bd92-bd2a-4911-927a-23ea6d3e8a4a tempest-GroupSnapshotsTest-448284547 None] Volume volume-70bfc472-83ce-4485-bd5f-9de268ddfa42 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:33:16.421456 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-7585bd92-bd2a-4911-927a-23ea6d3e8a4a tempest-GroupSnapshotsTest-448284547 None] deleting rbd volume volume-70bfc472-83ce-4485-bd5f-9de268ddfa42 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:33:20.280368 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-7585bd92-bd2a-4911-927a-23ea6d3e8a4a tempest-GroupSnapshotsTest-448284547 None] Created reservations ['dd0538a3-0e00-4502-aaaf-f9c1c72b17a7'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:33:20.307476 ncdv-master-1 cinder-volume[124407]: WARNING cinder.quota [None req-7585bd92-bd2a-4911-927a-23ea6d3e8a4a tempest-GroupSnapshotsTest-448284547 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-227564091 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-227564091, it is now deprecated. Please use the default quota class for default quota. May 21 21:33:20.439079 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-7585bd92-bd2a-4911-927a-23ea6d3e8a4a tempest-GroupSnapshotsTest-448284547 None] Created reservations ['838b1176-5709-44cd-b3d6-267a7b0ac5e4', '0e112563-2393-45b0-906e-540173b176ab', '9994a7a3-3927-4413-a02e-51be9b661416', 'bdc34d0a-7710-4554-8e0a-38c2dc19afe7'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:33:20.800354 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-7585bd92-bd2a-4911-927a-23ea6d3e8a4a tempest-GroupSnapshotsTest-448284547 None] Created reservations ['90355ee1-dd18-4b03-a8b2-e6031c9ad599', '173f7977-ded1-4b72-8cb2-ca590811b54b', '680ea1d9-5475-4024-b5b5-3f646e7cf508', '9ce1a88d-416c-45b1-82aa-b0b352080763'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:33:21.257906 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-7585bd92-bd2a-4911-927a-23ea6d3e8a4a tempest-GroupSnapshotsTest-448284547 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:33:21.290274 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-7585bd92-bd2a-4911-927a-23ea6d3e8a4a tempest-GroupSnapshotsTest-448284547 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:33:21.315600 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-7585bd92-bd2a-4911-927a-23ea6d3e8a4a tempest-GroupSnapshotsTest-448284547 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:33:21.324698 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-7585bd92-bd2a-4911-927a-23ea6d3e8a4a tempest-GroupSnapshotsTest-448284547 None] Delete group completed successfully. May 21 21:33:23.110273 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-8a32b7a3-4b95-48f2-a982-073b5856cd67 tempest-GroupSnapshotsTest-448284547 None] Group tempest-GroupSnapshotsTest-Group-2078598380: creating May 21 21:33:23.192963 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-8a32b7a3-4b95-48f2-a982-073b5856cd67 tempest-GroupSnapshotsTest-448284547 None] Group tempest-GroupSnapshotsTest-Group-2078598380: created successfully May 21 21:33:23.206691 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-8a32b7a3-4b95-48f2-a982-073b5856cd67 tempest-GroupSnapshotsTest-448284547 None] Create group completed successfully. May 21 21:33:25.629953 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-32416712-3dbc-467b-a545-ab17f8ee8898 tempest-GroupSnapshotsTest-448284547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:33:25.690657 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-32416712-3dbc-467b-a545-ab17f8ee8898 tempest-GroupSnapshotsTest-448284547 None] Flow 'volume_create_manager' (f566141c-e9ba-4309-b6cb-754152c2d9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:33:25.700341 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-32416712-3dbc-467b-a545-ab17f8ee8898 tempest-GroupSnapshotsTest-448284547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c9ac722-01d2-47cc-9de1-246ac6cdc49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:33:25.742309 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-32416712-3dbc-467b-a545-ab17f8ee8898 tempest-GroupSnapshotsTest-448284547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c9ac722-01d2-47cc-9de1-246ac6cdc49b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-547332985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e3a81e96-6e9b-4ccb-8ac9-dc029eda0d62,host='ncdv-master-1@ceph#ceph',id=76b8cdd4-662a-4857-9290-571bf2ce173e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f7b1be2c0614c328c07dd9a6a073233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:33:25Z,use_quota=True,user_id='daaee62d4ee44dd0b1d096d367a41017',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57034e52-4808-44aa-b7e9-d9c8cb642ce1),volume_type_id=57034e52-4808-44aa-b7e9-d9c8cb642ce1)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:33:25.754530 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-32416712-3dbc-467b-a545-ab17f8ee8898 tempest-GroupSnapshotsTest-448284547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6550603e-7489-42de-8bc9-29b8391c48b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:33:25.775014 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-32416712-3dbc-467b-a545-ab17f8ee8898 tempest-GroupSnapshotsTest-448284547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6550603e-7489-42de-8bc9-29b8391c48b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:33:25.779466 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-32416712-3dbc-467b-a545-ab17f8ee8898 tempest-GroupSnapshotsTest-448284547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a363ab03-e741-4a98-a6f8-96f8042a86ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:33:25.790570 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-32416712-3dbc-467b-a545-ab17f8ee8898 tempest-GroupSnapshotsTest-448284547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a363ab03-e741-4a98-a6f8-96f8042a86ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76b8cdd4-662a-4857-9290-571bf2ce173e', 'volume_name': 'volume-76b8cdd4-662a-4857-9290-571bf2ce173e', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:33:25.802696 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-32416712-3dbc-467b-a545-ab17f8ee8898 tempest-GroupSnapshotsTest-448284547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (532495e7-98eb-4ffa-b5f8-7a94e6a92c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:33:25.813081 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-32416712-3dbc-467b-a545-ab17f8ee8898 tempest-GroupSnapshotsTest-448284547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (532495e7-98eb-4ffa-b5f8-7a94e6a92c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:33:25.823259 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-32416712-3dbc-467b-a545-ab17f8ee8898 tempest-GroupSnapshotsTest-448284547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9788944a-0184-4a83-89e3-1f4444cf0606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:33:25.826639 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-32416712-3dbc-467b-a545-ab17f8ee8898 tempest-GroupSnapshotsTest-448284547 None] Volume 76b8cdd4-662a-4857-9290-571bf2ce173e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76b8cdd4-662a-4857-9290-571bf2ce173e', 'volume_size': 1} May 21 21:33:25.827046 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-32416712-3dbc-467b-a545-ab17f8ee8898 tempest-GroupSnapshotsTest-448284547 None] creating volume 'volume-76b8cdd4-662a-4857-9290-571bf2ce173e' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:33:25.827822 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-32416712-3dbc-467b-a545-ab17f8ee8898 tempest-GroupSnapshotsTest-448284547 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:33:26.362751 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-32416712-3dbc-467b-a545-ab17f8ee8898 tempest-GroupSnapshotsTest-448284547 None] extra_specs: {} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:33:26.363507 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-32416712-3dbc-467b-a545-ab17f8ee8898 tempest-GroupSnapshotsTest-448284547 None] extra_specs: {} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:33:26.371761 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-32416712-3dbc-467b-a545-ab17f8ee8898 tempest-GroupSnapshotsTest-448284547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9788944a-0184-4a83-89e3-1f4444cf0606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76b8cdd4-662a-4857-9290-571bf2ce173e', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:33:26.376930 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-32416712-3dbc-467b-a545-ab17f8ee8898 tempest-GroupSnapshotsTest-448284547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (194fda04-fc00-4cb0-b366-9437ea5cfcc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:33:26.781188 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-32416712-3dbc-467b-a545-ab17f8ee8898 tempest-GroupSnapshotsTest-448284547 None] Volume volume-76b8cdd4-662a-4857-9290-571bf2ce173e (76b8cdd4-662a-4857-9290-571bf2ce173e): created successfully May 21 21:33:26.787928 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-32416712-3dbc-467b-a545-ab17f8ee8898 tempest-GroupSnapshotsTest-448284547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (194fda04-fc00-4cb0-b366-9437ea5cfcc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:33:26.794005 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-32416712-3dbc-467b-a545-ab17f8ee8898 tempest-GroupSnapshotsTest-448284547 None] Flow 'volume_create_manager' (f566141c-e9ba-4309-b6cb-754152c2d9ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:33:26.906040 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-32416712-3dbc-467b-a545-ab17f8ee8898 tempest-GroupSnapshotsTest-448284547 None] Created volume successfully. May 21 21:33:28.584474 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-edc54ba0-dd72-4040-a3b5-024e40c0cc7a tempest-GroupSnapshotsTest-448284547 None] GroupSnapshot 517a5b73-3415-4278-8126-9bd44c1dc76a: creating. May 21 21:33:28.655140 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-edc54ba0-dd72-4040-a3b5-024e40c0cc7a tempest-GroupSnapshotsTest-448284547 None] Group snapshot 517a5b73-3415-4278-8126-9bd44c1dc76a: creating. {{(pid=124407) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4080}} May 21 21:33:28.697928 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-edc54ba0-dd72-4040-a3b5-024e40c0cc7a tempest-GroupSnapshotsTest-448284547 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:33:30.776903 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-edc54ba0-dd72-4040-a3b5-024e40c0cc7a tempest-GroupSnapshotsTest-448284547 None] group_snapshot 517a5b73-3415-4278-8126-9bd44c1dc76a: created successfully May 21 21:33:31.194506 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-b9ba7c77-8289-41e3-85d1-711c4019984d tempest-GroupSnapshotsTest-448284547 None] group_snapshot 517a5b73-3415-4278-8126-9bd44c1dc76a: deleting May 21 21:33:31.229090 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b9ba7c77-8289-41e3-85d1-711c4019984d tempest-GroupSnapshotsTest-448284547 None] group_snapshot 517a5b73-3415-4278-8126-9bd44c1dc76a: deleting {{(pid=124407) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4255}} May 21 21:33:31.254990 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b9ba7c77-8289-41e3-85d1-711c4019984d tempest-GroupSnapshotsTest-448284547 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:33:31.732499 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-e09c2f95-1b1d-4851-8a4f-df6e09aaac97 req-6c6f100c-4644-4a78-89a9-3019533e069b tempest-ServerRescueNegativeTestJSON-1981617934 None] Terminate volume connection completed successfully. May 21 21:33:31.732499 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-e09c2f95-1b1d-4851-8a4f-df6e09aaac97 req-6c6f100c-4644-4a78-89a9-3019533e069b tempest-ServerRescueNegativeTestJSON-1981617934 None] Deleting attachment ba7db391-a8c7-4f5f-9c18-1f98e431e05f. {{(pid=124407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4957}} May 21 21:33:34.251656 ncdv-master-1 cinder-volume[124407]: WARNING cinder.quota [None req-b9ba7c77-8289-41e3-85d1-711c4019984d tempest-GroupSnapshotsTest-448284547 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1695028219 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1695028219, it is now deprecated. Please use the default quota class for default quota. May 21 21:33:34.253009 ncdv-master-1 cinder-volume[124407]: WARNING cinder.quota [None req-b9ba7c77-8289-41e3-85d1-711c4019984d tempest-GroupSnapshotsTest-448284547 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1695028219 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1695028219, it is now deprecated. Please use the default quota class for default quota. May 21 21:33:34.269337 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:UPDATE=24,cinder:SELECT=72,cinder:INSERT=4 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:33:34.374127 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-b9ba7c77-8289-41e3-85d1-711c4019984d tempest-GroupSnapshotsTest-448284547 None] Created reservations ['9618bb5f-a5ea-4fed-9820-c9ad82cbdb71', '9defaa8a-3a83-4124-90ea-53dd092820df', '1a812c9b-ce90-4534-a3dd-a1f5ed4848b8', '60def927-66ae-4a98-9c8c-f6d94487c081'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:33:34.588046 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=57,cinder:UPDATE=33,cinder:INSERT=9,cinder:DELETE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:33:34.770689 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-b9ba7c77-8289-41e3-85d1-711c4019984d tempest-GroupSnapshotsTest-448284547 None] group_snapshot 517a5b73-3415-4278-8126-9bd44c1dc76a: deleted successfully May 21 21:33:35.610458 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-3a93b5b4-9e0d-4978-b7a9-8aa75be208e1 tempest-ServersNegativeTestJSON-1080286652 None] Lock "b'cinder-843d6fda-b12c-470a-8f8c-5d3bbce1dede-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:33:35.825106 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3a93b5b4-9e0d-4978-b7a9-8aa75be208e1 tempest-ServersNegativeTestJSON-1080286652 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:33:36.307392 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3a93b5b4-9e0d-4978-b7a9-8aa75be208e1 tempest-ServersNegativeTestJSON-1080286652 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:33:36.308739 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3a93b5b4-9e0d-4978-b7a9-8aa75be208e1 tempest-ServersNegativeTestJSON-1080286652 None] Volume volume-843d6fda-b12c-470a-8f8c-5d3bbce1dede is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:33:36.497569 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3a93b5b4-9e0d-4978-b7a9-8aa75be208e1 tempest-ServersNegativeTestJSON-1080286652 None] deleting rbd volume volume-843d6fda-b12c-470a-8f8c-5d3bbce1dede {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:33:36.591576 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-53ddf080-91ed-4e5f-b48a-b82bd6ad0f43 tempest-GroupSnapshotsTest-448284547 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:33:36.838039 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-53ddf080-91ed-4e5f-b48a-b82bd6ad0f43 tempest-GroupSnapshotsTest-448284547 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:33:36.838039 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-53ddf080-91ed-4e5f-b48a-b82bd6ad0f43 tempest-GroupSnapshotsTest-448284547 None] Volume volume-76b8cdd4-662a-4857-9290-571bf2ce173e is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:33:37.082983 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-53ddf080-91ed-4e5f-b48a-b82bd6ad0f43 tempest-GroupSnapshotsTest-448284547 None] deleting rbd volume volume-76b8cdd4-662a-4857-9290-571bf2ce173e {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:33:42.360058 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-3a93b5b4-9e0d-4978-b7a9-8aa75be208e1 tempest-ServersNegativeTestJSON-1080286652 None] Created reservations ['08403277-893d-4e88-8601-d63d521f8ad4', '34d8f181-bc4c-43dd-badf-6e4f7282bb48', '8d219a92-e47f-4c4c-a4b9-df2e8d13044c', 'f87fa53a-7227-4322-9d02-aa689b8fb6b7'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:33:42.544519 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-53ddf080-91ed-4e5f-b48a-b82bd6ad0f43 tempest-GroupSnapshotsTest-448284547 None] Created reservations ['abb6380e-e8c7-4ddc-85cf-8443efb2b8de'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:33:42.586365 ncdv-master-1 cinder-volume[124407]: WARNING cinder.quota [None req-53ddf080-91ed-4e5f-b48a-b82bd6ad0f43 tempest-GroupSnapshotsTest-448284547 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1695028219 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1695028219, it is now deprecated. Please use the default quota class for default quota. May 21 21:33:42.742307 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3a93b5b4-9e0d-4978-b7a9-8aa75be208e1 tempest-ServersNegativeTestJSON-1080286652 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:33:42.837165 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3a93b5b4-9e0d-4978-b7a9-8aa75be208e1 tempest-ServersNegativeTestJSON-1080286652 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:33:42.948443 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-3a93b5b4-9e0d-4978-b7a9-8aa75be208e1 tempest-ServersNegativeTestJSON-1080286652 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:33:42.951060 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-53ddf080-91ed-4e5f-b48a-b82bd6ad0f43 tempest-GroupSnapshotsTest-448284547 None] Created reservations ['01f7239f-e65b-4a74-ae29-e9e2bef0b6d7', '3c6f75bf-3a32-4fda-aaa6-77e8880d2800', '0f84e0da-fb69-4f62-b640-9fcc7dcfbd83', '3e9b4227-df0f-4648-91d9-e9aeff76a081'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:33:42.970626 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-3a93b5b4-9e0d-4978-b7a9-8aa75be208e1 tempest-ServersNegativeTestJSON-1080286652 None] Deleted volume successfully. May 21 21:33:43.068532 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-3a93b5b4-9e0d-4978-b7a9-8aa75be208e1 tempest-ServersNegativeTestJSON-1080286652 None] Lock "b'cinder-843d6fda-b12c-470a-8f8c-5d3bbce1dede-delete_volume'" released by "delete_volume" :: held 7.459s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:33:43.495608 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-53ddf080-91ed-4e5f-b48a-b82bd6ad0f43 tempest-GroupSnapshotsTest-448284547 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:33:43.585948 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-53ddf080-91ed-4e5f-b48a-b82bd6ad0f43 tempest-GroupSnapshotsTest-448284547 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:33:43.702631 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-53ddf080-91ed-4e5f-b48a-b82bd6ad0f43 tempest-GroupSnapshotsTest-448284547 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:33:43.733259 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-5d23879d-05de-4182-8af4-6b3e54d0416f tempest-ServersNegativeTestJSON-1080286652 None] Lock "b'cinder-1443538c-c5ec-49af-ae97-c3dd6e72198e-delete_volume'" acquired by "delete_volume" :: waited 0.240s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:33:43.736515 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-53ddf080-91ed-4e5f-b48a-b82bd6ad0f43 tempest-GroupSnapshotsTest-448284547 None] Delete group completed successfully. May 21 21:33:43.881416 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-5d23879d-05de-4182-8af4-6b3e54d0416f tempest-ServersNegativeTestJSON-1080286652 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:33:44.008228 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-5d23879d-05de-4182-8af4-6b3e54d0416f tempest-ServersNegativeTestJSON-1080286652 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:33:44.008797 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-5d23879d-05de-4182-8af4-6b3e54d0416f tempest-ServersNegativeTestJSON-1080286652 None] Volume volume-1443538c-c5ec-49af-ae97-c3dd6e72198e is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:33:44.105430 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-5d23879d-05de-4182-8af4-6b3e54d0416f tempest-ServersNegativeTestJSON-1080286652 None] deleting rbd volume volume-1443538c-c5ec-49af-ae97-c3dd6e72198e {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:33:44.322518 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-057f65ba-ff07-42ff-b23d-6fe5de30ef9b tempest-ServerRescueNegativeTestJSON-1981617934 None] Lock "b'cinder-b0b1920b-8151-4e90-ac66-f993da5e7e8e-delete_volume'" acquired by "delete_volume" :: waited 0.026s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:33:44.477463 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-057f65ba-ff07-42ff-b23d-6fe5de30ef9b tempest-ServerRescueNegativeTestJSON-1981617934 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:33:44.821912 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-057f65ba-ff07-42ff-b23d-6fe5de30ef9b tempest-ServerRescueNegativeTestJSON-1981617934 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:33:44.822555 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-057f65ba-ff07-42ff-b23d-6fe5de30ef9b tempest-ServerRescueNegativeTestJSON-1981617934 None] Volume volume-b0b1920b-8151-4e90-ac66-f993da5e7e8e is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:33:44.972522 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-057f65ba-ff07-42ff-b23d-6fe5de30ef9b tempest-ServerRescueNegativeTestJSON-1981617934 None] deleting rbd volume volume-b0b1920b-8151-4e90-ac66-f993da5e7e8e {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:33:46.669864 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-9159a9bf-35d1-44bf-9d15-46d84f320725 req-cf9ee00d-7b5c-42fd-ab57-73a9bdaa0726 tempest-AttachVolumeShelveTestJSON-418539187 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:33:47.457424 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:33:47.460362 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:33:47.509468 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:33:47.609426 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:33:47.621489 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-9159a9bf-35d1-44bf-9d15-46d84f320725 req-cf9ee00d-7b5c-42fd-ab57-73a9bdaa0726 tempest-AttachVolumeShelveTestJSON-418539187 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.950s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:33:47.624243 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-9159a9bf-35d1-44bf-9d15-46d84f320725 req-cf9ee00d-7b5c-42fd-ab57-73a9bdaa0726 tempest-AttachVolumeShelveTestJSON-418539187 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-fc38d82a-c55c-417b-ad9e-028de27fde5a', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'efef91cd-d8f8-4d93-9ad2-86d0b33251f4', 'volume_id': 'fc38d82a-c55c-417b-ad9e-028de27fde5a', 'discard': True}} {{(pid=124407) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} May 21 21:33:47.781781 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-9159a9bf-35d1-44bf-9d15-46d84f320725 req-cf9ee00d-7b5c-42fd-ab57-73a9bdaa0726 tempest-AttachVolumeShelveTestJSON-418539187 None] Connection info returned from driver {'name': 'volumes/volume-fc38d82a-c55c-417b-ad9e-028de27fde5a', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'fc38d82a-c55c-417b-ad9e-028de27fde5a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'bc11f84b-8b03-4b3c-b6f8-cd08d99909b5'} {{(pid=124407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4826}} May 21 21:33:47.991292 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=56,cinder:UPDATE=35,cinder:INSERT=8,cinder:DELETE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:33:47.993792 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-9159a9bf-35d1-44bf-9d15-46d84f320725 req-cf9ee00d-7b5c-42fd-ab57-73a9bdaa0726 tempest-AttachVolumeShelveTestJSON-418539187 None] attachment_update completed successfully. May 21 21:33:49.019577 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-5d23879d-05de-4182-8af4-6b3e54d0416f tempest-ServersNegativeTestJSON-1080286652 None] Created reservations ['355715a9-64f9-4016-b341-aea1dd3f8034', '8652a223-30b8-45d0-a8c3-b5df3084061b', 'b886302b-63dc-4f10-89d8-958fefca1948', '0379e0ee-a933-491a-8ee9-959e343343d8'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:33:49.174100 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=70,cinder:UPDATE=25,cinder:INSERT=5 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:33:49.267965 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-5d23879d-05de-4182-8af4-6b3e54d0416f tempest-ServersNegativeTestJSON-1080286652 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:33:49.322423 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-5d23879d-05de-4182-8af4-6b3e54d0416f tempest-ServersNegativeTestJSON-1080286652 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:33:49.374314 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-5d23879d-05de-4182-8af4-6b3e54d0416f tempest-ServersNegativeTestJSON-1080286652 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:33:49.386037 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-5d23879d-05de-4182-8af4-6b3e54d0416f tempest-ServersNegativeTestJSON-1080286652 None] Deleted volume successfully. May 21 21:33:49.490556 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-5d23879d-05de-4182-8af4-6b3e54d0416f tempest-ServersNegativeTestJSON-1080286652 None] Lock "b'cinder-1443538c-c5ec-49af-ae97-c3dd6e72198e-delete_volume'" released by "delete_volume" :: held 5.757s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:33:49.762308 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-057f65ba-ff07-42ff-b23d-6fe5de30ef9b tempest-ServerRescueNegativeTestJSON-1981617934 None] Created reservations ['cdedc4c1-cc3e-4b3e-bad2-760f17275a27', '88d2a9d6-10a3-4ff6-a840-706679a29029', 'ccdba9e9-448d-4f2c-b686-70ca1c503aba', 'a12cbe0e-b8d8-42df-bf6c-35ac9645145d'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:33:50.143713 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-057f65ba-ff07-42ff-b23d-6fe5de30ef9b tempest-ServerRescueNegativeTestJSON-1981617934 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:33:50.231941 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-057f65ba-ff07-42ff-b23d-6fe5de30ef9b tempest-ServerRescueNegativeTestJSON-1981617934 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:33:50.289860 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-057f65ba-ff07-42ff-b23d-6fe5de30ef9b tempest-ServerRescueNegativeTestJSON-1981617934 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:33:50.304056 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-057f65ba-ff07-42ff-b23d-6fe5de30ef9b tempest-ServerRescueNegativeTestJSON-1981617934 None] Deleted volume successfully. May 21 21:33:50.381798 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-057f65ba-ff07-42ff-b23d-6fe5de30ef9b tempest-ServerRescueNegativeTestJSON-1981617934 None] Lock "b'cinder-b0b1920b-8151-4e90-ac66-f993da5e7e8e-delete_volume'" released by "delete_volume" :: held 6.065s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:33:51.106066 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-a08f82c3-a28e-4ab1-907f-a2c4825afa13 tempest-ServerRescueNegativeTestJSON-1981617934 None] Lock "b'cinder-05d70c6a-b739-4ca4-96bd-e8a3338bb914-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:33:51.289903 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a08f82c3-a28e-4ab1-907f-a2c4825afa13 tempest-ServerRescueNegativeTestJSON-1981617934 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:33:51.499695 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a08f82c3-a28e-4ab1-907f-a2c4825afa13 tempest-ServerRescueNegativeTestJSON-1981617934 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:33:51.500211 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a08f82c3-a28e-4ab1-907f-a2c4825afa13 tempest-ServerRescueNegativeTestJSON-1981617934 None] Volume volume-05d70c6a-b739-4ca4-96bd-e8a3338bb914 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:33:51.625163 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a08f82c3-a28e-4ab1-907f-a2c4825afa13 tempest-ServerRescueNegativeTestJSON-1981617934 None] deleting rbd volume volume-05d70c6a-b739-4ca4-96bd-e8a3338bb914 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:33:53.837556 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-45eaba2b-b29e-4ba5-80ea-f91ab02f30c7 tempest-GroupSnapshotsV319Test-1151658344 None] Group tempest-GroupSnapshotsV319Test-Group-130660160: creating May 21 21:33:53.969400 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-45eaba2b-b29e-4ba5-80ea-f91ab02f30c7 tempest-GroupSnapshotsV319Test-1151658344 None] Group tempest-GroupSnapshotsV319Test-Group-130660160: created successfully May 21 21:33:54.007050 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-45eaba2b-b29e-4ba5-80ea-f91ab02f30c7 tempest-GroupSnapshotsV319Test-1151658344 None] Create group completed successfully. May 21 21:33:54.539686 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-a08f82c3-a28e-4ab1-907f-a2c4825afa13 tempest-ServerRescueNegativeTestJSON-1981617934 None] Created reservations ['33fb3ce7-0e42-419f-8262-099df65a1290', 'aec14d92-529f-4a9f-ad75-9b745e0d38ac', 'f696ca51-0aa8-4183-ac02-5672b4af32e6', 'e77de854-e512-42a0-ae55-51aa64360218'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:33:54.782912 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a08f82c3-a28e-4ab1-907f-a2c4825afa13 tempest-ServerRescueNegativeTestJSON-1981617934 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:33:54.834541 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a08f82c3-a28e-4ab1-907f-a2c4825afa13 tempest-ServerRescueNegativeTestJSON-1981617934 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:33:54.890322 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-a08f82c3-a28e-4ab1-907f-a2c4825afa13 tempest-ServerRescueNegativeTestJSON-1981617934 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:33:54.895417 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-a08f82c3-a28e-4ab1-907f-a2c4825afa13 tempest-ServerRescueNegativeTestJSON-1981617934 None] Deleted volume successfully. May 21 21:33:54.996575 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-a08f82c3-a28e-4ab1-907f-a2c4825afa13 tempest-ServerRescueNegativeTestJSON-1981617934 None] Lock "b'cinder-05d70c6a-b739-4ca4-96bd-e8a3338bb914-delete_volume'" released by "delete_volume" :: held 3.890s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:33:56.309550 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef81ffab-126b-4294-84f4-0108f4d708cd tempest-GroupSnapshotsV319Test-1151658344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:33:56.336257 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ef81ffab-126b-4294-84f4-0108f4d708cd tempest-GroupSnapshotsV319Test-1151658344 None] Flow 'volume_create_manager' (c3f7c298-bcff-443a-85b0-d97798793bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:33:56.361615 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ef81ffab-126b-4294-84f4-0108f4d708cd tempest-GroupSnapshotsV319Test-1151658344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d6ba0dc-0823-4dd3-ae65-d869c24565b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:33:56.412123 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ef81ffab-126b-4294-84f4-0108f4d708cd tempest-GroupSnapshotsV319Test-1151658344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d6ba0dc-0823-4dd3-ae65-d869c24565b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:33:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsV319Test-Volume-464721353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e628db88-a434-4c50-977a-219527fe13c7,host='ncdv-master-1@ceph#ceph',id=48670f6f-861d-4199-8de7-42a8e889ef2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c4527dfe06b48a6be33637625a4faf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:33:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:33:56Z,use_quota=True,user_id='95389b1971964793ac80a99714f97d1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d05709b3-87b9-4a74-85de-9a2f881a89f0),volume_type_id=d05709b3-87b9-4a74-85de-9a2f881a89f0)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:33:56.428224 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ef81ffab-126b-4294-84f4-0108f4d708cd tempest-GroupSnapshotsV319Test-1151658344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (343dad1e-3344-4a46-aa20-caf9d1adb635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:33:56.451471 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ef81ffab-126b-4294-84f4-0108f4d708cd tempest-GroupSnapshotsV319Test-1151658344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (343dad1e-3344-4a46-aa20-caf9d1adb635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:33:56.468694 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ef81ffab-126b-4294-84f4-0108f4d708cd tempest-GroupSnapshotsV319Test-1151658344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cbe01e5-11a1-40a5-922b-90380f67bc69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:33:56.477634 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ef81ffab-126b-4294-84f4-0108f4d708cd tempest-GroupSnapshotsV319Test-1151658344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cbe01e5-11a1-40a5-922b-90380f67bc69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48670f6f-861d-4199-8de7-42a8e889ef2d', 'volume_name': 'volume-48670f6f-861d-4199-8de7-42a8e889ef2d', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:33:56.499495 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ef81ffab-126b-4294-84f4-0108f4d708cd tempest-GroupSnapshotsV319Test-1151658344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dcaf14b-6de5-4a0c-853f-c81dcb12873d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:33:56.505235 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ef81ffab-126b-4294-84f4-0108f4d708cd tempest-GroupSnapshotsV319Test-1151658344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dcaf14b-6de5-4a0c-853f-c81dcb12873d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:33:56.510472 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ef81ffab-126b-4294-84f4-0108f4d708cd tempest-GroupSnapshotsV319Test-1151658344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbfd7fff-d909-4bb4-8453-ecb8b16c20be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:33:56.511782 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-ef81ffab-126b-4294-84f4-0108f4d708cd tempest-GroupSnapshotsV319Test-1151658344 None] Volume 48670f6f-861d-4199-8de7-42a8e889ef2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48670f6f-861d-4199-8de7-42a8e889ef2d', 'volume_size': 1} May 21 21:33:56.515279 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ef81ffab-126b-4294-84f4-0108f4d708cd tempest-GroupSnapshotsV319Test-1151658344 None] creating volume 'volume-48670f6f-861d-4199-8de7-42a8e889ef2d' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:33:56.515279 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ef81ffab-126b-4294-84f4-0108f4d708cd tempest-GroupSnapshotsV319Test-1151658344 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:33:57.002444 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ef81ffab-126b-4294-84f4-0108f4d708cd tempest-GroupSnapshotsV319Test-1151658344 None] extra_specs: {} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:33:57.002828 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ef81ffab-126b-4294-84f4-0108f4d708cd tempest-GroupSnapshotsV319Test-1151658344 None] extra_specs: {} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:33:57.008089 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ef81ffab-126b-4294-84f4-0108f4d708cd tempest-GroupSnapshotsV319Test-1151658344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbfd7fff-d909-4bb4-8453-ecb8b16c20be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48670f6f-861d-4199-8de7-42a8e889ef2d', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:33:57.017123 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ef81ffab-126b-4294-84f4-0108f4d708cd tempest-GroupSnapshotsV319Test-1151658344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6589349-7240-464c-bafc-80e69b207bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:33:57.138801 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-ef81ffab-126b-4294-84f4-0108f4d708cd tempest-GroupSnapshotsV319Test-1151658344 None] Volume volume-48670f6f-861d-4199-8de7-42a8e889ef2d (48670f6f-861d-4199-8de7-42a8e889ef2d): created successfully May 21 21:33:57.142942 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ef81ffab-126b-4294-84f4-0108f4d708cd tempest-GroupSnapshotsV319Test-1151658344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6589349-7240-464c-bafc-80e69b207bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:33:57.155291 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ef81ffab-126b-4294-84f4-0108f4d708cd tempest-GroupSnapshotsV319Test-1151658344 None] Flow 'volume_create_manager' (c3f7c298-bcff-443a-85b0-d97798793bc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:33:57.261500 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-ef81ffab-126b-4294-84f4-0108f4d708cd tempest-GroupSnapshotsV319Test-1151658344 None] Created volume successfully. May 21 21:33:59.076073 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-83c15fda-3ceb-4aa3-a4a7-fe2436f404eb tempest-GroupSnapshotsV319Test-1151658344 None] GroupSnapshot 9019a1bf-a194-4a73-a02f-07a63360c838: creating. May 21 21:33:59.111812 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-83c15fda-3ceb-4aa3-a4a7-fe2436f404eb tempest-GroupSnapshotsV319Test-1151658344 None] Group snapshot 9019a1bf-a194-4a73-a02f-07a63360c838: creating. {{(pid=124407) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4080}} May 21 21:33:59.143854 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-83c15fda-3ceb-4aa3-a4a7-fe2436f404eb tempest-GroupSnapshotsV319Test-1151658344 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:34:02.148693 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:UPDATE=38,cinder:SELECT=51,cinder:DELETE=3,cinder:INSERT=8 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:34:02.272317 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-83c15fda-3ceb-4aa3-a4a7-fe2436f404eb tempest-GroupSnapshotsV319Test-1151658344 None] group_snapshot 9019a1bf-a194-4a73-a02f-07a63360c838: created successfully May 21 21:34:03.987223 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-0b60543d-78cb-435a-988d-9ad69184a90c tempest-GroupSnapshotsV319Test-1151658344 None] group_snapshot 9019a1bf-a194-4a73-a02f-07a63360c838: deleting May 21 21:34:04.006548 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-0b60543d-78cb-435a-988d-9ad69184a90c tempest-GroupSnapshotsV319Test-1151658344 None] group_snapshot 9019a1bf-a194-4a73-a02f-07a63360c838: deleting {{(pid=124407) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4255}} May 21 21:34:04.025035 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-0b60543d-78cb-435a-988d-9ad69184a90c tempest-GroupSnapshotsV319Test-1151658344 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:34:06.002583 ncdv-master-1 cinder-volume[124407]: WARNING cinder.quota [None req-0b60543d-78cb-435a-988d-9ad69184a90c tempest-GroupSnapshotsV319Test-1151658344 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1221882540 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1221882540, it is now deprecated. Please use the default quota class for default quota. May 21 21:34:06.005733 ncdv-master-1 cinder-volume[124407]: WARNING cinder.quota [None req-0b60543d-78cb-435a-988d-9ad69184a90c tempest-GroupSnapshotsV319Test-1151658344 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1221882540 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1221882540, it is now deprecated. Please use the default quota class for default quota. May 21 21:34:06.181125 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-0b60543d-78cb-435a-988d-9ad69184a90c tempest-GroupSnapshotsV319Test-1151658344 None] Created reservations ['43d8ab07-8037-4042-bd64-f45209ad0755', 'bd4993c0-e392-4389-8610-1dcc137c496e', '61eb3a8e-7d47-468b-8255-1a52e1e6ed2d', '3ca55c91-54f8-4bd8-bea2-24969f73cc1a'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:34:06.521609 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-0b60543d-78cb-435a-988d-9ad69184a90c tempest-GroupSnapshotsV319Test-1151658344 None] group_snapshot 9019a1bf-a194-4a73-a02f-07a63360c838: deleted successfully May 21 21:34:07.857589 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b7a00690-af93-44a2-9ce9-cc5cfe2968de tempest-GroupSnapshotsV319Test-1151658344 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:34:08.031764 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b7a00690-af93-44a2-9ce9-cc5cfe2968de tempest-GroupSnapshotsV319Test-1151658344 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:34:08.032196 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b7a00690-af93-44a2-9ce9-cc5cfe2968de tempest-GroupSnapshotsV319Test-1151658344 None] Volume volume-48670f6f-861d-4199-8de7-42a8e889ef2d is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:34:08.164173 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b7a00690-af93-44a2-9ce9-cc5cfe2968de tempest-GroupSnapshotsV319Test-1151658344 None] deleting rbd volume volume-48670f6f-861d-4199-8de7-42a8e889ef2d {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:34:11.511894 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-b7a00690-af93-44a2-9ce9-cc5cfe2968de tempest-GroupSnapshotsV319Test-1151658344 None] Created reservations ['874da4c1-312f-49fb-8a20-ba69b6f496f2'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:34:11.531413 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=75,cinder:UPDATE=19,cinder:DELETE=1,cinder:INSERT=5 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:34:11.540678 ncdv-master-1 cinder-volume[124407]: WARNING cinder.quota [None req-b7a00690-af93-44a2-9ce9-cc5cfe2968de tempest-GroupSnapshotsV319Test-1151658344 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1221882540 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1221882540, it is now deprecated. Please use the default quota class for default quota. May 21 21:34:11.668089 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-b7a00690-af93-44a2-9ce9-cc5cfe2968de tempest-GroupSnapshotsV319Test-1151658344 None] Created reservations ['1e3d1a89-42a7-4cf3-9dd8-1ffd4f4c1bb7', '8af1cfd8-020f-4f4c-9c3a-a19657835008', '83195c51-49b4-4e4c-8dc6-02255ef11dfb', '2decf1a2-86da-43f7-b94b-97f387fedc9d'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:34:12.165543 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b7a00690-af93-44a2-9ce9-cc5cfe2968de tempest-GroupSnapshotsV319Test-1151658344 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:34:12.272198 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b7a00690-af93-44a2-9ce9-cc5cfe2968de tempest-GroupSnapshotsV319Test-1151658344 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:34:12.361868 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-b7a00690-af93-44a2-9ce9-cc5cfe2968de tempest-GroupSnapshotsV319Test-1151658344 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:34:12.377430 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-b7a00690-af93-44a2-9ce9-cc5cfe2968de tempest-GroupSnapshotsV319Test-1151658344 None] Delete group completed successfully. May 21 21:34:25.743273 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:UPDATE=27,cinder:SELECT=31,cinder:INSERT=4 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:34:30.849832 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-122b617f-a107-4537-aa9e-3c217d69f362 tempest-VolumeTypesAccessTest-167572950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:34:30.874745 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-122b617f-a107-4537-aa9e-3c217d69f362 tempest-VolumeTypesAccessTest-167572950 None] Flow 'volume_create_manager' (21325d46-c72e-45fb-8597-d9b04dfcec0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:34:30.882259 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-122b617f-a107-4537-aa9e-3c217d69f362 tempest-VolumeTypesAccessTest-167572950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c845b7de-d100-4989-a03e-7423e57d529f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:34:30.900465 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-122b617f-a107-4537-aa9e-3c217d69f362 tempest-VolumeTypesAccessTest-167572950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c845b7de-d100-4989-a03e-7423e57d529f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1197746695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=21c6f3a1-875c-49b7-83a2-b0321e27ef41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='371eff40f74a4b458b70bb10e0c3dd34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:34:31Z,use_quota=True,user_id='edc2ec3ee0f948fb9fc5775067b45dd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a80be35a-098e-4e0d-88da-2620b884d77d),volume_type_id=a80be35a-098e-4e0d-88da-2620b884d77d)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:34:30.905994 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-122b617f-a107-4537-aa9e-3c217d69f362 tempest-VolumeTypesAccessTest-167572950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (665923e7-07db-4f36-a618-0beb4374d06c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:34:30.910289 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-122b617f-a107-4537-aa9e-3c217d69f362 tempest-VolumeTypesAccessTest-167572950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (665923e7-07db-4f36-a618-0beb4374d06c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:34:30.915261 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-122b617f-a107-4537-aa9e-3c217d69f362 tempest-VolumeTypesAccessTest-167572950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37b6e51f-d878-4dab-b686-05ad5d741397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:34:30.919855 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-122b617f-a107-4537-aa9e-3c217d69f362 tempest-VolumeTypesAccessTest-167572950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37b6e51f-d878-4dab-b686-05ad5d741397) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21c6f3a1-875c-49b7-83a2-b0321e27ef41', 'volume_name': 'volume-21c6f3a1-875c-49b7-83a2-b0321e27ef41', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:34:30.926767 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-122b617f-a107-4537-aa9e-3c217d69f362 tempest-VolumeTypesAccessTest-167572950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ae4b3f2-3d67-4986-aacd-c4ef00662562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:34:30.931200 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-122b617f-a107-4537-aa9e-3c217d69f362 tempest-VolumeTypesAccessTest-167572950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ae4b3f2-3d67-4986-aacd-c4ef00662562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:34:30.936110 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-122b617f-a107-4537-aa9e-3c217d69f362 tempest-VolumeTypesAccessTest-167572950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b91ffe2-bdad-45be-a145-eaf12e3b7196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:34:30.937271 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-122b617f-a107-4537-aa9e-3c217d69f362 tempest-VolumeTypesAccessTest-167572950 None] Volume 21c6f3a1-875c-49b7-83a2-b0321e27ef41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21c6f3a1-875c-49b7-83a2-b0321e27ef41', 'volume_size': 1} May 21 21:34:30.937731 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-122b617f-a107-4537-aa9e-3c217d69f362 tempest-VolumeTypesAccessTest-167572950 None] creating volume 'volume-21c6f3a1-875c-49b7-83a2-b0321e27ef41' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:34:30.938563 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-122b617f-a107-4537-aa9e-3c217d69f362 tempest-VolumeTypesAccessTest-167572950 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:34:31.621352 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-122b617f-a107-4537-aa9e-3c217d69f362 tempest-VolumeTypesAccessTest-167572950 None] extra_specs: {} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:34:31.621745 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-122b617f-a107-4537-aa9e-3c217d69f362 tempest-VolumeTypesAccessTest-167572950 None] extra_specs: {} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:34:31.625454 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-122b617f-a107-4537-aa9e-3c217d69f362 tempest-VolumeTypesAccessTest-167572950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b91ffe2-bdad-45be-a145-eaf12e3b7196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21c6f3a1-875c-49b7-83a2-b0321e27ef41', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:34:31.631016 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-122b617f-a107-4537-aa9e-3c217d69f362 tempest-VolumeTypesAccessTest-167572950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d4a975e-6371-4a72-a697-94c97968a3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:34:31.703439 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-122b617f-a107-4537-aa9e-3c217d69f362 tempest-VolumeTypesAccessTest-167572950 None] Volume volume-21c6f3a1-875c-49b7-83a2-b0321e27ef41 (21c6f3a1-875c-49b7-83a2-b0321e27ef41): created successfully May 21 21:34:31.708043 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-122b617f-a107-4537-aa9e-3c217d69f362 tempest-VolumeTypesAccessTest-167572950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d4a975e-6371-4a72-a697-94c97968a3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:34:31.713847 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-122b617f-a107-4537-aa9e-3c217d69f362 tempest-VolumeTypesAccessTest-167572950 None] Flow 'volume_create_manager' (21325d46-c72e-45fb-8597-d9b04dfcec0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:34:31.806619 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-122b617f-a107-4537-aa9e-3c217d69f362 tempest-VolumeTypesAccessTest-167572950 None] Created volume successfully. May 21 21:34:34.043159 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-38ce41e2-042e-4e2e-9c39-5895c914cbb1 tempest-VolumeTypesAccessTest-167572950 None] Lock "b'cinder-21c6f3a1-875c-49b7-83a2-b0321e27ef41-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:34:34.175776 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-38ce41e2-042e-4e2e-9c39-5895c914cbb1 tempest-VolumeTypesAccessTest-167572950 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:34:34.317250 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-38ce41e2-042e-4e2e-9c39-5895c914cbb1 tempest-VolumeTypesAccessTest-167572950 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:34:34.317685 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-38ce41e2-042e-4e2e-9c39-5895c914cbb1 tempest-VolumeTypesAccessTest-167572950 None] Volume volume-21c6f3a1-875c-49b7-83a2-b0321e27ef41 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:34:34.374666 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-38ce41e2-042e-4e2e-9c39-5895c914cbb1 tempest-VolumeTypesAccessTest-167572950 None] deleting rbd volume volume-21c6f3a1-875c-49b7-83a2-b0321e27ef41 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:34:36.730080 ncdv-master-1 cinder-volume[124407]: WARNING cinder.quota [None req-38ce41e2-042e-4e2e-9c39-5895c914cbb1 tempest-VolumeTypesAccessTest-167572950 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2012359975 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2012359975, it is now deprecated. Please use the default quota class for default quota. May 21 21:34:36.730997 ncdv-master-1 cinder-volume[124407]: WARNING cinder.quota [None req-38ce41e2-042e-4e2e-9c39-5895c914cbb1 tempest-VolumeTypesAccessTest-167572950 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2012359975 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2012359975, it is now deprecated. Please use the default quota class for default quota. May 21 21:34:36.885620 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-38ce41e2-042e-4e2e-9c39-5895c914cbb1 tempest-VolumeTypesAccessTest-167572950 None] Created reservations ['5bcbe5c7-f365-4aab-9b74-caf198ebab88', '116a7341-473d-430b-ad87-88d1be3a426a', '87e7025d-9bdf-45cf-9f9e-2423e28a2a8f', '47e256be-904d-453e-afaa-024d7b88ee1e'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:34:37.091962 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-38ce41e2-042e-4e2e-9c39-5895c914cbb1 tempest-VolumeTypesAccessTest-167572950 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:34:37.117332 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-38ce41e2-042e-4e2e-9c39-5895c914cbb1 tempest-VolumeTypesAccessTest-167572950 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:34:37.140415 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-38ce41e2-042e-4e2e-9c39-5895c914cbb1 tempest-VolumeTypesAccessTest-167572950 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:34:37.146030 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-38ce41e2-042e-4e2e-9c39-5895c914cbb1 tempest-VolumeTypesAccessTest-167572950 None] Deleted volume successfully. May 21 21:34:37.307034 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-38ce41e2-042e-4e2e-9c39-5895c914cbb1 tempest-VolumeTypesAccessTest-167572950 None] Lock "b'cinder-21c6f3a1-875c-49b7-83a2-b0321e27ef41-delete_volume'" released by "delete_volume" :: held 3.264s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:34:46.534760 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-749d8b8e-0b72-4a1c-822b-7496b16ecd76 tempest-VolumesCloneNegativeTest-939733426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:34:46.554591 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-749d8b8e-0b72-4a1c-822b-7496b16ecd76 tempest-VolumesCloneNegativeTest-939733426 None] Flow 'volume_create_manager' (2bca41ea-0ba3-43b6-b00b-7a7b82b3dea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:34:46.560944 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-749d8b8e-0b72-4a1c-822b-7496b16ecd76 tempest-VolumesCloneNegativeTest-939733426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03c5c7c7-5bf5-4b2c-9e6a-0878ae6f6f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:34:46.577027 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-749d8b8e-0b72-4a1c-822b-7496b16ecd76 tempest-VolumesCloneNegativeTest-939733426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03c5c7c7-5bf5-4b2c-9e6a-0878ae6f6f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-658528419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3d0ede42-0bfe-4ea3-b118-b4a8a18a6d4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b290ff4991a41a08010fa2a4e89cd76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:34:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:34:46Z,use_quota=True,user_id='b1066031ff8e44d583f4b73c5f1c1045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:34:46.582366 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-749d8b8e-0b72-4a1c-822b-7496b16ecd76 tempest-VolumesCloneNegativeTest-939733426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e2259c5-f5ca-4d0d-96e4-277c679e34cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:34:46.587530 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-749d8b8e-0b72-4a1c-822b-7496b16ecd76 tempest-VolumesCloneNegativeTest-939733426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e2259c5-f5ca-4d0d-96e4-277c679e34cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:34:46.594334 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-749d8b8e-0b72-4a1c-822b-7496b16ecd76 tempest-VolumesCloneNegativeTest-939733426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c57d8e0-42d9-4a63-a0fe-37972cc5863b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:34:46.595972 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-749d8b8e-0b72-4a1c-822b-7496b16ecd76 tempest-VolumesCloneNegativeTest-939733426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c57d8e0-42d9-4a63-a0fe-37972cc5863b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d0ede42-0bfe-4ea3-b118-b4a8a18a6d4d', 'volume_name': 'volume-3d0ede42-0bfe-4ea3-b118-b4a8a18a6d4d', 'volume_size': 2}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:34:46.601114 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-749d8b8e-0b72-4a1c-822b-7496b16ecd76 tempest-VolumesCloneNegativeTest-939733426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52f6a76e-e960-42d2-9694-5c8a5ec80297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:34:46.604996 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-749d8b8e-0b72-4a1c-822b-7496b16ecd76 tempest-VolumesCloneNegativeTest-939733426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52f6a76e-e960-42d2-9694-5c8a5ec80297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:34:46.609682 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-749d8b8e-0b72-4a1c-822b-7496b16ecd76 tempest-VolumesCloneNegativeTest-939733426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be270844-796d-44cf-b984-31a0531f4cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:34:46.610747 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-749d8b8e-0b72-4a1c-822b-7496b16ecd76 tempest-VolumesCloneNegativeTest-939733426 None] Volume 3d0ede42-0bfe-4ea3-b118-b4a8a18a6d4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d0ede42-0bfe-4ea3-b118-b4a8a18a6d4d', 'volume_size': 2} May 21 21:34:46.611143 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-749d8b8e-0b72-4a1c-822b-7496b16ecd76 tempest-VolumesCloneNegativeTest-939733426 None] creating volume 'volume-3d0ede42-0bfe-4ea3-b118-b4a8a18a6d4d' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:34:46.611901 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-749d8b8e-0b72-4a1c-822b-7496b16ecd76 tempest-VolumesCloneNegativeTest-939733426 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:34:46.986841 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-749d8b8e-0b72-4a1c-822b-7496b16ecd76 tempest-VolumesCloneNegativeTest-939733426 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:34:46.987243 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-749d8b8e-0b72-4a1c-822b-7496b16ecd76 tempest-VolumesCloneNegativeTest-939733426 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:34:46.992597 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-749d8b8e-0b72-4a1c-822b-7496b16ecd76 tempest-VolumesCloneNegativeTest-939733426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be270844-796d-44cf-b984-31a0531f4cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d0ede42-0bfe-4ea3-b118-b4a8a18a6d4d', 'volume_size': 2}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:34:46.997102 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-749d8b8e-0b72-4a1c-822b-7496b16ecd76 tempest-VolumesCloneNegativeTest-939733426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e86f3bf6-24ce-43f0-8e04-8cba63a1466a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:34:47.093651 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-749d8b8e-0b72-4a1c-822b-7496b16ecd76 tempest-VolumesCloneNegativeTest-939733426 None] Volume volume-3d0ede42-0bfe-4ea3-b118-b4a8a18a6d4d (3d0ede42-0bfe-4ea3-b118-b4a8a18a6d4d): created successfully May 21 21:34:47.103270 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-749d8b8e-0b72-4a1c-822b-7496b16ecd76 tempest-VolumesCloneNegativeTest-939733426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e86f3bf6-24ce-43f0-8e04-8cba63a1466a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:34:47.105257 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-749d8b8e-0b72-4a1c-822b-7496b16ecd76 tempest-VolumesCloneNegativeTest-939733426 None] Flow 'volume_create_manager' (2bca41ea-0ba3-43b6-b00b-7a7b82b3dea5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:34:47.211547 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-749d8b8e-0b72-4a1c-822b-7496b16ecd76 tempest-VolumesCloneNegativeTest-939733426 None] Created volume successfully. May 21 21:34:47.454814 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:34:47.456180 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:34:47.499968 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:34:47.531584 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:34:47.692790 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-8209c8e4-731e-43a6-ab9f-271d38c5c3e4 tempest-VolumesCloneNegativeTest-939733426 None] Lock "b'cinder-3d0ede42-0bfe-4ea3-b118-b4a8a18a6d4d-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:34:47.795714 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8209c8e4-731e-43a6-ab9f-271d38c5c3e4 tempest-VolumesCloneNegativeTest-939733426 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:34:47.936786 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8209c8e4-731e-43a6-ab9f-271d38c5c3e4 tempest-VolumesCloneNegativeTest-939733426 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:34:47.937210 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8209c8e4-731e-43a6-ab9f-271d38c5c3e4 tempest-VolumesCloneNegativeTest-939733426 None] Volume volume-3d0ede42-0bfe-4ea3-b118-b4a8a18a6d4d is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:34:48.031541 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8209c8e4-731e-43a6-ab9f-271d38c5c3e4 tempest-VolumesCloneNegativeTest-939733426 None] deleting rbd volume volume-3d0ede42-0bfe-4ea3-b118-b4a8a18a6d4d {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:34:50.032120 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-937a3a50-bc81-41ca-834e-2cea0b8fcc1d tempest-AttachVolumeTestJSON-105426157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:34:50.082569 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-937a3a50-bc81-41ca-834e-2cea0b8fcc1d tempest-AttachVolumeTestJSON-105426157 None] Flow 'volume_create_manager' (b75f2ad2-4373-4dd6-904f-430ecaf409f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:34:50.091032 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-937a3a50-bc81-41ca-834e-2cea0b8fcc1d tempest-AttachVolumeTestJSON-105426157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f68d28f-8d78-4b42-b561-9685960907f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:34:50.123684 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-937a3a50-bc81-41ca-834e-2cea0b8fcc1d tempest-AttachVolumeTestJSON-105426157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f68d28f-8d78-4b42-b561-9685960907f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:34:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-289769504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f7fe4a25-3d2f-4cc7-92c7-c4adcc753524,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbeaf54409d44d0abe3cd6c176fa7ea4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:34:50Z,use_quota=True,user_id='66b6501f7543485db27a33dd1a1a8400',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:34:50.130519 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-937a3a50-bc81-41ca-834e-2cea0b8fcc1d tempest-AttachVolumeTestJSON-105426157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83008720-9a7c-4913-863e-2105c591182c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:34:50.134586 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-937a3a50-bc81-41ca-834e-2cea0b8fcc1d tempest-AttachVolumeTestJSON-105426157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83008720-9a7c-4913-863e-2105c591182c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:34:50.139583 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-937a3a50-bc81-41ca-834e-2cea0b8fcc1d tempest-AttachVolumeTestJSON-105426157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59a10c6d-fc00-4966-9da1-044d0f4695bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:34:50.143643 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-937a3a50-bc81-41ca-834e-2cea0b8fcc1d tempest-AttachVolumeTestJSON-105426157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59a10c6d-fc00-4966-9da1-044d0f4695bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7fe4a25-3d2f-4cc7-92c7-c4adcc753524', 'volume_name': 'volume-f7fe4a25-3d2f-4cc7-92c7-c4adcc753524', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:34:50.149737 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-937a3a50-bc81-41ca-834e-2cea0b8fcc1d tempest-AttachVolumeTestJSON-105426157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3fea133-cb30-4d5a-ae6f-de36669efd83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:34:50.153520 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-937a3a50-bc81-41ca-834e-2cea0b8fcc1d tempest-AttachVolumeTestJSON-105426157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3fea133-cb30-4d5a-ae6f-de36669efd83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:34:50.158683 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-937a3a50-bc81-41ca-834e-2cea0b8fcc1d tempest-AttachVolumeTestJSON-105426157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b136453-35c1-434b-a0a4-c26413f166f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:34:50.159257 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-937a3a50-bc81-41ca-834e-2cea0b8fcc1d tempest-AttachVolumeTestJSON-105426157 None] Volume f7fe4a25-3d2f-4cc7-92c7-c4adcc753524: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7fe4a25-3d2f-4cc7-92c7-c4adcc753524', 'volume_size': 1} May 21 21:34:50.159731 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-937a3a50-bc81-41ca-834e-2cea0b8fcc1d tempest-AttachVolumeTestJSON-105426157 None] creating volume 'volume-f7fe4a25-3d2f-4cc7-92c7-c4adcc753524' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:34:50.161238 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-937a3a50-bc81-41ca-834e-2cea0b8fcc1d tempest-AttachVolumeTestJSON-105426157 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:34:50.190848 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-9dd288fb-49cd-4aab-8dbe-289027132fda req-ca9ea3f2-77be-49bb-921a-044301663d93 tempest-AttachVolumeShelveTestJSON-418539187 None] Terminate volume connection completed successfully. May 21 21:34:50.192434 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-9dd288fb-49cd-4aab-8dbe-289027132fda req-ca9ea3f2-77be-49bb-921a-044301663d93 tempest-AttachVolumeShelveTestJSON-418539187 None] Deleting attachment bc11f84b-8b03-4b3c-b6f8-cd08d99909b5. {{(pid=124407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4957}} May 21 21:34:50.957563 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-937a3a50-bc81-41ca-834e-2cea0b8fcc1d tempest-AttachVolumeTestJSON-105426157 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:34:50.957965 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-937a3a50-bc81-41ca-834e-2cea0b8fcc1d tempest-AttachVolumeTestJSON-105426157 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:34:50.961707 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-937a3a50-bc81-41ca-834e-2cea0b8fcc1d tempest-AttachVolumeTestJSON-105426157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b136453-35c1-434b-a0a4-c26413f166f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7fe4a25-3d2f-4cc7-92c7-c4adcc753524', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:34:50.966383 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-937a3a50-bc81-41ca-834e-2cea0b8fcc1d tempest-AttachVolumeTestJSON-105426157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae228a8b-1bdb-4088-b8d3-0762de1e6986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:34:51.089649 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-937a3a50-bc81-41ca-834e-2cea0b8fcc1d tempest-AttachVolumeTestJSON-105426157 None] Volume volume-f7fe4a25-3d2f-4cc7-92c7-c4adcc753524 (f7fe4a25-3d2f-4cc7-92c7-c4adcc753524): created successfully May 21 21:34:51.093225 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-937a3a50-bc81-41ca-834e-2cea0b8fcc1d tempest-AttachVolumeTestJSON-105426157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae228a8b-1bdb-4088-b8d3-0762de1e6986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:34:51.100534 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-937a3a50-bc81-41ca-834e-2cea0b8fcc1d tempest-AttachVolumeTestJSON-105426157 None] Flow 'volume_create_manager' (b75f2ad2-4373-4dd6-904f-430ecaf409f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:34:51.173703 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-937a3a50-bc81-41ca-834e-2cea0b8fcc1d tempest-AttachVolumeTestJSON-105426157 None] Created volume successfully. May 21 21:34:51.401752 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-8209c8e4-731e-43a6-ab9f-271d38c5c3e4 tempest-VolumesCloneNegativeTest-939733426 None] Created reservations ['ab6ad0f7-6bfd-497d-90e3-1e17866d1708', '44e3f675-6f5a-440c-87c1-1e155ad32491', '3662f8d1-ba31-417d-81b5-925b1c6908d7', '877b5aa6-d0ca-4dc8-89a0-40f4a10f222e'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:34:51.647534 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8209c8e4-731e-43a6-ab9f-271d38c5c3e4 tempest-VolumesCloneNegativeTest-939733426 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:34:51.686900 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8209c8e4-731e-43a6-ab9f-271d38c5c3e4 tempest-VolumesCloneNegativeTest-939733426 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:34:51.732152 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-8209c8e4-731e-43a6-ab9f-271d38c5c3e4 tempest-VolumesCloneNegativeTest-939733426 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:34:51.736995 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-8209c8e4-731e-43a6-ab9f-271d38c5c3e4 tempest-VolumesCloneNegativeTest-939733426 None] Deleted volume successfully. May 21 21:34:51.824062 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-8209c8e4-731e-43a6-ab9f-271d38c5c3e4 tempest-VolumesCloneNegativeTest-939733426 None] Lock "b'cinder-3d0ede42-0bfe-4ea3-b118-b4a8a18a6d4d-delete_volume'" released by "delete_volume" :: held 4.131s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:34:54.244772 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-bbe21f9d-ed13-4188-b700-b2cba43ac50a req-72a4cb0b-ed74-4220-a64e-2949b2f3756d tempest-AttachVolumeTestJSON-105426157 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:34:55.105251 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-bbe21f9d-ed13-4188-b700-b2cba43ac50a req-72a4cb0b-ed74-4220-a64e-2949b2f3756d tempest-AttachVolumeTestJSON-105426157 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.860s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:34:55.106078 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-bbe21f9d-ed13-4188-b700-b2cba43ac50a req-72a4cb0b-ed74-4220-a64e-2949b2f3756d tempest-AttachVolumeTestJSON-105426157 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f7fe4a25-3d2f-4cc7-92c7-c4adcc753524', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'efef91cd-d8f8-4d93-9ad2-86d0b33251f4', 'volume_id': 'f7fe4a25-3d2f-4cc7-92c7-c4adcc753524', 'discard': True}} {{(pid=124407) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} May 21 21:34:55.124377 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=44,cinder:UPDATE=25,cinder:DELETE=2,cinder:INSERT=4 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:34:55.230414 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-bbe21f9d-ed13-4188-b700-b2cba43ac50a req-72a4cb0b-ed74-4220-a64e-2949b2f3756d tempest-AttachVolumeTestJSON-105426157 None] Connection info returned from driver {'name': 'volumes/volume-f7fe4a25-3d2f-4cc7-92c7-c4adcc753524', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f7fe4a25-3d2f-4cc7-92c7-c4adcc753524', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a7aee862-666b-45a2-9d8e-fdb2d3acec92'} {{(pid=124407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4826}} May 21 21:34:55.411643 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-bbe21f9d-ed13-4188-b700-b2cba43ac50a req-72a4cb0b-ed74-4220-a64e-2949b2f3756d tempest-AttachVolumeTestJSON-105426157 None] attachment_update completed successfully. May 21 21:34:56.485711 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-03d7b721-f182-47f7-9c19-dd7d7a61df0c tempest-BackendsCapabilitiesAdminTestsJSON-1836108631 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:ec07190a-fb05-40c3-a80d-35117997cae4:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=124407) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4735}} May 21 21:34:56.520705 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-be0174b6-1dee-4938-9682-4451e320877a tempest-BackendsCapabilitiesAdminTestsJSON-1836108631 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:ec07190a-fb05-40c3-a80d-35117997cae4:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=124407) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4735}} May 21 21:34:56.739365 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=68,cinder:UPDATE=23,cinder:INSERT=4,cinder:DELETE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:34:56.841102 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb2d019f-161e-477b-b1e4-37e069331518 tempest-VolumesListTestJSON-780253760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:34:56.863676 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-bb2d019f-161e-477b-b1e4-37e069331518 tempest-VolumesListTestJSON-780253760 None] Flow 'volume_create_manager' (870d1d38-e9cc-4e2f-b3cb-3fc2463bd4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:34:56.871910 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-bb2d019f-161e-477b-b1e4-37e069331518 tempest-VolumesListTestJSON-780253760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17c72379-5b77-4720-af24-2b425a4c9b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:34:56.889449 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-bb2d019f-161e-477b-b1e4-37e069331518 tempest-VolumesListTestJSON-780253760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17c72379-5b77-4720-af24-2b425a4c9b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-273053770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9d9583c0-cf3b-4f88-956e-8680eb59c15a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='edeeafd867ec4e2bae081d58b637b470',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:34:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:34:57Z,use_quota=True,user_id='fdc9c1b4f17541bf98b938d5779c5cee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:34:56.895617 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-bb2d019f-161e-477b-b1e4-37e069331518 tempest-VolumesListTestJSON-780253760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (679d879f-0b05-45cf-8e17-6b898e3f8845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:34:56.899946 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-bb2d019f-161e-477b-b1e4-37e069331518 tempest-VolumesListTestJSON-780253760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (679d879f-0b05-45cf-8e17-6b898e3f8845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:34:56.905044 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-bb2d019f-161e-477b-b1e4-37e069331518 tempest-VolumesListTestJSON-780253760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a667fd77-1550-47a2-872d-f308becf3746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:34:56.910305 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-bb2d019f-161e-477b-b1e4-37e069331518 tempest-VolumesListTestJSON-780253760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a667fd77-1550-47a2-872d-f308becf3746) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d9583c0-cf3b-4f88-956e-8680eb59c15a', 'volume_name': 'volume-9d9583c0-cf3b-4f88-956e-8680eb59c15a', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:34:56.915974 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-bb2d019f-161e-477b-b1e4-37e069331518 tempest-VolumesListTestJSON-780253760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (430f42e5-0b3a-49b8-bd6b-7483808f7e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:34:56.919866 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-bb2d019f-161e-477b-b1e4-37e069331518 tempest-VolumesListTestJSON-780253760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (430f42e5-0b3a-49b8-bd6b-7483808f7e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:34:56.924504 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-bb2d019f-161e-477b-b1e4-37e069331518 tempest-VolumesListTestJSON-780253760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (219c8887-2d7e-4d0a-b5d7-24bec56cc335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:34:56.925925 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-bb2d019f-161e-477b-b1e4-37e069331518 tempest-VolumesListTestJSON-780253760 None] Volume 9d9583c0-cf3b-4f88-956e-8680eb59c15a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d9583c0-cf3b-4f88-956e-8680eb59c15a', 'volume_size': 1} May 21 21:34:56.926392 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-bb2d019f-161e-477b-b1e4-37e069331518 tempest-VolumesListTestJSON-780253760 None] creating volume 'volume-9d9583c0-cf3b-4f88-956e-8680eb59c15a' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:34:56.928247 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-bb2d019f-161e-477b-b1e4-37e069331518 tempest-VolumesListTestJSON-780253760 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:34:57.633066 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-bb2d019f-161e-477b-b1e4-37e069331518 tempest-VolumesListTestJSON-780253760 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:34:57.633665 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-bb2d019f-161e-477b-b1e4-37e069331518 tempest-VolumesListTestJSON-780253760 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:34:57.637164 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-bb2d019f-161e-477b-b1e4-37e069331518 tempest-VolumesListTestJSON-780253760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (219c8887-2d7e-4d0a-b5d7-24bec56cc335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d9583c0-cf3b-4f88-956e-8680eb59c15a', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:34:57.645164 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-bb2d019f-161e-477b-b1e4-37e069331518 tempest-VolumesListTestJSON-780253760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e332f27-08b5-4c17-8dac-6f6d30258fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:34:57.732874 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-bb2d019f-161e-477b-b1e4-37e069331518 tempest-VolumesListTestJSON-780253760 None] Volume volume-9d9583c0-cf3b-4f88-956e-8680eb59c15a (9d9583c0-cf3b-4f88-956e-8680eb59c15a): created successfully May 21 21:34:57.736822 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-bb2d019f-161e-477b-b1e4-37e069331518 tempest-VolumesListTestJSON-780253760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e332f27-08b5-4c17-8dac-6f6d30258fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:34:57.746114 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-bb2d019f-161e-477b-b1e4-37e069331518 tempest-VolumesListTestJSON-780253760 None] Flow 'volume_create_manager' (870d1d38-e9cc-4e2f-b3cb-3fc2463bd4f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:34:57.805233 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-bb2d019f-161e-477b-b1e4-37e069331518 tempest-VolumesListTestJSON-780253760 None] Created volume successfully. May 21 21:34:58.411174 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c9bd733-1540-496d-b0e3-3727a0eb63ed tempest-AttachVolumeTestJSON-105426157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:34:58.432006 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3c9bd733-1540-496d-b0e3-3727a0eb63ed tempest-AttachVolumeTestJSON-105426157 None] Flow 'volume_create_manager' (3233aec8-bf5f-4dc2-9e19-b5d2ff106765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:34:58.438693 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3c9bd733-1540-496d-b0e3-3727a0eb63ed tempest-AttachVolumeTestJSON-105426157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b51dc0e-1199-4714-82ab-18824b4f1b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:34:58.456761 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3c9bd733-1540-496d-b0e3-3727a0eb63ed tempest-AttachVolumeTestJSON-105426157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b51dc0e-1199-4714-82ab-18824b4f1b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-641874085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=cdc5df23-beb1-4657-b84c-dda6067aaee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbeaf54409d44d0abe3cd6c176fa7ea4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:34:58Z,use_quota=True,user_id='66b6501f7543485db27a33dd1a1a8400',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:34:58.462307 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3c9bd733-1540-496d-b0e3-3727a0eb63ed tempest-AttachVolumeTestJSON-105426157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed5841e4-6eda-4a18-bf36-c62bbcf53002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:34:58.466541 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3c9bd733-1540-496d-b0e3-3727a0eb63ed tempest-AttachVolumeTestJSON-105426157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed5841e4-6eda-4a18-bf36-c62bbcf53002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:34:58.472483 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3c9bd733-1540-496d-b0e3-3727a0eb63ed tempest-AttachVolumeTestJSON-105426157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c18e0490-a947-404b-93b8-8102db5fe986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:34:58.476719 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3c9bd733-1540-496d-b0e3-3727a0eb63ed tempest-AttachVolumeTestJSON-105426157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c18e0490-a947-404b-93b8-8102db5fe986) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdc5df23-beb1-4657-b84c-dda6067aaee3', 'volume_name': 'volume-cdc5df23-beb1-4657-b84c-dda6067aaee3', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:34:58.481671 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3c9bd733-1540-496d-b0e3-3727a0eb63ed tempest-AttachVolumeTestJSON-105426157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aefb47ff-f63b-401d-b750-6aa38661b67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:34:58.485514 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3c9bd733-1540-496d-b0e3-3727a0eb63ed tempest-AttachVolumeTestJSON-105426157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aefb47ff-f63b-401d-b750-6aa38661b67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:34:58.490504 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3c9bd733-1540-496d-b0e3-3727a0eb63ed tempest-AttachVolumeTestJSON-105426157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (227ac6da-337a-4925-9b66-5c3f039d282b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:34:58.491645 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-3c9bd733-1540-496d-b0e3-3727a0eb63ed tempest-AttachVolumeTestJSON-105426157 None] Volume cdc5df23-beb1-4657-b84c-dda6067aaee3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdc5df23-beb1-4657-b84c-dda6067aaee3', 'volume_size': 1} May 21 21:34:58.492035 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3c9bd733-1540-496d-b0e3-3727a0eb63ed tempest-AttachVolumeTestJSON-105426157 None] creating volume 'volume-cdc5df23-beb1-4657-b84c-dda6067aaee3' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:34:58.492711 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3c9bd733-1540-496d-b0e3-3727a0eb63ed tempest-AttachVolumeTestJSON-105426157 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:34:58.932588 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3c9bd733-1540-496d-b0e3-3727a0eb63ed tempest-AttachVolumeTestJSON-105426157 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:34:58.933187 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3c9bd733-1540-496d-b0e3-3727a0eb63ed tempest-AttachVolumeTestJSON-105426157 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:34:58.941784 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3c9bd733-1540-496d-b0e3-3727a0eb63ed tempest-AttachVolumeTestJSON-105426157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (227ac6da-337a-4925-9b66-5c3f039d282b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdc5df23-beb1-4657-b84c-dda6067aaee3', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:34:58.945086 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3c9bd733-1540-496d-b0e3-3727a0eb63ed tempest-AttachVolumeTestJSON-105426157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4435c685-7f81-488f-b7c8-16645e32739b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:34:59.061894 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-3c9bd733-1540-496d-b0e3-3727a0eb63ed tempest-AttachVolumeTestJSON-105426157 None] Volume volume-cdc5df23-beb1-4657-b84c-dda6067aaee3 (cdc5df23-beb1-4657-b84c-dda6067aaee3): created successfully May 21 21:34:59.066202 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3c9bd733-1540-496d-b0e3-3727a0eb63ed tempest-AttachVolumeTestJSON-105426157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4435c685-7f81-488f-b7c8-16645e32739b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:34:59.071494 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3c9bd733-1540-496d-b0e3-3727a0eb63ed tempest-AttachVolumeTestJSON-105426157 None] Flow 'volume_create_manager' (3233aec8-bf5f-4dc2-9e19-b5d2ff106765) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:34:59.256236 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-3c9bd733-1540-496d-b0e3-3727a0eb63ed tempest-AttachVolumeTestJSON-105426157 None] Created volume successfully. May 21 21:34:59.896246 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-727252fa-49d4-4f46-b40b-a947882472d0 tempest-VolumesListTestJSON-780253760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:34:59.917336 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-727252fa-49d4-4f46-b40b-a947882472d0 tempest-VolumesListTestJSON-780253760 None] Flow 'volume_create_manager' (d8797072-a63e-4c3d-9d44-ef69bb4d068e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:34:59.925546 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-727252fa-49d4-4f46-b40b-a947882472d0 tempest-VolumesListTestJSON-780253760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee55d0c2-0479-459e-a8b1-cfeb6e6892e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:34:59.945968 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-727252fa-49d4-4f46-b40b-a947882472d0 tempest-VolumesListTestJSON-780253760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee55d0c2-0479-459e-a8b1-cfeb6e6892e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:34:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-767874220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4ba2171f-7996-45e8-b4df-e0dfab16ccbc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='edeeafd867ec4e2bae081d58b637b470',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:35:00Z,use_quota=True,user_id='fdc9c1b4f17541bf98b938d5779c5cee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:34:59.960912 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-727252fa-49d4-4f46-b40b-a947882472d0 tempest-VolumesListTestJSON-780253760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98728be9-ceeb-4216-8a65-93df073cb864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:34:59.966070 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-727252fa-49d4-4f46-b40b-a947882472d0 tempest-VolumesListTestJSON-780253760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98728be9-ceeb-4216-8a65-93df073cb864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:34:59.971184 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-727252fa-49d4-4f46-b40b-a947882472d0 tempest-VolumesListTestJSON-780253760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d2974d8-89f4-49ef-a572-d8720cecee22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:34:59.975544 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-727252fa-49d4-4f46-b40b-a947882472d0 tempest-VolumesListTestJSON-780253760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d2974d8-89f4-49ef-a572-d8720cecee22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ba2171f-7996-45e8-b4df-e0dfab16ccbc', 'volume_name': 'volume-4ba2171f-7996-45e8-b4df-e0dfab16ccbc', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:34:59.983704 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-727252fa-49d4-4f46-b40b-a947882472d0 tempest-VolumesListTestJSON-780253760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61b3813e-ffe2-4e6c-9802-175787266225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:34:59.987132 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-727252fa-49d4-4f46-b40b-a947882472d0 tempest-VolumesListTestJSON-780253760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61b3813e-ffe2-4e6c-9802-175787266225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:34:59.996498 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-727252fa-49d4-4f46-b40b-a947882472d0 tempest-VolumesListTestJSON-780253760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bbfb6ee-8fac-45a4-906e-19833107fe12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:34:59.996498 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-727252fa-49d4-4f46-b40b-a947882472d0 tempest-VolumesListTestJSON-780253760 None] Volume 4ba2171f-7996-45e8-b4df-e0dfab16ccbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ba2171f-7996-45e8-b4df-e0dfab16ccbc', 'volume_size': 1} May 21 21:34:59.996780 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-727252fa-49d4-4f46-b40b-a947882472d0 tempest-VolumesListTestJSON-780253760 None] creating volume 'volume-4ba2171f-7996-45e8-b4df-e0dfab16ccbc' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:34:59.997328 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-727252fa-49d4-4f46-b40b-a947882472d0 tempest-VolumesListTestJSON-780253760 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:35:00.440961 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-727252fa-49d4-4f46-b40b-a947882472d0 tempest-VolumesListTestJSON-780253760 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:35:00.441659 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-727252fa-49d4-4f46-b40b-a947882472d0 tempest-VolumesListTestJSON-780253760 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:35:00.445970 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-727252fa-49d4-4f46-b40b-a947882472d0 tempest-VolumesListTestJSON-780253760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bbfb6ee-8fac-45a4-906e-19833107fe12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ba2171f-7996-45e8-b4df-e0dfab16ccbc', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:35:00.451259 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-727252fa-49d4-4f46-b40b-a947882472d0 tempest-VolumesListTestJSON-780253760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff47154d-d2b3-468c-a988-cdacd1bb7126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:35:00.526357 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-b164ded3-fb7c-4a97-95f1-7649be6b9e40 req-00433c3f-e475-4b2b-8466-9f6efeec1aaf tempest-AttachVolumeTestJSON-105426157 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:35:00.558834 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-727252fa-49d4-4f46-b40b-a947882472d0 tempest-VolumesListTestJSON-780253760 None] Volume volume-4ba2171f-7996-45e8-b4df-e0dfab16ccbc (4ba2171f-7996-45e8-b4df-e0dfab16ccbc): created successfully May 21 21:35:00.563312 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-727252fa-49d4-4f46-b40b-a947882472d0 tempest-VolumesListTestJSON-780253760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff47154d-d2b3-468c-a988-cdacd1bb7126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:35:00.569488 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-727252fa-49d4-4f46-b40b-a947882472d0 tempest-VolumesListTestJSON-780253760 None] Flow 'volume_create_manager' (d8797072-a63e-4c3d-9d44-ef69bb4d068e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:35:00.673128 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-727252fa-49d4-4f46-b40b-a947882472d0 tempest-VolumesListTestJSON-780253760 None] Created volume successfully. May 21 21:35:01.273907 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-b164ded3-fb7c-4a97-95f1-7649be6b9e40 req-00433c3f-e475-4b2b-8466-9f6efeec1aaf tempest-AttachVolumeTestJSON-105426157 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.748s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:35:01.274641 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-b164ded3-fb7c-4a97-95f1-7649be6b9e40 req-00433c3f-e475-4b2b-8466-9f6efeec1aaf tempest-AttachVolumeTestJSON-105426157 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-cdc5df23-beb1-4657-b84c-dda6067aaee3', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'efef91cd-d8f8-4d93-9ad2-86d0b33251f4', 'volume_id': 'cdc5df23-beb1-4657-b84c-dda6067aaee3', 'discard': True}} {{(pid=124407) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} May 21 21:35:01.380967 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-b164ded3-fb7c-4a97-95f1-7649be6b9e40 req-00433c3f-e475-4b2b-8466-9f6efeec1aaf tempest-AttachVolumeTestJSON-105426157 None] Connection info returned from driver {'name': 'volumes/volume-cdc5df23-beb1-4657-b84c-dda6067aaee3', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'cdc5df23-beb1-4657-b84c-dda6067aaee3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '6f2ad338-09e2-41fc-b0b0-a180443ea7b3'} {{(pid=124407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4826}} May 21 21:35:01.503671 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-b164ded3-fb7c-4a97-95f1-7649be6b9e40 req-00433c3f-e475-4b2b-8466-9f6efeec1aaf tempest-AttachVolumeTestJSON-105426157 None] attachment_update completed successfully. May 21 21:35:02.970885 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-02f2db34-d178-4525-a9dc-9e7f09f607b6 tempest-VolumesListTestJSON-780253760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:35:02.998059 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-02f2db34-d178-4525-a9dc-9e7f09f607b6 tempest-VolumesListTestJSON-780253760 None] Flow 'volume_create_manager' (b44c7e07-6578-451c-bf5c-2fc07d177299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:35:03.006818 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-02f2db34-d178-4525-a9dc-9e7f09f607b6 tempest-VolumesListTestJSON-780253760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a3e3ba8-b925-4ae9-8b0e-b4486eb09cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:35:03.025862 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-02f2db34-d178-4525-a9dc-9e7f09f607b6 tempest-VolumesListTestJSON-780253760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a3e3ba8-b925-4ae9-8b0e-b4486eb09cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-69811052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6ffa905a-e0e6-46a1-bf0e-3dcd7acedc8c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='edeeafd867ec4e2bae081d58b637b470',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:35:03Z,use_quota=True,user_id='fdc9c1b4f17541bf98b938d5779c5cee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:35:03.042227 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-02f2db34-d178-4525-a9dc-9e7f09f607b6 tempest-VolumesListTestJSON-780253760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deb43392-8622-4954-b3c3-0b548b7684c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:35:03.060992 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-02f2db34-d178-4525-a9dc-9e7f09f607b6 tempest-VolumesListTestJSON-780253760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deb43392-8622-4954-b3c3-0b548b7684c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:35:03.089928 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-02f2db34-d178-4525-a9dc-9e7f09f607b6 tempest-VolumesListTestJSON-780253760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebe22dc4-e05c-4a96-87f8-dc860d4eedcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:35:03.097335 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-02f2db34-d178-4525-a9dc-9e7f09f607b6 tempest-VolumesListTestJSON-780253760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebe22dc4-e05c-4a96-87f8-dc860d4eedcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ffa905a-e0e6-46a1-bf0e-3dcd7acedc8c', 'volume_name': 'volume-6ffa905a-e0e6-46a1-bf0e-3dcd7acedc8c', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:35:03.104976 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-02f2db34-d178-4525-a9dc-9e7f09f607b6 tempest-VolumesListTestJSON-780253760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fbe532c-fcc6-44e2-871b-104f02ecc255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:35:03.111378 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-02f2db34-d178-4525-a9dc-9e7f09f607b6 tempest-VolumesListTestJSON-780253760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fbe532c-fcc6-44e2-871b-104f02ecc255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:35:03.117850 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-02f2db34-d178-4525-a9dc-9e7f09f607b6 tempest-VolumesListTestJSON-780253760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fde35387-cee3-4ec6-b21b-e0df949482f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:35:03.119461 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-02f2db34-d178-4525-a9dc-9e7f09f607b6 tempest-VolumesListTestJSON-780253760 None] Volume 6ffa905a-e0e6-46a1-bf0e-3dcd7acedc8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ffa905a-e0e6-46a1-bf0e-3dcd7acedc8c', 'volume_size': 1} May 21 21:35:03.131343 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-02f2db34-d178-4525-a9dc-9e7f09f607b6 tempest-VolumesListTestJSON-780253760 None] creating volume 'volume-6ffa905a-e0e6-46a1-bf0e-3dcd7acedc8c' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:35:03.131343 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-02f2db34-d178-4525-a9dc-9e7f09f607b6 tempest-VolumesListTestJSON-780253760 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:35:03.559035 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-02f2db34-d178-4525-a9dc-9e7f09f607b6 tempest-VolumesListTestJSON-780253760 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:35:03.559035 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-02f2db34-d178-4525-a9dc-9e7f09f607b6 tempest-VolumesListTestJSON-780253760 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:35:03.559746 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-02f2db34-d178-4525-a9dc-9e7f09f607b6 tempest-VolumesListTestJSON-780253760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fde35387-cee3-4ec6-b21b-e0df949482f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ffa905a-e0e6-46a1-bf0e-3dcd7acedc8c', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:35:03.564410 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-02f2db34-d178-4525-a9dc-9e7f09f607b6 tempest-VolumesListTestJSON-780253760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea3fc019-25e2-4b14-a2f0-72a5b6e77e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:35:03.681457 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-02f2db34-d178-4525-a9dc-9e7f09f607b6 tempest-VolumesListTestJSON-780253760 None] Volume volume-6ffa905a-e0e6-46a1-bf0e-3dcd7acedc8c (6ffa905a-e0e6-46a1-bf0e-3dcd7acedc8c): created successfully May 21 21:35:03.689039 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-02f2db34-d178-4525-a9dc-9e7f09f607b6 tempest-VolumesListTestJSON-780253760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea3fc019-25e2-4b14-a2f0-72a5b6e77e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:35:03.695000 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-02f2db34-d178-4525-a9dc-9e7f09f607b6 tempest-VolumesListTestJSON-780253760 None] Flow 'volume_create_manager' (b44c7e07-6578-451c-bf5c-2fc07d177299) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:35:03.837338 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-02f2db34-d178-4525-a9dc-9e7f09f607b6 tempest-VolumesListTestJSON-780253760 None] Created volume successfully. May 21 21:35:05.169191 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-8561e774-db48-4865-8a29-c9336a060ff3 req-532e23f6-f8e8-4cfe-aecd-80c16e7839ca tempest-AttachVolumeTestJSON-105426157 None] Terminate volume connection completed successfully. May 21 21:35:05.172788 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-8561e774-db48-4865-8a29-c9336a060ff3 req-532e23f6-f8e8-4cfe-aecd-80c16e7839ca tempest-AttachVolumeTestJSON-105426157 None] Deleting attachment a7aee862-666b-45a2-9d8e-fdb2d3acec92. {{(pid=124407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4957}} May 21 21:35:06.932482 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-1841282d-4fa3-43e3-a079-01e785d54cf7 req-cc8fa149-c072-41b3-96d3-044c20f6e6ed tempest-AttachVolumeTestJSON-105426157 None] Terminate volume connection completed successfully. May 21 21:35:06.936904 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-1841282d-4fa3-43e3-a079-01e785d54cf7 req-cc8fa149-c072-41b3-96d3-044c20f6e6ed tempest-AttachVolumeTestJSON-105426157 None] Deleting attachment 6f2ad338-09e2-41fc-b0b0-a180443ea7b3. {{(pid=124407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4957}} May 21 21:35:08.383166 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-c16e15f3-e235-494a-8aa1-f59e43f043af tempest-VolumesListTestJSON-780253760 None] Lock "b'cinder-6ffa905a-e0e6-46a1-bf0e-3dcd7acedc8c-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:35:08.575138 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c16e15f3-e235-494a-8aa1-f59e43f043af tempest-VolumesListTestJSON-780253760 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:35:08.709450 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c16e15f3-e235-494a-8aa1-f59e43f043af tempest-VolumesListTestJSON-780253760 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:35:08.709895 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c16e15f3-e235-494a-8aa1-f59e43f043af tempest-VolumesListTestJSON-780253760 None] Volume volume-6ffa905a-e0e6-46a1-bf0e-3dcd7acedc8c is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:35:08.761206 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c16e15f3-e235-494a-8aa1-f59e43f043af tempest-VolumesListTestJSON-780253760 None] deleting rbd volume volume-6ffa905a-e0e6-46a1-bf0e-3dcd7acedc8c {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:35:11.453995 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-c16e15f3-e235-494a-8aa1-f59e43f043af tempest-VolumesListTestJSON-780253760 None] Created reservations ['ddc5548c-6895-4008-889b-e1a853fc0120', '3df2b43b-100e-4232-afcf-397811879ad8', '3870c06b-f03c-42fc-bd6e-a886139be4b3', '7f692e52-1aae-4487-aa38-8cd9585a50bd'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:35:11.713761 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c16e15f3-e235-494a-8aa1-f59e43f043af tempest-VolumesListTestJSON-780253760 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:35:11.792703 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c16e15f3-e235-494a-8aa1-f59e43f043af tempest-VolumesListTestJSON-780253760 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:35:11.848254 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-c16e15f3-e235-494a-8aa1-f59e43f043af tempest-VolumesListTestJSON-780253760 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:35:11.852672 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-c16e15f3-e235-494a-8aa1-f59e43f043af tempest-VolumesListTestJSON-780253760 None] Deleted volume successfully. May 21 21:35:11.939233 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-c16e15f3-e235-494a-8aa1-f59e43f043af tempest-VolumesListTestJSON-780253760 None] Lock "b'cinder-6ffa905a-e0e6-46a1-bf0e-3dcd7acedc8c-delete_volume'" released by "delete_volume" :: held 3.555s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:35:12.188660 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-fe0f819c-bd68-4ddf-b221-612f59722c0d tempest-VolumesListTestJSON-780253760 None] Lock "b'cinder-4ba2171f-7996-45e8-b4df-e0dfab16ccbc-delete_volume'" acquired by "delete_volume" :: waited 0.033s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:35:12.364907 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-fe0f819c-bd68-4ddf-b221-612f59722c0d tempest-VolumesListTestJSON-780253760 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:35:12.613874 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-fe0f819c-bd68-4ddf-b221-612f59722c0d tempest-VolumesListTestJSON-780253760 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:35:12.619201 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-fe0f819c-bd68-4ddf-b221-612f59722c0d tempest-VolumesListTestJSON-780253760 None] Volume volume-4ba2171f-7996-45e8-b4df-e0dfab16ccbc is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:35:12.714039 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-fe0f819c-bd68-4ddf-b221-612f59722c0d tempest-VolumesListTestJSON-780253760 None] deleting rbd volume volume-4ba2171f-7996-45e8-b4df-e0dfab16ccbc {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:35:15.290850 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-bcb03712-8e10-4bea-a593-e49c59963414 tempest-AttachVolumeTestJSON-105426157 None] Lock "b'cinder-cdc5df23-beb1-4657-b84c-dda6067aaee3-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:35:15.424653 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-bcb03712-8e10-4bea-a593-e49c59963414 tempest-AttachVolumeTestJSON-105426157 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:35:15.590133 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-bcb03712-8e10-4bea-a593-e49c59963414 tempest-AttachVolumeTestJSON-105426157 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:35:15.590565 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-bcb03712-8e10-4bea-a593-e49c59963414 tempest-AttachVolumeTestJSON-105426157 None] Volume volume-cdc5df23-beb1-4657-b84c-dda6067aaee3 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:35:15.732212 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-bcb03712-8e10-4bea-a593-e49c59963414 tempest-AttachVolumeTestJSON-105426157 None] deleting rbd volume volume-cdc5df23-beb1-4657-b84c-dda6067aaee3 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:35:15.737656 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-fe0f819c-bd68-4ddf-b221-612f59722c0d tempest-VolumesListTestJSON-780253760 None] Created reservations ['852033c5-287f-4069-8d0b-59557e72e51d', '7ee2f2e2-1901-46d2-ad6a-8330a164ac69', '0a5ba7a4-db09-40c6-adc4-09294b70e330', 'd6d805a6-a37e-4436-8e88-81694f882e6e'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:35:15.955888 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-fe0f819c-bd68-4ddf-b221-612f59722c0d tempest-VolumesListTestJSON-780253760 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:35:15.994370 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-fe0f819c-bd68-4ddf-b221-612f59722c0d tempest-VolumesListTestJSON-780253760 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:35:16.024739 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-fe0f819c-bd68-4ddf-b221-612f59722c0d tempest-VolumesListTestJSON-780253760 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:35:16.030565 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-fe0f819c-bd68-4ddf-b221-612f59722c0d tempest-VolumesListTestJSON-780253760 None] Deleted volume successfully. May 21 21:35:16.171848 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-fe0f819c-bd68-4ddf-b221-612f59722c0d tempest-VolumesListTestJSON-780253760 None] Lock "b'cinder-4ba2171f-7996-45e8-b4df-e0dfab16ccbc-delete_volume'" released by "delete_volume" :: held 3.983s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:35:16.803037 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-b9b013a7-30ba-48fe-9e25-611f03214040 tempest-VolumesListTestJSON-780253760 None] Lock "b'cinder-9d9583c0-cf3b-4f88-956e-8680eb59c15a-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:35:16.946064 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=70,cinder:UPDATE=24,cinder:DELETE=4,cinder:INSERT=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:35:16.967620 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b9b013a7-30ba-48fe-9e25-611f03214040 tempest-VolumesListTestJSON-780253760 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:35:17.306917 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b9b013a7-30ba-48fe-9e25-611f03214040 tempest-VolumesListTestJSON-780253760 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:35:17.307408 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b9b013a7-30ba-48fe-9e25-611f03214040 tempest-VolumesListTestJSON-780253760 None] Volume volume-9d9583c0-cf3b-4f88-956e-8680eb59c15a is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:35:17.496219 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b9b013a7-30ba-48fe-9e25-611f03214040 tempest-VolumesListTestJSON-780253760 None] deleting rbd volume volume-9d9583c0-cf3b-4f88-956e-8680eb59c15a {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:35:19.101071 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=65,cinder:UPDATE=27,cinder:DELETE=2,cinder:INSERT=6 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:35:19.174786 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfbb1b97-cff8-41e4-b041-649d3f8025ff tempest-SnapshotMetadataTestJSON-847251419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:35:19.194295 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-cfbb1b97-cff8-41e4-b041-649d3f8025ff tempest-SnapshotMetadataTestJSON-847251419 None] Flow 'volume_create_manager' (afe23764-6f62-4a9f-a5e4-f90c6e0fe89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:35:19.201703 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-cfbb1b97-cff8-41e4-b041-649d3f8025ff tempest-SnapshotMetadataTestJSON-847251419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9519905c-3743-4e2d-a586-6f82b6d23b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:35:19.218498 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-cfbb1b97-cff8-41e4-b041-649d3f8025ff tempest-SnapshotMetadataTestJSON-847251419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9519905c-3743-4e2d-a586-6f82b6d23b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:35:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-223653417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a656c3a9-907b-4b7b-a170-a4ffb104c6a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c477b9d95b2e43a2a90d0f1b82226152',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:35:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:35:19Z,use_quota=True,user_id='d1739c8501264667b9b6bdfa414ecaa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:35:19.223844 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-cfbb1b97-cff8-41e4-b041-649d3f8025ff tempest-SnapshotMetadataTestJSON-847251419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a2590f6-dd5a-481f-bb7d-1d7c093d0171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:35:19.228158 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-cfbb1b97-cff8-41e4-b041-649d3f8025ff tempest-SnapshotMetadataTestJSON-847251419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a2590f6-dd5a-481f-bb7d-1d7c093d0171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:35:19.233635 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-cfbb1b97-cff8-41e4-b041-649d3f8025ff tempest-SnapshotMetadataTestJSON-847251419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d84df421-888f-42d9-8f43-041f45c91458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:35:19.238041 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-cfbb1b97-cff8-41e4-b041-649d3f8025ff tempest-SnapshotMetadataTestJSON-847251419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d84df421-888f-42d9-8f43-041f45c91458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a656c3a9-907b-4b7b-a170-a4ffb104c6a7', 'volume_name': 'volume-a656c3a9-907b-4b7b-a170-a4ffb104c6a7', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:35:19.242818 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-cfbb1b97-cff8-41e4-b041-649d3f8025ff tempest-SnapshotMetadataTestJSON-847251419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d94ee510-5a0b-4278-bcb5-a3eb3176ee1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:35:19.246661 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-cfbb1b97-cff8-41e4-b041-649d3f8025ff tempest-SnapshotMetadataTestJSON-847251419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d94ee510-5a0b-4278-bcb5-a3eb3176ee1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:35:19.251263 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-cfbb1b97-cff8-41e4-b041-649d3f8025ff tempest-SnapshotMetadataTestJSON-847251419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (450ee9a6-3fdf-4a52-adf4-1a4d7d0f97c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:35:19.253054 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-cfbb1b97-cff8-41e4-b041-649d3f8025ff tempest-SnapshotMetadataTestJSON-847251419 None] Volume a656c3a9-907b-4b7b-a170-a4ffb104c6a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a656c3a9-907b-4b7b-a170-a4ffb104c6a7', 'volume_size': 1} May 21 21:35:19.253436 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-cfbb1b97-cff8-41e4-b041-649d3f8025ff tempest-SnapshotMetadataTestJSON-847251419 None] creating volume 'volume-a656c3a9-907b-4b7b-a170-a4ffb104c6a7' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:35:19.254182 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-cfbb1b97-cff8-41e4-b041-649d3f8025ff tempest-SnapshotMetadataTestJSON-847251419 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:35:19.819923 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-bcb03712-8e10-4bea-a593-e49c59963414 tempest-AttachVolumeTestJSON-105426157 None] Created reservations ['3eddacdb-11d2-4a57-9da2-b1b1f0c2052a', '49b84fa0-98cf-4d6e-a393-9326c9890305', '0960f00a-937a-430f-b555-20774072bd4c', '0a5c5060-1b27-489e-b589-cfe5c906934f'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:35:20.035200 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-bcb03712-8e10-4bea-a593-e49c59963414 tempest-AttachVolumeTestJSON-105426157 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:35:20.088018 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-bcb03712-8e10-4bea-a593-e49c59963414 tempest-AttachVolumeTestJSON-105426157 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:35:20.131400 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-bcb03712-8e10-4bea-a593-e49c59963414 tempest-AttachVolumeTestJSON-105426157 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:35:20.139385 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-bcb03712-8e10-4bea-a593-e49c59963414 tempest-AttachVolumeTestJSON-105426157 None] Deleted volume successfully. May 21 21:35:20.159521 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-cfbb1b97-cff8-41e4-b041-649d3f8025ff tempest-SnapshotMetadataTestJSON-847251419 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:35:20.160053 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-cfbb1b97-cff8-41e4-b041-649d3f8025ff tempest-SnapshotMetadataTestJSON-847251419 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:35:20.164721 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-cfbb1b97-cff8-41e4-b041-649d3f8025ff tempest-SnapshotMetadataTestJSON-847251419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (450ee9a6-3fdf-4a52-adf4-1a4d7d0f97c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a656c3a9-907b-4b7b-a170-a4ffb104c6a7', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:35:20.170533 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-cfbb1b97-cff8-41e4-b041-649d3f8025ff tempest-SnapshotMetadataTestJSON-847251419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79ad6fcd-2f84-4e8c-8ce5-c785b09028ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:35:20.226613 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-bcb03712-8e10-4bea-a593-e49c59963414 tempest-AttachVolumeTestJSON-105426157 None] Lock "b'cinder-cdc5df23-beb1-4657-b84c-dda6067aaee3-delete_volume'" released by "delete_volume" :: held 4.935s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:35:20.247842 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-cfbb1b97-cff8-41e4-b041-649d3f8025ff tempest-SnapshotMetadataTestJSON-847251419 None] Volume volume-a656c3a9-907b-4b7b-a170-a4ffb104c6a7 (a656c3a9-907b-4b7b-a170-a4ffb104c6a7): created successfully May 21 21:35:20.258388 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-cfbb1b97-cff8-41e4-b041-649d3f8025ff tempest-SnapshotMetadataTestJSON-847251419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79ad6fcd-2f84-4e8c-8ce5-c785b09028ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:35:20.267625 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-cfbb1b97-cff8-41e4-b041-649d3f8025ff tempest-SnapshotMetadataTestJSON-847251419 None] Flow 'volume_create_manager' (afe23764-6f62-4a9f-a5e4-f90c6e0fe89f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:35:20.407115 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-cfbb1b97-cff8-41e4-b041-649d3f8025ff tempest-SnapshotMetadataTestJSON-847251419 None] Created volume successfully. May 21 21:35:20.894349 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-a0571680-153c-438f-bb27-8c3095e0d001 tempest-AttachVolumeTestJSON-105426157 None] Lock "b'cinder-f7fe4a25-3d2f-4cc7-92c7-c4adcc753524-delete_volume'" acquired by "delete_volume" :: waited 0.032s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:35:21.093011 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a0571680-153c-438f-bb27-8c3095e0d001 tempest-AttachVolumeTestJSON-105426157 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:35:21.297358 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a0571680-153c-438f-bb27-8c3095e0d001 tempest-AttachVolumeTestJSON-105426157 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:35:21.297358 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a0571680-153c-438f-bb27-8c3095e0d001 tempest-AttachVolumeTestJSON-105426157 None] Volume volume-f7fe4a25-3d2f-4cc7-92c7-c4adcc753524 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:35:21.389988 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a0571680-153c-438f-bb27-8c3095e0d001 tempest-AttachVolumeTestJSON-105426157 None] deleting rbd volume volume-f7fe4a25-3d2f-4cc7-92c7-c4adcc753524 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:35:21.578619 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-b9b013a7-30ba-48fe-9e25-611f03214040 tempest-VolumesListTestJSON-780253760 None] Created reservations ['8d301981-5da8-4ce2-a334-e1466fd1f292', '66765717-ae60-458e-9984-bb551912e989', 'affed37d-5589-4ae6-9847-6b4be8fc7d09', '87df6683-80fa-49ea-bcd2-f208d516b4f7'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:35:21.897064 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b9b013a7-30ba-48fe-9e25-611f03214040 tempest-VolumesListTestJSON-780253760 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:35:21.940373 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b9b013a7-30ba-48fe-9e25-611f03214040 tempest-VolumesListTestJSON-780253760 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:35:22.043670 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-b9b013a7-30ba-48fe-9e25-611f03214040 tempest-VolumesListTestJSON-780253760 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:35:22.069410 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-b9b013a7-30ba-48fe-9e25-611f03214040 tempest-VolumesListTestJSON-780253760 None] Deleted volume successfully. May 21 21:35:22.170017 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-98609d56-a798-4255-a9f0-91b6c86d0e11 tempest-SnapshotMetadataTestJSON-847251419 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:35:22.457024 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-b9b013a7-30ba-48fe-9e25-611f03214040 tempest-VolumesListTestJSON-780253760 None] Lock "b'cinder-9d9583c0-cf3b-4f88-956e-8680eb59c15a-delete_volume'" released by "delete_volume" :: held 5.661s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:35:25.320986 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-a0571680-153c-438f-bb27-8c3095e0d001 tempest-AttachVolumeTestJSON-105426157 None] Created reservations ['63672fce-a6e4-4d72-9093-6156377343b3', '1d94ff25-09f7-4cd1-ab28-894197c73dd6', 'fdfc2274-57a6-49b1-8e07-4862e2e8bb6a', 'f7e29fb0-cdd1-4cec-b2e2-16839b515ab4'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:35:25.366957 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-98609d56-a798-4255-a9f0-91b6c86d0e11 tempest-SnapshotMetadataTestJSON-847251419 None] Create snapshot completed successfully May 21 21:35:25.510051 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a0571680-153c-438f-bb27-8c3095e0d001 tempest-AttachVolumeTestJSON-105426157 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:35:25.563945 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a0571680-153c-438f-bb27-8c3095e0d001 tempest-AttachVolumeTestJSON-105426157 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:35:25.607719 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-a0571680-153c-438f-bb27-8c3095e0d001 tempest-AttachVolumeTestJSON-105426157 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:35:25.611214 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-a0571680-153c-438f-bb27-8c3095e0d001 tempest-AttachVolumeTestJSON-105426157 None] Deleted volume successfully. May 21 21:35:25.696438 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-a0571680-153c-438f-bb27-8c3095e0d001 tempest-AttachVolumeTestJSON-105426157 None] Lock "b'cinder-f7fe4a25-3d2f-4cc7-92c7-c4adcc753524-delete_volume'" released by "delete_volume" :: held 4.798s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:35:26.593570 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-214d37b8-b9d4-43e3-ae73-22393b1d6efe tempest-AttachVolumeTestJSON-105426157 None] Lock "b'cinder-8d62796e-2b52-4323-9da6-17210b1a2dfc-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:35:26.613322 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=57,cinder:UPDATE=33,cinder:INSERT=8,cinder:DELETE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:35:26.713679 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-214d37b8-b9d4-43e3-ae73-22393b1d6efe tempest-AttachVolumeTestJSON-105426157 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:35:26.842270 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-214d37b8-b9d4-43e3-ae73-22393b1d6efe tempest-AttachVolumeTestJSON-105426157 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:35:26.842270 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-214d37b8-b9d4-43e3-ae73-22393b1d6efe tempest-AttachVolumeTestJSON-105426157 None] Volume volume-8d62796e-2b52-4323-9da6-17210b1a2dfc is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:35:26.983477 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-214d37b8-b9d4-43e3-ae73-22393b1d6efe tempest-AttachVolumeTestJSON-105426157 None] deleting rbd volume volume-8d62796e-2b52-4323-9da6-17210b1a2dfc {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:35:27.829286 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-a980eb46-54db-416d-87ee-293df51000f9 tempest-SnapshotMetadataTestJSON-847251419 None] Lock "b'cinder-f922bcb2-fc47-499a-8aaf-4d9c1955d1bc-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:35:27.832387 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a980eb46-54db-416d-87ee-293df51000f9 tempest-SnapshotMetadataTestJSON-847251419 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:35:30.406598 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-a980eb46-54db-416d-87ee-293df51000f9 tempest-SnapshotMetadataTestJSON-847251419 None] Created reservations ['aaf967ea-0680-4941-9f1e-c2c4ba45e363', 'e618081c-7ccb-405d-b533-f31f3afce537', '49c3ac2c-e579-4008-a344-fbb0f126b49a', 'f55f1b84-c134-4ea4-acb1-ebb418fff4fe'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:35:30.686323 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-a980eb46-54db-416d-87ee-293df51000f9 tempest-SnapshotMetadataTestJSON-847251419 None] Delete snapshot completed successfully. May 21 21:35:30.707808 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-a980eb46-54db-416d-87ee-293df51000f9 tempest-SnapshotMetadataTestJSON-847251419 None] Lock "b'cinder-f922bcb2-fc47-499a-8aaf-4d9c1955d1bc-delete_snapshot'" released by "delete_snapshot" :: held 2.881s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:35:30.866581 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-214d37b8-b9d4-43e3-ae73-22393b1d6efe tempest-AttachVolumeTestJSON-105426157 None] Created reservations ['bb9f8062-16f4-4dcc-bdd6-b5b4bb1c268e', '8d06365c-e223-481a-b914-7b2bca8e36ed', '7fe9c9b5-befe-4854-8a83-fe9f0b632a32', '2e995e28-1cfc-49a0-a5a7-d1f92221416e'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:35:31.138643 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-214d37b8-b9d4-43e3-ae73-22393b1d6efe tempest-AttachVolumeTestJSON-105426157 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:35:31.202295 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-214d37b8-b9d4-43e3-ae73-22393b1d6efe tempest-AttachVolumeTestJSON-105426157 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:35:31.302676 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-214d37b8-b9d4-43e3-ae73-22393b1d6efe tempest-AttachVolumeTestJSON-105426157 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:35:31.316856 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-214d37b8-b9d4-43e3-ae73-22393b1d6efe tempest-AttachVolumeTestJSON-105426157 None] Deleted volume successfully. May 21 21:35:31.340836 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-d26d707d-b860-490a-bae4-297ea1faca01 tempest-SnapshotMetadataTestJSON-847251419 None] Lock "b'cinder-a656c3a9-907b-4b7b-a170-a4ffb104c6a7-delete_volume'" acquired by "delete_volume" :: waited 0.032s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:35:31.414156 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-214d37b8-b9d4-43e3-ae73-22393b1d6efe tempest-AttachVolumeTestJSON-105426157 None] Lock "b'cinder-8d62796e-2b52-4323-9da6-17210b1a2dfc-delete_volume'" released by "delete_volume" :: held 4.821s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:35:31.470944 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d26d707d-b860-490a-bae4-297ea1faca01 tempest-SnapshotMetadataTestJSON-847251419 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:35:31.639770 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d26d707d-b860-490a-bae4-297ea1faca01 tempest-SnapshotMetadataTestJSON-847251419 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:35:31.640225 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d26d707d-b860-490a-bae4-297ea1faca01 tempest-SnapshotMetadataTestJSON-847251419 None] Volume volume-a656c3a9-907b-4b7b-a170-a4ffb104c6a7 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:35:31.727920 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d26d707d-b860-490a-bae4-297ea1faca01 tempest-SnapshotMetadataTestJSON-847251419 None] deleting rbd volume volume-a656c3a9-907b-4b7b-a170-a4ffb104c6a7 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:35:34.626153 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=53,cinder:INSERT=7,cinder:UPDATE=36,cinder:DELETE=4 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:35:34.800477 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-d26d707d-b860-490a-bae4-297ea1faca01 tempest-SnapshotMetadataTestJSON-847251419 None] Created reservations ['aff298c0-c3e0-4a4f-a228-d19b90ee77c8', '0bd374d0-2d3a-4714-b0db-7ad2e209ee63', '61e8d0e5-5751-4fef-900c-9224d4016f5b', '79e88eff-eb27-4b58-8d9f-a820b867d6c3'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:35:35.018706 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d26d707d-b860-490a-bae4-297ea1faca01 tempest-SnapshotMetadataTestJSON-847251419 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:35:35.088619 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d26d707d-b860-490a-bae4-297ea1faca01 tempest-SnapshotMetadataTestJSON-847251419 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:35:35.169295 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-d26d707d-b860-490a-bae4-297ea1faca01 tempest-SnapshotMetadataTestJSON-847251419 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:35:35.174202 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-d26d707d-b860-490a-bae4-297ea1faca01 tempest-SnapshotMetadataTestJSON-847251419 None] Deleted volume successfully. May 21 21:35:35.265361 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-d26d707d-b860-490a-bae4-297ea1faca01 tempest-SnapshotMetadataTestJSON-847251419 None] Lock "b'cinder-a656c3a9-907b-4b7b-a170-a4ffb104c6a7-delete_volume'" released by "delete_volume" :: held 3.924s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:35:41.934365 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-b697e330-a4e0-4bba-929d-00228d4c41ce tempest-VolumesDeleteCascade-522251888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:35:41.981746 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b697e330-a4e0-4bba-929d-00228d4c41ce tempest-VolumesDeleteCascade-522251888 None] Flow 'volume_create_manager' (411a4df2-3307-4e69-bc36-5ed8d73b6f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:35:41.996368 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b697e330-a4e0-4bba-929d-00228d4c41ce tempest-VolumesDeleteCascade-522251888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70fbca70-16a5-4e5d-b3b9-e5dc2151a6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:35:42.017151 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b697e330-a4e0-4bba-929d-00228d4c41ce tempest-VolumesDeleteCascade-522251888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70fbca70-16a5-4e5d-b3b9-e5dc2151a6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-625467298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9160cc7f-3466-4093-a4ea-b0bee1bf1280,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92159f0574964fffb0f10610b2594c9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:35:42Z,use_quota=True,user_id='22bd7e16e04e4e1cb1625816c318ddd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:35:42.025143 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b697e330-a4e0-4bba-929d-00228d4c41ce tempest-VolumesDeleteCascade-522251888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (619efedd-2d76-4493-b518-d53f0f884f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:35:42.033418 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b697e330-a4e0-4bba-929d-00228d4c41ce tempest-VolumesDeleteCascade-522251888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (619efedd-2d76-4493-b518-d53f0f884f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:35:42.039685 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b697e330-a4e0-4bba-929d-00228d4c41ce tempest-VolumesDeleteCascade-522251888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d077235e-141b-48d4-bd43-bf5785057e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:35:42.044760 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b697e330-a4e0-4bba-929d-00228d4c41ce tempest-VolumesDeleteCascade-522251888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d077235e-141b-48d4-bd43-bf5785057e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9160cc7f-3466-4093-a4ea-b0bee1bf1280', 'volume_name': 'volume-9160cc7f-3466-4093-a4ea-b0bee1bf1280', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:35:42.051626 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b697e330-a4e0-4bba-929d-00228d4c41ce tempest-VolumesDeleteCascade-522251888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e0f0fd4-4485-4d58-823d-3bb46accd4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:35:42.061603 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b697e330-a4e0-4bba-929d-00228d4c41ce tempest-VolumesDeleteCascade-522251888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e0f0fd4-4485-4d58-823d-3bb46accd4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:35:42.076305 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b697e330-a4e0-4bba-929d-00228d4c41ce tempest-VolumesDeleteCascade-522251888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e74955fb-8d1d-44be-8782-d09578884511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:35:42.077423 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-b697e330-a4e0-4bba-929d-00228d4c41ce tempest-VolumesDeleteCascade-522251888 None] Volume 9160cc7f-3466-4093-a4ea-b0bee1bf1280: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9160cc7f-3466-4093-a4ea-b0bee1bf1280', 'volume_size': 1} May 21 21:35:42.077811 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b697e330-a4e0-4bba-929d-00228d4c41ce tempest-VolumesDeleteCascade-522251888 None] creating volume 'volume-9160cc7f-3466-4093-a4ea-b0bee1bf1280' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:35:42.078617 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b697e330-a4e0-4bba-929d-00228d4c41ce tempest-VolumesDeleteCascade-522251888 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:35:42.546324 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b697e330-a4e0-4bba-929d-00228d4c41ce tempest-VolumesDeleteCascade-522251888 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:35:42.550696 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b697e330-a4e0-4bba-929d-00228d4c41ce tempest-VolumesDeleteCascade-522251888 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:35:42.551336 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b697e330-a4e0-4bba-929d-00228d4c41ce tempest-VolumesDeleteCascade-522251888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e74955fb-8d1d-44be-8782-d09578884511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9160cc7f-3466-4093-a4ea-b0bee1bf1280', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:35:42.557329 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b697e330-a4e0-4bba-929d-00228d4c41ce tempest-VolumesDeleteCascade-522251888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c86aebb6-f10c-4d4a-94c7-ff814db993f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:35:42.708067 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-b697e330-a4e0-4bba-929d-00228d4c41ce tempest-VolumesDeleteCascade-522251888 None] Volume volume-9160cc7f-3466-4093-a4ea-b0bee1bf1280 (9160cc7f-3466-4093-a4ea-b0bee1bf1280): created successfully May 21 21:35:42.719147 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b697e330-a4e0-4bba-929d-00228d4c41ce tempest-VolumesDeleteCascade-522251888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c86aebb6-f10c-4d4a-94c7-ff814db993f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:35:42.727813 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b697e330-a4e0-4bba-929d-00228d4c41ce tempest-VolumesDeleteCascade-522251888 None] Flow 'volume_create_manager' (411a4df2-3307-4e69-bc36-5ed8d73b6f54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:35:42.863775 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-b697e330-a4e0-4bba-929d-00228d4c41ce tempest-VolumesDeleteCascade-522251888 None] Created volume successfully. May 21 21:35:44.692851 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ca663c14-92a6-41e7-b292-e1de12bb5944 tempest-VolumesDeleteCascade-522251888 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:35:45.787529 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [req-6872e286-8a4d-4d65-acd8-fb7abba10c4b req-d7dd8e18-6eed-419f-bd80-04b31b5c5dac tempest-VolumesSnapshotsTestJSON-782237458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:35:45.807811 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-6872e286-8a4d-4d65-acd8-fb7abba10c4b req-d7dd8e18-6eed-419f-bd80-04b31b5c5dac tempest-VolumesSnapshotsTestJSON-782237458 None] Flow 'volume_create_manager' (5e7d9b2b-7cc3-489d-8457-45117c191e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:35:45.815672 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-6872e286-8a4d-4d65-acd8-fb7abba10c4b req-d7dd8e18-6eed-419f-bd80-04b31b5c5dac tempest-VolumesSnapshotsTestJSON-782237458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ef0a4ae-0b7f-4dfe-b02f-cdcf63fee437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:35:45.834389 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-6872e286-8a4d-4d65-acd8-fb7abba10c4b req-d7dd8e18-6eed-419f-bd80-04b31b5c5dac tempest-VolumesSnapshotsTestJSON-782237458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ef0a4ae-0b7f-4dfe-b02f-cdcf63fee437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-724773042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d2ddf5f1-ca93-4d2c-ba9b-0eb432223718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef6ca19b86d748438ebfd030f2f293e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:35:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:35:46Z,use_quota=True,user_id='d5aa01fa55ad4b6b8f7f8d0557273565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:35:45.840862 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-6872e286-8a4d-4d65-acd8-fb7abba10c4b req-d7dd8e18-6eed-419f-bd80-04b31b5c5dac tempest-VolumesSnapshotsTestJSON-782237458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6ba0c5a-50a1-425b-98b0-ff1d01900871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:35:45.845436 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-6872e286-8a4d-4d65-acd8-fb7abba10c4b req-d7dd8e18-6eed-419f-bd80-04b31b5c5dac tempest-VolumesSnapshotsTestJSON-782237458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6ba0c5a-50a1-425b-98b0-ff1d01900871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:35:45.850483 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-6872e286-8a4d-4d65-acd8-fb7abba10c4b req-d7dd8e18-6eed-419f-bd80-04b31b5c5dac tempest-VolumesSnapshotsTestJSON-782237458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e848d7-14c9-48fc-9abd-f7bedca7361b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:35:45.855043 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-6872e286-8a4d-4d65-acd8-fb7abba10c4b req-d7dd8e18-6eed-419f-bd80-04b31b5c5dac tempest-VolumesSnapshotsTestJSON-782237458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e848d7-14c9-48fc-9abd-f7bedca7361b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2ddf5f1-ca93-4d2c-ba9b-0eb432223718', 'volume_name': 'volume-d2ddf5f1-ca93-4d2c-ba9b-0eb432223718', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:35:45.859995 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-6872e286-8a4d-4d65-acd8-fb7abba10c4b req-d7dd8e18-6eed-419f-bd80-04b31b5c5dac tempest-VolumesSnapshotsTestJSON-782237458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75f3df8b-856b-4e07-93ba-fa422a13a932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:35:45.865165 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-6872e286-8a4d-4d65-acd8-fb7abba10c4b req-d7dd8e18-6eed-419f-bd80-04b31b5c5dac tempest-VolumesSnapshotsTestJSON-782237458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75f3df8b-856b-4e07-93ba-fa422a13a932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:35:45.869600 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-6872e286-8a4d-4d65-acd8-fb7abba10c4b req-d7dd8e18-6eed-419f-bd80-04b31b5c5dac tempest-VolumesSnapshotsTestJSON-782237458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9df297be-2380-4f19-b28d-58a4b7625564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:35:45.870641 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [req-6872e286-8a4d-4d65-acd8-fb7abba10c4b req-d7dd8e18-6eed-419f-bd80-04b31b5c5dac tempest-VolumesSnapshotsTestJSON-782237458 None] Volume d2ddf5f1-ca93-4d2c-ba9b-0eb432223718: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2ddf5f1-ca93-4d2c-ba9b-0eb432223718', 'volume_size': 1} May 21 21:35:45.871021 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-6872e286-8a4d-4d65-acd8-fb7abba10c4b req-d7dd8e18-6eed-419f-bd80-04b31b5c5dac tempest-VolumesSnapshotsTestJSON-782237458 None] creating volume 'volume-d2ddf5f1-ca93-4d2c-ba9b-0eb432223718' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:35:45.871826 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-6872e286-8a4d-4d65-acd8-fb7abba10c4b req-d7dd8e18-6eed-419f-bd80-04b31b5c5dac tempest-VolumesSnapshotsTestJSON-782237458 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:35:46.358576 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-6872e286-8a4d-4d65-acd8-fb7abba10c4b req-d7dd8e18-6eed-419f-bd80-04b31b5c5dac tempest-VolumesSnapshotsTestJSON-782237458 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:35:46.359528 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-6872e286-8a4d-4d65-acd8-fb7abba10c4b req-d7dd8e18-6eed-419f-bd80-04b31b5c5dac tempest-VolumesSnapshotsTestJSON-782237458 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:35:46.364754 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-6872e286-8a4d-4d65-acd8-fb7abba10c4b req-d7dd8e18-6eed-419f-bd80-04b31b5c5dac tempest-VolumesSnapshotsTestJSON-782237458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9df297be-2380-4f19-b28d-58a4b7625564) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2ddf5f1-ca93-4d2c-ba9b-0eb432223718', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:35:46.369379 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-6872e286-8a4d-4d65-acd8-fb7abba10c4b req-d7dd8e18-6eed-419f-bd80-04b31b5c5dac tempest-VolumesSnapshotsTestJSON-782237458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb75497b-d1e3-4517-b9d4-21b1fccdc190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:35:46.479650 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [req-6872e286-8a4d-4d65-acd8-fb7abba10c4b req-d7dd8e18-6eed-419f-bd80-04b31b5c5dac tempest-VolumesSnapshotsTestJSON-782237458 None] Volume volume-d2ddf5f1-ca93-4d2c-ba9b-0eb432223718 (d2ddf5f1-ca93-4d2c-ba9b-0eb432223718): created successfully May 21 21:35:46.484497 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-6872e286-8a4d-4d65-acd8-fb7abba10c4b req-d7dd8e18-6eed-419f-bd80-04b31b5c5dac tempest-VolumesSnapshotsTestJSON-782237458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb75497b-d1e3-4517-b9d4-21b1fccdc190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:35:46.497712 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-6872e286-8a4d-4d65-acd8-fb7abba10c4b req-d7dd8e18-6eed-419f-bd80-04b31b5c5dac tempest-VolumesSnapshotsTestJSON-782237458 None] Flow 'volume_create_manager' (5e7d9b2b-7cc3-489d-8457-45117c191e43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:35:46.620711 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-6872e286-8a4d-4d65-acd8-fb7abba10c4b req-d7dd8e18-6eed-419f-bd80-04b31b5c5dac tempest-VolumesSnapshotsTestJSON-782237458 None] Created volume successfully. May 21 21:35:47.458014 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:35:47.459485 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:35:47.504418 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:35:47.568852 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:35:47.572961 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-ca663c14-92a6-41e7-b292-e1de12bb5944 tempest-VolumesDeleteCascade-522251888 None] Create snapshot completed successfully May 21 21:35:47.903541 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-a83081b8-d75c-41af-8f4d-7a6239bc2bd9 req-f68ab826-e69f-420e-a8e0-f0803dc2e7de tempest-VolumesSnapshotsTestJSON-782237458 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:35:48.413126 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-05c6b5f8-b9f2-4a8c-88b7-cade49d649b3 tempest-VolumesDeleteCascade-522251888 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:35:49.888475 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=55,cinder:INSERT=9,cinder:UPDATE=34,cinder:DELETE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:35:49.997659 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-a83081b8-d75c-41af-8f4d-7a6239bc2bd9 req-f68ab826-e69f-420e-a8e0-f0803dc2e7de tempest-VolumesSnapshotsTestJSON-782237458 None] Create snapshot completed successfully May 21 21:35:51.187665 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-05c6b5f8-b9f2-4a8c-88b7-cade49d649b3 tempest-VolumesDeleteCascade-522251888 None] Create snapshot completed successfully May 21 21:35:51.258165 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [req-bc047c40-d93d-49d5-a9bc-0eaa17dbe523 req-cce28517-190b-475d-a18c-450071529d65 tempest-VolumesSnapshotsTestJSON-782237458 None] Lock "b'cinder-4c98838a-b181-4285-9fd1-c2dd37e4e352-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:35:51.259747 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-bc047c40-d93d-49d5-a9bc-0eaa17dbe523 req-cce28517-190b-475d-a18c-450071529d65 tempest-VolumesSnapshotsTestJSON-782237458 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:35:51.954094 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-73156d7e-3c13-4591-a623-0f4bc73707fc tempest-VolumesDeleteCascade-522251888 None] Lock "b'cinder-9160cc7f-3466-4093-a4ea-b0bee1bf1280-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:35:52.112022 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-73156d7e-3c13-4591-a623-0f4bc73707fc tempest-VolumesDeleteCascade-522251888 None] Performing cascade delete. {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/manager.py:966}} May 21 21:35:52.146709 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-73156d7e-3c13-4591-a623-0f4bc73707fc tempest-VolumesDeleteCascade-522251888 None] Lock "b'cinder-a83ab347-9cd4-43ba-b60a-3c5c034ac3a7-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.013s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:35:52.172698 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-73156d7e-3c13-4591-a623-0f4bc73707fc tempest-VolumesDeleteCascade-522251888 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:35:54.216423 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [req-bc047c40-d93d-49d5-a9bc-0eaa17dbe523 req-cce28517-190b-475d-a18c-450071529d65 tempest-VolumesSnapshotsTestJSON-782237458 None] Created reservations ['07b9b405-7091-4992-88bb-634ae1f167b0', '3ec4393d-b0e9-4fa3-9a00-4a4de466fa26', '37a9166f-3e03-4555-b4d9-fce59b3bd287', '6ac979b8-de16-43f1-913e-3ac695189b71'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:35:54.557093 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-bc047c40-d93d-49d5-a9bc-0eaa17dbe523 req-cce28517-190b-475d-a18c-450071529d65 tempest-VolumesSnapshotsTestJSON-782237458 None] Delete snapshot completed successfully. May 21 21:35:54.563155 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [req-bc047c40-d93d-49d5-a9bc-0eaa17dbe523 req-cce28517-190b-475d-a18c-450071529d65 tempest-VolumesSnapshotsTestJSON-782237458 None] Lock "b'cinder-4c98838a-b181-4285-9fd1-c2dd37e4e352-delete_snapshot'" released by "delete_snapshot" :: held 3.305s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:35:54.816403 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [req-01da55c1-cda3-4b4e-a4d1-6a3a2a367646 req-827d98ab-2747-48d6-b102-2dbfa9aaeac5 tempest-VolumesSnapshotsTestJSON-782237458 None] Lock "b'cinder-d2ddf5f1-ca93-4d2c-ba9b-0eb432223718-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:35:54.949053 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-01da55c1-cda3-4b4e-a4d1-6a3a2a367646 req-827d98ab-2747-48d6-b102-2dbfa9aaeac5 tempest-VolumesSnapshotsTestJSON-782237458 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:35:55.162493 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-01da55c1-cda3-4b4e-a4d1-6a3a2a367646 req-827d98ab-2747-48d6-b102-2dbfa9aaeac5 tempest-VolumesSnapshotsTestJSON-782237458 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:35:55.172864 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-01da55c1-cda3-4b4e-a4d1-6a3a2a367646 req-827d98ab-2747-48d6-b102-2dbfa9aaeac5 tempest-VolumesSnapshotsTestJSON-782237458 None] Volume volume-d2ddf5f1-ca93-4d2c-ba9b-0eb432223718 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:35:55.260699 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-01da55c1-cda3-4b4e-a4d1-6a3a2a367646 req-827d98ab-2747-48d6-b102-2dbfa9aaeac5 tempest-VolumesSnapshotsTestJSON-782237458 None] deleting rbd volume volume-d2ddf5f1-ca93-4d2c-ba9b-0eb432223718 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:35:55.449087 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-73156d7e-3c13-4591-a623-0f4bc73707fc tempest-VolumesDeleteCascade-522251888 None] Created reservations ['87d42359-6d2f-4c0a-9dfb-0cdda5bc72a5', 'ae782eeb-912b-43ce-a915-249e14278de7', 'b8492bdb-b1c3-4866-b085-42b2dcd72048', 'f8e71f39-c020-4e69-8f95-8e1d8fac9e84'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:35:55.685809 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-73156d7e-3c13-4591-a623-0f4bc73707fc tempest-VolumesDeleteCascade-522251888 None] Delete snapshot completed successfully. May 21 21:35:55.694859 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-73156d7e-3c13-4591-a623-0f4bc73707fc tempest-VolumesDeleteCascade-522251888 None] Lock "b'cinder-a83ab347-9cd4-43ba-b60a-3c5c034ac3a7-delete_snapshot'" released by "delete_snapshot" :: held 3.545s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:35:55.702426 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-73156d7e-3c13-4591-a623-0f4bc73707fc tempest-VolumesDeleteCascade-522251888 None] Lock "b'cinder-bf912f4c-fde2-4756-9563-a5026ba19b01-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:35:55.730040 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-73156d7e-3c13-4591-a623-0f4bc73707fc tempest-VolumesDeleteCascade-522251888 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:35:56.039873 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=70,cinder:UPDATE=20,cinder:DELETE=4,cinder:INSERT=6 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:35:56.238523 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-57b70168-8d5e-488d-8ec1-ece9d0458145 tempest-AttachVolumeShelveTestJSON-418539187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:35:56.275088 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-57b70168-8d5e-488d-8ec1-ece9d0458145 tempest-AttachVolumeShelveTestJSON-418539187 None] Flow 'volume_create_manager' (8434e5ac-8d4c-4cd6-9fcc-f9d7fe5f9625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:35:56.283780 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-57b70168-8d5e-488d-8ec1-ece9d0458145 tempest-AttachVolumeShelveTestJSON-418539187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e38112e-8ad6-4126-b33a-1a36f48deb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:35:56.304686 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-57b70168-8d5e-488d-8ec1-ece9d0458145 tempest-AttachVolumeShelveTestJSON-418539187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e38112e-8ad6-4126-b33a-1a36f48deb03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-375591320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=864c40b1-6204-4590-b0ce-4ef445d07347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28972bcc37da4f9188ffca6bd1a9a3b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:35:56Z,use_quota=True,user_id='b29c0c0fb03c46838f3efe58b16c68d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:35:56.311902 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-57b70168-8d5e-488d-8ec1-ece9d0458145 tempest-AttachVolumeShelveTestJSON-418539187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (568b1c4e-9c00-46be-802b-28da17bd9aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:35:56.316859 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-57b70168-8d5e-488d-8ec1-ece9d0458145 tempest-AttachVolumeShelveTestJSON-418539187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (568b1c4e-9c00-46be-802b-28da17bd9aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:35:56.327466 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-57b70168-8d5e-488d-8ec1-ece9d0458145 tempest-AttachVolumeShelveTestJSON-418539187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb2b2e95-2d96-4371-a955-d0cd9418200c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:35:56.336505 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-57b70168-8d5e-488d-8ec1-ece9d0458145 tempest-AttachVolumeShelveTestJSON-418539187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb2b2e95-2d96-4371-a955-d0cd9418200c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '864c40b1-6204-4590-b0ce-4ef445d07347', 'volume_name': 'volume-864c40b1-6204-4590-b0ce-4ef445d07347', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:35:56.339848 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-57b70168-8d5e-488d-8ec1-ece9d0458145 tempest-AttachVolumeShelveTestJSON-418539187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26e730c1-bcd5-423d-9df4-2a6ede6a9aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:35:56.345808 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-57b70168-8d5e-488d-8ec1-ece9d0458145 tempest-AttachVolumeShelveTestJSON-418539187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26e730c1-bcd5-423d-9df4-2a6ede6a9aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:35:56.351137 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-57b70168-8d5e-488d-8ec1-ece9d0458145 tempest-AttachVolumeShelveTestJSON-418539187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b490da03-919b-49d3-8e0e-1421044c8ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:35:56.353003 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-57b70168-8d5e-488d-8ec1-ece9d0458145 tempest-AttachVolumeShelveTestJSON-418539187 None] Volume 864c40b1-6204-4590-b0ce-4ef445d07347: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-864c40b1-6204-4590-b0ce-4ef445d07347', 'volume_size': 1} May 21 21:35:56.353723 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-57b70168-8d5e-488d-8ec1-ece9d0458145 tempest-AttachVolumeShelveTestJSON-418539187 None] creating volume 'volume-864c40b1-6204-4590-b0ce-4ef445d07347' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:35:56.354420 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-57b70168-8d5e-488d-8ec1-ece9d0458145 tempest-AttachVolumeShelveTestJSON-418539187 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:35:57.312048 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-57b70168-8d5e-488d-8ec1-ece9d0458145 tempest-AttachVolumeShelveTestJSON-418539187 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:35:57.316608 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-57b70168-8d5e-488d-8ec1-ece9d0458145 tempest-AttachVolumeShelveTestJSON-418539187 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:35:57.317304 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-57b70168-8d5e-488d-8ec1-ece9d0458145 tempest-AttachVolumeShelveTestJSON-418539187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b490da03-919b-49d3-8e0e-1421044c8ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-864c40b1-6204-4590-b0ce-4ef445d07347', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:35:57.321938 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-57b70168-8d5e-488d-8ec1-ece9d0458145 tempest-AttachVolumeShelveTestJSON-418539187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baebef10-f36b-417a-b50a-dc08c2a73095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:35:57.448498 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-57b70168-8d5e-488d-8ec1-ece9d0458145 tempest-AttachVolumeShelveTestJSON-418539187 None] Volume volume-864c40b1-6204-4590-b0ce-4ef445d07347 (864c40b1-6204-4590-b0ce-4ef445d07347): created successfully May 21 21:35:57.452438 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-57b70168-8d5e-488d-8ec1-ece9d0458145 tempest-AttachVolumeShelveTestJSON-418539187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baebef10-f36b-417a-b50a-dc08c2a73095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:35:57.458572 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-57b70168-8d5e-488d-8ec1-ece9d0458145 tempest-AttachVolumeShelveTestJSON-418539187 None] Flow 'volume_create_manager' (8434e5ac-8d4c-4cd6-9fcc-f9d7fe5f9625) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:35:57.534415 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-57b70168-8d5e-488d-8ec1-ece9d0458145 tempest-AttachVolumeShelveTestJSON-418539187 None] Created volume successfully. May 21 21:35:59.496681 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [req-01da55c1-cda3-4b4e-a4d1-6a3a2a367646 req-827d98ab-2747-48d6-b102-2dbfa9aaeac5 tempest-VolumesSnapshotsTestJSON-782237458 None] Created reservations ['2983c9e5-912e-42c8-8883-7729e5b857d1', '394f5cfd-3e0e-4474-8e61-1a874a94e13b', 'ead2cbfa-0c86-44eb-b506-f8a56eef1c86', '7edcb6b3-67ee-4601-9d4f-16b7ee988ed9'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:35:59.776317 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-01da55c1-cda3-4b4e-a4d1-6a3a2a367646 req-827d98ab-2747-48d6-b102-2dbfa9aaeac5 tempest-VolumesSnapshotsTestJSON-782237458 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:35:59.847677 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-01da55c1-cda3-4b4e-a4d1-6a3a2a367646 req-827d98ab-2747-48d6-b102-2dbfa9aaeac5 tempest-VolumesSnapshotsTestJSON-782237458 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:35:59.908838 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [req-01da55c1-cda3-4b4e-a4d1-6a3a2a367646 req-827d98ab-2747-48d6-b102-2dbfa9aaeac5 tempest-VolumesSnapshotsTestJSON-782237458 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:35:59.916504 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-01da55c1-cda3-4b4e-a4d1-6a3a2a367646 req-827d98ab-2747-48d6-b102-2dbfa9aaeac5 tempest-VolumesSnapshotsTestJSON-782237458 None] Deleted volume successfully. May 21 21:35:59.988392 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-73156d7e-3c13-4591-a623-0f4bc73707fc tempest-VolumesDeleteCascade-522251888 None] Created reservations ['16e8ec7c-3fc6-45f8-b1fa-a1203512fa81', '5960df3b-ee74-4b39-8399-0fc2a9faf350', 'd496b965-3289-47ff-86c9-e683b5aade64', 'b6e28b5e-5ad6-4e6e-89a1-001e845210c5'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:36:00.016867 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [req-01da55c1-cda3-4b4e-a4d1-6a3a2a367646 req-827d98ab-2747-48d6-b102-2dbfa9aaeac5 tempest-VolumesSnapshotsTestJSON-782237458 None] Lock "b'cinder-d2ddf5f1-ca93-4d2c-ba9b-0eb432223718-delete_volume'" released by "delete_volume" :: held 5.202s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:36:00.254065 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-73156d7e-3c13-4591-a623-0f4bc73707fc tempest-VolumesDeleteCascade-522251888 None] Delete snapshot completed successfully. May 21 21:36:00.259003 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-73156d7e-3c13-4591-a623-0f4bc73707fc tempest-VolumesDeleteCascade-522251888 None] Lock "b'cinder-bf912f4c-fde2-4756-9563-a5026ba19b01-delete_snapshot'" released by "delete_snapshot" :: held 4.558s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:36:00.263596 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-73156d7e-3c13-4591-a623-0f4bc73707fc tempest-VolumesDeleteCascade-522251888 None] Snapshots deleted, issuing volume delete {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/manager.py:981}} May 21 21:36:00.263596 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-73156d7e-3c13-4591-a623-0f4bc73707fc tempest-VolumesDeleteCascade-522251888 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:36:00.553888 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-73156d7e-3c13-4591-a623-0f4bc73707fc tempest-VolumesDeleteCascade-522251888 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:36:00.556175 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-73156d7e-3c13-4591-a623-0f4bc73707fc tempest-VolumesDeleteCascade-522251888 None] Volume volume-9160cc7f-3466-4093-a4ea-b0bee1bf1280 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:36:00.654741 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-73156d7e-3c13-4591-a623-0f4bc73707fc tempest-VolumesDeleteCascade-522251888 None] deleting rbd volume volume-9160cc7f-3466-4093-a4ea-b0bee1bf1280 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:36:03.808741 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-73156d7e-3c13-4591-a623-0f4bc73707fc tempest-VolumesDeleteCascade-522251888 None] Created reservations ['5719a627-f002-4ab7-9ca8-bc4fdcb0fa14', 'da9885b0-05c5-4b57-b0ff-a626e3f03106', 'e007fb9c-2cfe-4776-b396-46ec5bfde3e1', 'f2bdc35b-8241-4c12-bbdc-6d5633ebf9ec'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:36:04.039388 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-73156d7e-3c13-4591-a623-0f4bc73707fc tempest-VolumesDeleteCascade-522251888 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:36:04.075624 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-73156d7e-3c13-4591-a623-0f4bc73707fc tempest-VolumesDeleteCascade-522251888 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:36:04.101293 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-73156d7e-3c13-4591-a623-0f4bc73707fc tempest-VolumesDeleteCascade-522251888 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:36:04.105441 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-73156d7e-3c13-4591-a623-0f4bc73707fc tempest-VolumesDeleteCascade-522251888 None] Deleted volume successfully. May 21 21:36:04.204512 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-73156d7e-3c13-4591-a623-0f4bc73707fc tempest-VolumesDeleteCascade-522251888 None] Lock "b'cinder-9160cc7f-3466-4093-a4ea-b0bee1bf1280-delete_volume'" released by "delete_volume" :: held 12.250s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:36:12.865316 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-49b2002f-54a5-442d-9ec6-985db35d6c4d tempest-VolumesActionsTest-344293892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:36:12.996862 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-49b2002f-54a5-442d-9ec6-985db35d6c4d tempest-VolumesActionsTest-344293892 None] Flow 'volume_create_manager' (3adf829c-50b1-43d9-b2f3-ed836f40873b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:36:13.054305 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-49b2002f-54a5-442d-9ec6-985db35d6c4d tempest-VolumesActionsTest-344293892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e061d950-5833-48ba-bbf6-198601cc1306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:36:13.114057 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=53,cinder:INSERT=8,cinder:UPDATE=37,cinder:DELETE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:36:13.129163 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-49b2002f-54a5-442d-9ec6-985db35d6c4d tempest-VolumesActionsTest-344293892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e061d950-5833-48ba-bbf6-198601cc1306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:36:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1110154283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c0e89e43-4281-48f1-8170-e196587d4f23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dadf0c028b4441b0871d6c484ed30418',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:36:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:36:13Z,use_quota=True,user_id='991088a86b78431a96c0d4f69035e791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:36:13.141400 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-49b2002f-54a5-442d-9ec6-985db35d6c4d tempest-VolumesActionsTest-344293892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eae2febb-347c-41ba-8bfa-713ba50ea848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:36:13.150914 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-49b2002f-54a5-442d-9ec6-985db35d6c4d tempest-VolumesActionsTest-344293892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eae2febb-347c-41ba-8bfa-713ba50ea848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:36:13.158124 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-49b2002f-54a5-442d-9ec6-985db35d6c4d tempest-VolumesActionsTest-344293892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8c245a6-5a9a-465c-afbb-2dae4d0470db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:36:13.162587 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-49b2002f-54a5-442d-9ec6-985db35d6c4d tempest-VolumesActionsTest-344293892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8c245a6-5a9a-465c-afbb-2dae4d0470db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0e89e43-4281-48f1-8170-e196587d4f23', 'volume_name': 'volume-c0e89e43-4281-48f1-8170-e196587d4f23', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:36:13.168456 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-49b2002f-54a5-442d-9ec6-985db35d6c4d tempest-VolumesActionsTest-344293892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b73a39f-f0fe-407f-8e28-2ab4e6460e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:36:13.172891 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-49b2002f-54a5-442d-9ec6-985db35d6c4d tempest-VolumesActionsTest-344293892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b73a39f-f0fe-407f-8e28-2ab4e6460e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:36:13.178304 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-49b2002f-54a5-442d-9ec6-985db35d6c4d tempest-VolumesActionsTest-344293892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6ff86d6-621a-4289-b30f-26769f31b01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:36:13.179576 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-49b2002f-54a5-442d-9ec6-985db35d6c4d tempest-VolumesActionsTest-344293892 None] Volume c0e89e43-4281-48f1-8170-e196587d4f23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0e89e43-4281-48f1-8170-e196587d4f23', 'volume_size': 1} May 21 21:36:13.180133 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-49b2002f-54a5-442d-9ec6-985db35d6c4d tempest-VolumesActionsTest-344293892 None] creating volume 'volume-c0e89e43-4281-48f1-8170-e196587d4f23' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:36:13.181070 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-49b2002f-54a5-442d-9ec6-985db35d6c4d tempest-VolumesActionsTest-344293892 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:36:13.756311 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-49b2002f-54a5-442d-9ec6-985db35d6c4d tempest-VolumesActionsTest-344293892 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:36:13.756709 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-49b2002f-54a5-442d-9ec6-985db35d6c4d tempest-VolumesActionsTest-344293892 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:36:13.761494 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-49b2002f-54a5-442d-9ec6-985db35d6c4d tempest-VolumesActionsTest-344293892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6ff86d6-621a-4289-b30f-26769f31b01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0e89e43-4281-48f1-8170-e196587d4f23', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:36:13.767073 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-49b2002f-54a5-442d-9ec6-985db35d6c4d tempest-VolumesActionsTest-344293892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d104afd-7b71-45e0-8be1-5c7969c06899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:36:13.834793 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-49b2002f-54a5-442d-9ec6-985db35d6c4d tempest-VolumesActionsTest-344293892 None] Volume volume-c0e89e43-4281-48f1-8170-e196587d4f23 (c0e89e43-4281-48f1-8170-e196587d4f23): created successfully May 21 21:36:13.854921 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-49b2002f-54a5-442d-9ec6-985db35d6c4d tempest-VolumesActionsTest-344293892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d104afd-7b71-45e0-8be1-5c7969c06899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:36:13.888220 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-49b2002f-54a5-442d-9ec6-985db35d6c4d tempest-VolumesActionsTest-344293892 None] Flow 'volume_create_manager' (3adf829c-50b1-43d9-b2f3-ed836f40873b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:36:14.008007 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-49b2002f-54a5-442d-9ec6-985db35d6c4d tempest-VolumesActionsTest-344293892 None] Created volume successfully. May 21 21:36:24.015750 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=37,cinder:INSERT=6,cinder:UPDATE=22,cinder:DELETE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:36:40.990372 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-f28e3bdb-0a79-42b3-9b52-599ae0c5b38b req-59fe7342-be70-4c13-8419-076f0cfcee0a tempest-AttachVolumeShelveTestJSON-418539187 None] No connector for attachment 6f65ee99-47af-4f79-bdc2-1eb55c86f468; skipping storage backend terminate_connection call. {{(pid=124407) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4912}} May 21 21:36:40.991057 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-f28e3bdb-0a79-42b3-9b52-599ae0c5b38b req-59fe7342-be70-4c13-8419-076f0cfcee0a tempest-AttachVolumeShelveTestJSON-418539187 None] Deleting attachment 6f65ee99-47af-4f79-bdc2-1eb55c86f468. {{(pid=124407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4957}} May 21 21:36:42.319746 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-c6bb052b-d883-49fe-9a68-8e9a51ed319f tempest-VolumesActionsTest-344293892 None] Lock "b'cinder-c0e89e43-4281-48f1-8170-e196587d4f23'" acquired by "attach_volume" :: waited 0.014s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:36:42.580032 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-c6bb052b-d883-49fe-9a68-8e9a51ed319f tempest-VolumesActionsTest-344293892 None] Attaching volume c0e89e43-4281-48f1-8170-e196587d4f23 to instance d7418aa6-4538-48fa-b168-64083d3f381c at mountpoint /dev/sdb on host None. May 21 21:36:42.711201 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-c6bb052b-d883-49fe-9a68-8e9a51ed319f tempest-VolumesActionsTest-344293892 None] Attach volume completed successfully. May 21 21:36:42.729616 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-c6bb052b-d883-49fe-9a68-8e9a51ed319f tempest-VolumesActionsTest-344293892 None] Lock "b'cinder-c0e89e43-4281-48f1-8170-e196587d4f23'" released by "attach_volume" :: held 0.409s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:36:42.995093 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-ee77b4f2-946b-4b49-8b04-b4cbab487b16 tempest-VolumesActionsTest-344293892 None] Lock "b'cinder-c0e89e43-4281-48f1-8170-e196587d4f23-detach_volume'" acquired by "detach_volume" :: waited 0.018s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:36:43.003302 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-ee77b4f2-946b-4b49-8b04-b4cbab487b16 tempest-VolumesActionsTest-344293892 None] Detaching volume c0e89e43-4281-48f1-8170-e196587d4f23 from instance d7418aa6-4538-48fa-b168-64083d3f381c. May 21 21:36:43.320376 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-ee77b4f2-946b-4b49-8b04-b4cbab487b16 tempest-VolumesActionsTest-344293892 None] Detach volume completed successfully. May 21 21:36:43.331035 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-ee77b4f2-946b-4b49-8b04-b4cbab487b16 tempest-VolumesActionsTest-344293892 None] Lock "b'cinder-c0e89e43-4281-48f1-8170-e196587d4f23-detach_volume'" released by "detach_volume" :: held 0.336s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:36:47.463355 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:36:47.469585 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:36:47.526807 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:36:47.595078 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:36:53.355370 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=26,cinder:UPDATE=7,cinder:INSERT=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:37:05.986429 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=20,cinder:UPDATE=4 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:37:12.741336 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-fcecc488-afb9-44a0-9841-22613fe2e511 tempest-VolumesActionsTest-344293892 None] Lock "b'cinder-c0e89e43-4281-48f1-8170-e196587d4f23'" acquired by "attach_volume" :: waited 0.011s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:37:12.892162 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-fcecc488-afb9-44a0-9841-22613fe2e511 tempest-VolumesActionsTest-344293892 None] Attaching volume c0e89e43-4281-48f1-8170-e196587d4f23 to instance 5fac7b33-2e5f-40a9-9bd6-4e23eba62e15 at mountpoint /dev/sdb on host None. May 21 21:37:13.017124 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-fcecc488-afb9-44a0-9841-22613fe2e511 tempest-VolumesActionsTest-344293892 None] Attach volume completed successfully. May 21 21:37:13.035379 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-fcecc488-afb9-44a0-9841-22613fe2e511 tempest-VolumesActionsTest-344293892 None] Lock "b'cinder-c0e89e43-4281-48f1-8170-e196587d4f23'" released by "attach_volume" :: held 0.298s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:37:13.260681 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-0858e565-6414-4b39-b837-70c36b3f531a tempest-VolumesActionsTest-344293892 None] Lock "b'cinder-c0e89e43-4281-48f1-8170-e196587d4f23-detach_volume'" acquired by "detach_volume" :: waited 0.010s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:37:13.273530 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-0858e565-6414-4b39-b837-70c36b3f531a tempest-VolumesActionsTest-344293892 None] Detaching volume c0e89e43-4281-48f1-8170-e196587d4f23 from instance 5fac7b33-2e5f-40a9-9bd6-4e23eba62e15. May 21 21:37:13.477976 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-0858e565-6414-4b39-b837-70c36b3f531a tempest-VolumesActionsTest-344293892 None] Detach volume completed successfully. May 21 21:37:13.484122 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-0858e565-6414-4b39-b837-70c36b3f531a tempest-VolumesActionsTest-344293892 None] Lock "b'cinder-c0e89e43-4281-48f1-8170-e196587d4f23-detach_volume'" released by "detach_volume" :: held 0.224s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:37:21.758417 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [None req-dd1196df-3322-43f8-8973-25dcc100408a tempest-VolumesActionsTest-344293892 None] Running cmd (subprocess): rbd export --pool volumes volume-c0e89e43-4281-48f1-8170-e196587d4f23 /opt/stack/data/cinder/conversion/volume-c0e89e43-4281-48f1-8170-e196587d4f23-8764c6cf-9e02-4fda-809d-3c2b8e618a52 --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:37:22.749638 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [None req-dd1196df-3322-43f8-8973-25dcc100408a tempest-VolumesActionsTest-344293892 None] CMD "rbd export --pool volumes volume-c0e89e43-4281-48f1-8170-e196587d4f23 /opt/stack/data/cinder/conversion/volume-c0e89e43-4281-48f1-8170-e196587d4f23-8764c6cf-9e02-4fda-809d-3c2b8e618a52 --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.991s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:37:22.763090 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.image_utils [None req-dd1196df-3322-43f8-8973-25dcc100408a tempest-VolumesActionsTest-344293892 None] 8764c6cf-9e02-4fda-809d-3c2b8e618a52 was raw, no need to convert to raw {{(pid=124407) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:815}} May 21 21:37:26.014155 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=24,cinder:UPDATE=4 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:37:45.990678 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:37:45.991450 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=18,cinder:INSERT=2,cinder:UPDATE=6 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:37:47.467500 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:37:47.471877 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:37:47.553488 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:37:47.701890 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:37:55.649147 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-8df55ad2-5ef1-4e86-9e96-3e797c944b41 tempest-AttachVolumeShelveTestJSON-418539187 None] Lock "b'cinder-864c40b1-6204-4590-b0ce-4ef445d07347-delete_volume'" acquired by "delete_volume" :: waited 0.032s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:37:55.848670 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8df55ad2-5ef1-4e86-9e96-3e797c944b41 tempest-AttachVolumeShelveTestJSON-418539187 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:37:56.014806 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8df55ad2-5ef1-4e86-9e96-3e797c944b41 tempest-AttachVolumeShelveTestJSON-418539187 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:37:56.015406 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8df55ad2-5ef1-4e86-9e96-3e797c944b41 tempest-AttachVolumeShelveTestJSON-418539187 None] Volume volume-864c40b1-6204-4590-b0ce-4ef445d07347 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:37:56.070942 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8df55ad2-5ef1-4e86-9e96-3e797c944b41 tempest-AttachVolumeShelveTestJSON-418539187 None] deleting rbd volume volume-864c40b1-6204-4590-b0ce-4ef445d07347 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:37:59.060088 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-8df55ad2-5ef1-4e86-9e96-3e797c944b41 tempest-AttachVolumeShelveTestJSON-418539187 None] Created reservations ['9d800f37-ff6e-4e16-8467-c4bd1f975962', 'dce6185e-992e-467f-a7ea-52500b2ae919', 'c01d6720-c4f9-4091-9d24-0a973f7b7324', 'b60a117b-7b69-490e-82f6-61e8767f8fbc'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:37:59.375151 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8df55ad2-5ef1-4e86-9e96-3e797c944b41 tempest-AttachVolumeShelveTestJSON-418539187 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:37:59.467488 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8df55ad2-5ef1-4e86-9e96-3e797c944b41 tempest-AttachVolumeShelveTestJSON-418539187 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:37:59.539490 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-8df55ad2-5ef1-4e86-9e96-3e797c944b41 tempest-AttachVolumeShelveTestJSON-418539187 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:37:59.547584 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-8df55ad2-5ef1-4e86-9e96-3e797c944b41 tempest-AttachVolumeShelveTestJSON-418539187 None] Deleted volume successfully. May 21 21:37:59.869505 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-dd1196df-3322-43f8-8973-25dcc100408a tempest-VolumesActionsTest-344293892 None] Uploaded volume to glance image-id: 8764c6cf-9e02-4fda-809d-3c2b8e618a52. {{(pid=124407) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1749}} May 21 21:37:59.891322 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-8df55ad2-5ef1-4e86-9e96-3e797c944b41 tempest-AttachVolumeShelveTestJSON-418539187 None] Lock "b'cinder-864c40b1-6204-4590-b0ce-4ef445d07347-delete_volume'" released by "delete_volume" :: held 4.242s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:37:59.973006 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-dd1196df-3322-43f8-8973-25dcc100408a tempest-VolumesActionsTest-344293892 None] Copy volume to image completed successfully. May 21 21:38:00.646707 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-aebb457e-9459-4c1c-b63b-3db49bf8016b tempest-AttachVolumeShelveTestJSON-418539187 None] Lock "b'cinder-fc38d82a-c55c-417b-ad9e-028de27fde5a-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:38:00.814585 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aebb457e-9459-4c1c-b63b-3db49bf8016b tempest-AttachVolumeShelveTestJSON-418539187 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:38:01.025134 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aebb457e-9459-4c1c-b63b-3db49bf8016b tempest-AttachVolumeShelveTestJSON-418539187 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:38:01.025725 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aebb457e-9459-4c1c-b63b-3db49bf8016b tempest-AttachVolumeShelveTestJSON-418539187 None] Volume volume-fc38d82a-c55c-417b-ad9e-028de27fde5a is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:38:01.088844 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aebb457e-9459-4c1c-b63b-3db49bf8016b tempest-AttachVolumeShelveTestJSON-418539187 None] deleting rbd volume volume-fc38d82a-c55c-417b-ad9e-028de27fde5a {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:38:03.412214 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-ead7752f-668f-41a6-8762-6cf4bae894ce tempest-VolumesActionsTest-344293892 None] Lock "b'cinder-c0e89e43-4281-48f1-8170-e196587d4f23-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:38:03.563722 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ead7752f-668f-41a6-8762-6cf4bae894ce tempest-VolumesActionsTest-344293892 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:38:03.848389 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ead7752f-668f-41a6-8762-6cf4bae894ce tempest-VolumesActionsTest-344293892 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:38:03.848807 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ead7752f-668f-41a6-8762-6cf4bae894ce tempest-VolumesActionsTest-344293892 None] Volume volume-c0e89e43-4281-48f1-8170-e196587d4f23 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:38:03.900128 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ead7752f-668f-41a6-8762-6cf4bae894ce tempest-VolumesActionsTest-344293892 None] deleting rbd volume volume-c0e89e43-4281-48f1-8170-e196587d4f23 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:38:04.054318 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-aebb457e-9459-4c1c-b63b-3db49bf8016b tempest-AttachVolumeShelveTestJSON-418539187 None] Created reservations ['d53b129a-3297-4aeb-a2cf-872b1ad7acd6', 'd2b7f7d7-0bc7-4e8e-8717-e579ecfebf9d', 'c2ca5d31-2877-4938-829c-d07be0bad67f', '17d7216a-9f28-4d4e-95d2-9e7b44f1e59d'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:38:04.291283 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aebb457e-9459-4c1c-b63b-3db49bf8016b tempest-AttachVolumeShelveTestJSON-418539187 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:38:04.359417 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aebb457e-9459-4c1c-b63b-3db49bf8016b tempest-AttachVolumeShelveTestJSON-418539187 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:38:04.387973 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aebb457e-9459-4c1c-b63b-3db49bf8016b tempest-AttachVolumeShelveTestJSON-418539187 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:38:04.418261 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-aebb457e-9459-4c1c-b63b-3db49bf8016b tempest-AttachVolumeShelveTestJSON-418539187 None] Deleted volume successfully. May 21 21:38:04.540523 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-aebb457e-9459-4c1c-b63b-3db49bf8016b tempest-AttachVolumeShelveTestJSON-418539187 None] Lock "b'cinder-fc38d82a-c55c-417b-ad9e-028de27fde5a-delete_volume'" released by "delete_volume" :: held 3.894s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:38:06.613356 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-ead7752f-668f-41a6-8762-6cf4bae894ce tempest-VolumesActionsTest-344293892 None] Created reservations ['ebfacbfc-a2c4-441d-9310-f9227b96c14e', 'd36c8a4a-c647-4161-b013-89dc36559324', '53299469-d778-47e2-85fe-798318f77175', '6821dcc9-690a-400e-b630-4041893406e2'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:38:06.901051 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ead7752f-668f-41a6-8762-6cf4bae894ce tempest-VolumesActionsTest-344293892 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:38:06.950087 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ead7752f-668f-41a6-8762-6cf4bae894ce tempest-VolumesActionsTest-344293892 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:38:07.043310 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-ead7752f-668f-41a6-8762-6cf4bae894ce tempest-VolumesActionsTest-344293892 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:38:07.048390 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-ead7752f-668f-41a6-8762-6cf4bae894ce tempest-VolumesActionsTest-344293892 None] Deleted volume successfully. May 21 21:38:07.175441 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-ead7752f-668f-41a6-8762-6cf4bae894ce tempest-VolumesActionsTest-344293892 None] Lock "b'cinder-c0e89e43-4281-48f1-8170-e196587d4f23-delete_volume'" released by "delete_volume" :: held 3.762s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:38:14.343166 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-c37bc7db-e6cb-42ef-981e-7cd157a32a02 tempest-VolumesExtendTest-315302066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:38:14.368586 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-c37bc7db-e6cb-42ef-981e-7cd157a32a02 tempest-VolumesExtendTest-315302066 None] Flow 'volume_create_manager' (e9e1807a-056c-4a7c-8de1-9e5888c859fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:38:14.375427 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-c37bc7db-e6cb-42ef-981e-7cd157a32a02 tempest-VolumesExtendTest-315302066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (444b08cb-9950-46e7-be14-a2e2f85ea856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:38:14.391915 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-c37bc7db-e6cb-42ef-981e-7cd157a32a02 tempest-VolumesExtendTest-315302066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (444b08cb-9950-46e7-be14-a2e2f85ea856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1627224969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f276e36b-7ee4-4c4b-8633-777228c146f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e363e22d4b4b118aaea8fa8cbad2a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:38:14Z,use_quota=True,user_id='f11649ec03b740f9804f7555d904bb86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:38:14.397341 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-c37bc7db-e6cb-42ef-981e-7cd157a32a02 tempest-VolumesExtendTest-315302066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ccfa586-0dcb-4853-b9c1-443baae656ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:38:14.401769 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-c37bc7db-e6cb-42ef-981e-7cd157a32a02 tempest-VolumesExtendTest-315302066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ccfa586-0dcb-4853-b9c1-443baae656ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:38:14.407498 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-c37bc7db-e6cb-42ef-981e-7cd157a32a02 tempest-VolumesExtendTest-315302066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7bbb201-da1a-406b-bdbc-422175dd2502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:38:14.537411 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-c37bc7db-e6cb-42ef-981e-7cd157a32a02 tempest-VolumesExtendTest-315302066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7bbb201-da1a-406b-bdbc-422175dd2502) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f276e36b-7ee4-4c4b-8633-777228c146f1', 'volume_name': 'volume-f276e36b-7ee4-4c4b-8633-777228c146f1', 'volume_size': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5593f8cb452404083dfa177b4ee68b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'created_at': datetime.datetime(2022, 5, 21, 21, 0, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:38:14.558970 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-c37bc7db-e6cb-42ef-981e-7cd157a32a02 tempest-VolumesExtendTest-315302066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f470d7-a87a-4505-9cdb-f26b989e1a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:38:14.563167 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-c37bc7db-e6cb-42ef-981e-7cd157a32a02 tempest-VolumesExtendTest-315302066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f470d7-a87a-4505-9cdb-f26b989e1a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:38:14.568892 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-c37bc7db-e6cb-42ef-981e-7cd157a32a02 tempest-VolumesExtendTest-315302066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba2c7009-6b99-4ee3-8f04-717494b1fb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:38:14.570575 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-c37bc7db-e6cb-42ef-981e-7cd157a32a02 tempest-VolumesExtendTest-315302066 None] Volume f276e36b-7ee4-4c4b-8633-777228c146f1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f276e36b-7ee4-4c4b-8633-777228c146f1', 'volume_size': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5593f8cb452404083dfa177b4ee68b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'created_at': datetime.datetime(2022, 5, 21, 21, 0, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } May 21 21:38:14.571635 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-c37bc7db-e6cb-42ef-981e-7cd157a32a02 tempest-VolumesExtendTest-315302066 None] Cloning f276e36b-7ee4-4c4b-8633-777228c146f1 from image e570f5eb-6047-4214-a420-fdfdbdf19a4c at location (None, None). {{(pid=124407) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1053}} May 21 21:38:14.590840 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-c37bc7db-e6cb-42ef-981e-7cd157a32a02 tempest-VolumesExtendTest-315302066 None] Lock "b'cinder-e570f5eb-6047-4214-a420-fdfdbdf19a4c'" acquired by "_prepare_image_cache_entry" :: waited 0.018s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:38:14.685596 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-c37bc7db-e6cb-42ef-981e-7cd157a32a02 tempest-VolumesExtendTest-315302066 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'volume_id': '4057e637-23ba-493f-a45d-eb28c07ac60a', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28), 'last_used': datetime.datetime(2022, 5, 21, 21, 38, 14, 596410)}. {{(pid=124407) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 21 21:38:14.685962 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-c37bc7db-e6cb-42ef-981e-7cd157a32a02 tempest-VolumesExtendTest-315302066 None] Image-volume cache entry image_update_at = 2022-05-21 21:00:28+00:00, requested image updated_at = 2022-05-21 21:00:28+00:00. {{(pid=124407) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 21 21:38:14.686371 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-c37bc7db-e6cb-42ef-981e-7cd157a32a02 tempest-VolumesExtendTest-315302066 None] Found cache entry for image = e570f5eb-6047-4214-a420-fdfdbdf19a4c on host ncdv-master-1@ceph#ceph. {{(pid=124407) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:876}} May 21 21:38:14.698649 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-c37bc7db-e6cb-42ef-981e-7cd157a32a02 tempest-VolumesExtendTest-315302066 None] Lock "b'cinder-e570f5eb-6047-4214-a420-fdfdbdf19a4c'" released by "_prepare_image_cache_entry" :: held 0.108s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:38:14.699761 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-c37bc7db-e6cb-42ef-981e-7cd157a32a02 tempest-VolumesExtendTest-315302066 None] Attempting to retrieve cache entry for image = e570f5eb-6047-4214-a420-fdfdbdf19a4c on host ncdv-master-1@ceph#ceph. {{(pid=124407) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:817}} May 21 21:38:14.707732 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-c37bc7db-e6cb-42ef-981e-7cd157a32a02 tempest-VolumesExtendTest-315302066 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'volume_id': '4057e637-23ba-493f-a45d-eb28c07ac60a', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28), 'last_used': datetime.datetime(2022, 5, 21, 21, 38, 14, 704105)}. {{(pid=124407) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 21 21:38:14.708156 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-c37bc7db-e6cb-42ef-981e-7cd157a32a02 tempest-VolumesExtendTest-315302066 None] Image-volume cache entry image_update_at = 2022-05-21 21:00:28+00:00, requested image updated_at = 2022-05-21 21:00:28+00:00. {{(pid=124407) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 21 21:38:14.708670 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-c37bc7db-e6cb-42ef-981e-7cd157a32a02 tempest-VolumesExtendTest-315302066 None] Creating from source image-volume 4057e637-23ba-493f-a45d-eb28c07ac60a {{(pid=124407) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:831}} May 21 21:38:14.722892 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c37bc7db-e6cb-42ef-981e-7cd157a32a02 tempest-VolumesExtendTest-315302066 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:38:14.905609 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c37bc7db-e6cb-42ef-981e-7cd157a32a02 tempest-VolumesExtendTest-315302066 None] creating snapshot='volume-f276e36b-7ee4-4c4b-8633-777228c146f1.clone_snap' {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 21 21:38:15.941361 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c37bc7db-e6cb-42ef-981e-7cd157a32a02 tempest-VolumesExtendTest-315302066 None] cloning 'volume-4057e637-23ba-493f-a45d-eb28c07ac60a@volume-f276e36b-7ee4-4c4b-8633-777228c146f1.clone_snap' to 'volume-f276e36b-7ee4-4c4b-8633-777228c146f1' {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:789}} May 21 21:38:16.858017 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c37bc7db-e6cb-42ef-981e-7cd157a32a02 tempest-VolumesExtendTest-315302066 None] Volume volume-b9ebacac-5f32-42e3-9194-003aee7e2435.deleted is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:38:16.859493 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c37bc7db-e6cb-42ef-981e-7cd157a32a02 tempest-VolumesExtendTest-315302066 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:38:16.860079 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c37bc7db-e6cb-42ef-981e-7cd157a32a02 tempest-VolumesExtendTest-315302066 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:38:17.104100 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c37bc7db-e6cb-42ef-981e-7cd157a32a02 tempest-VolumesExtendTest-315302066 None] clone created successfully {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:862}} May 21 21:38:17.104877 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.volume_utils [None req-c37bc7db-e6cb-42ef-981e-7cd157a32a02 tempest-VolumesExtendTest-315302066 None] Marking volume f276e36b-7ee4-4c4b-8633-777228c146f1 as bootable. {{(pid=124407) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} May 21 21:38:17.204428 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-c37bc7db-e6cb-42ef-981e-7cd157a32a02 tempest-VolumesExtendTest-315302066 None] Copying metadata from image e570f5eb-6047-4214-a420-fdfdbdf19a4c to f276e36b-7ee4-4c4b-8633-777228c146f1. {{(pid=124407) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} May 21 21:38:17.205069 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-c37bc7db-e6cb-42ef-981e-7cd157a32a02 tempest-VolumesExtendTest-315302066 None] Creating volume glance metadata for volume f276e36b-7ee4-4c4b-8633-777228c146f1 backed by image e570f5eb-6047-4214-a420-fdfdbdf19a4c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=124407) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:673}} May 21 21:38:17.215696 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=50,cinder:UPDATE=23,cinder:INSERT=6,cinder:DELETE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:38:17.215696 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=52,cinder:UPDATE=34,cinder:INSERT=6,cinder:DELETE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:38:17.349773 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-c37bc7db-e6cb-42ef-981e-7cd157a32a02 tempest-VolumesExtendTest-315302066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba2c7009-6b99-4ee3-8f04-717494b1fb14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f276e36b-7ee4-4c4b-8633-777228c146f1', 'volume_size': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5593f8cb452404083dfa177b4ee68b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'created_at': datetime.datetime(2022, 5, 21, 21, 0, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:38:17.354310 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-c37bc7db-e6cb-42ef-981e-7cd157a32a02 tempest-VolumesExtendTest-315302066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb84222b-42ad-4624-8748-c566b8623a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:38:17.434961 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-c37bc7db-e6cb-42ef-981e-7cd157a32a02 tempest-VolumesExtendTest-315302066 None] Volume volume-f276e36b-7ee4-4c4b-8633-777228c146f1 (f276e36b-7ee4-4c4b-8633-777228c146f1): created successfully May 21 21:38:17.441775 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-c37bc7db-e6cb-42ef-981e-7cd157a32a02 tempest-VolumesExtendTest-315302066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb84222b-42ad-4624-8748-c566b8623a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:38:17.449043 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-c37bc7db-e6cb-42ef-981e-7cd157a32a02 tempest-VolumesExtendTest-315302066 None] Flow 'volume_create_manager' (e9e1807a-056c-4a7c-8de1-9e5888c859fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:38:17.551701 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-c37bc7db-e6cb-42ef-981e-7cd157a32a02 tempest-VolumesExtendTest-315302066 None] Created volume successfully. May 21 21:38:18.749824 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ced5c027-94ff-42b2-9cf9-3a334ec66a76 tempest-VolumesExtendTest-315302066 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:38:19.604244 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ced5c027-94ff-42b2-9cf9-3a334ec66a76 tempest-VolumesExtendTest-315302066 None] Extend volume from 1 GB to 2 GB. {{(pid=124407) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1886}} May 21 21:38:19.873307 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-ced5c027-94ff-42b2-9cf9-3a334ec66a76 tempest-VolumesExtendTest-315302066 None] Extend volume completed successfully. May 21 21:38:22.422875 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-e041d6ca-f144-4e64-bb3c-badf09acf487 tempest-VolumesExtendTest-315302066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:38:22.464861 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-e041d6ca-f144-4e64-bb3c-badf09acf487 tempest-VolumesExtendTest-315302066 None] Flow 'volume_create_manager' (cfcbba22-d081-4254-8b00-a9d4ce5765c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:38:22.476204 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-e041d6ca-f144-4e64-bb3c-badf09acf487 tempest-VolumesExtendTest-315302066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd190437-dbbf-4741-a935-2b9f50c29a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:38:22.520270 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-e041d6ca-f144-4e64-bb3c-badf09acf487 tempest-VolumesExtendTest-315302066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd190437-dbbf-4741-a935-2b9f50c29a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:38:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1658522788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c77e0ebf-20bd-452a-9b74-4bbb8f76974f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e363e22d4b4b118aaea8fa8cbad2a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:38:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:38:22Z,use_quota=True,user_id='f11649ec03b740f9804f7555d904bb86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:38:22.529182 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-e041d6ca-f144-4e64-bb3c-badf09acf487 tempest-VolumesExtendTest-315302066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df5efd54-a8be-4b94-b464-80f30d14e813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:38:22.535486 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-e041d6ca-f144-4e64-bb3c-badf09acf487 tempest-VolumesExtendTest-315302066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df5efd54-a8be-4b94-b464-80f30d14e813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:38:22.544034 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-e041d6ca-f144-4e64-bb3c-badf09acf487 tempest-VolumesExtendTest-315302066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd8579ed-5fee-409a-ba29-68c47e2f0c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:38:22.548817 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-e041d6ca-f144-4e64-bb3c-badf09acf487 tempest-VolumesExtendTest-315302066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd8579ed-5fee-409a-ba29-68c47e2f0c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c77e0ebf-20bd-452a-9b74-4bbb8f76974f', 'volume_name': 'volume-c77e0ebf-20bd-452a-9b74-4bbb8f76974f', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:38:22.555021 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-e041d6ca-f144-4e64-bb3c-badf09acf487 tempest-VolumesExtendTest-315302066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (726cd966-2f5c-4859-8129-99c01b111b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:38:22.559963 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-e041d6ca-f144-4e64-bb3c-badf09acf487 tempest-VolumesExtendTest-315302066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (726cd966-2f5c-4859-8129-99c01b111b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:38:22.568330 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-e041d6ca-f144-4e64-bb3c-badf09acf487 tempest-VolumesExtendTest-315302066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38af9606-7187-4f57-9772-f99e15a887d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:38:22.582203 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-e041d6ca-f144-4e64-bb3c-badf09acf487 tempest-VolumesExtendTest-315302066 None] Volume c77e0ebf-20bd-452a-9b74-4bbb8f76974f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c77e0ebf-20bd-452a-9b74-4bbb8f76974f', 'volume_size': 1} May 21 21:38:22.583355 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-e041d6ca-f144-4e64-bb3c-badf09acf487 tempest-VolumesExtendTest-315302066 None] creating volume 'volume-c77e0ebf-20bd-452a-9b74-4bbb8f76974f' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:38:22.585007 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-e041d6ca-f144-4e64-bb3c-badf09acf487 tempest-VolumesExtendTest-315302066 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:38:23.242205 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-e041d6ca-f144-4e64-bb3c-badf09acf487 tempest-VolumesExtendTest-315302066 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:38:23.243208 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-e041d6ca-f144-4e64-bb3c-badf09acf487 tempest-VolumesExtendTest-315302066 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:38:23.266899 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-e041d6ca-f144-4e64-bb3c-badf09acf487 tempest-VolumesExtendTest-315302066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38af9606-7187-4f57-9772-f99e15a887d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c77e0ebf-20bd-452a-9b74-4bbb8f76974f', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:38:23.271500 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-e041d6ca-f144-4e64-bb3c-badf09acf487 tempest-VolumesExtendTest-315302066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (486feabe-9c71-46a6-af92-bfc4aaccefdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:38:23.392406 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-e041d6ca-f144-4e64-bb3c-badf09acf487 tempest-VolumesExtendTest-315302066 None] Volume volume-c77e0ebf-20bd-452a-9b74-4bbb8f76974f (c77e0ebf-20bd-452a-9b74-4bbb8f76974f): created successfully May 21 21:38:23.396267 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-e041d6ca-f144-4e64-bb3c-badf09acf487 tempest-VolumesExtendTest-315302066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (486feabe-9c71-46a6-af92-bfc4aaccefdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:38:23.405659 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-e041d6ca-f144-4e64-bb3c-badf09acf487 tempest-VolumesExtendTest-315302066 None] Flow 'volume_create_manager' (cfcbba22-d081-4254-8b00-a9d4ce5765c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:38:23.535761 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-e041d6ca-f144-4e64-bb3c-badf09acf487 tempest-VolumesExtendTest-315302066 None] Created volume successfully. May 21 21:38:25.380150 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6303ead3-b800-4e85-b6e8-aad45095309c tempest-VolumesExtendTest-315302066 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:38:27.558676 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-6303ead3-b800-4e85-b6e8-aad45095309c tempest-VolumesExtendTest-315302066 None] Create snapshot completed successfully May 21 21:38:28.810523 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-06316912-4055-41b8-bf3b-e6be331c9286 tempest-VolumesExtendTest-315302066 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:38:29.774521 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-06316912-4055-41b8-bf3b-e6be331c9286 tempest-VolumesExtendTest-315302066 None] Extend volume from 1 GB to 2 GB. {{(pid=124407) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1886}} May 21 21:38:29.958296 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-06316912-4055-41b8-bf3b-e6be331c9286 tempest-VolumesExtendTest-315302066 None] Extend volume completed successfully. May 21 21:38:31.329864 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-e22f934a-c08e-4b59-805e-b40f3c2bf544 tempest-VolumesExtendTest-315302066 None] Lock "b'cinder-5e0c8e50-3d35-43ca-8435-6aa8361752bd-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.016s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:38:31.331928 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-e22f934a-c08e-4b59-805e-b40f3c2bf544 tempest-VolumesExtendTest-315302066 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:38:33.790683 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-e22f934a-c08e-4b59-805e-b40f3c2bf544 tempest-VolumesExtendTest-315302066 None] Created reservations ['42cc94f2-da56-4137-be06-1e278bebe8d8', '21ad98da-cf94-4b4e-bbd9-69314c3a0997', '3935a790-9abc-4405-8834-5948ccd3828c', '18ca0b6f-1237-4f08-8bae-78a393c026e2'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:38:34.001900 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-e22f934a-c08e-4b59-805e-b40f3c2bf544 tempest-VolumesExtendTest-315302066 None] Delete snapshot completed successfully. May 21 21:38:34.008650 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-e22f934a-c08e-4b59-805e-b40f3c2bf544 tempest-VolumesExtendTest-315302066 None] Lock "b'cinder-5e0c8e50-3d35-43ca-8435-6aa8361752bd-delete_snapshot'" released by "delete_snapshot" :: held 2.678s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:38:34.832377 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-19f4a065-2f2c-4ede-9a89-c4bb749654fa tempest-VolumesExtendTest-315302066 None] Lock "b'cinder-c77e0ebf-20bd-452a-9b74-4bbb8f76974f-delete_volume'" acquired by "delete_volume" :: waited 0.030s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:38:34.975685 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-19f4a065-2f2c-4ede-9a89-c4bb749654fa tempest-VolumesExtendTest-315302066 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:38:35.147017 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-19f4a065-2f2c-4ede-9a89-c4bb749654fa tempest-VolumesExtendTest-315302066 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:38:35.148766 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-19f4a065-2f2c-4ede-9a89-c4bb749654fa tempest-VolumesExtendTest-315302066 None] Volume volume-c77e0ebf-20bd-452a-9b74-4bbb8f76974f is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:38:35.286671 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-19f4a065-2f2c-4ede-9a89-c4bb749654fa tempest-VolumesExtendTest-315302066 None] deleting rbd volume volume-c77e0ebf-20bd-452a-9b74-4bbb8f76974f {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:38:38.180947 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-19f4a065-2f2c-4ede-9a89-c4bb749654fa tempest-VolumesExtendTest-315302066 None] Created reservations ['956466df-5255-425f-adb1-b9ca0d5e5fe0', '98b17808-7acd-4ec3-bebd-7c0aeaf42728', '075cd365-cb7f-4d1b-94de-aed4b0c1a4f4', 'c8767f86-c015-4325-80ec-23c63bfcacff'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:38:38.469023 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-19f4a065-2f2c-4ede-9a89-c4bb749654fa tempest-VolumesExtendTest-315302066 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:38:38.538469 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-19f4a065-2f2c-4ede-9a89-c4bb749654fa tempest-VolumesExtendTest-315302066 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:38:38.587922 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-19f4a065-2f2c-4ede-9a89-c4bb749654fa tempest-VolumesExtendTest-315302066 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:38:38.596550 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-19f4a065-2f2c-4ede-9a89-c4bb749654fa tempest-VolumesExtendTest-315302066 None] Deleted volume successfully. May 21 21:38:38.696459 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-19f4a065-2f2c-4ede-9a89-c4bb749654fa tempest-VolumesExtendTest-315302066 None] Lock "b'cinder-c77e0ebf-20bd-452a-9b74-4bbb8f76974f-delete_volume'" released by "delete_volume" :: held 3.864s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:38:39.475954 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-48cbf185-5838-45f2-a5b3-823e58101e89 tempest-VolumesExtendTest-315302066 None] Lock "b'cinder-f276e36b-7ee4-4c4b-8633-777228c146f1-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:38:39.488634 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=60,cinder:INSERT=14,cinder:UPDATE=24,cinder:DELETE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:38:39.640202 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-48cbf185-5838-45f2-a5b3-823e58101e89 tempest-VolumesExtendTest-315302066 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:38:39.838831 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-48cbf185-5838-45f2-a5b3-823e58101e89 tempest-VolumesExtendTest-315302066 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:38:39.950416 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-48cbf185-5838-45f2-a5b3-823e58101e89 tempest-VolumesExtendTest-315302066 None] deleting rbd volume volume-f276e36b-7ee4-4c4b-8633-777228c146f1 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:38:42.870013 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-48cbf185-5838-45f2-a5b3-823e58101e89 tempest-VolumesExtendTest-315302066 None] volume is a clone so cleaning references {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1352}} May 21 21:38:42.983757 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-48cbf185-5838-45f2-a5b3-823e58101e89 tempest-VolumesExtendTest-315302066 None] deleting parent snapshot volume-f276e36b-7ee4-4c4b-8633-777228c146f1.clone_snap {{(pid=124407) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1243}} May 21 21:38:44.639722 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-48cbf185-5838-45f2-a5b3-823e58101e89 tempest-VolumesExtendTest-315302066 None] Created reservations ['7240f5f9-df50-4f75-978f-2fc28222b5bb', '899bed59-ebe9-404d-aef2-a42a929bb6ee', '349245a1-85c8-4d84-9490-f96f9f4d4e30', '4fd8d3bb-8536-4443-abec-0d1663856c9e'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:38:44.875161 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-48cbf185-5838-45f2-a5b3-823e58101e89 tempest-VolumesExtendTest-315302066 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:38:44.997293 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-48cbf185-5838-45f2-a5b3-823e58101e89 tempest-VolumesExtendTest-315302066 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:38:45.039473 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-48cbf185-5838-45f2-a5b3-823e58101e89 tempest-VolumesExtendTest-315302066 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:38:45.057172 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-48cbf185-5838-45f2-a5b3-823e58101e89 tempest-VolumesExtendTest-315302066 None] Deleted volume successfully. May 21 21:38:45.164003 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-48cbf185-5838-45f2-a5b3-823e58101e89 tempest-VolumesExtendTest-315302066 None] Lock "b'cinder-f276e36b-7ee4-4c4b-8633-777228c146f1-delete_volume'" released by "delete_volume" :: held 5.690s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:38:47.467847 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:38:47.469253 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:38:47.604632 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:38:47.637653 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:38:54.776739 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=52,cinder:UPDATE=31,cinder:DELETE=3,cinder:INSERT=7 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:38:54.812345 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-d2c787cb-2ac2-40f2-92ba-03577422c766 tempest-GroupsV314Test-1079872366 None] Group tempest-GroupsV314Test-Group-1584933528: creating May 21 21:38:54.925400 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-d2c787cb-2ac2-40f2-92ba-03577422c766 tempest-GroupsV314Test-1079872366 None] Group tempest-GroupsV314Test-Group-1584933528: created successfully May 21 21:38:54.939145 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-d2c787cb-2ac2-40f2-92ba-03577422c766 tempest-GroupsV314Test-1079872366 None] Create group completed successfully. May 21 21:38:57.050282 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-62c4576d-2a83-4a4c-ae7a-791b407e551a tempest-GroupsV314Test-1079872366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:38:57.083187 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-62c4576d-2a83-4a4c-ae7a-791b407e551a tempest-GroupsV314Test-1079872366 None] Flow 'volume_create_manager' (7007969d-7305-4702-9f0d-8f1556d7904e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:38:57.089982 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-62c4576d-2a83-4a4c-ae7a-791b407e551a tempest-GroupsV314Test-1079872366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fcbe548-ac03-42dd-838e-ce5e58270098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:38:57.108872 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-62c4576d-2a83-4a4c-ae7a-791b407e551a tempest-GroupsV314Test-1079872366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fcbe548-ac03-42dd-838e-ce5e58270098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:38:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsV314Test-Volume-124963433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7a4ba9c2-cb44-49e7-8c74-e37cdbfa80f3,host='ncdv-master-1@ceph#ceph',id=334e2398-7364-4430-a922-7a08c598d785,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e89e0de85514037a2293673552f1eaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:38:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:38:57Z,use_quota=True,user_id='1d8dbf8776e94f4ba0781b42104c763a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e3e5c15-7edf-49be-bbfd-50bcf3da219c),volume_type_id=8e3e5c15-7edf-49be-bbfd-50bcf3da219c)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:38:57.114631 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-62c4576d-2a83-4a4c-ae7a-791b407e551a tempest-GroupsV314Test-1079872366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e18fdb0-24b1-4cfc-b95d-745b00a0b871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:38:57.119383 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-62c4576d-2a83-4a4c-ae7a-791b407e551a tempest-GroupsV314Test-1079872366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e18fdb0-24b1-4cfc-b95d-745b00a0b871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:38:57.125559 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-62c4576d-2a83-4a4c-ae7a-791b407e551a tempest-GroupsV314Test-1079872366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46c948d3-4e96-4c48-80a0-54eabc2b5ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:38:57.129964 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-62c4576d-2a83-4a4c-ae7a-791b407e551a tempest-GroupsV314Test-1079872366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46c948d3-4e96-4c48-80a0-54eabc2b5ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '334e2398-7364-4430-a922-7a08c598d785', 'volume_name': 'volume-334e2398-7364-4430-a922-7a08c598d785', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:38:57.135245 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-62c4576d-2a83-4a4c-ae7a-791b407e551a tempest-GroupsV314Test-1079872366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94c52e42-9284-4ef7-9171-6ff0d486f625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:38:57.139883 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-62c4576d-2a83-4a4c-ae7a-791b407e551a tempest-GroupsV314Test-1079872366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94c52e42-9284-4ef7-9171-6ff0d486f625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:38:57.144852 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-62c4576d-2a83-4a4c-ae7a-791b407e551a tempest-GroupsV314Test-1079872366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5896ef47-7f10-4408-b931-f8bc5a8729c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:38:57.146203 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-62c4576d-2a83-4a4c-ae7a-791b407e551a tempest-GroupsV314Test-1079872366 None] Volume 334e2398-7364-4430-a922-7a08c598d785: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-334e2398-7364-4430-a922-7a08c598d785', 'volume_size': 1} May 21 21:38:57.146805 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-62c4576d-2a83-4a4c-ae7a-791b407e551a tempest-GroupsV314Test-1079872366 None] creating volume 'volume-334e2398-7364-4430-a922-7a08c598d785' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:38:57.147683 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-62c4576d-2a83-4a4c-ae7a-791b407e551a tempest-GroupsV314Test-1079872366 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:38:57.702088 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-62c4576d-2a83-4a4c-ae7a-791b407e551a tempest-GroupsV314Test-1079872366 None] extra_specs: {} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:38:57.702975 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-62c4576d-2a83-4a4c-ae7a-791b407e551a tempest-GroupsV314Test-1079872366 None] extra_specs: {} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:38:57.716134 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-62c4576d-2a83-4a4c-ae7a-791b407e551a tempest-GroupsV314Test-1079872366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5896ef47-7f10-4408-b931-f8bc5a8729c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-334e2398-7364-4430-a922-7a08c598d785', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:38:57.718465 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-62c4576d-2a83-4a4c-ae7a-791b407e551a tempest-GroupsV314Test-1079872366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3358fd8-368b-4cb8-bfa2-5c28b88104f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:38:57.784604 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-62c4576d-2a83-4a4c-ae7a-791b407e551a tempest-GroupsV314Test-1079872366 None] Volume volume-334e2398-7364-4430-a922-7a08c598d785 (334e2398-7364-4430-a922-7a08c598d785): created successfully May 21 21:38:57.790837 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-62c4576d-2a83-4a4c-ae7a-791b407e551a tempest-GroupsV314Test-1079872366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3358fd8-368b-4cb8-bfa2-5c28b88104f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:38:57.806934 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-62c4576d-2a83-4a4c-ae7a-791b407e551a tempest-GroupsV314Test-1079872366 None] Flow 'volume_create_manager' (7007969d-7305-4702-9f0d-8f1556d7904e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:38:57.921426 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-62c4576d-2a83-4a4c-ae7a-791b407e551a tempest-GroupsV314Test-1079872366 None] Created volume successfully. May 21 21:38:59.549879 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-eb662600-eec2-4161-945a-0f6d887097aa tempest-GroupsV314Test-1079872366 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:38:59.851387 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-eb662600-eec2-4161-945a-0f6d887097aa tempest-GroupsV314Test-1079872366 None] creating snapshot='volume-332f7c5f-7c05-48de-ad89-cdd958606b88.clone_snap' {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 21 21:39:01.110489 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-eb662600-eec2-4161-945a-0f6d887097aa tempest-GroupsV314Test-1079872366 None] cloning 'volume-334e2398-7364-4430-a922-7a08c598d785@volume-332f7c5f-7c05-48de-ad89-cdd958606b88.clone_snap' to 'volume-332f7c5f-7c05-48de-ad89-cdd958606b88' {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:789}} May 21 21:39:02.103941 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-eb662600-eec2-4161-945a-0f6d887097aa tempest-GroupsV314Test-1079872366 None] Volume volume-334e2398-7364-4430-a922-7a08c598d785 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:39:02.112719 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-eb662600-eec2-4161-945a-0f6d887097aa tempest-GroupsV314Test-1079872366 None] extra_specs: {} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:39:02.114779 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-eb662600-eec2-4161-945a-0f6d887097aa tempest-GroupsV314Test-1079872366 None] extra_specs: {} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:39:02.440871 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-eb662600-eec2-4161-945a-0f6d887097aa tempest-GroupsV314Test-1079872366 None] clone created successfully {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:862}} May 21 21:39:02.835256 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-eb662600-eec2-4161-945a-0f6d887097aa tempest-GroupsV314Test-1079872366 None] Create group from source-group-7a4ba9c2-cb44-49e7-8c74-e37cdbfa80f3 completed successfully. May 21 21:39:03.651834 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c8eaa10a-aae2-4677-b7bc-f4f33aa08020 tempest-GroupsV314Test-1079872366 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:39:03.916957 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c8eaa10a-aae2-4677-b7bc-f4f33aa08020 tempest-GroupsV314Test-1079872366 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:39:04.088381 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c8eaa10a-aae2-4677-b7bc-f4f33aa08020 tempest-GroupsV314Test-1079872366 None] deleting rbd volume volume-332f7c5f-7c05-48de-ad89-cdd958606b88 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:39:06.671489 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c8eaa10a-aae2-4677-b7bc-f4f33aa08020 tempest-GroupsV314Test-1079872366 None] volume is a clone so cleaning references {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1352}} May 21 21:39:06.762769 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c8eaa10a-aae2-4677-b7bc-f4f33aa08020 tempest-GroupsV314Test-1079872366 None] Volume volume-334e2398-7364-4430-a922-7a08c598d785 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:39:06.763267 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c8eaa10a-aae2-4677-b7bc-f4f33aa08020 tempest-GroupsV314Test-1079872366 None] deleting parent snapshot volume-332f7c5f-7c05-48de-ad89-cdd958606b88.clone_snap {{(pid=124407) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1243}} May 21 21:39:09.486960 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-c8eaa10a-aae2-4677-b7bc-f4f33aa08020 tempest-GroupsV314Test-1079872366 None] Created reservations ['23ccb8fa-5ca5-4676-886f-5571ec171de7'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:39:09.511972 ncdv-master-1 cinder-volume[124407]: WARNING cinder.quota [None req-c8eaa10a-aae2-4677-b7bc-f4f33aa08020 tempest-GroupsV314Test-1079872366 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1705218464 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1705218464, it is now deprecated. Please use the default quota class for default quota. May 21 21:39:09.513789 ncdv-master-1 cinder-volume[124407]: WARNING cinder.quota [None req-c8eaa10a-aae2-4677-b7bc-f4f33aa08020 tempest-GroupsV314Test-1079872366 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1705218464 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1705218464, it is now deprecated. Please use the default quota class for default quota. May 21 21:39:09.590200 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-c8eaa10a-aae2-4677-b7bc-f4f33aa08020 tempest-GroupsV314Test-1079872366 None] Created reservations ['5feba25b-c29a-4ae2-bd22-9128c6daa484', 'd9d7efc3-71dc-4993-adfe-07d8ecb7ad0b', '837b827d-6c0d-4223-8340-b44bf6cc3847', '9df708e7-cd86-4d01-ab17-aa774558df5f'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:39:10.041751 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c8eaa10a-aae2-4677-b7bc-f4f33aa08020 tempest-GroupsV314Test-1079872366 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:39:10.104135 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c8eaa10a-aae2-4677-b7bc-f4f33aa08020 tempest-GroupsV314Test-1079872366 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:39:10.208977 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-c8eaa10a-aae2-4677-b7bc-f4f33aa08020 tempest-GroupsV314Test-1079872366 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:39:10.216451 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-c8eaa10a-aae2-4677-b7bc-f4f33aa08020 tempest-GroupsV314Test-1079872366 None] Delete group completed successfully. May 21 21:39:11.097575 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a12fff3f-0b9b-49b5-9d09-960be42b5224 tempest-GroupsV314Test-1079872366 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:39:11.304029 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a12fff3f-0b9b-49b5-9d09-960be42b5224 tempest-GroupsV314Test-1079872366 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:39:11.304490 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a12fff3f-0b9b-49b5-9d09-960be42b5224 tempest-GroupsV314Test-1079872366 None] Volume volume-334e2398-7364-4430-a922-7a08c598d785 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:39:11.378769 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a12fff3f-0b9b-49b5-9d09-960be42b5224 tempest-GroupsV314Test-1079872366 None] deleting rbd volume volume-334e2398-7364-4430-a922-7a08c598d785 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:39:14.328069 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=58,cinder:INSERT=6,cinder:UPDATE=28 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:39:14.584157 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-a12fff3f-0b9b-49b5-9d09-960be42b5224 tempest-GroupsV314Test-1079872366 None] Created reservations ['2b1b087f-3e1e-4be7-ba5d-8dcb342999e8'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:39:14.698557 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-a12fff3f-0b9b-49b5-9d09-960be42b5224 tempest-GroupsV314Test-1079872366 None] Created reservations ['5db09edf-7d56-411f-9118-24df20c0af19', '28bbbe36-c488-4a0a-8bcc-5c00e4c61df0', '194ecf27-b492-48cd-b7d6-1eb139c42ef1', 'd366f5cb-7460-4f82-92fe-bbcd9c6bc767'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:39:14.931024 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=63,cinder:DELETE=1,cinder:UPDATE=29,cinder:INSERT=7 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:39:15.080955 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a12fff3f-0b9b-49b5-9d09-960be42b5224 tempest-GroupsV314Test-1079872366 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:39:15.128114 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a12fff3f-0b9b-49b5-9d09-960be42b5224 tempest-GroupsV314Test-1079872366 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:39:15.183462 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-a12fff3f-0b9b-49b5-9d09-960be42b5224 tempest-GroupsV314Test-1079872366 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:39:15.190619 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-a12fff3f-0b9b-49b5-9d09-960be42b5224 tempest-GroupsV314Test-1079872366 None] Delete group completed successfully. May 21 21:39:24.092421 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-852afd5d-82a6-40a1-bdb7-a99d2728c548 tempest-GroupsV320Test-241632465 None] Group tempest-GroupsV320Test-Group-853767533: creating May 21 21:39:24.156821 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-852afd5d-82a6-40a1-bdb7-a99d2728c548 tempest-GroupsV320Test-241632465 None] Group tempest-GroupsV320Test-Group-853767533: created successfully May 21 21:39:24.168704 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-852afd5d-82a6-40a1-bdb7-a99d2728c548 tempest-GroupsV320Test-241632465 None] Create group completed successfully. May 21 21:39:25.992082 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-fda527c9-6006-4978-a205-fb5f0af8162f tempest-AttachVolumeNegativeTest-617587518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:39:26.030470 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-fda527c9-6006-4978-a205-fb5f0af8162f tempest-AttachVolumeNegativeTest-617587518 None] Flow 'volume_create_manager' (2d5fd2e1-4f3d-4f3f-a24d-3abf783ee328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:39:26.038044 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-fda527c9-6006-4978-a205-fb5f0af8162f tempest-AttachVolumeNegativeTest-617587518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0489784-f089-4eeb-bc2c-a00e0e5c81bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:39:26.059168 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-fda527c9-6006-4978-a205-fb5f0af8162f tempest-AttachVolumeNegativeTest-617587518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0489784-f089-4eeb-bc2c-a00e0e5c81bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-890314351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=01346cc1-2b76-407c-9c84-8982256c9623,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41b9c87f24cd4bac983b83b49daeae5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:39:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:39:26Z,use_quota=True,user_id='f01908adbe2c4aebb89d6fd3af3de207',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:39:26.065814 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-fda527c9-6006-4978-a205-fb5f0af8162f tempest-AttachVolumeNegativeTest-617587518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (067121a2-72b6-40ea-a7c2-c3133ca41917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:39:26.072259 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-fda527c9-6006-4978-a205-fb5f0af8162f tempest-AttachVolumeNegativeTest-617587518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (067121a2-72b6-40ea-a7c2-c3133ca41917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:39:26.079431 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-fda527c9-6006-4978-a205-fb5f0af8162f tempest-AttachVolumeNegativeTest-617587518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32ae181b-678e-4038-8d80-420b6985c777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:39:26.084614 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-fda527c9-6006-4978-a205-fb5f0af8162f tempest-AttachVolumeNegativeTest-617587518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32ae181b-678e-4038-8d80-420b6985c777) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01346cc1-2b76-407c-9c84-8982256c9623', 'volume_name': 'volume-01346cc1-2b76-407c-9c84-8982256c9623', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:39:26.090309 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-fda527c9-6006-4978-a205-fb5f0af8162f tempest-AttachVolumeNegativeTest-617587518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe63fc49-8533-4223-a7af-62a4c462a5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:39:26.117419 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-fda527c9-6006-4978-a205-fb5f0af8162f tempest-AttachVolumeNegativeTest-617587518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe63fc49-8533-4223-a7af-62a4c462a5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:39:26.128926 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-fda527c9-6006-4978-a205-fb5f0af8162f tempest-AttachVolumeNegativeTest-617587518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f27729c-ab26-4635-936c-64bff95f7544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:39:26.131081 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-fda527c9-6006-4978-a205-fb5f0af8162f tempest-AttachVolumeNegativeTest-617587518 None] Volume 01346cc1-2b76-407c-9c84-8982256c9623: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01346cc1-2b76-407c-9c84-8982256c9623', 'volume_size': 1} May 21 21:39:26.135700 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-fda527c9-6006-4978-a205-fb5f0af8162f tempest-AttachVolumeNegativeTest-617587518 None] creating volume 'volume-01346cc1-2b76-407c-9c84-8982256c9623' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:39:26.137032 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-fda527c9-6006-4978-a205-fb5f0af8162f tempest-AttachVolumeNegativeTest-617587518 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:39:26.552810 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-6026d101-985c-4e15-9e93-80125456ad51 tempest-GroupsV320Test-241632465 None] Created reservations ['2c3c3132-374d-42da-84a3-ab2b1b3f2f81'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:39:26.761730 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-fda527c9-6006-4978-a205-fb5f0af8162f tempest-AttachVolumeNegativeTest-617587518 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:39:26.762458 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-fda527c9-6006-4978-a205-fb5f0af8162f tempest-AttachVolumeNegativeTest-617587518 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:39:26.768111 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-fda527c9-6006-4978-a205-fb5f0af8162f tempest-AttachVolumeNegativeTest-617587518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f27729c-ab26-4635-936c-64bff95f7544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01346cc1-2b76-407c-9c84-8982256c9623', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:39:26.774294 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-fda527c9-6006-4978-a205-fb5f0af8162f tempest-AttachVolumeNegativeTest-617587518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aefa2709-de8a-49d6-9fc4-284c6150af32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:39:26.790970 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6026d101-985c-4e15-9e93-80125456ad51 tempest-GroupsV320Test-241632465 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:39:26.843774 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6026d101-985c-4e15-9e93-80125456ad51 tempest-GroupsV320Test-241632465 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:39:26.897081 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-6026d101-985c-4e15-9e93-80125456ad51 tempest-GroupsV320Test-241632465 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:39:26.910538 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-fda527c9-6006-4978-a205-fb5f0af8162f tempest-AttachVolumeNegativeTest-617587518 None] Volume volume-01346cc1-2b76-407c-9c84-8982256c9623 (01346cc1-2b76-407c-9c84-8982256c9623): created successfully May 21 21:39:26.915424 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-fda527c9-6006-4978-a205-fb5f0af8162f tempest-AttachVolumeNegativeTest-617587518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aefa2709-de8a-49d6-9fc4-284c6150af32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:39:26.932953 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-fda527c9-6006-4978-a205-fb5f0af8162f tempest-AttachVolumeNegativeTest-617587518 None] Flow 'volume_create_manager' (2d5fd2e1-4f3d-4f3f-a24d-3abf783ee328) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:39:26.945969 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-6026d101-985c-4e15-9e93-80125456ad51 tempest-GroupsV320Test-241632465 None] Delete group completed successfully. May 21 21:39:27.042226 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-fda527c9-6006-4978-a205-fb5f0af8162f tempest-AttachVolumeNegativeTest-617587518 None] Created volume successfully. May 21 21:39:29.201666 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-2226aa75-45af-4623-a700-6256152802c7 req-05953a91-afa0-4169-b2d6-36b181bb9b9b tempest-AttachVolumeNegativeTest-617587518 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:39:30.403281 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-2226aa75-45af-4623-a700-6256152802c7 req-05953a91-afa0-4169-b2d6-36b181bb9b9b tempest-AttachVolumeNegativeTest-617587518 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.201s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:39:30.405163 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-2226aa75-45af-4623-a700-6256152802c7 req-05953a91-afa0-4169-b2d6-36b181bb9b9b tempest-AttachVolumeNegativeTest-617587518 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-01346cc1-2b76-407c-9c84-8982256c9623', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'efef91cd-d8f8-4d93-9ad2-86d0b33251f4', 'volume_id': '01346cc1-2b76-407c-9c84-8982256c9623', 'discard': True}} {{(pid=124407) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} May 21 21:39:30.494216 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-2226aa75-45af-4623-a700-6256152802c7 req-05953a91-afa0-4169-b2d6-36b181bb9b9b tempest-AttachVolumeNegativeTest-617587518 None] Connection info returned from driver {'name': 'volumes/volume-01346cc1-2b76-407c-9c84-8982256c9623', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '01346cc1-2b76-407c-9c84-8982256c9623', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a8b833d4-da2d-4740-bcf9-f9e58dfa54f5'} {{(pid=124407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4826}} May 21 21:39:30.634760 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-2226aa75-45af-4623-a700-6256152802c7 req-05953a91-afa0-4169-b2d6-36b181bb9b9b tempest-AttachVolumeNegativeTest-617587518 None] attachment_update completed successfully. May 21 21:39:40.692658 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-13862ed5-4393-4aa3-ac0f-0a2027b1e6de tempest-VolumesMetadataTest-1120741418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:39:40.714694 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-13862ed5-4393-4aa3-ac0f-0a2027b1e6de tempest-VolumesMetadataTest-1120741418 None] Flow 'volume_create_manager' (5e8cf8ca-8f89-4186-ae81-f0b6ad0f15a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:39:40.721539 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-13862ed5-4393-4aa3-ac0f-0a2027b1e6de tempest-VolumesMetadataTest-1120741418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d7a2327-4d70-4c87-9582-62f25547ab9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:39:40.738740 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-13862ed5-4393-4aa3-ac0f-0a2027b1e6de tempest-VolumesMetadataTest-1120741418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d7a2327-4d70-4c87-9582-62f25547ab9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:39:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-323027982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f2c6eb52-bb26-40e7-86a6-b3b27ec9d695,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02e79161a6804ec997a21a8b9bf58929',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:39:40Z,use_quota=True,user_id='ba6656eaa979455bbc2e42f8ffc89830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:39:40.743988 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-13862ed5-4393-4aa3-ac0f-0a2027b1e6de tempest-VolumesMetadataTest-1120741418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a57b5633-e538-4d75-bd90-6432ebbe000d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:39:40.748082 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-13862ed5-4393-4aa3-ac0f-0a2027b1e6de tempest-VolumesMetadataTest-1120741418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a57b5633-e538-4d75-bd90-6432ebbe000d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:39:40.753830 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-13862ed5-4393-4aa3-ac0f-0a2027b1e6de tempest-VolumesMetadataTest-1120741418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29c3f24a-0218-427c-a89e-b22269e5a060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:39:40.757765 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-13862ed5-4393-4aa3-ac0f-0a2027b1e6de tempest-VolumesMetadataTest-1120741418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29c3f24a-0218-427c-a89e-b22269e5a060) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2c6eb52-bb26-40e7-86a6-b3b27ec9d695', 'volume_name': 'volume-f2c6eb52-bb26-40e7-86a6-b3b27ec9d695', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:39:40.762606 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-13862ed5-4393-4aa3-ac0f-0a2027b1e6de tempest-VolumesMetadataTest-1120741418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ce278d6-dcc0-4209-9f37-652bdb14e08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:39:40.767750 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-13862ed5-4393-4aa3-ac0f-0a2027b1e6de tempest-VolumesMetadataTest-1120741418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ce278d6-dcc0-4209-9f37-652bdb14e08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:39:40.773871 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-13862ed5-4393-4aa3-ac0f-0a2027b1e6de tempest-VolumesMetadataTest-1120741418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (218d0955-4677-468e-b736-64040a3309f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:39:40.774714 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-13862ed5-4393-4aa3-ac0f-0a2027b1e6de tempest-VolumesMetadataTest-1120741418 None] Volume f2c6eb52-bb26-40e7-86a6-b3b27ec9d695: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2c6eb52-bb26-40e7-86a6-b3b27ec9d695', 'volume_size': 1} May 21 21:39:40.775141 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-13862ed5-4393-4aa3-ac0f-0a2027b1e6de tempest-VolumesMetadataTest-1120741418 None] creating volume 'volume-f2c6eb52-bb26-40e7-86a6-b3b27ec9d695' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:39:40.777041 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-13862ed5-4393-4aa3-ac0f-0a2027b1e6de tempest-VolumesMetadataTest-1120741418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:39:41.248651 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-13862ed5-4393-4aa3-ac0f-0a2027b1e6de tempest-VolumesMetadataTest-1120741418 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:39:41.249682 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-13862ed5-4393-4aa3-ac0f-0a2027b1e6de tempest-VolumesMetadataTest-1120741418 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:39:41.254097 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-13862ed5-4393-4aa3-ac0f-0a2027b1e6de tempest-VolumesMetadataTest-1120741418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (218d0955-4677-468e-b736-64040a3309f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2c6eb52-bb26-40e7-86a6-b3b27ec9d695', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:39:41.264005 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-13862ed5-4393-4aa3-ac0f-0a2027b1e6de tempest-VolumesMetadataTest-1120741418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03805996-ba6d-4eb9-a15b-7f32a9a96ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:39:41.386130 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-13862ed5-4393-4aa3-ac0f-0a2027b1e6de tempest-VolumesMetadataTest-1120741418 None] Volume volume-f2c6eb52-bb26-40e7-86a6-b3b27ec9d695 (f2c6eb52-bb26-40e7-86a6-b3b27ec9d695): created successfully May 21 21:39:41.392731 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-13862ed5-4393-4aa3-ac0f-0a2027b1e6de tempest-VolumesMetadataTest-1120741418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03805996-ba6d-4eb9-a15b-7f32a9a96ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:39:41.403762 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-13862ed5-4393-4aa3-ac0f-0a2027b1e6de tempest-VolumesMetadataTest-1120741418 None] Flow 'volume_create_manager' (5e8cf8ca-8f89-4186-ae81-f0b6ad0f15a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:39:41.487805 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-13862ed5-4393-4aa3-ac0f-0a2027b1e6de tempest-VolumesMetadataTest-1120741418 None] Created volume successfully. May 21 21:39:44.354482 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-53c826a0-c139-41da-a5e6-701718af8e77 tempest-VolumesMetadataTest-1120741418 None] Lock "b'cinder-f2c6eb52-bb26-40e7-86a6-b3b27ec9d695-delete_volume'" acquired by "delete_volume" :: waited 0.033s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:39:44.506199 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-53c826a0-c139-41da-a5e6-701718af8e77 tempest-VolumesMetadataTest-1120741418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:39:44.716698 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-53c826a0-c139-41da-a5e6-701718af8e77 tempest-VolumesMetadataTest-1120741418 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:39:44.717186 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-53c826a0-c139-41da-a5e6-701718af8e77 tempest-VolumesMetadataTest-1120741418 None] Volume volume-f2c6eb52-bb26-40e7-86a6-b3b27ec9d695 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:39:44.809081 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-53c826a0-c139-41da-a5e6-701718af8e77 tempest-VolumesMetadataTest-1120741418 None] deleting rbd volume volume-f2c6eb52-bb26-40e7-86a6-b3b27ec9d695 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:39:46.191735 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:UPDATE=16,cinder:SELECT=42,cinder:INSERT=1,cinder:DELETE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:39:47.129294 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-53c826a0-c139-41da-a5e6-701718af8e77 tempest-VolumesMetadataTest-1120741418 None] Created reservations ['18c93f84-8e2a-403c-9dd9-c275b9d5a383', '752a4baa-3f8d-4677-a0ee-ceb67470fe15', 'c6f04add-06c5-46f9-9d4f-3637f328090f', '448807dd-7993-4cf0-9627-bbde3eafec01'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:39:47.411781 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-53c826a0-c139-41da-a5e6-701718af8e77 tempest-VolumesMetadataTest-1120741418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:39:47.465863 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-53c826a0-c139-41da-a5e6-701718af8e77 tempest-VolumesMetadataTest-1120741418 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:39:47.512361 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-53c826a0-c139-41da-a5e6-701718af8e77 tempest-VolumesMetadataTest-1120741418 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:39:47.525218 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-53c826a0-c139-41da-a5e6-701718af8e77 tempest-VolumesMetadataTest-1120741418 None] Deleted volume successfully. May 21 21:39:47.541553 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:39:47.542369 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:39:47.606127 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:39:47.678556 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:39:47.746795 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-53c826a0-c139-41da-a5e6-701718af8e77 tempest-VolumesMetadataTest-1120741418 None] Lock "b'cinder-f2c6eb52-bb26-40e7-86a6-b3b27ec9d695-delete_volume'" released by "delete_volume" :: held 3.392s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:39:54.015668 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=52,cinder:UPDATE=17,cinder:DELETE=1,cinder:INSERT=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:39:54.085619 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-154646c8-2094-43df-b762-420aa1f90c21 tempest-VolumesTransfersV355Test-1912548649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:39:54.106501 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-154646c8-2094-43df-b762-420aa1f90c21 tempest-VolumesTransfersV355Test-1912548649 None] Flow 'volume_create_manager' (65326c04-cece-4dcd-855f-c5adeea12529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:39:54.117825 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-154646c8-2094-43df-b762-420aa1f90c21 tempest-VolumesTransfersV355Test-1912548649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d48aed0d-69c6-4711-99da-805c7f658b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:39:54.142820 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-154646c8-2094-43df-b762-420aa1f90c21 tempest-VolumesTransfersV355Test-1912548649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d48aed0d-69c6-4711-99da-805c7f658b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:39:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1002416764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2b1606f2-b317-43ac-a1d8-8e0cffdfce08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aacd5431ae345d595a37ba8d571875e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:39:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:39:54Z,use_quota=True,user_id='cdd561ead6634b74b398082151f34e19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:39:54.152508 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-154646c8-2094-43df-b762-420aa1f90c21 tempest-VolumesTransfersV355Test-1912548649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12b080ed-c976-4787-92fd-a9b8ef95e354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:39:54.159840 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-154646c8-2094-43df-b762-420aa1f90c21 tempest-VolumesTransfersV355Test-1912548649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12b080ed-c976-4787-92fd-a9b8ef95e354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:39:54.169182 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-154646c8-2094-43df-b762-420aa1f90c21 tempest-VolumesTransfersV355Test-1912548649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a50fcc2c-4a0a-4950-803a-c80bb8ba6dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:39:54.181291 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-154646c8-2094-43df-b762-420aa1f90c21 tempest-VolumesTransfersV355Test-1912548649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a50fcc2c-4a0a-4950-803a-c80bb8ba6dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b1606f2-b317-43ac-a1d8-8e0cffdfce08', 'volume_name': 'volume-2b1606f2-b317-43ac-a1d8-8e0cffdfce08', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:39:54.186801 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-154646c8-2094-43df-b762-420aa1f90c21 tempest-VolumesTransfersV355Test-1912548649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18ca9238-9133-41b5-bcd9-b699b4cfd7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:39:54.191771 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-154646c8-2094-43df-b762-420aa1f90c21 tempest-VolumesTransfersV355Test-1912548649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18ca9238-9133-41b5-bcd9-b699b4cfd7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:39:54.196660 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-154646c8-2094-43df-b762-420aa1f90c21 tempest-VolumesTransfersV355Test-1912548649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da3c5b16-aac8-4af6-a392-6f07bbd95c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:39:54.197738 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-154646c8-2094-43df-b762-420aa1f90c21 tempest-VolumesTransfersV355Test-1912548649 None] Volume 2b1606f2-b317-43ac-a1d8-8e0cffdfce08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b1606f2-b317-43ac-a1d8-8e0cffdfce08', 'volume_size': 1} May 21 21:39:54.198240 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-154646c8-2094-43df-b762-420aa1f90c21 tempest-VolumesTransfersV355Test-1912548649 None] creating volume 'volume-2b1606f2-b317-43ac-a1d8-8e0cffdfce08' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:39:54.199219 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-154646c8-2094-43df-b762-420aa1f90c21 tempest-VolumesTransfersV355Test-1912548649 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:39:54.633506 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-154646c8-2094-43df-b762-420aa1f90c21 tempest-VolumesTransfersV355Test-1912548649 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:39:54.638488 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-154646c8-2094-43df-b762-420aa1f90c21 tempest-VolumesTransfersV355Test-1912548649 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:39:54.638651 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-154646c8-2094-43df-b762-420aa1f90c21 tempest-VolumesTransfersV355Test-1912548649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da3c5b16-aac8-4af6-a392-6f07bbd95c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b1606f2-b317-43ac-a1d8-8e0cffdfce08', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:39:54.644373 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-154646c8-2094-43df-b762-420aa1f90c21 tempest-VolumesTransfersV355Test-1912548649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cf47566-6894-4f4e-8f89-e4906cc40946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:39:54.726138 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-154646c8-2094-43df-b762-420aa1f90c21 tempest-VolumesTransfersV355Test-1912548649 None] Volume volume-2b1606f2-b317-43ac-a1d8-8e0cffdfce08 (2b1606f2-b317-43ac-a1d8-8e0cffdfce08): created successfully May 21 21:39:54.733080 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-154646c8-2094-43df-b762-420aa1f90c21 tempest-VolumesTransfersV355Test-1912548649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cf47566-6894-4f4e-8f89-e4906cc40946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:39:54.742201 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-154646c8-2094-43df-b762-420aa1f90c21 tempest-VolumesTransfersV355Test-1912548649 None] Flow 'volume_create_manager' (65326c04-cece-4dcd-855f-c5adeea12529) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:39:54.831693 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-154646c8-2094-43df-b762-420aa1f90c21 tempest-VolumesTransfersV355Test-1912548649 None] Created volume successfully. May 21 21:39:56.444188 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-e52fcafe-7fb3-4f83-a7df-e42e7a5b3fc9 tempest-VolumesTransfersV355Test-1583712655 None] Transfer volume completed successfully. May 21 21:39:57.751371 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-442ee48f-c791-473a-a7db-b3b09af6cc98 tempest-VolumesTransfersV355Test-1850280044 None] Lock "b'cinder-2b1606f2-b317-43ac-a1d8-8e0cffdfce08-delete_volume'" acquired by "delete_volume" :: waited 0.049s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:39:57.876887 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-442ee48f-c791-473a-a7db-b3b09af6cc98 tempest-VolumesTransfersV355Test-1850280044 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:39:57.997589 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-442ee48f-c791-473a-a7db-b3b09af6cc98 tempest-VolumesTransfersV355Test-1850280044 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:39:57.997947 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-442ee48f-c791-473a-a7db-b3b09af6cc98 tempest-VolumesTransfersV355Test-1850280044 None] Volume volume-2b1606f2-b317-43ac-a1d8-8e0cffdfce08 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:39:58.073055 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-442ee48f-c791-473a-a7db-b3b09af6cc98 tempest-VolumesTransfersV355Test-1850280044 None] deleting rbd volume volume-2b1606f2-b317-43ac-a1d8-8e0cffdfce08 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:40:00.650658 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-442ee48f-c791-473a-a7db-b3b09af6cc98 tempest-VolumesTransfersV355Test-1850280044 None] Created reservations ['a9be7ba1-2b1a-49f2-9da5-d08ae48428ef', 'd4427e41-776f-4634-8000-38e2190337b9', '89507ef6-2244-4006-b058-0d8d4ab9a4c7', '38fd39c3-295a-4e14-a601-e2a53474cdfd'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:40:00.844483 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-442ee48f-c791-473a-a7db-b3b09af6cc98 tempest-VolumesTransfersV355Test-1850280044 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:40:00.927087 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-442ee48f-c791-473a-a7db-b3b09af6cc98 tempest-VolumesTransfersV355Test-1850280044 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:40:00.991900 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-442ee48f-c791-473a-a7db-b3b09af6cc98 tempest-VolumesTransfersV355Test-1850280044 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:40:01.009498 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-442ee48f-c791-473a-a7db-b3b09af6cc98 tempest-VolumesTransfersV355Test-1850280044 None] Deleted volume successfully. May 21 21:40:01.115894 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-442ee48f-c791-473a-a7db-b3b09af6cc98 tempest-VolumesTransfersV355Test-1850280044 None] Lock "b'cinder-2b1606f2-b317-43ac-a1d8-8e0cffdfce08-delete_volume'" released by "delete_volume" :: held 3.365s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:40:02.039717 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a48b0e1-9604-45d1-9f0f-7470026e0a79 tempest-VolumesTransfersV355Test-1912548649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:40:02.060849 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6a48b0e1-9604-45d1-9f0f-7470026e0a79 tempest-VolumesTransfersV355Test-1912548649 None] Flow 'volume_create_manager' (e7a3001f-95fa-4e9e-821a-54bbceb4e907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:40:02.068227 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6a48b0e1-9604-45d1-9f0f-7470026e0a79 tempest-VolumesTransfersV355Test-1912548649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eb418de-739d-4906-b0ee-310a5e27978f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:40:02.087931 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6a48b0e1-9604-45d1-9f0f-7470026e0a79 tempest-VolumesTransfersV355Test-1912548649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eb418de-739d-4906-b0ee-310a5e27978f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:40:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-694925293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=44b8ce06-7247-4e3d-8894-1d12317bd823,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aacd5431ae345d595a37ba8d571875e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:40:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:40:02Z,use_quota=True,user_id='cdd561ead6634b74b398082151f34e19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:40:02.095016 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6a48b0e1-9604-45d1-9f0f-7470026e0a79 tempest-VolumesTransfersV355Test-1912548649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0044135-877f-4413-ba74-6636d46f853e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:40:02.102084 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6a48b0e1-9604-45d1-9f0f-7470026e0a79 tempest-VolumesTransfersV355Test-1912548649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0044135-877f-4413-ba74-6636d46f853e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:40:02.107898 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6a48b0e1-9604-45d1-9f0f-7470026e0a79 tempest-VolumesTransfersV355Test-1912548649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d72ccf4-73bc-417f-a8da-066b0342f200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:40:02.112888 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6a48b0e1-9604-45d1-9f0f-7470026e0a79 tempest-VolumesTransfersV355Test-1912548649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d72ccf4-73bc-417f-a8da-066b0342f200) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44b8ce06-7247-4e3d-8894-1d12317bd823', 'volume_name': 'volume-44b8ce06-7247-4e3d-8894-1d12317bd823', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:40:02.117866 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6a48b0e1-9604-45d1-9f0f-7470026e0a79 tempest-VolumesTransfersV355Test-1912548649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc33efa4-b500-47b4-a1fd-7612a976e5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:40:02.121825 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6a48b0e1-9604-45d1-9f0f-7470026e0a79 tempest-VolumesTransfersV355Test-1912548649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc33efa4-b500-47b4-a1fd-7612a976e5d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:40:02.127150 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6a48b0e1-9604-45d1-9f0f-7470026e0a79 tempest-VolumesTransfersV355Test-1912548649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43b1c263-83b3-4407-a61d-ead00faae269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:40:02.128199 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-6a48b0e1-9604-45d1-9f0f-7470026e0a79 tempest-VolumesTransfersV355Test-1912548649 None] Volume 44b8ce06-7247-4e3d-8894-1d12317bd823: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44b8ce06-7247-4e3d-8894-1d12317bd823', 'volume_size': 1} May 21 21:40:02.128755 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6a48b0e1-9604-45d1-9f0f-7470026e0a79 tempest-VolumesTransfersV355Test-1912548649 None] creating volume 'volume-44b8ce06-7247-4e3d-8894-1d12317bd823' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:40:02.129755 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6a48b0e1-9604-45d1-9f0f-7470026e0a79 tempest-VolumesTransfersV355Test-1912548649 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:40:02.538268 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6a48b0e1-9604-45d1-9f0f-7470026e0a79 tempest-VolumesTransfersV355Test-1912548649 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:40:02.539203 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6a48b0e1-9604-45d1-9f0f-7470026e0a79 tempest-VolumesTransfersV355Test-1912548649 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:40:02.543070 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6a48b0e1-9604-45d1-9f0f-7470026e0a79 tempest-VolumesTransfersV355Test-1912548649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43b1c263-83b3-4407-a61d-ead00faae269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44b8ce06-7247-4e3d-8894-1d12317bd823', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:40:02.549104 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6a48b0e1-9604-45d1-9f0f-7470026e0a79 tempest-VolumesTransfersV355Test-1912548649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (125703a1-a5db-4817-95aa-933eb1d4c1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:40:02.643936 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-6a48b0e1-9604-45d1-9f0f-7470026e0a79 tempest-VolumesTransfersV355Test-1912548649 None] Volume volume-44b8ce06-7247-4e3d-8894-1d12317bd823 (44b8ce06-7247-4e3d-8894-1d12317bd823): created successfully May 21 21:40:02.647603 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6a48b0e1-9604-45d1-9f0f-7470026e0a79 tempest-VolumesTransfersV355Test-1912548649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (125703a1-a5db-4817-95aa-933eb1d4c1a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:40:02.653002 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6a48b0e1-9604-45d1-9f0f-7470026e0a79 tempest-VolumesTransfersV355Test-1912548649 None] Flow 'volume_create_manager' (e7a3001f-95fa-4e9e-821a-54bbceb4e907) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:40:02.735940 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-6a48b0e1-9604-45d1-9f0f-7470026e0a79 tempest-VolumesTransfersV355Test-1912548649 None] Created volume successfully. May 21 21:40:03.753906 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-47afaad9-af0a-459d-bc4d-34d8dfdc6966 tempest-VolumesTransfersV355Test-1850280044 None] Lock "b'cinder-44b8ce06-7247-4e3d-8894-1d12317bd823-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:40:03.869724 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-47afaad9-af0a-459d-bc4d-34d8dfdc6966 tempest-VolumesTransfersV355Test-1850280044 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:40:04.032690 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-47afaad9-af0a-459d-bc4d-34d8dfdc6966 tempest-VolumesTransfersV355Test-1850280044 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:40:04.032999 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-47afaad9-af0a-459d-bc4d-34d8dfdc6966 tempest-VolumesTransfersV355Test-1850280044 None] Volume volume-44b8ce06-7247-4e3d-8894-1d12317bd823 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:40:04.107009 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-47afaad9-af0a-459d-bc4d-34d8dfdc6966 tempest-VolumesTransfersV355Test-1850280044 None] deleting rbd volume volume-44b8ce06-7247-4e3d-8894-1d12317bd823 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:40:06.746431 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-47afaad9-af0a-459d-bc4d-34d8dfdc6966 tempest-VolumesTransfersV355Test-1850280044 None] Created reservations ['9be1e03a-605d-43d5-a1ba-7e5460faa435', 'f166653d-7750-42f3-89f2-6d35bbc1852c', '52e88cac-09c3-4b10-987a-d19c3271c6fe', '9cdeb66c-3648-4aa4-b828-063eb8448d6d'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:40:06.975946 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-47afaad9-af0a-459d-bc4d-34d8dfdc6966 tempest-VolumesTransfersV355Test-1850280044 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:40:07.051137 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-47afaad9-af0a-459d-bc4d-34d8dfdc6966 tempest-VolumesTransfersV355Test-1850280044 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:40:07.115293 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-47afaad9-af0a-459d-bc4d-34d8dfdc6966 tempest-VolumesTransfersV355Test-1850280044 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:40:07.122852 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-47afaad9-af0a-459d-bc4d-34d8dfdc6966 tempest-VolumesTransfersV355Test-1850280044 None] Deleted volume successfully. May 21 21:40:07.226272 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-47afaad9-af0a-459d-bc4d-34d8dfdc6966 tempest-VolumesTransfersV355Test-1850280044 None] Lock "b'cinder-44b8ce06-7247-4e3d-8894-1d12317bd823-delete_volume'" released by "delete_volume" :: held 3.473s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:40:15.464528 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fa8e998-77b9-4fda-9325-2b0faefa5a05 tempest-VolumesBackupsV39Test-886254803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:40:15.521936 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-7fa8e998-77b9-4fda-9325-2b0faefa5a05 tempest-VolumesBackupsV39Test-886254803 None] Flow 'volume_create_manager' (542af982-e8d6-43c4-84de-f660f87fa688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:40:15.529537 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-7fa8e998-77b9-4fda-9325-2b0faefa5a05 tempest-VolumesBackupsV39Test-886254803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fcee55d-6ab4-4430-af4a-fb997a02f3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:40:15.553534 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-7fa8e998-77b9-4fda-9325-2b0faefa5a05 tempest-VolumesBackupsV39Test-886254803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fcee55d-6ab4-4430-af4a-fb997a02f3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:40:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Volume-1530985422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2a65581d-ae8b-4c7e-b7af-590f8bb2effb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9c1208b9f6a4934854576efa8f41b4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:40:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:40:15Z,use_quota=True,user_id='6bea55bcdb704566923f2c079ae094a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:40:15.565322 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-7fa8e998-77b9-4fda-9325-2b0faefa5a05 tempest-VolumesBackupsV39Test-886254803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ef1ee62-0b9f-4ca7-b0a1-ee06c04fea86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:40:15.571966 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-7fa8e998-77b9-4fda-9325-2b0faefa5a05 tempest-VolumesBackupsV39Test-886254803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ef1ee62-0b9f-4ca7-b0a1-ee06c04fea86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:40:15.582779 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-7fa8e998-77b9-4fda-9325-2b0faefa5a05 tempest-VolumesBackupsV39Test-886254803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e5d1ef4-dec2-459c-9298-2095ec542f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:40:15.587767 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-7fa8e998-77b9-4fda-9325-2b0faefa5a05 tempest-VolumesBackupsV39Test-886254803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e5d1ef4-dec2-459c-9298-2095ec542f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a65581d-ae8b-4c7e-b7af-590f8bb2effb', 'volume_name': 'volume-2a65581d-ae8b-4c7e-b7af-590f8bb2effb', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:40:15.593414 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-7fa8e998-77b9-4fda-9325-2b0faefa5a05 tempest-VolumesBackupsV39Test-886254803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (709f894a-8765-41f4-bd36-96904c1767db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:40:15.598101 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-7fa8e998-77b9-4fda-9325-2b0faefa5a05 tempest-VolumesBackupsV39Test-886254803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (709f894a-8765-41f4-bd36-96904c1767db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:40:15.603429 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-7fa8e998-77b9-4fda-9325-2b0faefa5a05 tempest-VolumesBackupsV39Test-886254803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bb4f573-8929-4a38-93b2-24a406a3e5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:40:15.604852 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-7fa8e998-77b9-4fda-9325-2b0faefa5a05 tempest-VolumesBackupsV39Test-886254803 None] Volume 2a65581d-ae8b-4c7e-b7af-590f8bb2effb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a65581d-ae8b-4c7e-b7af-590f8bb2effb', 'volume_size': 1} May 21 21:40:15.605903 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-7fa8e998-77b9-4fda-9325-2b0faefa5a05 tempest-VolumesBackupsV39Test-886254803 None] creating volume 'volume-2a65581d-ae8b-4c7e-b7af-590f8bb2effb' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:40:15.606945 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-7fa8e998-77b9-4fda-9325-2b0faefa5a05 tempest-VolumesBackupsV39Test-886254803 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:40:16.098003 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-7fa8e998-77b9-4fda-9325-2b0faefa5a05 tempest-VolumesBackupsV39Test-886254803 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:40:16.098493 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-7fa8e998-77b9-4fda-9325-2b0faefa5a05 tempest-VolumesBackupsV39Test-886254803 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:40:16.102235 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-7fa8e998-77b9-4fda-9325-2b0faefa5a05 tempest-VolumesBackupsV39Test-886254803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bb4f573-8929-4a38-93b2-24a406a3e5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a65581d-ae8b-4c7e-b7af-590f8bb2effb', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:40:16.106752 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-7fa8e998-77b9-4fda-9325-2b0faefa5a05 tempest-VolumesBackupsV39Test-886254803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d0c5ccf-a740-4696-9635-3b84e3a6b1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:40:16.175881 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-7fa8e998-77b9-4fda-9325-2b0faefa5a05 tempest-VolumesBackupsV39Test-886254803 None] Volume volume-2a65581d-ae8b-4c7e-b7af-590f8bb2effb (2a65581d-ae8b-4c7e-b7af-590f8bb2effb): created successfully May 21 21:40:16.181694 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-7fa8e998-77b9-4fda-9325-2b0faefa5a05 tempest-VolumesBackupsV39Test-886254803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d0c5ccf-a740-4696-9635-3b84e3a6b1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:40:16.187010 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-7fa8e998-77b9-4fda-9325-2b0faefa5a05 tempest-VolumesBackupsV39Test-886254803 None] Flow 'volume_create_manager' (542af982-e8d6-43c4-84de-f660f87fa688) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:40:16.281711 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-7fa8e998-77b9-4fda-9325-2b0faefa5a05 tempest-VolumesBackupsV39Test-886254803 None] Created volume successfully. May 21 21:40:17.229916 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-1b30157d-e042-499d-a8c4-0a754116d44e tempest-VolumesBackupsV39Test-886254803 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-05-21T21:40:16Z,data_timestamp=2022-05-21T21:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Backup-74107373',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=ac80f866-2d7f-4d80-ae09-e862a18c8c13,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='e9c1208b9f6a4934854576efa8f41b4e',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='6bea55bcdb704566923f2c079ae094a3',volume_id=2a65581d-ae8b-4c7e-b7af-590f8bb2effb) May 21 21:40:17.237396 ncdv-master-1 cinder-volume[124407]: INFO cinder.rpc [None req-1b30157d-e042-499d-a8c4-0a754116d44e tempest-VolumesBackupsV39Test-886254803 None] Automatically selected cinder-backup objects version 1.39 as minimum service version. May 21 21:40:17.240150 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=57,cinder:INSERT=6,cinder:UPDATE=31,cinder:DELETE=4 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:40:17.243812 ncdv-master-1 cinder-volume[124407]: INFO cinder.rpc [None req-1b30157d-e042-499d-a8c4-0a754116d44e tempest-VolumesBackupsV39Test-886254803 None] Automatically selected cinder-backup RPC version 2.3 as minimum service version. May 21 21:40:17.244829 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.backup.rpcapi [None req-1b30157d-e042-499d-a8c4-0a754116d44e tempest-VolumesBackupsV39Test-886254803 None] continue_backup in rpcapi backup_id ac80f866-2d7f-4d80-ae09-e862a18c8c13 {{(pid=124407) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} May 21 21:40:24.463355 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [None req-1b30157d-e042-499d-a8c4-0a754116d44e tempest-VolumesBackupsV39Test-886254803 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:40:25.273142 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [None req-1b30157d-e042-499d-a8c4-0a754116d44e tempest-VolumesBackupsV39Test-886254803 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.809s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:40:25.274446 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-1b30157d-e042-499d-a8c4-0a754116d44e tempest-VolumesBackupsV39Test-886254803 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2a65581d-ae8b-4c7e-b7af-590f8bb2effb', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'efef91cd-d8f8-4d93-9ad2-86d0b33251f4', 'volume_id': '2a65581d-ae8b-4c7e-b7af-590f8bb2effb', 'discard': True}} {{(pid=124407) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} May 21 21:40:25.306233 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-1b30157d-e042-499d-a8c4-0a754116d44e tempest-VolumesBackupsV39Test-886254803 None] Initialize volume connection completed successfully. May 21 21:40:33.298995 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=41,cinder:INSERT=5,cinder:UPDATE=20,cinder:DELETE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:40:33.301128 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-1b30157d-e042-499d-a8c4-0a754116d44e tempest-VolumesBackupsV39Test-886254803 None] Terminate volume connection completed successfully. May 21 21:40:33.325035 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-1b30157d-e042-499d-a8c4-0a754116d44e tempest-VolumesBackupsV39Test-886254803 None] Remove volume export completed successfully. May 21 21:40:40.002274 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-0dd93f70-700f-43cf-8474-b2e1e4323a18 req-fa8e2cd0-58eb-496e-9065-11c4b73666ce tempest-AttachVolumeNegativeTest-617587518 None] Terminate volume connection completed successfully. May 21 21:40:40.003183 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-0dd93f70-700f-43cf-8474-b2e1e4323a18 req-fa8e2cd0-58eb-496e-9065-11c4b73666ce tempest-AttachVolumeNegativeTest-617587518 None] Deleting attachment a8b833d4-da2d-4740-bcf9-f9e58dfa54f5. {{(pid=124407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4957}} May 21 21:40:41.397143 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-e7124ca5-a1fe-4534-96c0-d70d33f05ce9 tempest-VolumesBackupsV39Test-886254803 None] Lock "b'cinder-2a65581d-ae8b-4c7e-b7af-590f8bb2effb-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:40:41.496118 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-e7124ca5-a1fe-4534-96c0-d70d33f05ce9 tempest-VolumesBackupsV39Test-886254803 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:40:42.741969 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-e7124ca5-a1fe-4534-96c0-d70d33f05ce9 tempest-VolumesBackupsV39Test-886254803 None] Volume volume-2a65581d-ae8b-4c7e-b7af-590f8bb2effb is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:40:43.052133 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-e7124ca5-a1fe-4534-96c0-d70d33f05ce9 tempest-VolumesBackupsV39Test-886254803 None] deleting rbd volume volume-2a65581d-ae8b-4c7e-b7af-590f8bb2effb {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:40:45.874108 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-e7124ca5-a1fe-4534-96c0-d70d33f05ce9 tempest-VolumesBackupsV39Test-886254803 None] Created reservations ['e1bd7256-7b40-49d3-96b4-44a735a3571b', '44724768-750b-48af-8adf-5924f941d268', 'c968521a-8eba-4a94-b42a-a717b2a38560', 'fcdaa36d-7fa2-43fa-9035-40a593c11183'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:40:46.127194 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-e7124ca5-a1fe-4534-96c0-d70d33f05ce9 tempest-VolumesBackupsV39Test-886254803 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:40:46.192192 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-e7124ca5-a1fe-4534-96c0-d70d33f05ce9 tempest-VolumesBackupsV39Test-886254803 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:40:46.254029 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-e7124ca5-a1fe-4534-96c0-d70d33f05ce9 tempest-VolumesBackupsV39Test-886254803 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:40:46.265195 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-e7124ca5-a1fe-4534-96c0-d70d33f05ce9 tempest-VolumesBackupsV39Test-886254803 None] Deleted volume successfully. May 21 21:40:46.365192 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-e7124ca5-a1fe-4534-96c0-d70d33f05ce9 tempest-VolumesBackupsV39Test-886254803 None] Lock "b'cinder-2a65581d-ae8b-4c7e-b7af-590f8bb2effb-delete_volume'" released by "delete_volume" :: held 4.965s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:40:47.539508 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:40:47.542011 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:40:47.616234 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:40:47.656229 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:40:56.264250 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=33,cinder:UPDATE=10,cinder:INSERT=4 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:41:06.265341 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=14,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:41:16.455019 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-3faac9e6-3cc8-4fe9-a4a4-88a5f22ba5d4 tempest-VolumeQuotasNegativeTestJSON-837385846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:41:16.476850 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3faac9e6-3cc8-4fe9-a4a4-88a5f22ba5d4 tempest-VolumeQuotasNegativeTestJSON-837385846 None] Flow 'volume_create_manager' (5cb2544c-b89c-4487-b199-c8c1981fdc6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:41:16.483348 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3faac9e6-3cc8-4fe9-a4a4-88a5f22ba5d4 tempest-VolumeQuotasNegativeTestJSON-837385846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5498ffc9-22ab-4348-a3b1-4c589871c212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:41:16.499566 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3faac9e6-3cc8-4fe9-a4a4-88a5f22ba5d4 tempest-VolumeQuotasNegativeTestJSON-837385846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5498ffc9-22ab-4348-a3b1-4c589871c212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1556555763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=758ff7e6-e326-4eb6-8ef4-6cdf111d3a7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f7f97182df14aa4a3ee3481f8c68863',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:41:16Z,use_quota=True,user_id='0ad00e9454f3416383c0365278758235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:41:16.505152 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3faac9e6-3cc8-4fe9-a4a4-88a5f22ba5d4 tempest-VolumeQuotasNegativeTestJSON-837385846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6223fbba-593e-4d2a-9845-75f437a68f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:41:16.509199 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3faac9e6-3cc8-4fe9-a4a4-88a5f22ba5d4 tempest-VolumeQuotasNegativeTestJSON-837385846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6223fbba-593e-4d2a-9845-75f437a68f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:41:16.514180 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3faac9e6-3cc8-4fe9-a4a4-88a5f22ba5d4 tempest-VolumeQuotasNegativeTestJSON-837385846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04d2ee79-d1bc-4ddd-807f-c2099b7f6ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:41:16.518162 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3faac9e6-3cc8-4fe9-a4a4-88a5f22ba5d4 tempest-VolumeQuotasNegativeTestJSON-837385846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04d2ee79-d1bc-4ddd-807f-c2099b7f6ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '758ff7e6-e326-4eb6-8ef4-6cdf111d3a7b', 'volume_name': 'volume-758ff7e6-e326-4eb6-8ef4-6cdf111d3a7b', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:41:16.523638 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3faac9e6-3cc8-4fe9-a4a4-88a5f22ba5d4 tempest-VolumeQuotasNegativeTestJSON-837385846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2f093cc-9e9a-43ad-a401-c7fe87a94264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:41:16.527569 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3faac9e6-3cc8-4fe9-a4a4-88a5f22ba5d4 tempest-VolumeQuotasNegativeTestJSON-837385846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2f093cc-9e9a-43ad-a401-c7fe87a94264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:41:16.532110 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3faac9e6-3cc8-4fe9-a4a4-88a5f22ba5d4 tempest-VolumeQuotasNegativeTestJSON-837385846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8088967f-dc0c-4b46-9ed1-1aa93f75f8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:41:16.533260 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-3faac9e6-3cc8-4fe9-a4a4-88a5f22ba5d4 tempest-VolumeQuotasNegativeTestJSON-837385846 None] Volume 758ff7e6-e326-4eb6-8ef4-6cdf111d3a7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-758ff7e6-e326-4eb6-8ef4-6cdf111d3a7b', 'volume_size': 1} May 21 21:41:16.533671 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3faac9e6-3cc8-4fe9-a4a4-88a5f22ba5d4 tempest-VolumeQuotasNegativeTestJSON-837385846 None] creating volume 'volume-758ff7e6-e326-4eb6-8ef4-6cdf111d3a7b' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:41:16.534445 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3faac9e6-3cc8-4fe9-a4a4-88a5f22ba5d4 tempest-VolumeQuotasNegativeTestJSON-837385846 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:41:16.964141 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3faac9e6-3cc8-4fe9-a4a4-88a5f22ba5d4 tempest-VolumeQuotasNegativeTestJSON-837385846 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:41:16.964584 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3faac9e6-3cc8-4fe9-a4a4-88a5f22ba5d4 tempest-VolumeQuotasNegativeTestJSON-837385846 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:41:16.972071 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3faac9e6-3cc8-4fe9-a4a4-88a5f22ba5d4 tempest-VolumeQuotasNegativeTestJSON-837385846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8088967f-dc0c-4b46-9ed1-1aa93f75f8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-758ff7e6-e326-4eb6-8ef4-6cdf111d3a7b', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:41:16.973504 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3faac9e6-3cc8-4fe9-a4a4-88a5f22ba5d4 tempest-VolumeQuotasNegativeTestJSON-837385846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ef28fb4-82bf-4604-a10f-ce04c7c5c0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:41:17.063931 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-3faac9e6-3cc8-4fe9-a4a4-88a5f22ba5d4 tempest-VolumeQuotasNegativeTestJSON-837385846 None] Volume volume-758ff7e6-e326-4eb6-8ef4-6cdf111d3a7b (758ff7e6-e326-4eb6-8ef4-6cdf111d3a7b): created successfully May 21 21:41:17.068780 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3faac9e6-3cc8-4fe9-a4a4-88a5f22ba5d4 tempest-VolumeQuotasNegativeTestJSON-837385846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ef28fb4-82bf-4604-a10f-ce04c7c5c0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:41:17.074337 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3faac9e6-3cc8-4fe9-a4a4-88a5f22ba5d4 tempest-VolumeQuotasNegativeTestJSON-837385846 None] Flow 'volume_create_manager' (5cb2544c-b89c-4487-b199-c8c1981fdc6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:41:17.155482 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-3faac9e6-3cc8-4fe9-a4a4-88a5f22ba5d4 tempest-VolumeQuotasNegativeTestJSON-837385846 None] Created volume successfully. May 21 21:41:18.664372 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-a1afeaac-63df-4c51-b9b2-ddbce49a5261 tempest-VolumeQuotasNegativeTestJSON-837385846 None] Lock "b'cinder-758ff7e6-e326-4eb6-8ef4-6cdf111d3a7b-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:41:18.764154 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a1afeaac-63df-4c51-b9b2-ddbce49a5261 tempest-VolumeQuotasNegativeTestJSON-837385846 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:41:18.892506 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a1afeaac-63df-4c51-b9b2-ddbce49a5261 tempest-VolumeQuotasNegativeTestJSON-837385846 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:41:18.892934 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a1afeaac-63df-4c51-b9b2-ddbce49a5261 tempest-VolumeQuotasNegativeTestJSON-837385846 None] Volume volume-758ff7e6-e326-4eb6-8ef4-6cdf111d3a7b is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:41:18.974125 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a1afeaac-63df-4c51-b9b2-ddbce49a5261 tempest-VolumeQuotasNegativeTestJSON-837385846 None] deleting rbd volume volume-758ff7e6-e326-4eb6-8ef4-6cdf111d3a7b {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:41:21.441918 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-a1afeaac-63df-4c51-b9b2-ddbce49a5261 tempest-VolumeQuotasNegativeTestJSON-837385846 None] Created reservations ['4169ea54-a362-40fa-8236-5d51852e2a1f', '3ff01ffa-84df-4f51-b01c-9ba3ecb8cb30', 'd38b249e-2e69-49a4-9d6c-3ca0ab5cfe91', '0b462b32-6a7f-4581-a910-ba09ddf9616e'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:41:21.601881 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a1afeaac-63df-4c51-b9b2-ddbce49a5261 tempest-VolumeQuotasNegativeTestJSON-837385846 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:41:21.651223 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a1afeaac-63df-4c51-b9b2-ddbce49a5261 tempest-VolumeQuotasNegativeTestJSON-837385846 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:41:21.711933 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-a1afeaac-63df-4c51-b9b2-ddbce49a5261 tempest-VolumeQuotasNegativeTestJSON-837385846 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:41:21.718256 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-a1afeaac-63df-4c51-b9b2-ddbce49a5261 tempest-VolumeQuotasNegativeTestJSON-837385846 None] Deleted volume successfully. May 21 21:41:21.782824 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-a1afeaac-63df-4c51-b9b2-ddbce49a5261 tempest-VolumeQuotasNegativeTestJSON-837385846 None] Lock "b'cinder-758ff7e6-e326-4eb6-8ef4-6cdf111d3a7b-delete_volume'" released by "delete_volume" :: held 3.119s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:41:33.309328 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=19,cinder:UPDATE=12,cinder:DELETE=2,cinder:INSERT=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:41:33.393363 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-d508f8f4-705e-4dc6-aca8-73e6858d86ac tempest-VolumesListAdminTestJSON-352411776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:41:33.421496 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d508f8f4-705e-4dc6-aca8-73e6858d86ac tempest-VolumesListAdminTestJSON-352411776 None] Flow 'volume_create_manager' (556cb2b2-409d-4b7d-8f75-80d0e041b865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:41:33.430712 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d508f8f4-705e-4dc6-aca8-73e6858d86ac tempest-VolumesListAdminTestJSON-352411776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ec73a4b-2eb1-4d55-bc2b-b0c0b6263799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:41:33.453003 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d508f8f4-705e-4dc6-aca8-73e6858d86ac tempest-VolumesListAdminTestJSON-352411776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ec73a4b-2eb1-4d55-bc2b-b0c0b6263799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:41:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1742970847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e8837072-63af-4c3e-a8e7-f09bcec6d44a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='107f0139a00b41ccba287398e533250e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:41:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:41:33Z,use_quota=True,user_id='b17e16a794dd46339012881756740b01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:41:33.460459 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d508f8f4-705e-4dc6-aca8-73e6858d86ac tempest-VolumesListAdminTestJSON-352411776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d97bf4e9-b129-421d-86bd-4b06f8cb657c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:41:33.466036 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d508f8f4-705e-4dc6-aca8-73e6858d86ac tempest-VolumesListAdminTestJSON-352411776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d97bf4e9-b129-421d-86bd-4b06f8cb657c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:41:33.477208 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d508f8f4-705e-4dc6-aca8-73e6858d86ac tempest-VolumesListAdminTestJSON-352411776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6345e311-7a71-4040-9c7d-97b05abd2922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:41:33.484633 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d508f8f4-705e-4dc6-aca8-73e6858d86ac tempest-VolumesListAdminTestJSON-352411776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6345e311-7a71-4040-9c7d-97b05abd2922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8837072-63af-4c3e-a8e7-f09bcec6d44a', 'volume_name': 'volume-e8837072-63af-4c3e-a8e7-f09bcec6d44a', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:41:33.487652 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d508f8f4-705e-4dc6-aca8-73e6858d86ac tempest-VolumesListAdminTestJSON-352411776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0dc5224-2506-480d-9a20-33ef467dd5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:41:33.492965 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d508f8f4-705e-4dc6-aca8-73e6858d86ac tempest-VolumesListAdminTestJSON-352411776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0dc5224-2506-480d-9a20-33ef467dd5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:41:33.498746 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d508f8f4-705e-4dc6-aca8-73e6858d86ac tempest-VolumesListAdminTestJSON-352411776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (badee3e1-024f-4664-883f-2ad89ef429bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:41:33.500011 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-d508f8f4-705e-4dc6-aca8-73e6858d86ac tempest-VolumesListAdminTestJSON-352411776 None] Volume e8837072-63af-4c3e-a8e7-f09bcec6d44a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8837072-63af-4c3e-a8e7-f09bcec6d44a', 'volume_size': 1} May 21 21:41:33.500589 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d508f8f4-705e-4dc6-aca8-73e6858d86ac tempest-VolumesListAdminTestJSON-352411776 None] creating volume 'volume-e8837072-63af-4c3e-a8e7-f09bcec6d44a' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:41:33.501542 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d508f8f4-705e-4dc6-aca8-73e6858d86ac tempest-VolumesListAdminTestJSON-352411776 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:41:33.890499 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d508f8f4-705e-4dc6-aca8-73e6858d86ac tempest-VolumesListAdminTestJSON-352411776 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:41:33.892492 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d508f8f4-705e-4dc6-aca8-73e6858d86ac tempest-VolumesListAdminTestJSON-352411776 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:41:33.895362 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d508f8f4-705e-4dc6-aca8-73e6858d86ac tempest-VolumesListAdminTestJSON-352411776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (badee3e1-024f-4664-883f-2ad89ef429bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8837072-63af-4c3e-a8e7-f09bcec6d44a', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:41:33.899837 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d508f8f4-705e-4dc6-aca8-73e6858d86ac tempest-VolumesListAdminTestJSON-352411776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b348bcc-7a86-4ad2-9bf5-31a3aeeae819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:41:33.967415 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-d508f8f4-705e-4dc6-aca8-73e6858d86ac tempest-VolumesListAdminTestJSON-352411776 None] Volume volume-e8837072-63af-4c3e-a8e7-f09bcec6d44a (e8837072-63af-4c3e-a8e7-f09bcec6d44a): created successfully May 21 21:41:33.971018 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d508f8f4-705e-4dc6-aca8-73e6858d86ac tempest-VolumesListAdminTestJSON-352411776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b348bcc-7a86-4ad2-9bf5-31a3aeeae819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:41:33.976685 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-d508f8f4-705e-4dc6-aca8-73e6858d86ac tempest-VolumesListAdminTestJSON-352411776 None] Flow 'volume_create_manager' (556cb2b2-409d-4b7d-8f75-80d0e041b865) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:41:34.036149 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-d508f8f4-705e-4dc6-aca8-73e6858d86ac tempest-VolumesListAdminTestJSON-352411776 None] Created volume successfully. May 21 21:41:35.101523 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-6abd22d7-08ff-4162-a2e2-7edfaae63191 tempest-VolumesListAdminTestJSON-352411776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:41:35.135702 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6abd22d7-08ff-4162-a2e2-7edfaae63191 tempest-VolumesListAdminTestJSON-352411776 None] Flow 'volume_create_manager' (b8d27b58-f2a1-46d4-a96d-a3603eb7df5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:41:35.143737 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6abd22d7-08ff-4162-a2e2-7edfaae63191 tempest-VolumesListAdminTestJSON-352411776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (687f27e6-8ac1-4897-90a8-4217bd3b2e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:41:35.165184 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6abd22d7-08ff-4162-a2e2-7edfaae63191 tempest-VolumesListAdminTestJSON-352411776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (687f27e6-8ac1-4897-90a8-4217bd3b2e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:41:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1705889404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d80497fe-82d2-4344-b792-6dd701a10a5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='107f0139a00b41ccba287398e533250e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:41:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:41:35Z,use_quota=True,user_id='b17e16a794dd46339012881756740b01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:41:35.170924 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6abd22d7-08ff-4162-a2e2-7edfaae63191 tempest-VolumesListAdminTestJSON-352411776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (574642ea-4a76-42ed-af2c-01cec7d69b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:41:35.175384 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6abd22d7-08ff-4162-a2e2-7edfaae63191 tempest-VolumesListAdminTestJSON-352411776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (574642ea-4a76-42ed-af2c-01cec7d69b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:41:35.182422 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6abd22d7-08ff-4162-a2e2-7edfaae63191 tempest-VolumesListAdminTestJSON-352411776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8138bfc-1311-44b9-995b-8bb652f9f019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:41:35.186808 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6abd22d7-08ff-4162-a2e2-7edfaae63191 tempest-VolumesListAdminTestJSON-352411776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8138bfc-1311-44b9-995b-8bb652f9f019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd80497fe-82d2-4344-b792-6dd701a10a5a', 'volume_name': 'volume-d80497fe-82d2-4344-b792-6dd701a10a5a', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:41:35.192965 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6abd22d7-08ff-4162-a2e2-7edfaae63191 tempest-VolumesListAdminTestJSON-352411776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (100ef9f3-1017-4da6-aaca-464b091c75ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:41:35.196985 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6abd22d7-08ff-4162-a2e2-7edfaae63191 tempest-VolumesListAdminTestJSON-352411776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (100ef9f3-1017-4da6-aaca-464b091c75ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:41:35.201856 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6abd22d7-08ff-4162-a2e2-7edfaae63191 tempest-VolumesListAdminTestJSON-352411776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae141e50-7b82-4b32-81ff-eed904f94a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:41:35.202878 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-6abd22d7-08ff-4162-a2e2-7edfaae63191 tempest-VolumesListAdminTestJSON-352411776 None] Volume d80497fe-82d2-4344-b792-6dd701a10a5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d80497fe-82d2-4344-b792-6dd701a10a5a', 'volume_size': 1} May 21 21:41:35.203269 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6abd22d7-08ff-4162-a2e2-7edfaae63191 tempest-VolumesListAdminTestJSON-352411776 None] creating volume 'volume-d80497fe-82d2-4344-b792-6dd701a10a5a' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:41:35.203920 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6abd22d7-08ff-4162-a2e2-7edfaae63191 tempest-VolumesListAdminTestJSON-352411776 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:41:35.621873 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6abd22d7-08ff-4162-a2e2-7edfaae63191 tempest-VolumesListAdminTestJSON-352411776 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:41:35.622419 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6abd22d7-08ff-4162-a2e2-7edfaae63191 tempest-VolumesListAdminTestJSON-352411776 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:41:35.626123 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6abd22d7-08ff-4162-a2e2-7edfaae63191 tempest-VolumesListAdminTestJSON-352411776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae141e50-7b82-4b32-81ff-eed904f94a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d80497fe-82d2-4344-b792-6dd701a10a5a', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:41:35.631418 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6abd22d7-08ff-4162-a2e2-7edfaae63191 tempest-VolumesListAdminTestJSON-352411776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9812b9a0-b752-4d34-ac77-bdd843ae1e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:41:35.677747 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-6abd22d7-08ff-4162-a2e2-7edfaae63191 tempest-VolumesListAdminTestJSON-352411776 None] Volume volume-d80497fe-82d2-4344-b792-6dd701a10a5a (d80497fe-82d2-4344-b792-6dd701a10a5a): created successfully May 21 21:41:35.681872 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6abd22d7-08ff-4162-a2e2-7edfaae63191 tempest-VolumesListAdminTestJSON-352411776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9812b9a0-b752-4d34-ac77-bdd843ae1e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:41:35.687455 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6abd22d7-08ff-4162-a2e2-7edfaae63191 tempest-VolumesListAdminTestJSON-352411776 None] Flow 'volume_create_manager' (b8d27b58-f2a1-46d4-a96d-a3603eb7df5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:41:35.739270 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-6abd22d7-08ff-4162-a2e2-7edfaae63191 tempest-VolumesListAdminTestJSON-352411776 None] Created volume successfully. May 21 21:41:36.820261 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b131571-82b4-4aee-82d7-84ef84c55417 tempest-VolumesListAdminTestJSON-352411776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:41:36.839975 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8b131571-82b4-4aee-82d7-84ef84c55417 tempest-VolumesListAdminTestJSON-352411776 None] Flow 'volume_create_manager' (3d8a155f-76d8-4773-9d09-4c269a659671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:41:36.846406 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8b131571-82b4-4aee-82d7-84ef84c55417 tempest-VolumesListAdminTestJSON-352411776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bf586ca-c050-4a46-ad46-72d7df3032a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:41:36.863566 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8b131571-82b4-4aee-82d7-84ef84c55417 tempest-VolumesListAdminTestJSON-352411776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bf586ca-c050-4a46-ad46-72d7df3032a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:41:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-321794300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=36f65be8-f6e9-41db-b17a-491ab729032b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='107f0139a00b41ccba287398e533250e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:41:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:41:37Z,use_quota=True,user_id='b17e16a794dd46339012881756740b01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:41:36.868967 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8b131571-82b4-4aee-82d7-84ef84c55417 tempest-VolumesListAdminTestJSON-352411776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44f66190-479d-4fba-a39a-618a5f222e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:41:36.873341 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8b131571-82b4-4aee-82d7-84ef84c55417 tempest-VolumesListAdminTestJSON-352411776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44f66190-479d-4fba-a39a-618a5f222e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:41:36.879984 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8b131571-82b4-4aee-82d7-84ef84c55417 tempest-VolumesListAdminTestJSON-352411776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7e91d3e-78d4-4288-ba5b-1d2017ed8594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:41:36.882936 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8b131571-82b4-4aee-82d7-84ef84c55417 tempest-VolumesListAdminTestJSON-352411776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7e91d3e-78d4-4288-ba5b-1d2017ed8594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36f65be8-f6e9-41db-b17a-491ab729032b', 'volume_name': 'volume-36f65be8-f6e9-41db-b17a-491ab729032b', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:41:36.887794 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8b131571-82b4-4aee-82d7-84ef84c55417 tempest-VolumesListAdminTestJSON-352411776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0c8f49a-3299-4d61-a6b2-4cef3d01144d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:41:36.891615 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8b131571-82b4-4aee-82d7-84ef84c55417 tempest-VolumesListAdminTestJSON-352411776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0c8f49a-3299-4d61-a6b2-4cef3d01144d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:41:36.896841 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8b131571-82b4-4aee-82d7-84ef84c55417 tempest-VolumesListAdminTestJSON-352411776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ef2e1be-37fb-47b5-91b6-ff2b0de02788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:41:36.897931 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-8b131571-82b4-4aee-82d7-84ef84c55417 tempest-VolumesListAdminTestJSON-352411776 None] Volume 36f65be8-f6e9-41db-b17a-491ab729032b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36f65be8-f6e9-41db-b17a-491ab729032b', 'volume_size': 1} May 21 21:41:36.898312 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8b131571-82b4-4aee-82d7-84ef84c55417 tempest-VolumesListAdminTestJSON-352411776 None] creating volume 'volume-36f65be8-f6e9-41db-b17a-491ab729032b' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:41:36.898949 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8b131571-82b4-4aee-82d7-84ef84c55417 tempest-VolumesListAdminTestJSON-352411776 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:41:37.342275 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8b131571-82b4-4aee-82d7-84ef84c55417 tempest-VolumesListAdminTestJSON-352411776 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:41:37.342656 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8b131571-82b4-4aee-82d7-84ef84c55417 tempest-VolumesListAdminTestJSON-352411776 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:41:37.347347 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8b131571-82b4-4aee-82d7-84ef84c55417 tempest-VolumesListAdminTestJSON-352411776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ef2e1be-37fb-47b5-91b6-ff2b0de02788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36f65be8-f6e9-41db-b17a-491ab729032b', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:41:37.353312 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8b131571-82b4-4aee-82d7-84ef84c55417 tempest-VolumesListAdminTestJSON-352411776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a20517c-1c75-4b01-ab6e-fd4c33246967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:41:37.358494 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=33,cinder:UPDATE=14,cinder:INSERT=2,cinder:DELETE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:41:37.436548 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-8b131571-82b4-4aee-82d7-84ef84c55417 tempest-VolumesListAdminTestJSON-352411776 None] Volume volume-36f65be8-f6e9-41db-b17a-491ab729032b (36f65be8-f6e9-41db-b17a-491ab729032b): created successfully May 21 21:41:37.442102 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8b131571-82b4-4aee-82d7-84ef84c55417 tempest-VolumesListAdminTestJSON-352411776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a20517c-1c75-4b01-ab6e-fd4c33246967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:41:37.449753 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8b131571-82b4-4aee-82d7-84ef84c55417 tempest-VolumesListAdminTestJSON-352411776 None] Flow 'volume_create_manager' (3d8a155f-76d8-4773-9d09-4c269a659671) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:41:37.544899 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-8b131571-82b4-4aee-82d7-84ef84c55417 tempest-VolumesListAdminTestJSON-352411776 None] Created volume successfully. May 21 21:41:39.003585 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a8a3e72-e1c0-4a68-8a1c-bbb24d969b9c tempest-VolumesListAdminTestJSON-2015623174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:41:39.026754 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8a8a3e72-e1c0-4a68-8a1c-bbb24d969b9c tempest-VolumesListAdminTestJSON-2015623174 None] Flow 'volume_create_manager' (5914d1d5-1cc6-4bd8-81aa-0b2b557cc441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:41:39.032962 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8a8a3e72-e1c0-4a68-8a1c-bbb24d969b9c tempest-VolumesListAdminTestJSON-2015623174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a191cb2-d954-45e4-a93e-a4b5206f5942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:41:39.052073 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8a8a3e72-e1c0-4a68-8a1c-bbb24d969b9c tempest-VolumesListAdminTestJSON-2015623174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a191cb2-d954-45e4-a93e-a4b5206f5942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:41:38Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=82152fdc-c2e5-4051-af23-4f8a7d31b4c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d67e6dbd30a04cdfa056a5fb8b3df491',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:41:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:41:39Z,use_quota=True,user_id='16273167bb424ef8bc11d9c0f1483805',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:41:39.057589 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8a8a3e72-e1c0-4a68-8a1c-bbb24d969b9c tempest-VolumesListAdminTestJSON-2015623174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (738c3e4c-11f9-4c31-9857-ae1befa347b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:41:39.062032 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8a8a3e72-e1c0-4a68-8a1c-bbb24d969b9c tempest-VolumesListAdminTestJSON-2015623174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (738c3e4c-11f9-4c31-9857-ae1befa347b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:41:39.067536 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8a8a3e72-e1c0-4a68-8a1c-bbb24d969b9c tempest-VolumesListAdminTestJSON-2015623174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eae408e2-75bd-4b64-b311-48474fb81db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:41:39.071762 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8a8a3e72-e1c0-4a68-8a1c-bbb24d969b9c tempest-VolumesListAdminTestJSON-2015623174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eae408e2-75bd-4b64-b311-48474fb81db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82152fdc-c2e5-4051-af23-4f8a7d31b4c6', 'volume_name': 'volume-82152fdc-c2e5-4051-af23-4f8a7d31b4c6', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:41:39.077154 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8a8a3e72-e1c0-4a68-8a1c-bbb24d969b9c tempest-VolumesListAdminTestJSON-2015623174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40445e62-fe5b-43cf-b50a-d9c51475b3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:41:39.091110 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8a8a3e72-e1c0-4a68-8a1c-bbb24d969b9c tempest-VolumesListAdminTestJSON-2015623174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40445e62-fe5b-43cf-b50a-d9c51475b3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:41:39.096061 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8a8a3e72-e1c0-4a68-8a1c-bbb24d969b9c tempest-VolumesListAdminTestJSON-2015623174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3bef589-3dcc-4bab-9c02-bcc4f292cdae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:41:39.097292 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-8a8a3e72-e1c0-4a68-8a1c-bbb24d969b9c tempest-VolumesListAdminTestJSON-2015623174 None] Volume 82152fdc-c2e5-4051-af23-4f8a7d31b4c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82152fdc-c2e5-4051-af23-4f8a7d31b4c6', 'volume_size': 1} May 21 21:41:39.098446 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8a8a3e72-e1c0-4a68-8a1c-bbb24d969b9c tempest-VolumesListAdminTestJSON-2015623174 None] creating volume 'volume-82152fdc-c2e5-4051-af23-4f8a7d31b4c6' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:41:39.099108 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8a8a3e72-e1c0-4a68-8a1c-bbb24d969b9c tempest-VolumesListAdminTestJSON-2015623174 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:41:39.613064 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8a8a3e72-e1c0-4a68-8a1c-bbb24d969b9c tempest-VolumesListAdminTestJSON-2015623174 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:41:39.614138 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8a8a3e72-e1c0-4a68-8a1c-bbb24d969b9c tempest-VolumesListAdminTestJSON-2015623174 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:41:39.618911 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8a8a3e72-e1c0-4a68-8a1c-bbb24d969b9c tempest-VolumesListAdminTestJSON-2015623174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3bef589-3dcc-4bab-9c02-bcc4f292cdae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82152fdc-c2e5-4051-af23-4f8a7d31b4c6', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:41:39.625552 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8a8a3e72-e1c0-4a68-8a1c-bbb24d969b9c tempest-VolumesListAdminTestJSON-2015623174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50ab91b1-ee38-41d1-adcc-89a903d67c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:41:39.688887 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-8a8a3e72-e1c0-4a68-8a1c-bbb24d969b9c tempest-VolumesListAdminTestJSON-2015623174 None] Volume volume-82152fdc-c2e5-4051-af23-4f8a7d31b4c6 (82152fdc-c2e5-4051-af23-4f8a7d31b4c6): created successfully May 21 21:41:39.693072 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8a8a3e72-e1c0-4a68-8a1c-bbb24d969b9c tempest-VolumesListAdminTestJSON-2015623174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50ab91b1-ee38-41d1-adcc-89a903d67c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:41:39.698486 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8a8a3e72-e1c0-4a68-8a1c-bbb24d969b9c tempest-VolumesListAdminTestJSON-2015623174 None] Flow 'volume_create_manager' (5914d1d5-1cc6-4bd8-81aa-0b2b557cc441) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:41:39.773527 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-8a8a3e72-e1c0-4a68-8a1c-bbb24d969b9c tempest-VolumesListAdminTestJSON-2015623174 None] Created volume successfully. May 21 21:41:40.081455 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-7eb4740d-fa1a-4ff7-8b79-b4996414789b tempest-VolumesListAdminTestJSON-2015623174 None] Lock "b'cinder-82152fdc-c2e5-4051-af23-4f8a7d31b4c6-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:41:40.181347 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-7eb4740d-fa1a-4ff7-8b79-b4996414789b tempest-VolumesListAdminTestJSON-2015623174 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:41:40.293102 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-7eb4740d-fa1a-4ff7-8b79-b4996414789b tempest-VolumesListAdminTestJSON-2015623174 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:41:40.293464 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-7eb4740d-fa1a-4ff7-8b79-b4996414789b tempest-VolumesListAdminTestJSON-2015623174 None] Volume volume-82152fdc-c2e5-4051-af23-4f8a7d31b4c6 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:41:40.378543 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-7eb4740d-fa1a-4ff7-8b79-b4996414789b tempest-VolumesListAdminTestJSON-2015623174 None] deleting rbd volume volume-82152fdc-c2e5-4051-af23-4f8a7d31b4c6 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:41:40.398302 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-355aa1ff-b033-49d2-a917-cf1b482454d4 tempest-VolumesListAdminTestJSON-352411776 None] Lock "b'cinder-36f65be8-f6e9-41db-b17a-491ab729032b-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:41:40.510285 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-355aa1ff-b033-49d2-a917-cf1b482454d4 tempest-VolumesListAdminTestJSON-352411776 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:41:40.618820 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-355aa1ff-b033-49d2-a917-cf1b482454d4 tempest-VolumesListAdminTestJSON-352411776 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:41:40.619283 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-355aa1ff-b033-49d2-a917-cf1b482454d4 tempest-VolumesListAdminTestJSON-352411776 None] Volume volume-36f65be8-f6e9-41db-b17a-491ab729032b is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:41:40.716928 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-355aa1ff-b033-49d2-a917-cf1b482454d4 tempest-VolumesListAdminTestJSON-352411776 None] deleting rbd volume volume-36f65be8-f6e9-41db-b17a-491ab729032b {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:41:42.735668 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-29860318-70c2-4635-9f56-a3965e6c72e5 tempest-AttachVolumeNegativeTest-617587518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:41:42.763292 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-29860318-70c2-4635-9f56-a3965e6c72e5 tempest-AttachVolumeNegativeTest-617587518 None] Flow 'volume_create_manager' (b82ae771-82f4-441a-ab0e-ad6e88a4d60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:41:42.771146 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-29860318-70c2-4635-9f56-a3965e6c72e5 tempest-AttachVolumeNegativeTest-617587518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3644b94-6987-405d-9e9f-6d145cba2a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:41:42.789093 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-29860318-70c2-4635-9f56-a3965e6c72e5 tempest-AttachVolumeNegativeTest-617587518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3644b94-6987-405d-9e9f-6d145cba2a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:41:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1189005072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6c377029-622a-4080-a22a-7ff58210f09d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41b9c87f24cd4bac983b83b49daeae5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:41:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:41:42Z,use_quota=True,user_id='f01908adbe2c4aebb89d6fd3af3de207',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:41:42.794322 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-29860318-70c2-4635-9f56-a3965e6c72e5 tempest-AttachVolumeNegativeTest-617587518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1553f96-7f32-480d-9d1e-ff3a3886a503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:41:42.798397 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-29860318-70c2-4635-9f56-a3965e6c72e5 tempest-AttachVolumeNegativeTest-617587518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1553f96-7f32-480d-9d1e-ff3a3886a503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:41:42.803366 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-29860318-70c2-4635-9f56-a3965e6c72e5 tempest-AttachVolumeNegativeTest-617587518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73cbbcf3-9846-45f1-a1a1-93beaaaec907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:41:42.807346 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-29860318-70c2-4635-9f56-a3965e6c72e5 tempest-AttachVolumeNegativeTest-617587518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73cbbcf3-9846-45f1-a1a1-93beaaaec907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c377029-622a-4080-a22a-7ff58210f09d', 'volume_name': 'volume-6c377029-622a-4080-a22a-7ff58210f09d', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:41:42.812158 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-29860318-70c2-4635-9f56-a3965e6c72e5 tempest-AttachVolumeNegativeTest-617587518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb4c17cb-6e58-4773-8f75-485d2fd9dc47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:41:42.816065 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-29860318-70c2-4635-9f56-a3965e6c72e5 tempest-AttachVolumeNegativeTest-617587518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb4c17cb-6e58-4773-8f75-485d2fd9dc47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:41:42.821074 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-29860318-70c2-4635-9f56-a3965e6c72e5 tempest-AttachVolumeNegativeTest-617587518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74453298-8fca-4c08-abdf-d26e59599777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:41:42.822126 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-29860318-70c2-4635-9f56-a3965e6c72e5 tempest-AttachVolumeNegativeTest-617587518 None] Volume 6c377029-622a-4080-a22a-7ff58210f09d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c377029-622a-4080-a22a-7ff58210f09d', 'volume_size': 1} May 21 21:41:42.822519 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-29860318-70c2-4635-9f56-a3965e6c72e5 tempest-AttachVolumeNegativeTest-617587518 None] creating volume 'volume-6c377029-622a-4080-a22a-7ff58210f09d' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:41:42.823161 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-29860318-70c2-4635-9f56-a3965e6c72e5 tempest-AttachVolumeNegativeTest-617587518 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:41:43.582926 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-29860318-70c2-4635-9f56-a3965e6c72e5 tempest-AttachVolumeNegativeTest-617587518 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:41:43.583393 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-29860318-70c2-4635-9f56-a3965e6c72e5 tempest-AttachVolumeNegativeTest-617587518 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:41:43.587733 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-29860318-70c2-4635-9f56-a3965e6c72e5 tempest-AttachVolumeNegativeTest-617587518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74453298-8fca-4c08-abdf-d26e59599777) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c377029-622a-4080-a22a-7ff58210f09d', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:41:43.592192 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-29860318-70c2-4635-9f56-a3965e6c72e5 tempest-AttachVolumeNegativeTest-617587518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (717534b8-0ddc-4b9d-8e08-eb252b41959e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:41:43.699840 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-29860318-70c2-4635-9f56-a3965e6c72e5 tempest-AttachVolumeNegativeTest-617587518 None] Volume volume-6c377029-622a-4080-a22a-7ff58210f09d (6c377029-622a-4080-a22a-7ff58210f09d): created successfully May 21 21:41:43.704364 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-29860318-70c2-4635-9f56-a3965e6c72e5 tempest-AttachVolumeNegativeTest-617587518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (717534b8-0ddc-4b9d-8e08-eb252b41959e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:41:43.712448 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-29860318-70c2-4635-9f56-a3965e6c72e5 tempest-AttachVolumeNegativeTest-617587518 None] Flow 'volume_create_manager' (b82ae771-82f4-441a-ab0e-ad6e88a4d60a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:41:43.819406 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-29860318-70c2-4635-9f56-a3965e6c72e5 tempest-AttachVolumeNegativeTest-617587518 None] Created volume successfully. May 21 21:41:45.669492 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-5e576c31-e531-4ecf-9c1e-62b820f2c15c req-61049ed5-0334-4c8a-934c-e48eb274e2ff tempest-AttachVolumeNegativeTest-617587518 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:41:46.048530 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-7eb4740d-fa1a-4ff7-8b79-b4996414789b tempest-VolumesListAdminTestJSON-2015623174 None] Created reservations ['e92a5607-4cff-455c-b98b-6256e25a7ed6', 'f2a79572-d4de-43ba-a8d4-c0fabd05b39d', '8efbe53d-058d-4a6b-a744-3b8bf74ac053', 'e18bcc57-fb65-40ef-995d-979ecee4f7af'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:41:46.092087 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-355aa1ff-b033-49d2-a917-cf1b482454d4 tempest-VolumesListAdminTestJSON-352411776 None] Created reservations ['be82a9a7-eff6-4159-9061-f0c1468fce3f', '6a397c92-7187-406c-872e-fceeb932108c', '20762b45-d410-49cf-814b-5edaffd28fc5', '61586a4b-ca45-4e99-abb3-770f47938d52'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:41:46.303688 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-7eb4740d-fa1a-4ff7-8b79-b4996414789b tempest-VolumesListAdminTestJSON-2015623174 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:41:46.359623 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-7eb4740d-fa1a-4ff7-8b79-b4996414789b tempest-VolumesListAdminTestJSON-2015623174 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:41:46.424407 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-7eb4740d-fa1a-4ff7-8b79-b4996414789b tempest-VolumesListAdminTestJSON-2015623174 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:41:46.434485 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-355aa1ff-b033-49d2-a917-cf1b482454d4 tempest-VolumesListAdminTestJSON-352411776 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:41:46.478886 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-355aa1ff-b033-49d2-a917-cf1b482454d4 tempest-VolumesListAdminTestJSON-352411776 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:41:46.600630 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-355aa1ff-b033-49d2-a917-cf1b482454d4 tempest-VolumesListAdminTestJSON-352411776 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:41:46.606958 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-7eb4740d-fa1a-4ff7-8b79-b4996414789b tempest-VolumesListAdminTestJSON-2015623174 None] Deleted volume successfully. May 21 21:41:46.625116 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-355aa1ff-b033-49d2-a917-cf1b482454d4 tempest-VolumesListAdminTestJSON-352411776 None] Deleted volume successfully. May 21 21:41:46.718514 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-355aa1ff-b033-49d2-a917-cf1b482454d4 tempest-VolumesListAdminTestJSON-352411776 None] Lock "b'cinder-36f65be8-f6e9-41db-b17a-491ab729032b-delete_volume'" released by "delete_volume" :: held 6.321s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:41:46.720195 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-5e576c31-e531-4ecf-9c1e-62b820f2c15c req-61049ed5-0334-4c8a-934c-e48eb274e2ff tempest-AttachVolumeNegativeTest-617587518 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.051s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:41:46.721097 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-5e576c31-e531-4ecf-9c1e-62b820f2c15c req-61049ed5-0334-4c8a-934c-e48eb274e2ff tempest-AttachVolumeNegativeTest-617587518 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-6c377029-622a-4080-a22a-7ff58210f09d', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'efef91cd-d8f8-4d93-9ad2-86d0b33251f4', 'volume_id': '6c377029-622a-4080-a22a-7ff58210f09d', 'discard': True}} {{(pid=124407) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} May 21 21:41:46.748630 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-7eb4740d-fa1a-4ff7-8b79-b4996414789b tempest-VolumesListAdminTestJSON-2015623174 None] Lock "b'cinder-82152fdc-c2e5-4051-af23-4f8a7d31b4c6-delete_volume'" released by "delete_volume" :: held 6.667s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:41:46.808638 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-5e576c31-e531-4ecf-9c1e-62b820f2c15c req-61049ed5-0334-4c8a-934c-e48eb274e2ff tempest-AttachVolumeNegativeTest-617587518 None] Connection info returned from driver {'name': 'volumes/volume-6c377029-622a-4080-a22a-7ff58210f09d', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '6c377029-622a-4080-a22a-7ff58210f09d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '978a340e-309a-4d86-bcee-03696acbb844'} {{(pid=124407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4826}} May 21 21:41:46.943475 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-5e576c31-e531-4ecf-9c1e-62b820f2c15c req-61049ed5-0334-4c8a-934c-e48eb274e2ff tempest-AttachVolumeNegativeTest-617587518 None] attachment_update completed successfully. May 21 21:41:47.030125 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-50140814-8c7b-48d4-b5d0-176596d7c209 tempest-VolumesListAdminTestJSON-352411776 None] Lock "b'cinder-d80497fe-82d2-4344-b792-6dd701a10a5a-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:41:47.033225 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=60,cinder:UPDATE=38,cinder:DELETE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:41:47.150766 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-50140814-8c7b-48d4-b5d0-176596d7c209 tempest-VolumesListAdminTestJSON-352411776 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:41:47.299114 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-50140814-8c7b-48d4-b5d0-176596d7c209 tempest-VolumesListAdminTestJSON-352411776 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:41:47.299568 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-50140814-8c7b-48d4-b5d0-176596d7c209 tempest-VolumesListAdminTestJSON-352411776 None] Volume volume-d80497fe-82d2-4344-b792-6dd701a10a5a is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:41:47.374170 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-50140814-8c7b-48d4-b5d0-176596d7c209 tempest-VolumesListAdminTestJSON-352411776 None] deleting rbd volume volume-d80497fe-82d2-4344-b792-6dd701a10a5a {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:41:47.540361 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:41:47.541066 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:41:47.624422 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:41:47.727049 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:41:50.286360 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-50140814-8c7b-48d4-b5d0-176596d7c209 tempest-VolumesListAdminTestJSON-352411776 None] Created reservations ['a03b604c-2825-4cd2-a8c6-743fa958b319', 'a5a0f657-00c8-46b7-807a-a554ea72cb61', 'ad16b422-67f4-48f5-b1c6-616c4c91367d', '2caffb1c-5256-45bb-8659-6140b08d1244'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:41:50.569832 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-50140814-8c7b-48d4-b5d0-176596d7c209 tempest-VolumesListAdminTestJSON-352411776 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:41:50.630415 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-50140814-8c7b-48d4-b5d0-176596d7c209 tempest-VolumesListAdminTestJSON-352411776 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:41:50.700204 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-50140814-8c7b-48d4-b5d0-176596d7c209 tempest-VolumesListAdminTestJSON-352411776 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:41:50.706828 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-50140814-8c7b-48d4-b5d0-176596d7c209 tempest-VolumesListAdminTestJSON-352411776 None] Deleted volume successfully. May 21 21:41:50.812696 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-50140814-8c7b-48d4-b5d0-176596d7c209 tempest-VolumesListAdminTestJSON-352411776 None] Lock "b'cinder-d80497fe-82d2-4344-b792-6dd701a10a5a-delete_volume'" released by "delete_volume" :: held 3.782s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:41:51.246925 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-1e42d0b0-ba16-46f2-af6e-e0c1b3380aca req-ded47ab8-36f8-45d6-a3e5-5918f23cab1c tempest-AttachVolumeNegativeTest-617587518 None] Terminate volume connection completed successfully. May 21 21:41:51.247718 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-1e42d0b0-ba16-46f2-af6e-e0c1b3380aca req-ded47ab8-36f8-45d6-a3e5-5918f23cab1c tempest-AttachVolumeNegativeTest-617587518 None] Deleting attachment 978a340e-309a-4d86-bcee-03696acbb844. {{(pid=124407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4957}} May 21 21:41:51.685914 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-48ec609b-33b9-4d4e-adec-468656de1448 tempest-VolumesListAdminTestJSON-352411776 None] Lock "b'cinder-e8837072-63af-4c3e-a8e7-f09bcec6d44a-delete_volume'" acquired by "delete_volume" :: waited 0.029s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:41:51.827258 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-48ec609b-33b9-4d4e-adec-468656de1448 tempest-VolumesListAdminTestJSON-352411776 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:41:52.030662 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-48ec609b-33b9-4d4e-adec-468656de1448 tempest-VolumesListAdminTestJSON-352411776 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:41:52.031113 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-48ec609b-33b9-4d4e-adec-468656de1448 tempest-VolumesListAdminTestJSON-352411776 None] Volume volume-e8837072-63af-4c3e-a8e7-f09bcec6d44a is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:41:52.089236 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-48ec609b-33b9-4d4e-adec-468656de1448 tempest-VolumesListAdminTestJSON-352411776 None] deleting rbd volume volume-e8837072-63af-4c3e-a8e7-f09bcec6d44a {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:41:54.441944 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=66,cinder:UPDATE=20,cinder:DELETE=4,cinder:INSERT=10 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:41:54.597970 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-48ec609b-33b9-4d4e-adec-468656de1448 tempest-VolumesListAdminTestJSON-352411776 None] Created reservations ['448728b5-0f45-46d9-9617-3400e22d7764', '2d38db02-3e69-4070-853b-cc08955993f2', '181a78dc-3bf2-442f-a7d5-1eedfbbeb1a9', '55a9d6d9-4e6a-4728-ae4c-3988740cacc3'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:41:54.825852 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-48ec609b-33b9-4d4e-adec-468656de1448 tempest-VolumesListAdminTestJSON-352411776 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:41:54.891278 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-48ec609b-33b9-4d4e-adec-468656de1448 tempest-VolumesListAdminTestJSON-352411776 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:41:54.948368 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-48ec609b-33b9-4d4e-adec-468656de1448 tempest-VolumesListAdminTestJSON-352411776 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:41:54.964935 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-48ec609b-33b9-4d4e-adec-468656de1448 tempest-VolumesListAdminTestJSON-352411776 None] Deleted volume successfully. May 21 21:41:55.042808 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-48ec609b-33b9-4d4e-adec-468656de1448 tempest-VolumesListAdminTestJSON-352411776 None] Lock "b'cinder-e8837072-63af-4c3e-a8e7-f09bcec6d44a-delete_volume'" released by "delete_volume" :: held 3.358s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:42:00.687135 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-52e3e99a-595d-4538-afc8-cace14830596 tempest-TestVolumeBootPattern-343249266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:42:00.713889 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-52e3e99a-595d-4538-afc8-cace14830596 tempest-TestVolumeBootPattern-343249266 None] Flow 'volume_create_manager' (bf627e4e-67a8-4ed1-8369-af20b282564a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:42:00.723777 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-52e3e99a-595d-4538-afc8-cace14830596 tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cb27ad5-9bd6-44bf-893d-000f5ec524e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:42:00.775269 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-52e3e99a-595d-4538-afc8-cace14830596 tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cb27ad5-9bd6-44bf-893d-000f5ec524e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:42:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-49434580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=003f1b35-97a2-4c05-bb96-136894e77a85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8149564857f64342aef93f18c0d90eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:42:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:42:00Z,use_quota=True,user_id='730839d5531644eb9aa26dabe2fbd8f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:42:00.792544 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-52e3e99a-595d-4538-afc8-cace14830596 tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39a4105b-52b8-4916-bf2f-65f858f12a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:42:00.800482 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-52e3e99a-595d-4538-afc8-cace14830596 tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39a4105b-52b8-4916-bf2f-65f858f12a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:42:00.806827 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-52e3e99a-595d-4538-afc8-cace14830596 tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (263bd993-b1db-4b2c-88ba-57294a515d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:42:00.929564 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-52e3e99a-595d-4538-afc8-cace14830596 tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (263bd993-b1db-4b2c-88ba-57294a515d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '003f1b35-97a2-4c05-bb96-136894e77a85', 'volume_name': 'volume-003f1b35-97a2-4c05-bb96-136894e77a85', 'volume_size': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5593f8cb452404083dfa177b4ee68b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'created_at': datetime.datetime(2022, 5, 21, 21, 0, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:42:00.941259 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-52e3e99a-595d-4538-afc8-cace14830596 tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15918ba6-5e13-4f08-b1a0-1ae1fc9c56a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:42:00.961464 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-52e3e99a-595d-4538-afc8-cace14830596 tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15918ba6-5e13-4f08-b1a0-1ae1fc9c56a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:42:00.988940 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-52e3e99a-595d-4538-afc8-cace14830596 tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (821e441d-e415-4996-a933-94a01d3d0a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:42:00.995504 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-52e3e99a-595d-4538-afc8-cace14830596 tempest-TestVolumeBootPattern-343249266 None] Volume 003f1b35-97a2-4c05-bb96-136894e77a85: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-003f1b35-97a2-4c05-bb96-136894e77a85', 'volume_size': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5593f8cb452404083dfa177b4ee68b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'created_at': datetime.datetime(2022, 5, 21, 21, 0, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } May 21 21:42:00.996305 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-52e3e99a-595d-4538-afc8-cace14830596 tempest-TestVolumeBootPattern-343249266 None] Cloning 003f1b35-97a2-4c05-bb96-136894e77a85 from image e570f5eb-6047-4214-a420-fdfdbdf19a4c at location (None, None). {{(pid=124407) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1053}} May 21 21:42:01.024562 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-52e3e99a-595d-4538-afc8-cace14830596 tempest-TestVolumeBootPattern-343249266 None] Lock "b'cinder-e570f5eb-6047-4214-a420-fdfdbdf19a4c'" acquired by "_prepare_image_cache_entry" :: waited 0.020s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:42:01.117963 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-52e3e99a-595d-4538-afc8-cace14830596 tempest-TestVolumeBootPattern-343249266 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'volume_id': '4057e637-23ba-493f-a45d-eb28c07ac60a', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28), 'last_used': datetime.datetime(2022, 5, 21, 21, 42, 1, 43745)}. {{(pid=124407) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 21 21:42:01.118426 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-52e3e99a-595d-4538-afc8-cace14830596 tempest-TestVolumeBootPattern-343249266 None] Image-volume cache entry image_update_at = 2022-05-21 21:00:28+00:00, requested image updated_at = 2022-05-21 21:00:28+00:00. {{(pid=124407) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 21 21:42:01.118836 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-52e3e99a-595d-4538-afc8-cace14830596 tempest-TestVolumeBootPattern-343249266 None] Found cache entry for image = e570f5eb-6047-4214-a420-fdfdbdf19a4c on host ncdv-master-1@ceph#ceph. {{(pid=124407) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:876}} May 21 21:42:01.127864 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-52e3e99a-595d-4538-afc8-cace14830596 tempest-TestVolumeBootPattern-343249266 None] Lock "b'cinder-e570f5eb-6047-4214-a420-fdfdbdf19a4c'" released by "_prepare_image_cache_entry" :: held 0.106s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:42:01.127864 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-52e3e99a-595d-4538-afc8-cace14830596 tempest-TestVolumeBootPattern-343249266 None] Attempting to retrieve cache entry for image = e570f5eb-6047-4214-a420-fdfdbdf19a4c on host ncdv-master-1@ceph#ceph. {{(pid=124407) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:817}} May 21 21:42:01.138410 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-52e3e99a-595d-4538-afc8-cace14830596 tempest-TestVolumeBootPattern-343249266 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'volume_id': '4057e637-23ba-493f-a45d-eb28c07ac60a', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28), 'last_used': datetime.datetime(2022, 5, 21, 21, 42, 1, 133592)}. {{(pid=124407) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 21 21:42:01.138839 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-52e3e99a-595d-4538-afc8-cace14830596 tempest-TestVolumeBootPattern-343249266 None] Image-volume cache entry image_update_at = 2022-05-21 21:00:28+00:00, requested image updated_at = 2022-05-21 21:00:28+00:00. {{(pid=124407) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 21 21:42:01.141552 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-52e3e99a-595d-4538-afc8-cace14830596 tempest-TestVolumeBootPattern-343249266 None] Creating from source image-volume 4057e637-23ba-493f-a45d-eb28c07ac60a {{(pid=124407) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:831}} May 21 21:42:01.166782 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-52e3e99a-595d-4538-afc8-cace14830596 tempest-TestVolumeBootPattern-343249266 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:42:01.374827 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-52e3e99a-595d-4538-afc8-cace14830596 tempest-TestVolumeBootPattern-343249266 None] creating snapshot='volume-003f1b35-97a2-4c05-bb96-136894e77a85.clone_snap' {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 21 21:42:03.323430 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-52e3e99a-595d-4538-afc8-cace14830596 tempest-TestVolumeBootPattern-343249266 None] cloning 'volume-4057e637-23ba-493f-a45d-eb28c07ac60a@volume-003f1b35-97a2-4c05-bb96-136894e77a85.clone_snap' to 'volume-003f1b35-97a2-4c05-bb96-136894e77a85' {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:789}} May 21 21:42:04.466893 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-52e3e99a-595d-4538-afc8-cace14830596 tempest-TestVolumeBootPattern-343249266 None] Volume volume-b9ebacac-5f32-42e3-9194-003aee7e2435.deleted is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:42:04.468844 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-52e3e99a-595d-4538-afc8-cace14830596 tempest-TestVolumeBootPattern-343249266 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:42:04.469221 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-52e3e99a-595d-4538-afc8-cace14830596 tempest-TestVolumeBootPattern-343249266 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:42:04.734036 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-52e3e99a-595d-4538-afc8-cace14830596 tempest-TestVolumeBootPattern-343249266 None] clone created successfully {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:862}} May 21 21:42:04.734959 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.volume_utils [None req-52e3e99a-595d-4538-afc8-cace14830596 tempest-TestVolumeBootPattern-343249266 None] Marking volume 003f1b35-97a2-4c05-bb96-136894e77a85 as bootable. {{(pid=124407) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} May 21 21:42:04.791675 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-52e3e99a-595d-4538-afc8-cace14830596 tempest-TestVolumeBootPattern-343249266 None] Copying metadata from image e570f5eb-6047-4214-a420-fdfdbdf19a4c to 003f1b35-97a2-4c05-bb96-136894e77a85. {{(pid=124407) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} May 21 21:42:04.792109 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-52e3e99a-595d-4538-afc8-cace14830596 tempest-TestVolumeBootPattern-343249266 None] Creating volume glance metadata for volume 003f1b35-97a2-4c05-bb96-136894e77a85 backed by image e570f5eb-6047-4214-a420-fdfdbdf19a4c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=124407) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:673}} May 21 21:42:04.945618 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-52e3e99a-595d-4538-afc8-cace14830596 tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (821e441d-e415-4996-a933-94a01d3d0a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-003f1b35-97a2-4c05-bb96-136894e77a85', 'volume_size': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5593f8cb452404083dfa177b4ee68b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'created_at': datetime.datetime(2022, 5, 21, 21, 0, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:42:04.951795 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-52e3e99a-595d-4538-afc8-cace14830596 tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5a825de-ea4a-49c5-8246-203bbb6ee0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:42:05.003369 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-52e3e99a-595d-4538-afc8-cace14830596 tempest-TestVolumeBootPattern-343249266 None] Volume volume-003f1b35-97a2-4c05-bb96-136894e77a85 (003f1b35-97a2-4c05-bb96-136894e77a85): created successfully May 21 21:42:05.008210 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-52e3e99a-595d-4538-afc8-cace14830596 tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5a825de-ea4a-49c5-8246-203bbb6ee0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:42:05.018689 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-52e3e99a-595d-4538-afc8-cace14830596 tempest-TestVolumeBootPattern-343249266 None] Flow 'volume_create_manager' (bf627e4e-67a8-4ed1-8369-af20b282564a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:42:05.095380 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-52e3e99a-595d-4538-afc8-cace14830596 tempest-TestVolumeBootPattern-343249266 None] Created volume successfully. May 21 21:42:06.354231 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d7d54d41-879b-4b59-af70-24787858ae32 tempest-TestVolumeBootPattern-343249266 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:42:07.056107 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-81e970a7-3000-432d-af58-7bd848113d8f tempest-VolumesTransfersTest-336443359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:42:07.074772 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-81e970a7-3000-432d-af58-7bd848113d8f tempest-VolumesTransfersTest-336443359 None] Flow 'volume_create_manager' (e5cf0603-a8bf-4cdb-8fed-7037a134abad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:42:07.081390 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-81e970a7-3000-432d-af58-7bd848113d8f tempest-VolumesTransfersTest-336443359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56df11b2-a9a6-4646-91ad-f90c98716eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:42:07.096954 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-81e970a7-3000-432d-af58-7bd848113d8f tempest-VolumesTransfersTest-336443359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56df11b2-a9a6-4646-91ad-f90c98716eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:42:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1630024267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=097bbb68-b2ff-404b-a5e3-e165c1fdad05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af85adafddf340f5b906b7498eed952a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:42:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:42:07Z,use_quota=True,user_id='29c1f21e17d744daae254d031c24ab8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:42:07.102800 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-81e970a7-3000-432d-af58-7bd848113d8f tempest-VolumesTransfersTest-336443359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70f3ea05-de11-4f73-8ef7-83de349870ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:42:07.106848 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-81e970a7-3000-432d-af58-7bd848113d8f tempest-VolumesTransfersTest-336443359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70f3ea05-de11-4f73-8ef7-83de349870ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:42:07.111991 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-81e970a7-3000-432d-af58-7bd848113d8f tempest-VolumesTransfersTest-336443359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c2cb05c-73f3-4fd3-8f4d-4175cad2c15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:42:07.116709 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-81e970a7-3000-432d-af58-7bd848113d8f tempest-VolumesTransfersTest-336443359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c2cb05c-73f3-4fd3-8f4d-4175cad2c15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '097bbb68-b2ff-404b-a5e3-e165c1fdad05', 'volume_name': 'volume-097bbb68-b2ff-404b-a5e3-e165c1fdad05', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:42:07.121709 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-81e970a7-3000-432d-af58-7bd848113d8f tempest-VolumesTransfersTest-336443359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0acc3818-1c10-417f-aa16-340dbbc282d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:42:07.125581 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-81e970a7-3000-432d-af58-7bd848113d8f tempest-VolumesTransfersTest-336443359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0acc3818-1c10-417f-aa16-340dbbc282d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:42:07.130302 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-81e970a7-3000-432d-af58-7bd848113d8f tempest-VolumesTransfersTest-336443359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66d3cf2b-d5ca-4840-9413-0781d2ab700c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:42:07.131370 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-81e970a7-3000-432d-af58-7bd848113d8f tempest-VolumesTransfersTest-336443359 None] Volume 097bbb68-b2ff-404b-a5e3-e165c1fdad05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-097bbb68-b2ff-404b-a5e3-e165c1fdad05', 'volume_size': 1} May 21 21:42:07.131758 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-81e970a7-3000-432d-af58-7bd848113d8f tempest-VolumesTransfersTest-336443359 None] creating volume 'volume-097bbb68-b2ff-404b-a5e3-e165c1fdad05' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:42:07.132570 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-81e970a7-3000-432d-af58-7bd848113d8f tempest-VolumesTransfersTest-336443359 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:42:07.605951 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-81e970a7-3000-432d-af58-7bd848113d8f tempest-VolumesTransfersTest-336443359 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:42:07.606590 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-81e970a7-3000-432d-af58-7bd848113d8f tempest-VolumesTransfersTest-336443359 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:42:07.610757 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-81e970a7-3000-432d-af58-7bd848113d8f tempest-VolumesTransfersTest-336443359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66d3cf2b-d5ca-4840-9413-0781d2ab700c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-097bbb68-b2ff-404b-a5e3-e165c1fdad05', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:42:07.614979 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-81e970a7-3000-432d-af58-7bd848113d8f tempest-VolumesTransfersTest-336443359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (414319c9-92de-413b-abe5-d55d8915a2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:42:07.668592 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-81e970a7-3000-432d-af58-7bd848113d8f tempest-VolumesTransfersTest-336443359 None] Volume volume-097bbb68-b2ff-404b-a5e3-e165c1fdad05 (097bbb68-b2ff-404b-a5e3-e165c1fdad05): created successfully May 21 21:42:07.672882 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-81e970a7-3000-432d-af58-7bd848113d8f tempest-VolumesTransfersTest-336443359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (414319c9-92de-413b-abe5-d55d8915a2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:42:07.678434 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-81e970a7-3000-432d-af58-7bd848113d8f tempest-VolumesTransfersTest-336443359 None] Flow 'volume_create_manager' (e5cf0603-a8bf-4cdb-8fed-7037a134abad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:42:07.706312 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=54,cinder:INSERT=18,cinder:UPDATE=27,cinder:DELETE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:42:07.740553 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-81e970a7-3000-432d-af58-7bd848113d8f tempest-VolumesTransfersTest-336443359 None] Created volume successfully. May 21 21:42:07.906095 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-d7d54d41-879b-4b59-af70-24787858ae32 tempest-TestVolumeBootPattern-343249266 None] Create snapshot completed successfully May 21 21:42:09.545670 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-44fa1e81-0667-4f5d-bc47-8843c1bd99a2 tempest-VolumesTransfersTest-1251251864 None] Transfer volume completed successfully. May 21 21:42:10.684197 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-3ba75d66-0521-4233-91cc-15cf8d3a57aa tempest-VolumesTransfersTest-1065414543 None] Lock "b'cinder-097bbb68-b2ff-404b-a5e3-e165c1fdad05-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:42:10.781126 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3ba75d66-0521-4233-91cc-15cf8d3a57aa tempest-VolumesTransfersTest-1065414543 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:42:10.957535 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3ba75d66-0521-4233-91cc-15cf8d3a57aa tempest-VolumesTransfersTest-1065414543 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:42:10.957965 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3ba75d66-0521-4233-91cc-15cf8d3a57aa tempest-VolumesTransfersTest-1065414543 None] Volume volume-097bbb68-b2ff-404b-a5e3-e165c1fdad05 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:42:11.019584 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3ba75d66-0521-4233-91cc-15cf8d3a57aa tempest-VolumesTransfersTest-1065414543 None] deleting rbd volume volume-097bbb68-b2ff-404b-a5e3-e165c1fdad05 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:42:13.729393 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-3ba75d66-0521-4233-91cc-15cf8d3a57aa tempest-VolumesTransfersTest-1065414543 None] Created reservations ['634040c9-f908-454f-bd5f-2968b558cd3f', '95d4922e-9ad7-42b5-9430-bc6c1394241a', 'e7b42d87-9000-4ea4-9618-8e62a63121c6', 'd32cb469-ee98-4d96-a712-99ea1f8725d6'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:42:13.912595 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3ba75d66-0521-4233-91cc-15cf8d3a57aa tempest-VolumesTransfersTest-1065414543 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:42:13.964578 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3ba75d66-0521-4233-91cc-15cf8d3a57aa tempest-VolumesTransfersTest-1065414543 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:42:14.008610 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-3ba75d66-0521-4233-91cc-15cf8d3a57aa tempest-VolumesTransfersTest-1065414543 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:42:14.025317 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-3ba75d66-0521-4233-91cc-15cf8d3a57aa tempest-VolumesTransfersTest-1065414543 None] Deleted volume successfully. May 21 21:42:14.093391 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-3ba75d66-0521-4233-91cc-15cf8d3a57aa tempest-VolumesTransfersTest-1065414543 None] Lock "b'cinder-097bbb68-b2ff-404b-a5e3-e165c1fdad05-delete_volume'" released by "delete_volume" :: held 3.409s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:42:14.125626 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [req-a8c4c359-c983-4803-88b3-3fab97994751 req-da0f1c2d-91de-492b-a77e-58c135d6ab6c tempest-TestVolumeBootPattern-343249266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:42:14.176129 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-a8c4c359-c983-4803-88b3-3fab97994751 req-da0f1c2d-91de-492b-a77e-58c135d6ab6c tempest-TestVolumeBootPattern-343249266 None] Flow 'volume_create_manager' (ffb96204-3cb3-4cc8-8df3-3fe94b063680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:42:14.182768 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-a8c4c359-c983-4803-88b3-3fab97994751 req-da0f1c2d-91de-492b-a77e-58c135d6ab6c tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ea90e15-df70-44f2-90f9-9bf60d2a1338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:42:14.211475 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-a8c4c359-c983-4803-88b3-3fab97994751 req-da0f1c2d-91de-492b-a77e-58c135d6ab6c tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ea90e15-df70-44f2-90f9-9bf60d2a1338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:42:13Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=daf12c53-93c4-4606-9067-730e7c8178c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8149564857f64342aef93f18c0d90eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:42:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c534288c-e6e7-47cb-83be-40d881750c23,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:42:14Z,use_quota=True,user_id='730839d5531644eb9aa26dabe2fbd8f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:42:14.217190 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-a8c4c359-c983-4803-88b3-3fab97994751 req-da0f1c2d-91de-492b-a77e-58c135d6ab6c tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee77473a-7bf0-43a3-b89c-b3f242de33f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:42:14.221448 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-a8c4c359-c983-4803-88b3-3fab97994751 req-da0f1c2d-91de-492b-a77e-58c135d6ab6c tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee77473a-7bf0-43a3-b89c-b3f242de33f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:42:14.229005 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-a8c4c359-c983-4803-88b3-3fab97994751 req-da0f1c2d-91de-492b-a77e-58c135d6ab6c tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca463d08-0192-405f-99c1-8ea7e1448a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:42:14.233413 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-a8c4c359-c983-4803-88b3-3fab97994751 req-da0f1c2d-91de-492b-a77e-58c135d6ab6c tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca463d08-0192-405f-99c1-8ea7e1448a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'daf12c53-93c4-4606-9067-730e7c8178c8', 'volume_name': 'volume-daf12c53-93c4-4606-9067-730e7c8178c8', 'volume_size': 1, 'snapshot_id': 'c534288c-e6e7-47cb-83be-40d881750c23'}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:42:14.238342 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-a8c4c359-c983-4803-88b3-3fab97994751 req-da0f1c2d-91de-492b-a77e-58c135d6ab6c tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96e43a12-faeb-464e-9520-1877d3650d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:42:14.248930 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-a8c4c359-c983-4803-88b3-3fab97994751 req-da0f1c2d-91de-492b-a77e-58c135d6ab6c tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96e43a12-faeb-464e-9520-1877d3650d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:42:14.259630 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-a8c4c359-c983-4803-88b3-3fab97994751 req-da0f1c2d-91de-492b-a77e-58c135d6ab6c tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0df6707-9a6f-4292-9888-a7acbab1d581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:42:14.264020 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [req-a8c4c359-c983-4803-88b3-3fab97994751 req-da0f1c2d-91de-492b-a77e-58c135d6ab6c tempest-TestVolumeBootPattern-343249266 None] Volume daf12c53-93c4-4606-9067-730e7c8178c8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-daf12c53-93c4-4606-9067-730e7c8178c8', 'volume_size': 1, 'snapshot_id': 'c534288c-e6e7-47cb-83be-40d881750c23'} May 21 21:42:14.313383 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-a8c4c359-c983-4803-88b3-3fab97994751 req-da0f1c2d-91de-492b-a77e-58c135d6ab6c tempest-TestVolumeBootPattern-343249266 None] cloning volumes/volume-003f1b35-97a2-4c05-bb96-136894e77a85@snapshot-c534288c-e6e7-47cb-83be-40d881750c23 to volume-daf12c53-93c4-4606-9067-730e7c8178c8 {{(pid=124407) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1098}} May 21 21:42:14.313989 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-a8c4c359-c983-4803-88b3-3fab97994751 req-da0f1c2d-91de-492b-a77e-58c135d6ab6c tempest-TestVolumeBootPattern-343249266 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:42:14.402939 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-a8c4c359-c983-4803-88b3-3fab97994751 req-da0f1c2d-91de-492b-a77e-58c135d6ab6c tempest-TestVolumeBootPattern-343249266 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:42:14.915169 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9076915-9055-4d5e-ba94-ee813f558c3b tempest-VolumesTransfersTest-336443359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:42:14.936338 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b9076915-9055-4d5e-ba94-ee813f558c3b tempest-VolumesTransfersTest-336443359 None] Flow 'volume_create_manager' (2c6adc92-8121-4bf6-8524-841c7f9cd67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:42:14.942876 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b9076915-9055-4d5e-ba94-ee813f558c3b tempest-VolumesTransfersTest-336443359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f059bb79-382a-4db0-8377-a5de910e7fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:42:14.960566 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b9076915-9055-4d5e-ba94-ee813f558c3b tempest-VolumesTransfersTest-336443359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f059bb79-382a-4db0-8377-a5de910e7fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:42:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-44057970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=579e429c-5023-4b50-87af-650b22b7eb61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af85adafddf340f5b906b7498eed952a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:42:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:42:15Z,use_quota=True,user_id='29c1f21e17d744daae254d031c24ab8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:42:14.965967 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b9076915-9055-4d5e-ba94-ee813f558c3b tempest-VolumesTransfersTest-336443359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (248713e7-2668-4260-b189-c2faf34ede6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:42:14.970100 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b9076915-9055-4d5e-ba94-ee813f558c3b tempest-VolumesTransfersTest-336443359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (248713e7-2668-4260-b189-c2faf34ede6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:42:14.978475 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b9076915-9055-4d5e-ba94-ee813f558c3b tempest-VolumesTransfersTest-336443359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f719ef7b-f93f-4924-8164-6ed62e211be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:42:14.985585 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b9076915-9055-4d5e-ba94-ee813f558c3b tempest-VolumesTransfersTest-336443359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f719ef7b-f93f-4924-8164-6ed62e211be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '579e429c-5023-4b50-87af-650b22b7eb61', 'volume_name': 'volume-579e429c-5023-4b50-87af-650b22b7eb61', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:42:14.993244 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b9076915-9055-4d5e-ba94-ee813f558c3b tempest-VolumesTransfersTest-336443359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e53fbf8e-2a6e-40f9-957e-2e2544685ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:42:15.002244 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b9076915-9055-4d5e-ba94-ee813f558c3b tempest-VolumesTransfersTest-336443359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e53fbf8e-2a6e-40f9-957e-2e2544685ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:42:15.007287 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b9076915-9055-4d5e-ba94-ee813f558c3b tempest-VolumesTransfersTest-336443359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57d42816-3184-4bb7-886d-1b6652f74b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:42:15.008633 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-b9076915-9055-4d5e-ba94-ee813f558c3b tempest-VolumesTransfersTest-336443359 None] Volume 579e429c-5023-4b50-87af-650b22b7eb61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-579e429c-5023-4b50-87af-650b22b7eb61', 'volume_size': 1} May 21 21:42:15.009169 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b9076915-9055-4d5e-ba94-ee813f558c3b tempest-VolumesTransfersTest-336443359 None] creating volume 'volume-579e429c-5023-4b50-87af-650b22b7eb61' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:42:15.010589 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b9076915-9055-4d5e-ba94-ee813f558c3b tempest-VolumesTransfersTest-336443359 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:42:15.712936 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-a8c4c359-c983-4803-88b3-3fab97994751 req-da0f1c2d-91de-492b-a77e-58c135d6ab6c tempest-TestVolumeBootPattern-343249266 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:42:15.714017 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-a8c4c359-c983-4803-88b3-3fab97994751 req-da0f1c2d-91de-492b-a77e-58c135d6ab6c tempest-TestVolumeBootPattern-343249266 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:42:15.744447 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.volume_utils [req-a8c4c359-c983-4803-88b3-3fab97994751 req-da0f1c2d-91de-492b-a77e-58c135d6ab6c tempest-TestVolumeBootPattern-343249266 None] Marking volume daf12c53-93c4-4606-9067-730e7c8178c8 as bootable. {{(pid=124407) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} May 21 21:42:15.786714 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b9076915-9055-4d5e-ba94-ee813f558c3b tempest-VolumesTransfersTest-336443359 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:42:15.793424 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b9076915-9055-4d5e-ba94-ee813f558c3b tempest-VolumesTransfersTest-336443359 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:42:15.796198 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b9076915-9055-4d5e-ba94-ee813f558c3b tempest-VolumesTransfersTest-336443359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57d42816-3184-4bb7-886d-1b6652f74b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-579e429c-5023-4b50-87af-650b22b7eb61', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:42:15.803676 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b9076915-9055-4d5e-ba94-ee813f558c3b tempest-VolumesTransfersTest-336443359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26499b4b-531a-4288-93f4-a6b5198f6b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:42:15.826162 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [req-a8c4c359-c983-4803-88b3-3fab97994751 req-da0f1c2d-91de-492b-a77e-58c135d6ab6c tempest-TestVolumeBootPattern-343249266 None] Copying metadata from snapshot c534288c-e6e7-47cb-83be-40d881750c23 to daf12c53-93c4-4606-9067-730e7c8178c8. {{(pid=124407) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:429}} May 21 21:42:15.912617 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-b9076915-9055-4d5e-ba94-ee813f558c3b tempest-VolumesTransfersTest-336443359 None] Volume volume-579e429c-5023-4b50-87af-650b22b7eb61 (579e429c-5023-4b50-87af-650b22b7eb61): created successfully May 21 21:42:15.917605 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b9076915-9055-4d5e-ba94-ee813f558c3b tempest-VolumesTransfersTest-336443359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26499b4b-531a-4288-93f4-a6b5198f6b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:42:15.923687 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b9076915-9055-4d5e-ba94-ee813f558c3b tempest-VolumesTransfersTest-336443359 None] Flow 'volume_create_manager' (2c6adc92-8121-4bf6-8524-841c7f9cd67f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:42:15.950406 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-a8c4c359-c983-4803-88b3-3fab97994751 req-da0f1c2d-91de-492b-a77e-58c135d6ab6c tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0df6707-9a6f-4292-9888-a7acbab1d581) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daf12c53-93c4-4606-9067-730e7c8178c8', 'volume_size': 1, 'snapshot_id': 'c534288c-e6e7-47cb-83be-40d881750c23'}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:42:15.955677 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-a8c4c359-c983-4803-88b3-3fab97994751 req-da0f1c2d-91de-492b-a77e-58c135d6ab6c tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f7da570-b4e2-4382-90db-86fb873ff9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:42:15.999126 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-b9076915-9055-4d5e-ba94-ee813f558c3b tempest-VolumesTransfersTest-336443359 None] Created volume successfully. May 21 21:42:16.037843 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [req-a8c4c359-c983-4803-88b3-3fab97994751 req-da0f1c2d-91de-492b-a77e-58c135d6ab6c tempest-TestVolumeBootPattern-343249266 None] Volume volume-daf12c53-93c4-4606-9067-730e7c8178c8 (daf12c53-93c4-4606-9067-730e7c8178c8): created successfully May 21 21:42:16.041963 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-a8c4c359-c983-4803-88b3-3fab97994751 req-da0f1c2d-91de-492b-a77e-58c135d6ab6c tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f7da570-b4e2-4382-90db-86fb873ff9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:42:16.050215 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-a8c4c359-c983-4803-88b3-3fab97994751 req-da0f1c2d-91de-492b-a77e-58c135d6ab6c tempest-TestVolumeBootPattern-343249266 None] Flow 'volume_create_manager' (ffb96204-3cb3-4cc8-8df3-3fe94b063680) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:42:16.118894 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-a8c4c359-c983-4803-88b3-3fab97994751 req-da0f1c2d-91de-492b-a77e-58c135d6ab6c tempest-TestVolumeBootPattern-343249266 None] Created volume successfully. May 21 21:42:16.278027 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=59,cinder:DELETE=4,cinder:UPDATE=18,cinder:INSERT=19 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:42:17.437383 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-a8c4c359-c983-4803-88b3-3fab97994751 req-456986eb-c28e-4cc0-b385-8e86ee656855 tempest-TestVolumeBootPattern-343249266 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:42:17.749712 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-ffe3f1da-5a64-416b-8994-4cb876b61c0f tempest-VolumesTransfersTest-1065414543 None] Lock "b'cinder-579e429c-5023-4b50-87af-650b22b7eb61-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:42:17.855949 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ffe3f1da-5a64-416b-8994-4cb876b61c0f tempest-VolumesTransfersTest-1065414543 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:42:18.021206 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ffe3f1da-5a64-416b-8994-4cb876b61c0f tempest-VolumesTransfersTest-1065414543 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:42:18.021662 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ffe3f1da-5a64-416b-8994-4cb876b61c0f tempest-VolumesTransfersTest-1065414543 None] Volume volume-579e429c-5023-4b50-87af-650b22b7eb61 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:42:18.089971 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ffe3f1da-5a64-416b-8994-4cb876b61c0f tempest-VolumesTransfersTest-1065414543 None] deleting rbd volume volume-579e429c-5023-4b50-87af-650b22b7eb61 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:42:18.302184 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-a8c4c359-c983-4803-88b3-3fab97994751 req-456986eb-c28e-4cc0-b385-8e86ee656855 tempest-TestVolumeBootPattern-343249266 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.865s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:42:18.303616 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-a8c4c359-c983-4803-88b3-3fab97994751 req-456986eb-c28e-4cc0-b385-8e86ee656855 tempest-TestVolumeBootPattern-343249266 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-daf12c53-93c4-4606-9067-730e7c8178c8', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'efef91cd-d8f8-4d93-9ad2-86d0b33251f4', 'volume_id': 'daf12c53-93c4-4606-9067-730e7c8178c8', 'discard': True}} {{(pid=124407) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} May 21 21:42:18.398227 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-a8c4c359-c983-4803-88b3-3fab97994751 req-456986eb-c28e-4cc0-b385-8e86ee656855 tempest-TestVolumeBootPattern-343249266 None] Connection info returned from driver {'name': 'volumes/volume-daf12c53-93c4-4606-9067-730e7c8178c8', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'daf12c53-93c4-4606-9067-730e7c8178c8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'bd51ff14-6567-4573-af5c-2678d2fdccdf'} {{(pid=124407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4826}} May 21 21:42:18.532176 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-a8c4c359-c983-4803-88b3-3fab97994751 req-456986eb-c28e-4cc0-b385-8e86ee656855 tempest-TestVolumeBootPattern-343249266 None] attachment_update completed successfully. May 21 21:42:20.912520 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-ffe3f1da-5a64-416b-8994-4cb876b61c0f tempest-VolumesTransfersTest-1065414543 None] Created reservations ['6e7a3ff1-b28e-493e-be0d-6d51bc2a20b2', '36440f85-22a8-494a-bc64-4258b98e33e8', 'e2cb9540-c4be-408f-a7d3-6dd16b9b7071', 'b0b794a8-e7c1-49a1-8155-5f6729ce0076'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:42:21.066665 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ffe3f1da-5a64-416b-8994-4cb876b61c0f tempest-VolumesTransfersTest-1065414543 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:42:21.095840 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ffe3f1da-5a64-416b-8994-4cb876b61c0f tempest-VolumesTransfersTest-1065414543 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:42:21.123903 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-ffe3f1da-5a64-416b-8994-4cb876b61c0f tempest-VolumesTransfersTest-1065414543 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:42:21.130384 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-ffe3f1da-5a64-416b-8994-4cb876b61c0f tempest-VolumesTransfersTest-1065414543 None] Deleted volume successfully. May 21 21:42:21.207044 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-ffe3f1da-5a64-416b-8994-4cb876b61c0f tempest-VolumesTransfersTest-1065414543 None] Lock "b'cinder-579e429c-5023-4b50-87af-650b22b7eb61-delete_volume'" released by "delete_volume" :: held 3.458s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:42:30.428689 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ce3ecb5-7f52-48e8-b70f-1940ea58082b tempest-VolumesSnapshotTestJSON-2065732980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:42:30.449327 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-7ce3ecb5-7f52-48e8-b70f-1940ea58082b tempest-VolumesSnapshotTestJSON-2065732980 None] Flow 'volume_create_manager' (8e3a89a7-ce5b-4c55-8d92-29eff2625cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:42:30.456966 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-7ce3ecb5-7f52-48e8-b70f-1940ea58082b tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36ec4f49-19e7-411d-8aaa-85cab3e90b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:42:30.474748 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-7ce3ecb5-7f52-48e8-b70f-1940ea58082b tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36ec4f49-19e7-411d-8aaa-85cab3e90b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-372887346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=83ee5203-dcde-4e2f-9c30-819d45781c45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e046067a8e4197b18860f9b9e1e344',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:42:30Z,use_quota=True,user_id='88d6ab0c56ae4b16805f265728e20ed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:42:30.480897 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-7ce3ecb5-7f52-48e8-b70f-1940ea58082b tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23449d5d-8aad-4707-8440-731941dca469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:42:30.485257 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-7ce3ecb5-7f52-48e8-b70f-1940ea58082b tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23449d5d-8aad-4707-8440-731941dca469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:42:30.491792 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-7ce3ecb5-7f52-48e8-b70f-1940ea58082b tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88e7884d-1f37-41ee-9fc2-631c9b897fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:42:30.496127 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-7ce3ecb5-7f52-48e8-b70f-1940ea58082b tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88e7884d-1f37-41ee-9fc2-631c9b897fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83ee5203-dcde-4e2f-9c30-819d45781c45', 'volume_name': 'volume-83ee5203-dcde-4e2f-9c30-819d45781c45', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:42:30.501214 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-7ce3ecb5-7f52-48e8-b70f-1940ea58082b tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df6268eb-382f-419b-9f22-6f642f7e8744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:42:30.505986 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-7ce3ecb5-7f52-48e8-b70f-1940ea58082b tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df6268eb-382f-419b-9f22-6f642f7e8744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:42:30.511207 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-7ce3ecb5-7f52-48e8-b70f-1940ea58082b tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06ec18d2-b7ea-44b1-a4d8-95ad4c695bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:42:30.512223 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-7ce3ecb5-7f52-48e8-b70f-1940ea58082b tempest-VolumesSnapshotTestJSON-2065732980 None] Volume 83ee5203-dcde-4e2f-9c30-819d45781c45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83ee5203-dcde-4e2f-9c30-819d45781c45', 'volume_size': 1} May 21 21:42:30.512729 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-7ce3ecb5-7f52-48e8-b70f-1940ea58082b tempest-VolumesSnapshotTestJSON-2065732980 None] creating volume 'volume-83ee5203-dcde-4e2f-9c30-819d45781c45' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:42:30.513513 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-7ce3ecb5-7f52-48e8-b70f-1940ea58082b tempest-VolumesSnapshotTestJSON-2065732980 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:42:30.978347 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-7ce3ecb5-7f52-48e8-b70f-1940ea58082b tempest-VolumesSnapshotTestJSON-2065732980 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:42:30.978856 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-7ce3ecb5-7f52-48e8-b70f-1940ea58082b tempest-VolumesSnapshotTestJSON-2065732980 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:42:30.983189 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-7ce3ecb5-7f52-48e8-b70f-1940ea58082b tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06ec18d2-b7ea-44b1-a4d8-95ad4c695bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83ee5203-dcde-4e2f-9c30-819d45781c45', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:42:30.988213 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-7ce3ecb5-7f52-48e8-b70f-1940ea58082b tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e91302d-5c94-4b9e-8112-acd400249e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:42:31.077879 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-7ce3ecb5-7f52-48e8-b70f-1940ea58082b tempest-VolumesSnapshotTestJSON-2065732980 None] Volume volume-83ee5203-dcde-4e2f-9c30-819d45781c45 (83ee5203-dcde-4e2f-9c30-819d45781c45): created successfully May 21 21:42:31.081949 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-7ce3ecb5-7f52-48e8-b70f-1940ea58082b tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e91302d-5c94-4b9e-8112-acd400249e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:42:31.089073 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-7ce3ecb5-7f52-48e8-b70f-1940ea58082b tempest-VolumesSnapshotTestJSON-2065732980 None] Flow 'volume_create_manager' (8e3a89a7-ce5b-4c55-8d92-29eff2625cf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:42:31.094717 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=60,cinder:UPDATE=29,cinder:INSERT=9,cinder:DELETE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:42:31.164401 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-7ce3ecb5-7f52-48e8-b70f-1940ea58082b tempest-VolumesSnapshotTestJSON-2065732980 None] Created volume successfully. May 21 21:42:32.070714 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-5d89b4a5-c562-4b1b-9913-aebf69d85d2d tempest-VolumesSnapshotTestJSON-2065732980 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:42:32.427531 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-1bd82220-1ddb-4d8f-8fe5-dff2eda906ee req-fddb1912-fcef-4096-ad34-32fd16665fa9 tempest-TestVolumeBootPattern-343249266 None] Terminate volume connection completed successfully. May 21 21:42:32.428626 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-1bd82220-1ddb-4d8f-8fe5-dff2eda906ee req-fddb1912-fcef-4096-ad34-32fd16665fa9 tempest-TestVolumeBootPattern-343249266 None] Deleting attachment bd51ff14-6567-4573-af5c-2678d2fdccdf. {{(pid=124407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4957}} May 21 21:42:32.873790 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [req-1bd82220-1ddb-4d8f-8fe5-dff2eda906ee req-44680c9c-f9bd-4d44-a940-e1b616711def tempest-TestVolumeBootPattern-343249266 None] Lock "b'cinder-daf12c53-93c4-4606-9067-730e7c8178c8-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:42:32.985389 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-1bd82220-1ddb-4d8f-8fe5-dff2eda906ee req-44680c9c-f9bd-4d44-a940-e1b616711def tempest-TestVolumeBootPattern-343249266 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:42:33.146447 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-1bd82220-1ddb-4d8f-8fe5-dff2eda906ee req-44680c9c-f9bd-4d44-a940-e1b616711def tempest-TestVolumeBootPattern-343249266 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:42:33.195318 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-1bd82220-1ddb-4d8f-8fe5-dff2eda906ee req-44680c9c-f9bd-4d44-a940-e1b616711def tempest-TestVolumeBootPattern-343249266 None] deleting rbd volume volume-daf12c53-93c4-4606-9067-730e7c8178c8 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:42:34.870430 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-5d89b4a5-c562-4b1b-9913-aebf69d85d2d tempest-VolumesSnapshotTestJSON-2065732980 None] Create snapshot completed successfully May 21 21:42:35.698270 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.driver [None req-ee208302-3aaf-48bd-919b-8ab01373f1ab tempest-VolumesSnapshotTestJSON-2065732980 None] Creating a new backup for volume volume-83ee5203-dcde-4e2f-9c30-819d45781c45. {{(pid=124407) _get_backup_volume_temp_volume /opt/stack/cinder/cinder/volume/driver.py:1213}} May 21 21:42:35.806523 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ee208302-3aaf-48bd-919b-8ab01373f1ab tempest-VolumesSnapshotTestJSON-2065732980 None] cloning volumes/volume-83ee5203-dcde-4e2f-9c30-819d45781c45@snapshot-f865fa4a-2d95-4bc7-93b8-9be17f58dd00 to volume-309f4540-fbfc-4e92-9dea-f5d996d27e51 {{(pid=124407) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1098}} May 21 21:42:35.807165 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ee208302-3aaf-48bd-919b-8ab01373f1ab tempest-VolumesSnapshotTestJSON-2065732980 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:42:36.061438 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ee208302-3aaf-48bd-919b-8ab01373f1ab tempest-VolumesSnapshotTestJSON-2065732980 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:42:36.621552 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [req-1bd82220-1ddb-4d8f-8fe5-dff2eda906ee req-44680c9c-f9bd-4d44-a940-e1b616711def tempest-TestVolumeBootPattern-343249266 None] Created reservations ['bafc01e3-f053-4e5c-aa32-6ad30a6e8e48', '0ead3f3f-b6fc-4f9f-9f9d-7bdbf952e7ac', 'afdc59c9-2cf7-47d5-8860-3694ef943fc4', '22499855-6813-4747-b6f1-62b9cb64b701'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:42:36.794090 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-1bd82220-1ddb-4d8f-8fe5-dff2eda906ee req-44680c9c-f9bd-4d44-a940-e1b616711def tempest-TestVolumeBootPattern-343249266 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:42:36.820466 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-1bd82220-1ddb-4d8f-8fe5-dff2eda906ee req-44680c9c-f9bd-4d44-a940-e1b616711def tempest-TestVolumeBootPattern-343249266 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:42:36.901153 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [req-1bd82220-1ddb-4d8f-8fe5-dff2eda906ee req-44680c9c-f9bd-4d44-a940-e1b616711def tempest-TestVolumeBootPattern-343249266 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:42:36.906141 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-1bd82220-1ddb-4d8f-8fe5-dff2eda906ee req-44680c9c-f9bd-4d44-a940-e1b616711def tempest-TestVolumeBootPattern-343249266 None] Deleted volume successfully. May 21 21:42:36.963304 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [req-1bd82220-1ddb-4d8f-8fe5-dff2eda906ee req-44680c9c-f9bd-4d44-a940-e1b616711def tempest-TestVolumeBootPattern-343249266 None] Lock "b'cinder-daf12c53-93c4-4606-9067-730e7c8178c8-delete_volume'" released by "delete_volume" :: held 4.089s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:42:37.004056 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ee208302-3aaf-48bd-919b-8ab01373f1ab tempest-VolumesSnapshotTestJSON-2065732980 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:42:37.005410 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ee208302-3aaf-48bd-919b-8ab01373f1ab tempest-VolumesSnapshotTestJSON-2065732980 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:42:37.175607 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-ee208302-3aaf-48bd-919b-8ab01373f1ab tempest-VolumesSnapshotTestJSON-2065732980 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-05-21T21:42:35Z,data_timestamp=2022-05-21T21:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Backup-241305884',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=35561052-8c91-40d9-a0b2-6ceae3aa1276,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='07e046067a8e4197b18860f9b9e1e344',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id='f865fa4a-2d95-4bc7-93b8-9be17f58dd00',status='creating',temp_snapshot_id=None,temp_volume_id='309f4540-fbfc-4e92-9dea-f5d996d27e51',updated_at=None,user_id='88d6ab0c56ae4b16805f265728e20ed6',volume_id=83ee5203-dcde-4e2f-9c30-819d45781c45) May 21 21:42:37.176578 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.backup.rpcapi [None req-ee208302-3aaf-48bd-919b-8ab01373f1ab tempest-VolumesSnapshotTestJSON-2065732980 None] continue_backup in rpcapi backup_id 35561052-8c91-40d9-a0b2-6ceae3aa1276 {{(pid=124407) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} May 21 21:42:37.249915 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-707014b7-f124-4de0-b8ed-c138a7758ce1 tempest-TestVolumeBootPattern-343249266 None] Lock "b'cinder-c534288c-e6e7-47cb-83be-40d881750c23-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:42:37.253076 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-707014b7-f124-4de0-b8ed-c138a7758ce1 tempest-TestVolumeBootPattern-343249266 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:42:37.435006 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [None req-ee208302-3aaf-48bd-919b-8ab01373f1ab tempest-VolumesSnapshotTestJSON-2065732980 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:42:38.116663 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [None req-ee208302-3aaf-48bd-919b-8ab01373f1ab tempest-VolumesSnapshotTestJSON-2065732980 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.681s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:42:38.117709 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ee208302-3aaf-48bd-919b-8ab01373f1ab tempest-VolumesSnapshotTestJSON-2065732980 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-309f4540-fbfc-4e92-9dea-f5d996d27e51', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'efef91cd-d8f8-4d93-9ad2-86d0b33251f4', 'volume_id': '309f4540-fbfc-4e92-9dea-f5d996d27e51', 'discard': True}} {{(pid=124407) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} May 21 21:42:38.160192 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-ee208302-3aaf-48bd-919b-8ab01373f1ab tempest-VolumesSnapshotTestJSON-2065732980 None] Initialize volume connection completed successfully. May 21 21:42:39.216234 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-707014b7-f124-4de0-b8ed-c138a7758ce1 tempest-TestVolumeBootPattern-343249266 None] Created reservations ['a0dd7e5c-bb8f-4ce7-876d-65ca57da38a5', 'd57dbaf3-18f1-4077-b588-5120b98b4fc5', '79d263ee-632c-45fe-be97-ce57027b89ed', '6d1fac36-4973-409d-82e7-88ddea36cc28'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:42:39.536053 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-707014b7-f124-4de0-b8ed-c138a7758ce1 tempest-TestVolumeBootPattern-343249266 None] Delete snapshot completed successfully. May 21 21:42:39.544869 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-707014b7-f124-4de0-b8ed-c138a7758ce1 tempest-TestVolumeBootPattern-343249266 None] Lock "b'cinder-c534288c-e6e7-47cb-83be-40d881750c23-delete_snapshot'" released by "delete_snapshot" :: held 2.295s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:42:40.605412 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-864169b5-a04c-444d-baf9-5a14b0018414 tempest-TestVolumeBootPattern-343249266 None] Lock "b'cinder-003f1b35-97a2-4c05-bb96-136894e77a85-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:42:40.694687 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-864169b5-a04c-444d-baf9-5a14b0018414 tempest-TestVolumeBootPattern-343249266 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:42:40.981547 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-864169b5-a04c-444d-baf9-5a14b0018414 tempest-TestVolumeBootPattern-343249266 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:42:41.217209 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-864169b5-a04c-444d-baf9-5a14b0018414 tempest-TestVolumeBootPattern-343249266 None] deleting rbd volume volume-003f1b35-97a2-4c05-bb96-136894e77a85 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:42:47.365069 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-864169b5-a04c-444d-baf9-5a14b0018414 tempest-TestVolumeBootPattern-343249266 None] volume is a clone so cleaning references {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1352}} May 21 21:42:48.834567 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-864169b5-a04c-444d-baf9-5a14b0018414 tempest-TestVolumeBootPattern-343249266 None] deleting parent snapshot volume-003f1b35-97a2-4c05-bb96-136894e77a85.clone_snap {{(pid=124407) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1243}} May 21 21:42:54.387744 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:42:54.389235 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:42:54.441300 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:42:54.472198 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:42:54.476913 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=68,cinder:UPDATE=20,cinder:INSERT=8,cinder:DELETE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:42:54.635404 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-864169b5-a04c-444d-baf9-5a14b0018414 tempest-TestVolumeBootPattern-343249266 None] Created reservations ['7e4cdf23-fc25-4dac-81cb-579a7188d056', '65cf05d6-5662-4d36-92b7-ca930688e9ed', 'c365811a-b024-40ec-bffc-68b2ba938a6d', 'ab2cb7a3-6fdc-4b71-9778-162dcc21ce83'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:42:54.741468 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=57,cinder:UPDATE=31,cinder:DELETE=2,cinder:INSERT=10 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:42:54.840121 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-864169b5-a04c-444d-baf9-5a14b0018414 tempest-TestVolumeBootPattern-343249266 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:42:54.865310 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-864169b5-a04c-444d-baf9-5a14b0018414 tempest-TestVolumeBootPattern-343249266 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:42:54.890170 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-864169b5-a04c-444d-baf9-5a14b0018414 tempest-TestVolumeBootPattern-343249266 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:42:54.894548 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-864169b5-a04c-444d-baf9-5a14b0018414 tempest-TestVolumeBootPattern-343249266 None] Deleted volume successfully. May 21 21:42:54.991030 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-864169b5-a04c-444d-baf9-5a14b0018414 tempest-TestVolumeBootPattern-343249266 None] Lock "b'cinder-003f1b35-97a2-4c05-bb96-136894e77a85-delete_volume'" released by "delete_volume" :: held 14.386s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:42:56.726565 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-709d6242-0453-4066-9985-85d235a78aea tempest-AttachVolumeNegativeTest-617587518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:42:56.749290 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-709d6242-0453-4066-9985-85d235a78aea tempest-AttachVolumeNegativeTest-617587518 None] Flow 'volume_create_manager' (c85b4973-b0b0-40f1-a3b7-7fdf877e4888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:42:56.756477 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-709d6242-0453-4066-9985-85d235a78aea tempest-AttachVolumeNegativeTest-617587518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce3be122-53bd-47a2-bb61-5d0deb6c04e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:42:56.791587 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-709d6242-0453-4066-9985-85d235a78aea tempest-AttachVolumeNegativeTest-617587518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce3be122-53bd-47a2-bb61-5d0deb6c04e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-195866598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d49aa79f-8460-4aea-b95f-7a47df397625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41b9c87f24cd4bac983b83b49daeae5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:42:56Z,use_quota=True,user_id='f01908adbe2c4aebb89d6fd3af3de207',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:42:56.798185 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-709d6242-0453-4066-9985-85d235a78aea tempest-AttachVolumeNegativeTest-617587518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (269e2c90-b82a-456e-a34a-73eb4d9d650f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:42:56.801750 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-709d6242-0453-4066-9985-85d235a78aea tempest-AttachVolumeNegativeTest-617587518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (269e2c90-b82a-456e-a34a-73eb4d9d650f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:42:56.806893 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-709d6242-0453-4066-9985-85d235a78aea tempest-AttachVolumeNegativeTest-617587518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17280ac7-ee26-46c1-8a22-b7869b2d1819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:42:56.810890 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-709d6242-0453-4066-9985-85d235a78aea tempest-AttachVolumeNegativeTest-617587518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17280ac7-ee26-46c1-8a22-b7869b2d1819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd49aa79f-8460-4aea-b95f-7a47df397625', 'volume_name': 'volume-d49aa79f-8460-4aea-b95f-7a47df397625', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:42:56.815850 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-709d6242-0453-4066-9985-85d235a78aea tempest-AttachVolumeNegativeTest-617587518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af0167af-d491-403f-bf41-024d9d18ae15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:42:56.819747 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-709d6242-0453-4066-9985-85d235a78aea tempest-AttachVolumeNegativeTest-617587518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af0167af-d491-403f-bf41-024d9d18ae15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:42:56.824474 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-709d6242-0453-4066-9985-85d235a78aea tempest-AttachVolumeNegativeTest-617587518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5ab9cbd-381b-4aee-af94-08bb13600408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:42:56.825550 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-709d6242-0453-4066-9985-85d235a78aea tempest-AttachVolumeNegativeTest-617587518 None] Volume d49aa79f-8460-4aea-b95f-7a47df397625: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d49aa79f-8460-4aea-b95f-7a47df397625', 'volume_size': 1} May 21 21:42:56.826028 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-709d6242-0453-4066-9985-85d235a78aea tempest-AttachVolumeNegativeTest-617587518 None] creating volume 'volume-d49aa79f-8460-4aea-b95f-7a47df397625' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:42:56.826799 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-709d6242-0453-4066-9985-85d235a78aea tempest-AttachVolumeNegativeTest-617587518 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:42:56.869235 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9d8a6b3-fcf1-47f3-94b4-f05b5a298e4a tempest-TestVolumeBootPattern-343249266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:42:56.889056 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-f9d8a6b3-fcf1-47f3-94b4-f05b5a298e4a tempest-TestVolumeBootPattern-343249266 None] Flow 'volume_create_manager' (d34b3068-e928-41ae-a64b-e5172e26eadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:42:56.896304 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-f9d8a6b3-fcf1-47f3-94b4-f05b5a298e4a tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5866d20d-a4dd-4480-8c66-dd4bb1a83a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:42:56.914676 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-f9d8a6b3-fcf1-47f3-94b4-f05b5a298e4a tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5866d20d-a4dd-4480-8c66-dd4bb1a83a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-2042088533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f13b6e40-0105-40ef-8eda-4c160169087e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8149564857f64342aef93f18c0d90eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:42:57Z,use_quota=True,user_id='730839d5531644eb9aa26dabe2fbd8f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:42:56.920553 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-f9d8a6b3-fcf1-47f3-94b4-f05b5a298e4a tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc6501bd-656a-40b6-a405-714a5355304e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:42:56.925069 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-f9d8a6b3-fcf1-47f3-94b4-f05b5a298e4a tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc6501bd-656a-40b6-a405-714a5355304e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:42:56.931023 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-f9d8a6b3-fcf1-47f3-94b4-f05b5a298e4a tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a75bc504-83a2-4dcf-b5e5-d2149fa99f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:42:57.022010 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-f9d8a6b3-fcf1-47f3-94b4-f05b5a298e4a tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a75bc504-83a2-4dcf-b5e5-d2149fa99f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f13b6e40-0105-40ef-8eda-4c160169087e', 'volume_name': 'volume-f13b6e40-0105-40ef-8eda-4c160169087e', 'volume_size': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5593f8cb452404083dfa177b4ee68b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'created_at': datetime.datetime(2022, 5, 21, 21, 0, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:42:57.026983 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-f9d8a6b3-fcf1-47f3-94b4-f05b5a298e4a tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19285e79-706a-4148-8b2e-8e3be5cc6f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:42:57.031028 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-f9d8a6b3-fcf1-47f3-94b4-f05b5a298e4a tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19285e79-706a-4148-8b2e-8e3be5cc6f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:42:57.035727 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-f9d8a6b3-fcf1-47f3-94b4-f05b5a298e4a tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dcd4b7c-6c91-42a8-a3c5-2ad20a3d44f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:42:57.037476 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-f9d8a6b3-fcf1-47f3-94b4-f05b5a298e4a tempest-TestVolumeBootPattern-343249266 None] Volume f13b6e40-0105-40ef-8eda-4c160169087e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f13b6e40-0105-40ef-8eda-4c160169087e', 'volume_size': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5593f8cb452404083dfa177b4ee68b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'created_at': datetime.datetime(2022, 5, 21, 21, 0, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } May 21 21:42:57.038052 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9d8a6b3-fcf1-47f3-94b4-f05b5a298e4a tempest-TestVolumeBootPattern-343249266 None] Cloning f13b6e40-0105-40ef-8eda-4c160169087e from image e570f5eb-6047-4214-a420-fdfdbdf19a4c at location (None, None). {{(pid=124407) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1053}} May 21 21:42:57.046477 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-f9d8a6b3-fcf1-47f3-94b4-f05b5a298e4a tempest-TestVolumeBootPattern-343249266 None] Lock "b'cinder-e570f5eb-6047-4214-a420-fdfdbdf19a4c'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:42:57.210249 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-f9d8a6b3-fcf1-47f3-94b4-f05b5a298e4a tempest-TestVolumeBootPattern-343249266 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'volume_id': '4057e637-23ba-493f-a45d-eb28c07ac60a', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28), 'last_used': datetime.datetime(2022, 5, 21, 21, 42, 57, 50652)}. {{(pid=124407) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 21 21:42:57.210628 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-f9d8a6b3-fcf1-47f3-94b4-f05b5a298e4a tempest-TestVolumeBootPattern-343249266 None] Image-volume cache entry image_update_at = 2022-05-21 21:00:28+00:00, requested image updated_at = 2022-05-21 21:00:28+00:00. {{(pid=124407) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 21 21:42:57.211034 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9d8a6b3-fcf1-47f3-94b4-f05b5a298e4a tempest-TestVolumeBootPattern-343249266 None] Found cache entry for image = e570f5eb-6047-4214-a420-fdfdbdf19a4c on host ncdv-master-1@ceph#ceph. {{(pid=124407) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:876}} May 21 21:42:57.215413 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-f9d8a6b3-fcf1-47f3-94b4-f05b5a298e4a tempest-TestVolumeBootPattern-343249266 None] Lock "b'cinder-e570f5eb-6047-4214-a420-fdfdbdf19a4c'" released by "_prepare_image_cache_entry" :: held 0.169s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:42:57.216349 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9d8a6b3-fcf1-47f3-94b4-f05b5a298e4a tempest-TestVolumeBootPattern-343249266 None] Attempting to retrieve cache entry for image = e570f5eb-6047-4214-a420-fdfdbdf19a4c on host ncdv-master-1@ceph#ceph. {{(pid=124407) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:817}} May 21 21:42:57.222870 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-f9d8a6b3-fcf1-47f3-94b4-f05b5a298e4a tempest-TestVolumeBootPattern-343249266 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'volume_id': '4057e637-23ba-493f-a45d-eb28c07ac60a', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28), 'last_used': datetime.datetime(2022, 5, 21, 21, 42, 57, 220475)}. {{(pid=124407) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 21 21:42:57.223396 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-f9d8a6b3-fcf1-47f3-94b4-f05b5a298e4a tempest-TestVolumeBootPattern-343249266 None] Image-volume cache entry image_update_at = 2022-05-21 21:00:28+00:00, requested image updated_at = 2022-05-21 21:00:28+00:00. {{(pid=124407) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 21 21:42:57.223667 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9d8a6b3-fcf1-47f3-94b4-f05b5a298e4a tempest-TestVolumeBootPattern-343249266 None] Creating from source image-volume 4057e637-23ba-493f-a45d-eb28c07ac60a {{(pid=124407) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:831}} May 21 21:42:57.237373 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-f9d8a6b3-fcf1-47f3-94b4-f05b5a298e4a tempest-TestVolumeBootPattern-343249266 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:42:58.095488 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-f9d8a6b3-fcf1-47f3-94b4-f05b5a298e4a tempest-TestVolumeBootPattern-343249266 None] creating snapshot='volume-f13b6e40-0105-40ef-8eda-4c160169087e.clone_snap' {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 21 21:43:01.964805 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-f9d8a6b3-fcf1-47f3-94b4-f05b5a298e4a tempest-TestVolumeBootPattern-343249266 None] cloning 'volume-4057e637-23ba-493f-a45d-eb28c07ac60a@volume-f13b6e40-0105-40ef-8eda-4c160169087e.clone_snap' to 'volume-f13b6e40-0105-40ef-8eda-4c160169087e' {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:789}} May 21 21:43:01.976253 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-709d6242-0453-4066-9985-85d235a78aea tempest-AttachVolumeNegativeTest-617587518 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:43:01.976682 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-709d6242-0453-4066-9985-85d235a78aea tempest-AttachVolumeNegativeTest-617587518 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:43:01.980832 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-709d6242-0453-4066-9985-85d235a78aea tempest-AttachVolumeNegativeTest-617587518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5ab9cbd-381b-4aee-af94-08bb13600408) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d49aa79f-8460-4aea-b95f-7a47df397625', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:43:01.985340 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-709d6242-0453-4066-9985-85d235a78aea tempest-AttachVolumeNegativeTest-617587518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6956161e-2ee7-44d9-92bd-f26c6730378b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:43:02.051033 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-709d6242-0453-4066-9985-85d235a78aea tempest-AttachVolumeNegativeTest-617587518 None] Volume volume-d49aa79f-8460-4aea-b95f-7a47df397625 (d49aa79f-8460-4aea-b95f-7a47df397625): created successfully May 21 21:43:02.054824 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-709d6242-0453-4066-9985-85d235a78aea tempest-AttachVolumeNegativeTest-617587518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6956161e-2ee7-44d9-92bd-f26c6730378b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:43:02.060253 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-709d6242-0453-4066-9985-85d235a78aea tempest-AttachVolumeNegativeTest-617587518 None] Flow 'volume_create_manager' (c85b4973-b0b0-40f1-a3b7-7fdf877e4888) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:43:02.142252 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-709d6242-0453-4066-9985-85d235a78aea tempest-AttachVolumeNegativeTest-617587518 None] Created volume successfully. May 21 21:43:03.920200 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-db02f22d-e79b-485b-a418-ad88f923272b req-1d3827e5-d589-4577-a4ad-5d40912b79b0 tempest-AttachVolumeNegativeTest-617587518 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:43:04.589663 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-db02f22d-e79b-485b-a418-ad88f923272b req-1d3827e5-d589-4577-a4ad-5d40912b79b0 tempest-AttachVolumeNegativeTest-617587518 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.669s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:43:04.590609 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-db02f22d-e79b-485b-a418-ad88f923272b req-1d3827e5-d589-4577-a4ad-5d40912b79b0 tempest-AttachVolumeNegativeTest-617587518 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d49aa79f-8460-4aea-b95f-7a47df397625', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'efef91cd-d8f8-4d93-9ad2-86d0b33251f4', 'volume_id': 'd49aa79f-8460-4aea-b95f-7a47df397625', 'discard': True}} {{(pid=124407) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} May 21 21:43:04.696711 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-db02f22d-e79b-485b-a418-ad88f923272b req-1d3827e5-d589-4577-a4ad-5d40912b79b0 tempest-AttachVolumeNegativeTest-617587518 None] Connection info returned from driver {'name': 'volumes/volume-d49aa79f-8460-4aea-b95f-7a47df397625', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd49aa79f-8460-4aea-b95f-7a47df397625', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b5c19e3f-fc21-488f-886c-3e2411607847'} {{(pid=124407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4826}} May 21 21:43:04.796540 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-db02f22d-e79b-485b-a418-ad88f923272b req-1d3827e5-d589-4577-a4ad-5d40912b79b0 tempest-AttachVolumeNegativeTest-617587518 None] attachment_update completed successfully. May 21 21:43:05.238581 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-f9d8a6b3-fcf1-47f3-94b4-f05b5a298e4a tempest-TestVolumeBootPattern-343249266 None] Volume volume-b9ebacac-5f32-42e3-9194-003aee7e2435.deleted is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:43:05.240156 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-f9d8a6b3-fcf1-47f3-94b4-f05b5a298e4a tempest-TestVolumeBootPattern-343249266 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:43:05.242154 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-f9d8a6b3-fcf1-47f3-94b4-f05b5a298e4a tempest-TestVolumeBootPattern-343249266 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:43:05.638008 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-f9d8a6b3-fcf1-47f3-94b4-f05b5a298e4a tempest-TestVolumeBootPattern-343249266 None] clone created successfully {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:862}} May 21 21:43:05.638762 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.volume_utils [None req-f9d8a6b3-fcf1-47f3-94b4-f05b5a298e4a tempest-TestVolumeBootPattern-343249266 None] Marking volume f13b6e40-0105-40ef-8eda-4c160169087e as bootable. {{(pid=124407) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} May 21 21:43:05.776084 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9d8a6b3-fcf1-47f3-94b4-f05b5a298e4a tempest-TestVolumeBootPattern-343249266 None] Copying metadata from image e570f5eb-6047-4214-a420-fdfdbdf19a4c to f13b6e40-0105-40ef-8eda-4c160169087e. {{(pid=124407) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} May 21 21:43:05.776743 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9d8a6b3-fcf1-47f3-94b4-f05b5a298e4a tempest-TestVolumeBootPattern-343249266 None] Creating volume glance metadata for volume f13b6e40-0105-40ef-8eda-4c160169087e backed by image e570f5eb-6047-4214-a420-fdfdbdf19a4c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=124407) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:673}} May 21 21:43:05.912110 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-f9d8a6b3-fcf1-47f3-94b4-f05b5a298e4a tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dcd4b7c-6c91-42a8-a3c5-2ad20a3d44f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f13b6e40-0105-40ef-8eda-4c160169087e', 'volume_size': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5593f8cb452404083dfa177b4ee68b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'created_at': datetime.datetime(2022, 5, 21, 21, 0, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:43:05.917158 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-f9d8a6b3-fcf1-47f3-94b4-f05b5a298e4a tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e0844fc-90f8-47c9-8ccc-4cc754cff983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:43:06.010860 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-f9d8a6b3-fcf1-47f3-94b4-f05b5a298e4a tempest-TestVolumeBootPattern-343249266 None] Volume volume-f13b6e40-0105-40ef-8eda-4c160169087e (f13b6e40-0105-40ef-8eda-4c160169087e): created successfully May 21 21:43:06.016855 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-f9d8a6b3-fcf1-47f3-94b4-f05b5a298e4a tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e0844fc-90f8-47c9-8ccc-4cc754cff983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:43:06.020606 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-f9d8a6b3-fcf1-47f3-94b4-f05b5a298e4a tempest-TestVolumeBootPattern-343249266 None] Flow 'volume_create_manager' (d34b3068-e928-41ae-a64b-e5172e26eadc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:43:06.176016 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-f9d8a6b3-fcf1-47f3-94b4-f05b5a298e4a tempest-TestVolumeBootPattern-343249266 None] Created volume successfully. May 21 21:43:09.702127 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-f5c8401e-9c83-466c-a710-aeaa4382d644 req-f224afbd-cc0f-42a9-9455-f13c09d593d8 tempest-AttachVolumeNegativeTest-617587518 None] Terminate volume connection completed successfully. May 21 21:43:09.703346 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-f5c8401e-9c83-466c-a710-aeaa4382d644 req-f224afbd-cc0f-42a9-9455-f13c09d593d8 tempest-AttachVolumeNegativeTest-617587518 None] Deleting attachment b5c19e3f-fc21-488f-886c-3e2411607847. {{(pid=124407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4957}} May 21 21:43:11.563618 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-112fb4da-2db3-4073-ac66-8b9f14184268 req-0f5c9c9f-6f02-4ec9-9772-7bf22c755a62 tempest-TestVolumeBootPattern-343249266 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:43:12.355515 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-112fb4da-2db3-4073-ac66-8b9f14184268 req-0f5c9c9f-6f02-4ec9-9772-7bf22c755a62 tempest-TestVolumeBootPattern-343249266 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.792s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:43:12.356388 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-112fb4da-2db3-4073-ac66-8b9f14184268 req-0f5c9c9f-6f02-4ec9-9772-7bf22c755a62 tempest-TestVolumeBootPattern-343249266 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f13b6e40-0105-40ef-8eda-4c160169087e', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'efef91cd-d8f8-4d93-9ad2-86d0b33251f4', 'volume_id': 'f13b6e40-0105-40ef-8eda-4c160169087e', 'discard': True}} {{(pid=124407) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} May 21 21:43:12.519798 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-112fb4da-2db3-4073-ac66-8b9f14184268 req-0f5c9c9f-6f02-4ec9-9772-7bf22c755a62 tempest-TestVolumeBootPattern-343249266 None] Connection info returned from driver {'name': 'volumes/volume-f13b6e40-0105-40ef-8eda-4c160169087e', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f13b6e40-0105-40ef-8eda-4c160169087e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '2fea51c2-a2b3-4a61-967c-bbfc64a7ea57'} {{(pid=124407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4826}} May 21 21:43:12.683929 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-112fb4da-2db3-4073-ac66-8b9f14184268 req-0f5c9c9f-6f02-4ec9-9772-7bf22c755a62 tempest-TestVolumeBootPattern-343249266 None] attachment_update completed successfully. May 21 21:43:18.125010 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-6defc22f-ed8e-4540-8304-f27b41a3d613 tempest-AttachVolumeNegativeTest-617587518 None] Lock "b'cinder-d49aa79f-8460-4aea-b95f-7a47df397625-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:43:18.262658 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6defc22f-ed8e-4540-8304-f27b41a3d613 tempest-AttachVolumeNegativeTest-617587518 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:43:18.651177 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6defc22f-ed8e-4540-8304-f27b41a3d613 tempest-AttachVolumeNegativeTest-617587518 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:43:18.651704 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6defc22f-ed8e-4540-8304-f27b41a3d613 tempest-AttachVolumeNegativeTest-617587518 None] Volume volume-d49aa79f-8460-4aea-b95f-7a47df397625 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:43:19.002187 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6defc22f-ed8e-4540-8304-f27b41a3d613 tempest-AttachVolumeNegativeTest-617587518 None] deleting rbd volume volume-d49aa79f-8460-4aea-b95f-7a47df397625 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:43:26.086021 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=49,cinder:UPDATE=9,cinder:INSERT=7,cinder:DELETE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:43:26.087108 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:UPDATE=16,cinder:SELECT=56,cinder:DELETE=2,cinder:INSERT=5 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:43:26.249295 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-8adf3298-9158-4e51-89a1-c98bfabc5bb2 req-dedb1ba4-3f60-485e-b0d8-59534f7ba9c6 tempest-TestVolumeBootPattern-343249266 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:43:29.353900 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-8adf3298-9158-4e51-89a1-c98bfabc5bb2 req-dedb1ba4-3f60-485e-b0d8-59534f7ba9c6 tempest-TestVolumeBootPattern-343249266 None] Create snapshot completed successfully May 21 21:43:30.032607 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-6defc22f-ed8e-4540-8304-f27b41a3d613 tempest-AttachVolumeNegativeTest-617587518 None] Created reservations ['cbb1f70e-353d-4c14-95bd-0915e7b89fe9', '296444a9-c5e3-49c0-98c7-50f0b4e76863', '4b32e063-a47e-4f8b-9a00-8435e0047ecc', '32f02f9c-20e7-48bd-b004-a16ddc1a5577'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:43:30.229746 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6defc22f-ed8e-4540-8304-f27b41a3d613 tempest-AttachVolumeNegativeTest-617587518 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:43:30.276750 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6defc22f-ed8e-4540-8304-f27b41a3d613 tempest-AttachVolumeNegativeTest-617587518 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:43:30.318438 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-6defc22f-ed8e-4540-8304-f27b41a3d613 tempest-AttachVolumeNegativeTest-617587518 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:43:30.327333 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-6defc22f-ed8e-4540-8304-f27b41a3d613 tempest-AttachVolumeNegativeTest-617587518 None] Deleted volume successfully. May 21 21:43:30.392698 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-6defc22f-ed8e-4540-8304-f27b41a3d613 tempest-AttachVolumeNegativeTest-617587518 None] Lock "b'cinder-d49aa79f-8460-4aea-b95f-7a47df397625-delete_volume'" released by "delete_volume" :: held 12.268s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:43:31.401477 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-08885213-a91e-48bc-b78d-12ae7949fb46 tempest-AttachVolumeNegativeTest-617587518 None] Lock "b'cinder-6c377029-622a-4080-a22a-7ff58210f09d-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:43:31.570684 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-08885213-a91e-48bc-b78d-12ae7949fb46 tempest-AttachVolumeNegativeTest-617587518 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:43:32.616162 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-08885213-a91e-48bc-b78d-12ae7949fb46 tempest-AttachVolumeNegativeTest-617587518 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:43:32.617513 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-08885213-a91e-48bc-b78d-12ae7949fb46 tempest-AttachVolumeNegativeTest-617587518 None] Volume volume-6c377029-622a-4080-a22a-7ff58210f09d is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:43:32.944444 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-08885213-a91e-48bc-b78d-12ae7949fb46 tempest-AttachVolumeNegativeTest-617587518 None] deleting rbd volume volume-6c377029-622a-4080-a22a-7ff58210f09d {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:43:34.083964 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [req-cce88d23-c4db-42d6-b47a-577e1d1a633e req-6547577e-08ad-4f65-ace1-f9fe22c8cf52 tempest-TestVolumeBootPattern-343249266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:43:34.135735 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-cce88d23-c4db-42d6-b47a-577e1d1a633e req-6547577e-08ad-4f65-ace1-f9fe22c8cf52 tempest-TestVolumeBootPattern-343249266 None] Flow 'volume_create_manager' (10b0c49f-acd9-44ae-b5bd-469c95413de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:43:34.143054 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-cce88d23-c4db-42d6-b47a-577e1d1a633e req-6547577e-08ad-4f65-ace1-f9fe22c8cf52 tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e12f88d-d46f-4264-a3d5-c6b4e3935987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:43:34.168639 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-cce88d23-c4db-42d6-b47a-577e1d1a633e req-6547577e-08ad-4f65-ace1-f9fe22c8cf52 tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e12f88d-d46f-4264-a3d5-c6b4e3935987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:43:33Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f7ce0abb-b5c2-47da-81e2-b45f8ec55bf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8149564857f64342aef93f18c0d90eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=99cc8ea9-83d1-400c-a93e-ffb9942a0da8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:43:34Z,use_quota=True,user_id='730839d5531644eb9aa26dabe2fbd8f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:43:34.175758 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-cce88d23-c4db-42d6-b47a-577e1d1a633e req-6547577e-08ad-4f65-ace1-f9fe22c8cf52 tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b81ad6e7-14ca-4d4f-bb31-e20ec7c36518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:43:34.181241 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-cce88d23-c4db-42d6-b47a-577e1d1a633e req-6547577e-08ad-4f65-ace1-f9fe22c8cf52 tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b81ad6e7-14ca-4d4f-bb31-e20ec7c36518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:43:34.187716 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-cce88d23-c4db-42d6-b47a-577e1d1a633e req-6547577e-08ad-4f65-ace1-f9fe22c8cf52 tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7da34296-be06-4e1a-b9eb-e5212e514e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:43:34.192594 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-cce88d23-c4db-42d6-b47a-577e1d1a633e req-6547577e-08ad-4f65-ace1-f9fe22c8cf52 tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7da34296-be06-4e1a-b9eb-e5212e514e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f7ce0abb-b5c2-47da-81e2-b45f8ec55bf9', 'volume_name': 'volume-f7ce0abb-b5c2-47da-81e2-b45f8ec55bf9', 'volume_size': 1, 'snapshot_id': '99cc8ea9-83d1-400c-a93e-ffb9942a0da8'}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:43:34.199005 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-cce88d23-c4db-42d6-b47a-577e1d1a633e req-6547577e-08ad-4f65-ace1-f9fe22c8cf52 tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39431f71-12e8-4d34-837b-21b30dff3130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:43:34.203825 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-cce88d23-c4db-42d6-b47a-577e1d1a633e req-6547577e-08ad-4f65-ace1-f9fe22c8cf52 tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39431f71-12e8-4d34-837b-21b30dff3130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:43:34.210088 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-cce88d23-c4db-42d6-b47a-577e1d1a633e req-6547577e-08ad-4f65-ace1-f9fe22c8cf52 tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4903138f-1f4d-414b-ad82-e4b627162577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:43:34.213120 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [req-cce88d23-c4db-42d6-b47a-577e1d1a633e req-6547577e-08ad-4f65-ace1-f9fe22c8cf52 tempest-TestVolumeBootPattern-343249266 None] Volume f7ce0abb-b5c2-47da-81e2-b45f8ec55bf9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f7ce0abb-b5c2-47da-81e2-b45f8ec55bf9', 'volume_size': 1, 'snapshot_id': '99cc8ea9-83d1-400c-a93e-ffb9942a0da8'} May 21 21:43:34.249536 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-cce88d23-c4db-42d6-b47a-577e1d1a633e req-6547577e-08ad-4f65-ace1-f9fe22c8cf52 tempest-TestVolumeBootPattern-343249266 None] cloning volumes/volume-f13b6e40-0105-40ef-8eda-4c160169087e@snapshot-99cc8ea9-83d1-400c-a93e-ffb9942a0da8 to volume-f7ce0abb-b5c2-47da-81e2-b45f8ec55bf9 {{(pid=124407) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1098}} May 21 21:43:34.250721 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-cce88d23-c4db-42d6-b47a-577e1d1a633e req-6547577e-08ad-4f65-ace1-f9fe22c8cf52 tempest-TestVolumeBootPattern-343249266 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:43:35.190976 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-cce88d23-c4db-42d6-b47a-577e1d1a633e req-6547577e-08ad-4f65-ace1-f9fe22c8cf52 tempest-TestVolumeBootPattern-343249266 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:43:37.059366 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-cce88d23-c4db-42d6-b47a-577e1d1a633e req-6547577e-08ad-4f65-ace1-f9fe22c8cf52 tempest-TestVolumeBootPattern-343249266 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:43:37.060066 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-cce88d23-c4db-42d6-b47a-577e1d1a633e req-6547577e-08ad-4f65-ace1-f9fe22c8cf52 tempest-TestVolumeBootPattern-343249266 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:43:37.082846 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.volume_utils [req-cce88d23-c4db-42d6-b47a-577e1d1a633e req-6547577e-08ad-4f65-ace1-f9fe22c8cf52 tempest-TestVolumeBootPattern-343249266 None] Marking volume f7ce0abb-b5c2-47da-81e2-b45f8ec55bf9 as bootable. {{(pid=124407) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} May 21 21:43:37.136854 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [req-cce88d23-c4db-42d6-b47a-577e1d1a633e req-6547577e-08ad-4f65-ace1-f9fe22c8cf52 tempest-TestVolumeBootPattern-343249266 None] Copying metadata from snapshot 99cc8ea9-83d1-400c-a93e-ffb9942a0da8 to f7ce0abb-b5c2-47da-81e2-b45f8ec55bf9. {{(pid=124407) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:429}} May 21 21:43:37.269304 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-cce88d23-c4db-42d6-b47a-577e1d1a633e req-6547577e-08ad-4f65-ace1-f9fe22c8cf52 tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4903138f-1f4d-414b-ad82-e4b627162577) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7ce0abb-b5c2-47da-81e2-b45f8ec55bf9', 'volume_size': 1, 'snapshot_id': '99cc8ea9-83d1-400c-a93e-ffb9942a0da8'}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:43:37.276617 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-cce88d23-c4db-42d6-b47a-577e1d1a633e req-6547577e-08ad-4f65-ace1-f9fe22c8cf52 tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57252635-f243-4478-ab16-a884a3730cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:43:37.383353 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [req-cce88d23-c4db-42d6-b47a-577e1d1a633e req-6547577e-08ad-4f65-ace1-f9fe22c8cf52 tempest-TestVolumeBootPattern-343249266 None] Volume volume-f7ce0abb-b5c2-47da-81e2-b45f8ec55bf9 (f7ce0abb-b5c2-47da-81e2-b45f8ec55bf9): created successfully May 21 21:43:37.387809 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-cce88d23-c4db-42d6-b47a-577e1d1a633e req-6547577e-08ad-4f65-ace1-f9fe22c8cf52 tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57252635-f243-4478-ab16-a884a3730cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:43:37.393723 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-cce88d23-c4db-42d6-b47a-577e1d1a633e req-6547577e-08ad-4f65-ace1-f9fe22c8cf52 tempest-TestVolumeBootPattern-343249266 None] Flow 'volume_create_manager' (10b0c49f-acd9-44ae-b5bd-469c95413de8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:43:37.486842 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-cce88d23-c4db-42d6-b47a-577e1d1a633e req-6547577e-08ad-4f65-ace1-f9fe22c8cf52 tempest-TestVolumeBootPattern-343249266 None] Created volume successfully. May 21 21:43:40.439154 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-cce88d23-c4db-42d6-b47a-577e1d1a633e req-9e261114-537f-4dea-a987-d239d0a1a6a4 tempest-TestVolumeBootPattern-343249266 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:43:41.168707 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-cce88d23-c4db-42d6-b47a-577e1d1a633e req-9e261114-537f-4dea-a987-d239d0a1a6a4 tempest-TestVolumeBootPattern-343249266 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.729s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:43:41.169835 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-cce88d23-c4db-42d6-b47a-577e1d1a633e req-9e261114-537f-4dea-a987-d239d0a1a6a4 tempest-TestVolumeBootPattern-343249266 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f7ce0abb-b5c2-47da-81e2-b45f8ec55bf9', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'efef91cd-d8f8-4d93-9ad2-86d0b33251f4', 'volume_id': 'f7ce0abb-b5c2-47da-81e2-b45f8ec55bf9', 'discard': True}} {{(pid=124407) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} May 21 21:43:41.251990 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-cce88d23-c4db-42d6-b47a-577e1d1a633e req-9e261114-537f-4dea-a987-d239d0a1a6a4 tempest-TestVolumeBootPattern-343249266 None] Connection info returned from driver {'name': 'volumes/volume-f7ce0abb-b5c2-47da-81e2-b45f8ec55bf9', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f7ce0abb-b5c2-47da-81e2-b45f8ec55bf9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'df90cbe4-b40c-4964-b2d9-adc9e7c138fb'} {{(pid=124407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4826}} May 21 21:43:41.389286 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-cce88d23-c4db-42d6-b47a-577e1d1a633e req-9e261114-537f-4dea-a987-d239d0a1a6a4 tempest-TestVolumeBootPattern-343249266 None] attachment_update completed successfully. May 21 21:43:42.298944 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-08885213-a91e-48bc-b78d-12ae7949fb46 tempest-AttachVolumeNegativeTest-617587518 None] Created reservations ['63cd044d-41ed-4479-98af-dadc0a7e8c41', '2bbf9a47-58b6-40b9-b114-c03b481a9d1c', '574d5057-5714-47d2-a33b-35d81e8b9fee', '19f04f4d-b967-434e-8582-a8d7fbe50319'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:43:42.555616 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-08885213-a91e-48bc-b78d-12ae7949fb46 tempest-AttachVolumeNegativeTest-617587518 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:43:42.592848 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-08885213-a91e-48bc-b78d-12ae7949fb46 tempest-AttachVolumeNegativeTest-617587518 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:43:42.618944 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-08885213-a91e-48bc-b78d-12ae7949fb46 tempest-AttachVolumeNegativeTest-617587518 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:43:42.623694 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-08885213-a91e-48bc-b78d-12ae7949fb46 tempest-AttachVolumeNegativeTest-617587518 None] Deleted volume successfully. May 21 21:43:42.726764 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-08885213-a91e-48bc-b78d-12ae7949fb46 tempest-AttachVolumeNegativeTest-617587518 None] Lock "b'cinder-6c377029-622a-4080-a22a-7ff58210f09d-delete_volume'" released by "delete_volume" :: held 11.320s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:43:43.516253 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-00d4948a-d27e-4788-a461-0059043c80ab tempest-AttachVolumeNegativeTest-617587518 None] Lock "b'cinder-01346cc1-2b76-407c-9c84-8982256c9623-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:43:43.526943 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=61,cinder:UPDATE=22,cinder:INSERT=16,cinder:DELETE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:43:43.604334 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-00d4948a-d27e-4788-a461-0059043c80ab tempest-AttachVolumeNegativeTest-617587518 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:43:44.948652 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-00d4948a-d27e-4788-a461-0059043c80ab tempest-AttachVolumeNegativeTest-617587518 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:43:44.949297 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-00d4948a-d27e-4788-a461-0059043c80ab tempest-AttachVolumeNegativeTest-617587518 None] Volume volume-01346cc1-2b76-407c-9c84-8982256c9623 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:43:45.381602 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-00d4948a-d27e-4788-a461-0059043c80ab tempest-AttachVolumeNegativeTest-617587518 None] deleting rbd volume volume-01346cc1-2b76-407c-9c84-8982256c9623 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:43:54.390922 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:43:54.391659 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:43:54.419625 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:43:54.446928 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:43:56.511674 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:43:56.515965 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=59,cinder:INSERT=16,cinder:UPDATE=22,cinder:DELETE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:43:56.635034 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-00d4948a-d27e-4788-a461-0059043c80ab tempest-AttachVolumeNegativeTest-617587518 None] Created reservations ['357809c3-2342-4206-a599-b29b70bde676', '2091a496-d771-4d44-999f-574d5ec4283c', '73287b75-8b8d-4b34-a28c-97e263162214', '6c2b9530-06f0-4676-8202-5b3a6249716a'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:43:56.973686 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-00d4948a-d27e-4788-a461-0059043c80ab tempest-AttachVolumeNegativeTest-617587518 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:43:57.025861 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-00d4948a-d27e-4788-a461-0059043c80ab tempest-AttachVolumeNegativeTest-617587518 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:43:57.062635 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-00d4948a-d27e-4788-a461-0059043c80ab tempest-AttachVolumeNegativeTest-617587518 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:43:57.071633 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-00d4948a-d27e-4788-a461-0059043c80ab tempest-AttachVolumeNegativeTest-617587518 None] Deleted volume successfully. May 21 21:43:57.131629 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-00d4948a-d27e-4788-a461-0059043c80ab tempest-AttachVolumeNegativeTest-617587518 None] Lock "b'cinder-01346cc1-2b76-407c-9c84-8982256c9623-delete_volume'" released by "delete_volume" :: held 13.615s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:43:58.827115 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-d46f7d99-e8bb-4b61-911b-c813afb6e148 req-c4906faa-7020-41a9-9fa8-526d19f2c6c2 tempest-TestVolumeBootPattern-343249266 None] Terminate volume connection completed successfully. May 21 21:43:58.828300 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-d46f7d99-e8bb-4b61-911b-c813afb6e148 req-c4906faa-7020-41a9-9fa8-526d19f2c6c2 tempest-TestVolumeBootPattern-343249266 None] Deleting attachment df90cbe4-b40c-4964-b2d9-adc9e7c138fb. {{(pid=124407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4957}} May 21 21:43:59.234606 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [req-d46f7d99-e8bb-4b61-911b-c813afb6e148 req-ebe8444a-e3f5-4ab3-9c70-045c8f73b2c3 tempest-TestVolumeBootPattern-343249266 None] Lock "b'cinder-f7ce0abb-b5c2-47da-81e2-b45f8ec55bf9-delete_volume'" acquired by "delete_volume" :: waited 0.026s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:43:59.355086 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-d46f7d99-e8bb-4b61-911b-c813afb6e148 req-ebe8444a-e3f5-4ab3-9c70-045c8f73b2c3 tempest-TestVolumeBootPattern-343249266 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:43:59.880664 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-d46f7d99-e8bb-4b61-911b-c813afb6e148 req-ebe8444a-e3f5-4ab3-9c70-045c8f73b2c3 tempest-TestVolumeBootPattern-343249266 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:44:00.180329 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-d46f7d99-e8bb-4b61-911b-c813afb6e148 req-ebe8444a-e3f5-4ab3-9c70-045c8f73b2c3 tempest-TestVolumeBootPattern-343249266 None] deleting rbd volume volume-f7ce0abb-b5c2-47da-81e2-b45f8ec55bf9 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:44:00.223887 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-ee208302-3aaf-48bd-919b-8ab01373f1ab tempest-VolumesSnapshotTestJSON-2065732980 None] Terminate volume connection completed successfully. May 21 21:44:00.281903 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-ee208302-3aaf-48bd-919b-8ab01373f1ab tempest-VolumesSnapshotTestJSON-2065732980 None] Remove volume export completed successfully. May 21 21:44:00.378916 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-ee208302-3aaf-48bd-919b-8ab01373f1ab tempest-VolumesSnapshotTestJSON-2065732980 None] Lock "b'cinder-309f4540-fbfc-4e92-9dea-f5d996d27e51-delete_volume'" acquired by "delete_volume" :: waited 0.026s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:44:00.443965 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ee208302-3aaf-48bd-919b-8ab01373f1ab tempest-VolumesSnapshotTestJSON-2065732980 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:44:00.762627 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ee208302-3aaf-48bd-919b-8ab01373f1ab tempest-VolumesSnapshotTestJSON-2065732980 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:44:01.036245 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ee208302-3aaf-48bd-919b-8ab01373f1ab tempest-VolumesSnapshotTestJSON-2065732980 None] deleting rbd volume volume-309f4540-fbfc-4e92-9dea-f5d996d27e51 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:44:10.235339 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [req-d46f7d99-e8bb-4b61-911b-c813afb6e148 req-ebe8444a-e3f5-4ab3-9c70-045c8f73b2c3 tempest-TestVolumeBootPattern-343249266 None] Created reservations ['0c66c829-bbaa-449c-a3fc-d8b0eefe4e3c', '03584296-551f-4cc3-87de-fa96612bde98', 'ea245a8e-873b-4779-9e24-a78b30068371', 'fdaaab83-c8de-498d-b99b-7861178808a2'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:44:10.458188 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-ee208302-3aaf-48bd-919b-8ab01373f1ab tempest-VolumesSnapshotTestJSON-2065732980 None] Deleted volume successfully. May 21 21:44:10.465684 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-ee208302-3aaf-48bd-919b-8ab01373f1ab tempest-VolumesSnapshotTestJSON-2065732980 None] Lock "b'cinder-309f4540-fbfc-4e92-9dea-f5d996d27e51-delete_volume'" released by "delete_volume" :: held 10.087s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:44:10.536731 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-d46f7d99-e8bb-4b61-911b-c813afb6e148 req-ebe8444a-e3f5-4ab3-9c70-045c8f73b2c3 tempest-TestVolumeBootPattern-343249266 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:44:10.603212 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-d46f7d99-e8bb-4b61-911b-c813afb6e148 req-ebe8444a-e3f5-4ab3-9c70-045c8f73b2c3 tempest-TestVolumeBootPattern-343249266 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:44:10.703364 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [req-d46f7d99-e8bb-4b61-911b-c813afb6e148 req-ebe8444a-e3f5-4ab3-9c70-045c8f73b2c3 tempest-TestVolumeBootPattern-343249266 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:44:10.716950 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-d46f7d99-e8bb-4b61-911b-c813afb6e148 req-ebe8444a-e3f5-4ab3-9c70-045c8f73b2c3 tempest-TestVolumeBootPattern-343249266 None] Deleted volume successfully. May 21 21:44:10.741239 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-df55ca67-ffb0-472d-b1e5-79a752087990 tempest-TestVolumeBootPattern-343249266 None] Lock "b'cinder-99cc8ea9-83d1-400c-a93e-ffb9942a0da8-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.030s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:44:10.748002 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-df55ca67-ffb0-472d-b1e5-79a752087990 tempest-TestVolumeBootPattern-343249266 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:44:11.251557 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [req-d46f7d99-e8bb-4b61-911b-c813afb6e148 req-ebe8444a-e3f5-4ab3-9c70-045c8f73b2c3 tempest-TestVolumeBootPattern-343249266 None] Lock "b'cinder-f7ce0abb-b5c2-47da-81e2-b45f8ec55bf9-delete_volume'" released by "delete_volume" :: held 12.013s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:44:20.726126 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=34,cinder:UPDATE=22,cinder:INSERT=7,cinder:DELETE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:44:36.518814 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=27,cinder:UPDATE=19,cinder:INSERT=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:44:38.695463 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a0cfbd9-f104-4e14-b724-8556ad43f472 tempest-VolumesSnapshotTestJSON-2065732980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:44:38.715662 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3a0cfbd9-f104-4e14-b724-8556ad43f472 tempest-VolumesSnapshotTestJSON-2065732980 None] Flow 'volume_create_manager' (073ec77e-a26f-49ad-bfc7-c63576339e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:44:38.722139 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3a0cfbd9-f104-4e14-b724-8556ad43f472 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8796a9b-04cf-4fe2-95f0-cc1c5dd84cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:44:38.738862 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3a0cfbd9-f104-4e14-b724-8556ad43f472 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8796a9b-04cf-4fe2-95f0-cc1c5dd84cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:44:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-242366245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0073fe3d-0903-4f84-8e07-7e6bd96bbf32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e046067a8e4197b18860f9b9e1e344',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:44:39Z,use_quota=True,user_id='88d6ab0c56ae4b16805f265728e20ed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:44:38.745186 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3a0cfbd9-f104-4e14-b724-8556ad43f472 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f6c79d-a98d-4378-b64b-3a3a6501c2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:44:38.748978 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3a0cfbd9-f104-4e14-b724-8556ad43f472 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f6c79d-a98d-4378-b64b-3a3a6501c2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:44:38.754741 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3a0cfbd9-f104-4e14-b724-8556ad43f472 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37745db7-e650-4c7d-85ac-e4361d495021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:44:38.883111 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3a0cfbd9-f104-4e14-b724-8556ad43f472 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37745db7-e650-4c7d-85ac-e4361d495021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0073fe3d-0903-4f84-8e07-7e6bd96bbf32', 'volume_name': 'volume-0073fe3d-0903-4f84-8e07-7e6bd96bbf32', 'volume_size': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5593f8cb452404083dfa177b4ee68b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'created_at': datetime.datetime(2022, 5, 21, 21, 0, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:44:38.890189 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3a0cfbd9-f104-4e14-b724-8556ad43f472 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67844f94-7c4c-4fa8-82cd-394b60f62144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:44:38.905543 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3a0cfbd9-f104-4e14-b724-8556ad43f472 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67844f94-7c4c-4fa8-82cd-394b60f62144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:44:38.917489 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3a0cfbd9-f104-4e14-b724-8556ad43f472 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ba61a16-501f-4973-b6b6-c5cd44bb3faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:44:38.925820 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-3a0cfbd9-f104-4e14-b724-8556ad43f472 tempest-VolumesSnapshotTestJSON-2065732980 None] Volume 0073fe3d-0903-4f84-8e07-7e6bd96bbf32: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0073fe3d-0903-4f84-8e07-7e6bd96bbf32', 'volume_size': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5593f8cb452404083dfa177b4ee68b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'created_at': datetime.datetime(2022, 5, 21, 21, 0, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } May 21 21:44:38.925820 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a0cfbd9-f104-4e14-b724-8556ad43f472 tempest-VolumesSnapshotTestJSON-2065732980 None] Cloning 0073fe3d-0903-4f84-8e07-7e6bd96bbf32 from image e570f5eb-6047-4214-a420-fdfdbdf19a4c at location (None, None). {{(pid=124407) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1053}} May 21 21:44:38.932999 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-3a0cfbd9-f104-4e14-b724-8556ad43f472 tempest-VolumesSnapshotTestJSON-2065732980 None] Lock "b'cinder-e570f5eb-6047-4214-a420-fdfdbdf19a4c'" acquired by "_prepare_image_cache_entry" :: waited 0.013s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:44:39.058411 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-3a0cfbd9-f104-4e14-b724-8556ad43f472 tempest-VolumesSnapshotTestJSON-2065732980 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'volume_id': '4057e637-23ba-493f-a45d-eb28c07ac60a', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28), 'last_used': datetime.datetime(2022, 5, 21, 21, 44, 38, 943074)}. {{(pid=124407) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 21 21:44:39.058844 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-3a0cfbd9-f104-4e14-b724-8556ad43f472 tempest-VolumesSnapshotTestJSON-2065732980 None] Image-volume cache entry image_update_at = 2022-05-21 21:00:28+00:00, requested image updated_at = 2022-05-21 21:00:28+00:00. {{(pid=124407) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 21 21:44:39.059427 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a0cfbd9-f104-4e14-b724-8556ad43f472 tempest-VolumesSnapshotTestJSON-2065732980 None] Found cache entry for image = e570f5eb-6047-4214-a420-fdfdbdf19a4c on host ncdv-master-1@ceph#ceph. {{(pid=124407) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:876}} May 21 21:44:39.064517 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-3a0cfbd9-f104-4e14-b724-8556ad43f472 tempest-VolumesSnapshotTestJSON-2065732980 None] Lock "b'cinder-e570f5eb-6047-4214-a420-fdfdbdf19a4c'" released by "_prepare_image_cache_entry" :: held 0.132s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:44:39.065525 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a0cfbd9-f104-4e14-b724-8556ad43f472 tempest-VolumesSnapshotTestJSON-2065732980 None] Attempting to retrieve cache entry for image = e570f5eb-6047-4214-a420-fdfdbdf19a4c on host ncdv-master-1@ceph#ceph. {{(pid=124407) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:817}} May 21 21:44:39.073271 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-3a0cfbd9-f104-4e14-b724-8556ad43f472 tempest-VolumesSnapshotTestJSON-2065732980 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'volume_id': '4057e637-23ba-493f-a45d-eb28c07ac60a', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28), 'last_used': datetime.datetime(2022, 5, 21, 21, 44, 39, 69320)}. {{(pid=124407) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 21 21:44:39.073978 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-3a0cfbd9-f104-4e14-b724-8556ad43f472 tempest-VolumesSnapshotTestJSON-2065732980 None] Image-volume cache entry image_update_at = 2022-05-21 21:00:28+00:00, requested image updated_at = 2022-05-21 21:00:28+00:00. {{(pid=124407) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 21 21:44:39.074583 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a0cfbd9-f104-4e14-b724-8556ad43f472 tempest-VolumesSnapshotTestJSON-2065732980 None] Creating from source image-volume 4057e637-23ba-493f-a45d-eb28c07ac60a {{(pid=124407) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:831}} May 21 21:44:39.091606 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3a0cfbd9-f104-4e14-b724-8556ad43f472 tempest-VolumesSnapshotTestJSON-2065732980 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:44:39.355739 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3a0cfbd9-f104-4e14-b724-8556ad43f472 tempest-VolumesSnapshotTestJSON-2065732980 None] creating snapshot='volume-0073fe3d-0903-4f84-8e07-7e6bd96bbf32.clone_snap' {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 21 21:44:41.824647 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3a0cfbd9-f104-4e14-b724-8556ad43f472 tempest-VolumesSnapshotTestJSON-2065732980 None] cloning 'volume-4057e637-23ba-493f-a45d-eb28c07ac60a@volume-0073fe3d-0903-4f84-8e07-7e6bd96bbf32.clone_snap' to 'volume-0073fe3d-0903-4f84-8e07-7e6bd96bbf32' {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:789}} May 21 21:44:42.778108 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-df55ca67-ffb0-472d-b1e5-79a752087990 tempest-TestVolumeBootPattern-343249266 None] Created reservations ['9498fae7-6370-4959-af05-4b63733376f6', '1179e0b8-46c8-44dc-8952-a68cb1122a84', '47e7c0cf-7bd6-4798-87cb-276cabea00c0', '6a211882-1543-4b6b-9b84-be1290854e8c'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:44:43.059019 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-df55ca67-ffb0-472d-b1e5-79a752087990 tempest-TestVolumeBootPattern-343249266 None] Delete snapshot completed successfully. May 21 21:44:43.065684 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-df55ca67-ffb0-472d-b1e5-79a752087990 tempest-TestVolumeBootPattern-343249266 None] Lock "b'cinder-99cc8ea9-83d1-400c-a93e-ffb9942a0da8-delete_snapshot'" released by "delete_snapshot" :: held 32.324s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:44:43.955232 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3a0cfbd9-f104-4e14-b724-8556ad43f472 tempest-VolumesSnapshotTestJSON-2065732980 None] Volume volume-b9ebacac-5f32-42e3-9194-003aee7e2435.deleted is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:44:43.956903 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3a0cfbd9-f104-4e14-b724-8556ad43f472 tempest-VolumesSnapshotTestJSON-2065732980 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:44:43.957360 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3a0cfbd9-f104-4e14-b724-8556ad43f472 tempest-VolumesSnapshotTestJSON-2065732980 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:44:44.811027 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3a0cfbd9-f104-4e14-b724-8556ad43f472 tempest-VolumesSnapshotTestJSON-2065732980 None] clone created successfully {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:862}} May 21 21:44:44.811672 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.volume_utils [None req-3a0cfbd9-f104-4e14-b724-8556ad43f472 tempest-VolumesSnapshotTestJSON-2065732980 None] Marking volume 0073fe3d-0903-4f84-8e07-7e6bd96bbf32 as bootable. {{(pid=124407) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} May 21 21:44:44.881506 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a0cfbd9-f104-4e14-b724-8556ad43f472 tempest-VolumesSnapshotTestJSON-2065732980 None] Copying metadata from image e570f5eb-6047-4214-a420-fdfdbdf19a4c to 0073fe3d-0903-4f84-8e07-7e6bd96bbf32. {{(pid=124407) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} May 21 21:44:44.881993 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a0cfbd9-f104-4e14-b724-8556ad43f472 tempest-VolumesSnapshotTestJSON-2065732980 None] Creating volume glance metadata for volume 0073fe3d-0903-4f84-8e07-7e6bd96bbf32 backed by image e570f5eb-6047-4214-a420-fdfdbdf19a4c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=124407) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:673}} May 21 21:44:44.977795 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3a0cfbd9-f104-4e14-b724-8556ad43f472 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ba61a16-501f-4973-b6b6-c5cd44bb3faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0073fe3d-0903-4f84-8e07-7e6bd96bbf32', 'volume_size': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5593f8cb452404083dfa177b4ee68b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'created_at': datetime.datetime(2022, 5, 21, 21, 0, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:44:44.984442 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3a0cfbd9-f104-4e14-b724-8556ad43f472 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b17ff267-afed-4a74-9226-9401c6c97d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:44:45.070854 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-3a0cfbd9-f104-4e14-b724-8556ad43f472 tempest-VolumesSnapshotTestJSON-2065732980 None] Volume volume-0073fe3d-0903-4f84-8e07-7e6bd96bbf32 (0073fe3d-0903-4f84-8e07-7e6bd96bbf32): created successfully May 21 21:44:45.074754 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3a0cfbd9-f104-4e14-b724-8556ad43f472 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b17ff267-afed-4a74-9226-9401c6c97d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:44:45.080427 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3a0cfbd9-f104-4e14-b724-8556ad43f472 tempest-VolumesSnapshotTestJSON-2065732980 None] Flow 'volume_create_manager' (073ec77e-a26f-49ad-bfc7-c63576339e17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:44:45.190125 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-3a0cfbd9-f104-4e14-b724-8556ad43f472 tempest-VolumesSnapshotTestJSON-2065732980 None] Created volume successfully. May 21 21:44:46.910172 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-93bbdf6f-6ebb-4894-9aa7-da25dfdf6c1c req-d5482849-dc3b-4eeb-a7f9-779f6fe3bc9b tempest-VolumesSnapshotTestJSON-2065732980 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:44:47.036241 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-9abd15e9-dab3-44d4-9b95-e9744dfb10b9 req-7c2bbb45-2292-4c34-bf24-57994a19ec28 tempest-TestVolumeBootPattern-343249266 None] Terminate volume connection completed successfully. May 21 21:44:47.036837 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-9abd15e9-dab3-44d4-9b95-e9744dfb10b9 req-7c2bbb45-2292-4c34-bf24-57994a19ec28 tempest-TestVolumeBootPattern-343249266 None] Deleting attachment 2fea51c2-a2b3-4a61-967c-bbfc64a7ea57. {{(pid=124407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4957}} May 21 21:44:47.381546 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [req-9abd15e9-dab3-44d4-9b95-e9744dfb10b9 req-60416b49-01a3-469b-be1a-78cc0fc58d14 tempest-TestVolumeBootPattern-343249266 None] Lock "b'cinder-f13b6e40-0105-40ef-8eda-4c160169087e-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:44:47.499618 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-9abd15e9-dab3-44d4-9b95-e9744dfb10b9 req-60416b49-01a3-469b-be1a-78cc0fc58d14 tempest-TestVolumeBootPattern-343249266 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:44:47.730447 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-9abd15e9-dab3-44d4-9b95-e9744dfb10b9 req-60416b49-01a3-469b-be1a-78cc0fc58d14 tempest-TestVolumeBootPattern-343249266 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:44:47.908521 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-9abd15e9-dab3-44d4-9b95-e9744dfb10b9 req-60416b49-01a3-469b-be1a-78cc0fc58d14 tempest-TestVolumeBootPattern-343249266 None] deleting rbd volume volume-f13b6e40-0105-40ef-8eda-4c160169087e {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:44:47.917808 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-93bbdf6f-6ebb-4894-9aa7-da25dfdf6c1c req-d5482849-dc3b-4eeb-a7f9-779f6fe3bc9b tempest-VolumesSnapshotTestJSON-2065732980 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.001s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:44:47.917808 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-93bbdf6f-6ebb-4894-9aa7-da25dfdf6c1c req-d5482849-dc3b-4eeb-a7f9-779f6fe3bc9b tempest-VolumesSnapshotTestJSON-2065732980 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0073fe3d-0903-4f84-8e07-7e6bd96bbf32', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'efef91cd-d8f8-4d93-9ad2-86d0b33251f4', 'volume_id': '0073fe3d-0903-4f84-8e07-7e6bd96bbf32', 'discard': True}} {{(pid=124407) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} May 21 21:44:48.104600 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-93bbdf6f-6ebb-4894-9aa7-da25dfdf6c1c req-d5482849-dc3b-4eeb-a7f9-779f6fe3bc9b tempest-VolumesSnapshotTestJSON-2065732980 None] Connection info returned from driver {'name': 'volumes/volume-0073fe3d-0903-4f84-8e07-7e6bd96bbf32', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '0073fe3d-0903-4f84-8e07-7e6bd96bbf32', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '040173a9-6528-4720-9d96-0f31e72dca97'} {{(pid=124407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4826}} May 21 21:44:48.301063 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-93bbdf6f-6ebb-4894-9aa7-da25dfdf6c1c req-d5482849-dc3b-4eeb-a7f9-779f6fe3bc9b tempest-VolumesSnapshotTestJSON-2065732980 None] attachment_update completed successfully. May 21 21:44:51.500829 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=46,cinder:UPDATE=14,cinder:INSERT=11,cinder:DELETE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:44:51.515877 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-1b663660-3b58-409b-8464-795fc5896a8c tempest-VolumesSnapshotTestJSON-2065732980 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:44:52.929665 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1dbeb0e-2143-48ef-b6d5-ab575c6cd32a tempest-VolumesServicesTestJSON-90615119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:44:52.951855 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a1dbeb0e-2143-48ef-b6d5-ab575c6cd32a tempest-VolumesServicesTestJSON-90615119 None] Flow 'volume_create_manager' (96ad69c3-1807-4265-8922-a694ce28f753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:44:52.958251 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a1dbeb0e-2143-48ef-b6d5-ab575c6cd32a tempest-VolumesServicesTestJSON-90615119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7297bcdd-fb6c-4500-8344-7107c31a7f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:44:52.974078 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a1dbeb0e-2143-48ef-b6d5-ab575c6cd32a tempest-VolumesServicesTestJSON-90615119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7297bcdd-fb6c-4500-8344-7107c31a7f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1068629086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=be9b0277-19a6-443f-a400-eb5f0a56cdf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d16d28de3e7b435ea0335f079e3b0d83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:44:53Z,use_quota=True,user_id='05301d09b03c44d084e766d1a0e017f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:44:52.979851 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a1dbeb0e-2143-48ef-b6d5-ab575c6cd32a tempest-VolumesServicesTestJSON-90615119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea0cfc0d-d001-4406-b9e8-529eccd1bb40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:44:52.983912 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a1dbeb0e-2143-48ef-b6d5-ab575c6cd32a tempest-VolumesServicesTestJSON-90615119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea0cfc0d-d001-4406-b9e8-529eccd1bb40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:44:52.988920 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a1dbeb0e-2143-48ef-b6d5-ab575c6cd32a tempest-VolumesServicesTestJSON-90615119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12d11cd0-33fb-4745-8226-b8622005269f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:44:52.994539 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a1dbeb0e-2143-48ef-b6d5-ab575c6cd32a tempest-VolumesServicesTestJSON-90615119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12d11cd0-33fb-4745-8226-b8622005269f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be9b0277-19a6-443f-a400-eb5f0a56cdf2', 'volume_name': 'volume-be9b0277-19a6-443f-a400-eb5f0a56cdf2', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:44:52.999609 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a1dbeb0e-2143-48ef-b6d5-ab575c6cd32a tempest-VolumesServicesTestJSON-90615119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab783c63-cd8c-4a24-9a36-adb9ce175f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:44:53.003453 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a1dbeb0e-2143-48ef-b6d5-ab575c6cd32a tempest-VolumesServicesTestJSON-90615119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab783c63-cd8c-4a24-9a36-adb9ce175f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:44:53.009058 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a1dbeb0e-2143-48ef-b6d5-ab575c6cd32a tempest-VolumesServicesTestJSON-90615119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (958696f2-09f6-44a6-bea9-50e97e123943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:44:53.010254 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-a1dbeb0e-2143-48ef-b6d5-ab575c6cd32a tempest-VolumesServicesTestJSON-90615119 None] Volume be9b0277-19a6-443f-a400-eb5f0a56cdf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be9b0277-19a6-443f-a400-eb5f0a56cdf2', 'volume_size': 1} May 21 21:44:53.010766 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a1dbeb0e-2143-48ef-b6d5-ab575c6cd32a tempest-VolumesServicesTestJSON-90615119 None] creating volume 'volume-be9b0277-19a6-443f-a400-eb5f0a56cdf2' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:44:53.011530 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a1dbeb0e-2143-48ef-b6d5-ab575c6cd32a tempest-VolumesServicesTestJSON-90615119 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:44:53.034087 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-9abd15e9-dab3-44d4-9b95-e9744dfb10b9 req-60416b49-01a3-469b-be1a-78cc0fc58d14 tempest-TestVolumeBootPattern-343249266 None] volume is a clone so cleaning references {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1352}} May 21 21:44:53.197786 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-9abd15e9-dab3-44d4-9b95-e9744dfb10b9 req-60416b49-01a3-469b-be1a-78cc0fc58d14 tempest-TestVolumeBootPattern-343249266 None] deleting parent snapshot volume-f13b6e40-0105-40ef-8eda-4c160169087e.clone_snap {{(pid=124407) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1243}} May 21 21:44:56.129342 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:44:56.130115 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:44:56.151920 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:44:56.174706 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:44:56.180573 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a1dbeb0e-2143-48ef-b6d5-ab575c6cd32a tempest-VolumesServicesTestJSON-90615119 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:44:56.181671 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a1dbeb0e-2143-48ef-b6d5-ab575c6cd32a tempest-VolumesServicesTestJSON-90615119 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:44:56.185374 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a1dbeb0e-2143-48ef-b6d5-ab575c6cd32a tempest-VolumesServicesTestJSON-90615119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (958696f2-09f6-44a6-bea9-50e97e123943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be9b0277-19a6-443f-a400-eb5f0a56cdf2', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:44:56.189907 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a1dbeb0e-2143-48ef-b6d5-ab575c6cd32a tempest-VolumesServicesTestJSON-90615119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c577cec-6077-4f64-82f5-a9bca2697e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:44:56.264927 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-a1dbeb0e-2143-48ef-b6d5-ab575c6cd32a tempest-VolumesServicesTestJSON-90615119 None] Volume volume-be9b0277-19a6-443f-a400-eb5f0a56cdf2 (be9b0277-19a6-443f-a400-eb5f0a56cdf2): created successfully May 21 21:44:56.268208 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a1dbeb0e-2143-48ef-b6d5-ab575c6cd32a tempest-VolumesServicesTestJSON-90615119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c577cec-6077-4f64-82f5-a9bca2697e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:44:56.273753 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a1dbeb0e-2143-48ef-b6d5-ab575c6cd32a tempest-VolumesServicesTestJSON-90615119 None] Flow 'volume_create_manager' (96ad69c3-1807-4265-8922-a694ce28f753) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:44:56.279597 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [req-9abd15e9-dab3-44d4-9b95-e9744dfb10b9 req-60416b49-01a3-469b-be1a-78cc0fc58d14 tempest-TestVolumeBootPattern-343249266 None] Created reservations ['98af45cf-4e64-4b09-9d58-a93da01e7c16', 'b4acfd10-9467-4316-8905-a10c4b897940', 'f1b4ec5b-0bd5-42d5-8fe3-28aac88057b6', '9a28c2c7-12ec-48d0-b8f1-b955e8ff9a4b'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:44:56.339011 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-a1dbeb0e-2143-48ef-b6d5-ab575c6cd32a tempest-VolumesServicesTestJSON-90615119 None] Created volume successfully. May 21 21:44:56.467557 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=68,cinder:UPDATE=18,cinder:INSERT=13,cinder:DELETE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:44:56.545790 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-9abd15e9-dab3-44d4-9b95-e9744dfb10b9 req-60416b49-01a3-469b-be1a-78cc0fc58d14 tempest-TestVolumeBootPattern-343249266 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:44:56.576077 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-9abd15e9-dab3-44d4-9b95-e9744dfb10b9 req-60416b49-01a3-469b-be1a-78cc0fc58d14 tempest-TestVolumeBootPattern-343249266 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:44:56.602405 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [req-9abd15e9-dab3-44d4-9b95-e9744dfb10b9 req-60416b49-01a3-469b-be1a-78cc0fc58d14 tempest-TestVolumeBootPattern-343249266 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:44:56.611913 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-9abd15e9-dab3-44d4-9b95-e9744dfb10b9 req-60416b49-01a3-469b-be1a-78cc0fc58d14 tempest-TestVolumeBootPattern-343249266 None] Deleted volume successfully. May 21 21:44:56.716972 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-1b663660-3b58-409b-8464-795fc5896a8c tempest-VolumesSnapshotTestJSON-2065732980 None] Create snapshot completed successfully May 21 21:44:56.725852 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [req-9abd15e9-dab3-44d4-9b95-e9744dfb10b9 req-60416b49-01a3-469b-be1a-78cc0fc58d14 tempest-TestVolumeBootPattern-343249266 None] Lock "b'cinder-f13b6e40-0105-40ef-8eda-4c160169087e-delete_volume'" released by "delete_volume" :: held 9.344s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:44:57.110102 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-3386790a-740a-42da-920f-848371de860f tempest-VolumesServicesTestJSON-90615119 None] Lock "b'cinder-be9b0277-19a6-443f-a400-eb5f0a56cdf2-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:44:57.204439 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3386790a-740a-42da-920f-848371de860f tempest-VolumesServicesTestJSON-90615119 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:44:57.321238 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3386790a-740a-42da-920f-848371de860f tempest-VolumesServicesTestJSON-90615119 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:44:57.322125 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3386790a-740a-42da-920f-848371de860f tempest-VolumesServicesTestJSON-90615119 None] Volume volume-be9b0277-19a6-443f-a400-eb5f0a56cdf2 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:44:57.413523 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3386790a-740a-42da-920f-848371de860f tempest-VolumesServicesTestJSON-90615119 None] deleting rbd volume volume-be9b0277-19a6-443f-a400-eb5f0a56cdf2 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:44:58.039440 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-671333d8-31f7-44cc-82b2-780460a5b930 tempest-VolumesSnapshotTestJSON-2065732980 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:45:00.927889 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-671333d8-31f7-44cc-82b2-780460a5b930 tempest-VolumesSnapshotTestJSON-2065732980 None] Create snapshot completed successfully May 21 21:45:01.675384 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-95bcf259-ad73-48b1-ac8f-b753c7db6009 tempest-VolumesSnapshotTestJSON-2065732980 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:45:02.638224 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee2f2559-5831-4284-aaaf-121b563a60f7 tempest-TestVolumeBootPattern-343249266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:45:02.658719 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ee2f2559-5831-4284-aaaf-121b563a60f7 tempest-TestVolumeBootPattern-343249266 None] Flow 'volume_create_manager' (a33e82d9-0a5a-4e95-aa37-0b47279c9fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:45:02.665071 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ee2f2559-5831-4284-aaaf-121b563a60f7 tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa0a9b58-9ce5-4577-87f0-c42659782d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:45:02.692275 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ee2f2559-5831-4284-aaaf-121b563a60f7 tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa0a9b58-9ce5-4577-87f0-c42659782d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:45:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-884321801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0e7a744e-a92c-4fa2-bdf3-fe7de7654651,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8149564857f64342aef93f18c0d90eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:45:02Z,use_quota=True,user_id='730839d5531644eb9aa26dabe2fbd8f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:45:02.697499 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ee2f2559-5831-4284-aaaf-121b563a60f7 tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44a53bf6-f355-45c3-ae50-02482353f8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:45:02.702663 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ee2f2559-5831-4284-aaaf-121b563a60f7 tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44a53bf6-f355-45c3-ae50-02482353f8a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:45:02.707588 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ee2f2559-5831-4284-aaaf-121b563a60f7 tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c5cffe4-ed6a-479a-9169-f3781754d60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:45:02.801354 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ee2f2559-5831-4284-aaaf-121b563a60f7 tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c5cffe4-ed6a-479a-9169-f3781754d60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0e7a744e-a92c-4fa2-bdf3-fe7de7654651', 'volume_name': 'volume-0e7a744e-a92c-4fa2-bdf3-fe7de7654651', 'volume_size': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5593f8cb452404083dfa177b4ee68b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'created_at': datetime.datetime(2022, 5, 21, 21, 0, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:45:02.806436 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ee2f2559-5831-4284-aaaf-121b563a60f7 tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d65380f5-7552-4391-a37b-5174bc6e8fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:45:02.810507 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ee2f2559-5831-4284-aaaf-121b563a60f7 tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d65380f5-7552-4391-a37b-5174bc6e8fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:45:02.815143 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ee2f2559-5831-4284-aaaf-121b563a60f7 tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3918e9e6-156b-4ab8-bcd4-ea606140f308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:45:02.816273 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-ee2f2559-5831-4284-aaaf-121b563a60f7 tempest-TestVolumeBootPattern-343249266 None] Volume 0e7a744e-a92c-4fa2-bdf3-fe7de7654651: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0e7a744e-a92c-4fa2-bdf3-fe7de7654651', 'volume_size': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5593f8cb452404083dfa177b4ee68b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'created_at': datetime.datetime(2022, 5, 21, 21, 0, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } May 21 21:45:02.816871 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee2f2559-5831-4284-aaaf-121b563a60f7 tempest-TestVolumeBootPattern-343249266 None] Cloning 0e7a744e-a92c-4fa2-bdf3-fe7de7654651 from image e570f5eb-6047-4214-a420-fdfdbdf19a4c at location (None, None). {{(pid=124407) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1053}} May 21 21:45:02.825734 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-ee2f2559-5831-4284-aaaf-121b563a60f7 tempest-TestVolumeBootPattern-343249266 None] Lock "b'cinder-e570f5eb-6047-4214-a420-fdfdbdf19a4c'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:45:02.841353 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-3386790a-740a-42da-920f-848371de860f tempest-VolumesServicesTestJSON-90615119 None] Created reservations ['f17fdc0c-eff3-4149-bf1b-8fdf4f11d3f4', '5b05e508-a3d5-475e-8e72-fd329fed996a', '8e796461-13e1-4c4a-8f98-c80e8d85d303', '14d5d6ab-772c-49bb-88d9-bf40b98185d5'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:45:02.915659 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-ee2f2559-5831-4284-aaaf-121b563a60f7 tempest-TestVolumeBootPattern-343249266 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'volume_id': '4057e637-23ba-493f-a45d-eb28c07ac60a', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28), 'last_used': datetime.datetime(2022, 5, 21, 21, 45, 2, 829710)}. {{(pid=124407) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 21 21:45:02.916151 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-ee2f2559-5831-4284-aaaf-121b563a60f7 tempest-TestVolumeBootPattern-343249266 None] Image-volume cache entry image_update_at = 2022-05-21 21:00:28+00:00, requested image updated_at = 2022-05-21 21:00:28+00:00. {{(pid=124407) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 21 21:45:02.917909 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee2f2559-5831-4284-aaaf-121b563a60f7 tempest-TestVolumeBootPattern-343249266 None] Found cache entry for image = e570f5eb-6047-4214-a420-fdfdbdf19a4c on host ncdv-master-1@ceph#ceph. {{(pid=124407) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:876}} May 21 21:45:02.924893 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-ee2f2559-5831-4284-aaaf-121b563a60f7 tempest-TestVolumeBootPattern-343249266 None] Lock "b'cinder-e570f5eb-6047-4214-a420-fdfdbdf19a4c'" released by "_prepare_image_cache_entry" :: held 0.099s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:45:02.925935 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee2f2559-5831-4284-aaaf-121b563a60f7 tempest-TestVolumeBootPattern-343249266 None] Attempting to retrieve cache entry for image = e570f5eb-6047-4214-a420-fdfdbdf19a4c on host ncdv-master-1@ceph#ceph. {{(pid=124407) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:817}} May 21 21:45:02.938120 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-ee2f2559-5831-4284-aaaf-121b563a60f7 tempest-TestVolumeBootPattern-343249266 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'volume_id': '4057e637-23ba-493f-a45d-eb28c07ac60a', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28), 'last_used': datetime.datetime(2022, 5, 21, 21, 45, 2, 929909)}. {{(pid=124407) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 21 21:45:02.938681 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-ee2f2559-5831-4284-aaaf-121b563a60f7 tempest-TestVolumeBootPattern-343249266 None] Image-volume cache entry image_update_at = 2022-05-21 21:00:28+00:00, requested image updated_at = 2022-05-21 21:00:28+00:00. {{(pid=124407) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 21 21:45:02.939081 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee2f2559-5831-4284-aaaf-121b563a60f7 tempest-TestVolumeBootPattern-343249266 None] Creating from source image-volume 4057e637-23ba-493f-a45d-eb28c07ac60a {{(pid=124407) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:831}} May 21 21:45:02.958489 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ee2f2559-5831-4284-aaaf-121b563a60f7 tempest-TestVolumeBootPattern-343249266 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:45:03.235719 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ee2f2559-5831-4284-aaaf-121b563a60f7 tempest-TestVolumeBootPattern-343249266 None] creating snapshot='volume-0e7a744e-a92c-4fa2-bdf3-fe7de7654651.clone_snap' {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 21 21:45:04.666334 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ee2f2559-5831-4284-aaaf-121b563a60f7 tempest-TestVolumeBootPattern-343249266 None] cloning 'volume-4057e637-23ba-493f-a45d-eb28c07ac60a@volume-0e7a744e-a92c-4fa2-bdf3-fe7de7654651.clone_snap' to 'volume-0e7a744e-a92c-4fa2-bdf3-fe7de7654651' {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:789}} May 21 21:45:04.768462 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3386790a-740a-42da-920f-848371de860f tempest-VolumesServicesTestJSON-90615119 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:45:04.797058 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3386790a-740a-42da-920f-848371de860f tempest-VolumesServicesTestJSON-90615119 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:45:04.827521 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-3386790a-740a-42da-920f-848371de860f tempest-VolumesServicesTestJSON-90615119 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:45:04.835430 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-3386790a-740a-42da-920f-848371de860f tempest-VolumesServicesTestJSON-90615119 None] Deleted volume successfully. May 21 21:45:04.949188 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-3386790a-740a-42da-920f-848371de860f tempest-VolumesServicesTestJSON-90615119 None] Lock "b'cinder-be9b0277-19a6-443f-a400-eb5f0a56cdf2-delete_volume'" released by "delete_volume" :: held 7.840s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:45:05.044868 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=56,cinder:UPDATE=23,cinder:INSERT=18,cinder:DELETE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:45:05.254374 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-95bcf259-ad73-48b1-ac8f-b753c7db6009 tempest-VolumesSnapshotTestJSON-2065732980 None] Create snapshot completed successfully May 21 21:45:05.655970 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-ebbd3524-d28a-470f-a9a7-4de4c4beb28e tempest-VolumesSnapshotTestJSON-2065732980 None] Lock "b'cinder-83dd1036-da1d-4485-92ad-1bf41894ffdf-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:45:05.662395 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ebbd3524-d28a-470f-a9a7-4de4c4beb28e tempest-VolumesSnapshotTestJSON-2065732980 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:45:05.930150 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ee2f2559-5831-4284-aaaf-121b563a60f7 tempest-TestVolumeBootPattern-343249266 None] Volume volume-b9ebacac-5f32-42e3-9194-003aee7e2435.deleted is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:45:05.931376 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ee2f2559-5831-4284-aaaf-121b563a60f7 tempest-TestVolumeBootPattern-343249266 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:45:05.931995 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ee2f2559-5831-4284-aaaf-121b563a60f7 tempest-TestVolumeBootPattern-343249266 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:45:06.565655 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ee2f2559-5831-4284-aaaf-121b563a60f7 tempest-TestVolumeBootPattern-343249266 None] clone created successfully {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:862}} May 21 21:45:06.566282 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.volume_utils [None req-ee2f2559-5831-4284-aaaf-121b563a60f7 tempest-TestVolumeBootPattern-343249266 None] Marking volume 0e7a744e-a92c-4fa2-bdf3-fe7de7654651 as bootable. {{(pid=124407) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} May 21 21:45:06.624578 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee2f2559-5831-4284-aaaf-121b563a60f7 tempest-TestVolumeBootPattern-343249266 None] Copying metadata from image e570f5eb-6047-4214-a420-fdfdbdf19a4c to 0e7a744e-a92c-4fa2-bdf3-fe7de7654651. {{(pid=124407) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} May 21 21:45:06.625075 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee2f2559-5831-4284-aaaf-121b563a60f7 tempest-TestVolumeBootPattern-343249266 None] Creating volume glance metadata for volume 0e7a744e-a92c-4fa2-bdf3-fe7de7654651 backed by image e570f5eb-6047-4214-a420-fdfdbdf19a4c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=124407) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:673}} May 21 21:45:06.755012 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ee2f2559-5831-4284-aaaf-121b563a60f7 tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3918e9e6-156b-4ab8-bcd4-ea606140f308) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e7a744e-a92c-4fa2-bdf3-fe7de7654651', 'volume_size': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5593f8cb452404083dfa177b4ee68b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'created_at': datetime.datetime(2022, 5, 21, 21, 0, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:45:06.759966 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ee2f2559-5831-4284-aaaf-121b563a60f7 tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31e2aa1a-2352-4708-af03-c1e31f01e59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:45:06.847499 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-ee2f2559-5831-4284-aaaf-121b563a60f7 tempest-TestVolumeBootPattern-343249266 None] Volume volume-0e7a744e-a92c-4fa2-bdf3-fe7de7654651 (0e7a744e-a92c-4fa2-bdf3-fe7de7654651): created successfully May 21 21:45:06.851239 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ee2f2559-5831-4284-aaaf-121b563a60f7 tempest-TestVolumeBootPattern-343249266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31e2aa1a-2352-4708-af03-c1e31f01e59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:45:06.856992 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ee2f2559-5831-4284-aaaf-121b563a60f7 tempest-TestVolumeBootPattern-343249266 None] Flow 'volume_create_manager' (a33e82d9-0a5a-4e95-aa37-0b47279c9fe8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:45:06.933443 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-ee2f2559-5831-4284-aaaf-121b563a60f7 tempest-TestVolumeBootPattern-343249266 None] Created volume successfully. May 21 21:45:11.425189 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-d4066eff-58f1-438b-b1c9-7828d55248e0 req-a48eca12-ffe3-4c28-a23d-cb8c24da4e7b tempest-TestVolumeBootPattern-343249266 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:45:12.092229 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-d4066eff-58f1-438b-b1c9-7828d55248e0 req-a48eca12-ffe3-4c28-a23d-cb8c24da4e7b tempest-TestVolumeBootPattern-343249266 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.667s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:45:12.093090 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-d4066eff-58f1-438b-b1c9-7828d55248e0 req-a48eca12-ffe3-4c28-a23d-cb8c24da4e7b tempest-TestVolumeBootPattern-343249266 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0e7a744e-a92c-4fa2-bdf3-fe7de7654651', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'efef91cd-d8f8-4d93-9ad2-86d0b33251f4', 'volume_id': '0e7a744e-a92c-4fa2-bdf3-fe7de7654651', 'discard': True}} {{(pid=124407) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} May 21 21:45:12.218589 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-d4066eff-58f1-438b-b1c9-7828d55248e0 req-a48eca12-ffe3-4c28-a23d-cb8c24da4e7b tempest-TestVolumeBootPattern-343249266 None] Connection info returned from driver {'name': 'volumes/volume-0e7a744e-a92c-4fa2-bdf3-fe7de7654651', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '0e7a744e-a92c-4fa2-bdf3-fe7de7654651', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0db01838-7d30-46fd-80f0-897b39a1c6b7'} {{(pid=124407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4826}} May 21 21:45:12.404259 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-d4066eff-58f1-438b-b1c9-7828d55248e0 req-a48eca12-ffe3-4c28-a23d-cb8c24da4e7b tempest-TestVolumeBootPattern-343249266 None] attachment_update completed successfully. May 21 21:45:15.393044 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-373e508d-d6e3-4ab7-8014-3b073809e360 tempest-VolumeSnapshotQuotasNegativeTestJSON-390520460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:45:15.415881 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-373e508d-d6e3-4ab7-8014-3b073809e360 tempest-VolumeSnapshotQuotasNegativeTestJSON-390520460 None] Flow 'volume_create_manager' (dbed4ff6-177d-485a-9fb9-f874807a3af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:45:15.423700 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-373e508d-d6e3-4ab7-8014-3b073809e360 tempest-VolumeSnapshotQuotasNegativeTestJSON-390520460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd0a4e55-575d-4288-b69c-00346a5aab11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:45:15.441280 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-373e508d-d6e3-4ab7-8014-3b073809e360 tempest-VolumeSnapshotQuotasNegativeTestJSON-390520460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd0a4e55-575d-4288-b69c-00346a5aab11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:45:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-263717251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ea6ba78f-259d-45c5-aa14-7bf6891ad674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a11aa9bd8704075ba9aef7d649ff606',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:45:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:45:15Z,use_quota=True,user_id='2f36db1c216d4b58bbff492d96480ee3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:45:15.447819 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-373e508d-d6e3-4ab7-8014-3b073809e360 tempest-VolumeSnapshotQuotasNegativeTestJSON-390520460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50340fcd-f41f-4b2e-a115-d6fab91d0f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:45:15.452738 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-373e508d-d6e3-4ab7-8014-3b073809e360 tempest-VolumeSnapshotQuotasNegativeTestJSON-390520460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50340fcd-f41f-4b2e-a115-d6fab91d0f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:45:15.458252 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-373e508d-d6e3-4ab7-8014-3b073809e360 tempest-VolumeSnapshotQuotasNegativeTestJSON-390520460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f525723f-5e65-4ae6-a755-488f29a5c361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:45:15.462687 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-373e508d-d6e3-4ab7-8014-3b073809e360 tempest-VolumeSnapshotQuotasNegativeTestJSON-390520460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f525723f-5e65-4ae6-a755-488f29a5c361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea6ba78f-259d-45c5-aa14-7bf6891ad674', 'volume_name': 'volume-ea6ba78f-259d-45c5-aa14-7bf6891ad674', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:45:15.468630 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-373e508d-d6e3-4ab7-8014-3b073809e360 tempest-VolumeSnapshotQuotasNegativeTestJSON-390520460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88159c52-6716-4e2b-a12b-682bc18c70a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:45:15.477054 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-373e508d-d6e3-4ab7-8014-3b073809e360 tempest-VolumeSnapshotQuotasNegativeTestJSON-390520460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88159c52-6716-4e2b-a12b-682bc18c70a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:45:15.483336 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-373e508d-d6e3-4ab7-8014-3b073809e360 tempest-VolumeSnapshotQuotasNegativeTestJSON-390520460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d3fec44-eb5d-4f9b-935d-cf532b5afd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:45:15.484631 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-373e508d-d6e3-4ab7-8014-3b073809e360 tempest-VolumeSnapshotQuotasNegativeTestJSON-390520460 None] Volume ea6ba78f-259d-45c5-aa14-7bf6891ad674: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea6ba78f-259d-45c5-aa14-7bf6891ad674', 'volume_size': 1} May 21 21:45:15.485143 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-373e508d-d6e3-4ab7-8014-3b073809e360 tempest-VolumeSnapshotQuotasNegativeTestJSON-390520460 None] creating volume 'volume-ea6ba78f-259d-45c5-aa14-7bf6891ad674' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:45:15.486422 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-373e508d-d6e3-4ab7-8014-3b073809e360 tempest-VolumeSnapshotQuotasNegativeTestJSON-390520460 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:45:16.173780 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-373e508d-d6e3-4ab7-8014-3b073809e360 tempest-VolumeSnapshotQuotasNegativeTestJSON-390520460 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:45:16.174647 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-373e508d-d6e3-4ab7-8014-3b073809e360 tempest-VolumeSnapshotQuotasNegativeTestJSON-390520460 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:45:16.179077 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-373e508d-d6e3-4ab7-8014-3b073809e360 tempest-VolumeSnapshotQuotasNegativeTestJSON-390520460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d3fec44-eb5d-4f9b-935d-cf532b5afd17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea6ba78f-259d-45c5-aa14-7bf6891ad674', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:45:16.184945 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-373e508d-d6e3-4ab7-8014-3b073809e360 tempest-VolumeSnapshotQuotasNegativeTestJSON-390520460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee6c0a55-c1e9-4148-859c-45164f573d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:45:16.253340 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-373e508d-d6e3-4ab7-8014-3b073809e360 tempest-VolumeSnapshotQuotasNegativeTestJSON-390520460 None] Volume volume-ea6ba78f-259d-45c5-aa14-7bf6891ad674 (ea6ba78f-259d-45c5-aa14-7bf6891ad674): created successfully May 21 21:45:16.258518 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-373e508d-d6e3-4ab7-8014-3b073809e360 tempest-VolumeSnapshotQuotasNegativeTestJSON-390520460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee6c0a55-c1e9-4148-859c-45164f573d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:45:16.265331 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-373e508d-d6e3-4ab7-8014-3b073809e360 tempest-VolumeSnapshotQuotasNegativeTestJSON-390520460 None] Flow 'volume_create_manager' (dbed4ff6-177d-485a-9fb9-f874807a3af9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:45:16.327770 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-373e508d-d6e3-4ab7-8014-3b073809e360 tempest-VolumeSnapshotQuotasNegativeTestJSON-390520460 None] Created volume successfully. May 21 21:45:16.331085 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=54,cinder:INSERT=27,cinder:UPDATE=15,cinder:DELETE=4 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:45:17.905399 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-419b097d-be4a-4b9c-bb4f-a04c3bdb1b4f tempest-VolumeSnapshotQuotasNegativeTestJSON-390520460 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:45:19.934133 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-419b097d-be4a-4b9c-bb4f-a04c3bdb1b4f tempest-VolumeSnapshotQuotasNegativeTestJSON-390520460 None] Create snapshot completed successfully May 21 21:45:21.768677 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-a6f3d701-b2d4-42ac-99be-926f950aa3f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-390520460 None] Lock "b'cinder-9a0b2fcf-3e2d-4d11-9d6f-9e104f95c6fb-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:45:21.770136 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a6f3d701-b2d4-42ac-99be-926f950aa3f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-390520460 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:45:23.927764 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-a6f3d701-b2d4-42ac-99be-926f950aa3f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-390520460 None] Created reservations ['fa823dc5-7ffb-4d39-9db9-b14a691e6d16', '9f8ffdbc-7282-4c30-9c12-bfdd7298c17e', '360fd855-1fb0-4c79-acab-e16d460cbce8', 'fbc85bd1-64da-4678-ae6f-60c234315d0e'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:45:24.077808 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-a6f3d701-b2d4-42ac-99be-926f950aa3f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-390520460 None] Delete snapshot completed successfully. May 21 21:45:24.086284 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-a6f3d701-b2d4-42ac-99be-926f950aa3f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-390520460 None] Lock "b'cinder-9a0b2fcf-3e2d-4d11-9d6f-9e104f95c6fb-delete_snapshot'" released by "delete_snapshot" :: held 2.318s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:45:25.066100 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-5dad3a6f-8c16-43c9-8831-a89fccf17d69 tempest-VolumeSnapshotQuotasNegativeTestJSON-390520460 None] Lock "b'cinder-ea6ba78f-259d-45c5-aa14-7bf6891ad674-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:45:25.173654 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-5dad3a6f-8c16-43c9-8831-a89fccf17d69 tempest-VolumeSnapshotQuotasNegativeTestJSON-390520460 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:45:25.401827 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-5dad3a6f-8c16-43c9-8831-a89fccf17d69 tempest-VolumeSnapshotQuotasNegativeTestJSON-390520460 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:45:25.402283 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-5dad3a6f-8c16-43c9-8831-a89fccf17d69 tempest-VolumeSnapshotQuotasNegativeTestJSON-390520460 None] Volume volume-ea6ba78f-259d-45c5-aa14-7bf6891ad674 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:45:25.505148 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-5dad3a6f-8c16-43c9-8831-a89fccf17d69 tempest-VolumeSnapshotQuotasNegativeTestJSON-390520460 None] deleting rbd volume volume-ea6ba78f-259d-45c5-aa14-7bf6891ad674 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:45:28.957329 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-5dad3a6f-8c16-43c9-8831-a89fccf17d69 tempest-VolumeSnapshotQuotasNegativeTestJSON-390520460 None] Created reservations ['0fc546c6-3cbb-473c-a4b5-83cf063812cc', '357be3c6-bf11-41e6-8a51-b8e9bf8074b3', '32e515af-2167-4041-8130-2e18fe279872', '43f4f371-71da-42b7-b7a4-5dbed1f87f70'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:45:29.248896 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-5dad3a6f-8c16-43c9-8831-a89fccf17d69 tempest-VolumeSnapshotQuotasNegativeTestJSON-390520460 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:45:29.274780 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-5dad3a6f-8c16-43c9-8831-a89fccf17d69 tempest-VolumeSnapshotQuotasNegativeTestJSON-390520460 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:45:29.547166 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-5dad3a6f-8c16-43c9-8831-a89fccf17d69 tempest-VolumeSnapshotQuotasNegativeTestJSON-390520460 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:45:29.556035 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-5dad3a6f-8c16-43c9-8831-a89fccf17d69 tempest-VolumeSnapshotQuotasNegativeTestJSON-390520460 None] Deleted volume successfully. May 21 21:45:29.659397 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-5dad3a6f-8c16-43c9-8831-a89fccf17d69 tempest-VolumeSnapshotQuotasNegativeTestJSON-390520460 None] Lock "b'cinder-ea6ba78f-259d-45c5-aa14-7bf6891ad674-delete_volume'" released by "delete_volume" :: held 4.593s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:45:36.585714 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=61,cinder:UPDATE=24,cinder:INSERT=6,cinder:DELETE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:45:37.087514 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-ebbd3524-d28a-470f-a9a7-4de4c4beb28e tempest-VolumesSnapshotTestJSON-2065732980 None] Created reservations ['677e5e24-06a9-4899-b48d-e0c63a630f67', '2d5976c6-39ca-43e9-b377-e9266ccc596e', 'fa15be6e-3db9-4855-99fb-818956ca33eb', 'de533dbe-bae9-434f-b483-d5a78f272edc'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:45:37.390985 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-ebbd3524-d28a-470f-a9a7-4de4c4beb28e tempest-VolumesSnapshotTestJSON-2065732980 None] Delete snapshot completed successfully. May 21 21:45:37.395655 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-ebbd3524-d28a-470f-a9a7-4de4c4beb28e tempest-VolumesSnapshotTestJSON-2065732980 None] Lock "b'cinder-83dd1036-da1d-4485-92ad-1bf41894ffdf-delete_snapshot'" released by "delete_snapshot" :: held 31.740s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:45:37.769997 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-b75a8af1-fa4d-4243-815d-12b6e0b04158 tempest-VolumesSnapshotTestJSON-2065732980 None] Lock "b'cinder-f74f6b92-66b4-48d7-ae7c-e220393ef001-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:45:37.772065 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b75a8af1-fa4d-4243-815d-12b6e0b04158 tempest-VolumesSnapshotTestJSON-2065732980 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:45:41.180346 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-853c1b45-0e6c-4465-b021-26f17d2f212e tempest-VolumesBackupsTest-1124201519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:45:41.203116 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-853c1b45-0e6c-4465-b021-26f17d2f212e tempest-VolumesBackupsTest-1124201519 None] Flow 'volume_create_manager' (ebed99ec-8b25-44b5-b247-6421fe0c255c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:45:41.210122 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-853c1b45-0e6c-4465-b021-26f17d2f212e tempest-VolumesBackupsTest-1124201519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b10b1ec-c51c-4cda-9b4b-8d24851efb37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:45:41.231113 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-853c1b45-0e6c-4465-b021-26f17d2f212e tempest-VolumesBackupsTest-1124201519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b10b1ec-c51c-4cda-9b4b-8d24851efb37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-749748578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7165abec-f3d0-4873-a873-13811bf90dbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3ad039cefcd45fa827017cf6c30c895',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:45:41Z,use_quota=True,user_id='5c8068f63a974cf09e08695c80e57871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:45:41.238316 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-853c1b45-0e6c-4465-b021-26f17d2f212e tempest-VolumesBackupsTest-1124201519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f72f4b5-f99d-47d7-ae4a-de7f6c33f9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:45:41.243486 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-853c1b45-0e6c-4465-b021-26f17d2f212e tempest-VolumesBackupsTest-1124201519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f72f4b5-f99d-47d7-ae4a-de7f6c33f9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:45:41.250825 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-853c1b45-0e6c-4465-b021-26f17d2f212e tempest-VolumesBackupsTest-1124201519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c119ccd5-11fb-4ebf-b3e5-bc08b8022933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:45:41.256980 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-853c1b45-0e6c-4465-b021-26f17d2f212e tempest-VolumesBackupsTest-1124201519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c119ccd5-11fb-4ebf-b3e5-bc08b8022933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7165abec-f3d0-4873-a873-13811bf90dbd', 'volume_name': 'volume-7165abec-f3d0-4873-a873-13811bf90dbd', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:45:41.263150 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-853c1b45-0e6c-4465-b021-26f17d2f212e tempest-VolumesBackupsTest-1124201519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eb0d94a-7ad5-42e5-90c1-49af354689b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:45:41.270761 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-853c1b45-0e6c-4465-b021-26f17d2f212e tempest-VolumesBackupsTest-1124201519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eb0d94a-7ad5-42e5-90c1-49af354689b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:45:41.277591 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-853c1b45-0e6c-4465-b021-26f17d2f212e tempest-VolumesBackupsTest-1124201519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ca59130-37a5-4b80-b27b-95d1163122a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:45:41.278811 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-853c1b45-0e6c-4465-b021-26f17d2f212e tempest-VolumesBackupsTest-1124201519 None] Volume 7165abec-f3d0-4873-a873-13811bf90dbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7165abec-f3d0-4873-a873-13811bf90dbd', 'volume_size': 1} May 21 21:45:41.279213 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-853c1b45-0e6c-4465-b021-26f17d2f212e tempest-VolumesBackupsTest-1124201519 None] creating volume 'volume-7165abec-f3d0-4873-a873-13811bf90dbd' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:45:41.280549 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-853c1b45-0e6c-4465-b021-26f17d2f212e tempest-VolumesBackupsTest-1124201519 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:45:42.148026 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-853c1b45-0e6c-4465-b021-26f17d2f212e tempest-VolumesBackupsTest-1124201519 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:45:42.148441 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-853c1b45-0e6c-4465-b021-26f17d2f212e tempest-VolumesBackupsTest-1124201519 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:45:42.152063 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-853c1b45-0e6c-4465-b021-26f17d2f212e tempest-VolumesBackupsTest-1124201519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ca59130-37a5-4b80-b27b-95d1163122a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7165abec-f3d0-4873-a873-13811bf90dbd', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:45:42.156795 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-853c1b45-0e6c-4465-b021-26f17d2f212e tempest-VolumesBackupsTest-1124201519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b4ea4af-9de7-4ba2-9849-3db1512e7dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:45:42.208231 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-853c1b45-0e6c-4465-b021-26f17d2f212e tempest-VolumesBackupsTest-1124201519 None] Volume volume-7165abec-f3d0-4873-a873-13811bf90dbd (7165abec-f3d0-4873-a873-13811bf90dbd): created successfully May 21 21:45:42.211909 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-853c1b45-0e6c-4465-b021-26f17d2f212e tempest-VolumesBackupsTest-1124201519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b4ea4af-9de7-4ba2-9849-3db1512e7dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:45:42.218081 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-853c1b45-0e6c-4465-b021-26f17d2f212e tempest-VolumesBackupsTest-1124201519 None] Flow 'volume_create_manager' (ebed99ec-8b25-44b5-b247-6421fe0c255c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:45:42.294407 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-853c1b45-0e6c-4465-b021-26f17d2f212e tempest-VolumesBackupsTest-1124201519 None] Created volume successfully. May 21 21:45:46.581197 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=52,cinder:UPDATE=24,cinder:DELETE=1,cinder:INSERT=9 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:45:56.130684 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:45:56.131433 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:45:56.158688 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:45:56.190623 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:45:58.245820 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-36749a68-86a3-476d-9d6e-e1c29d0ecd13 req-8f51e038-bf06-44a3-9ca2-33f4826987ac tempest-VolumesBackupsTest-1124201519 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:45:58.886468 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-36749a68-86a3-476d-9d6e-e1c29d0ecd13 req-8f51e038-bf06-44a3-9ca2-33f4826987ac tempest-VolumesBackupsTest-1124201519 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.640s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:45:58.887306 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-36749a68-86a3-476d-9d6e-e1c29d0ecd13 req-8f51e038-bf06-44a3-9ca2-33f4826987ac tempest-VolumesBackupsTest-1124201519 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7165abec-f3d0-4873-a873-13811bf90dbd', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'efef91cd-d8f8-4d93-9ad2-86d0b33251f4', 'volume_id': '7165abec-f3d0-4873-a873-13811bf90dbd', 'discard': True}} {{(pid=124407) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} May 21 21:45:59.025707 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-36749a68-86a3-476d-9d6e-e1c29d0ecd13 req-8f51e038-bf06-44a3-9ca2-33f4826987ac tempest-VolumesBackupsTest-1124201519 None] Connection info returned from driver {'name': 'volumes/volume-7165abec-f3d0-4873-a873-13811bf90dbd', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '7165abec-f3d0-4873-a873-13811bf90dbd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '1455698b-0c2f-4a39-aa7f-11f302c6dcb3'} {{(pid=124407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4826}} May 21 21:45:59.142710 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-36749a68-86a3-476d-9d6e-e1c29d0ecd13 req-8f51e038-bf06-44a3-9ca2-33f4826987ac tempest-VolumesBackupsTest-1124201519 None] attachment_update completed successfully. May 21 21:46:03.363696 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-6b1ae61f-ba64-4ade-8642-9715cc6be72f tempest-VolumesBackupsTest-1124201519 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-05-21T21:46:02Z,data_timestamp=2022-05-21T21:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-418639716',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=3e80ecaa-af96-4743-9433-e36f6b4abf89,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='a3ad039cefcd45fa827017cf6c30c895',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='5c8068f63a974cf09e08695c80e57871',volume_id=7165abec-f3d0-4873-a873-13811bf90dbd) May 21 21:46:03.364947 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.backup.rpcapi [None req-6b1ae61f-ba64-4ade-8642-9715cc6be72f tempest-VolumesBackupsTest-1124201519 None] continue_backup in rpcapi backup_id 3e80ecaa-af96-4743-9433-e36f6b4abf89 {{(pid=124407) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} May 21 21:46:03.522807 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [None req-6b1ae61f-ba64-4ade-8642-9715cc6be72f tempest-VolumesBackupsTest-1124201519 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:46:04.152718 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [None req-6b1ae61f-ba64-4ade-8642-9715cc6be72f tempest-VolumesBackupsTest-1124201519 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.630s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:46:04.153818 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6b1ae61f-ba64-4ade-8642-9715cc6be72f tempest-VolumesBackupsTest-1124201519 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7165abec-f3d0-4873-a873-13811bf90dbd', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'efef91cd-d8f8-4d93-9ad2-86d0b33251f4', 'volume_id': '7165abec-f3d0-4873-a873-13811bf90dbd', 'discard': True}} {{(pid=124407) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} May 21 21:46:04.170279 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-6b1ae61f-ba64-4ade-8642-9715cc6be72f tempest-VolumesBackupsTest-1124201519 None] Initialize volume connection completed successfully. May 21 21:46:08.693819 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=29,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:46:08.803101 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-b75a8af1-fa4d-4243-815d-12b6e0b04158 tempest-VolumesSnapshotTestJSON-2065732980 None] Created reservations ['887112cf-4291-4c94-ba76-edf45be3a09c', '1b4b050f-c5c7-4181-b04b-45afabc3690b', '20eeea3a-5ad9-4d20-a9e4-2be5e1c0f612', 'a19cec4e-42cf-49a5-b1cf-a555e46e6d10'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:46:09.071309 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-b75a8af1-fa4d-4243-815d-12b6e0b04158 tempest-VolumesSnapshotTestJSON-2065732980 None] Delete snapshot completed successfully. May 21 21:46:09.077514 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-b75a8af1-fa4d-4243-815d-12b6e0b04158 tempest-VolumesSnapshotTestJSON-2065732980 None] Lock "b'cinder-f74f6b92-66b4-48d7-ae7c-e220393ef001-delete_snapshot'" released by "delete_snapshot" :: held 31.307s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:46:09.803909 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-894d1de8-a64d-4bc1-9872-1ed093a70378 tempest-VolumesSnapshotTestJSON-2065732980 None] Lock "b'cinder-56d6027d-61c4-48dd-901e-9b9f0b486955-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:46:09.806233 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-894d1de8-a64d-4bc1-9872-1ed093a70378 tempest-VolumesSnapshotTestJSON-2065732980 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:46:11.271624 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-6b1ae61f-ba64-4ade-8642-9715cc6be72f tempest-VolumesBackupsTest-1124201519 None] Terminate volume connection completed successfully. May 21 21:46:11.290562 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-6b1ae61f-ba64-4ade-8642-9715cc6be72f tempest-VolumesBackupsTest-1124201519 None] Remove volume export completed successfully. May 21 21:46:26.076527 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-62bfc094-9b74-4532-8dee-af028493d60d req-32a738f5-0ad4-464b-a8be-159a1d2ee5d6 tempest-VolumesBackupsTest-1124201519 None] Terminate volume connection completed successfully. May 21 21:46:26.077161 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-62bfc094-9b74-4532-8dee-af028493d60d req-32a738f5-0ad4-464b-a8be-159a1d2ee5d6 tempest-VolumesBackupsTest-1124201519 None] Deleting attachment 1455698b-0c2f-4a39-aa7f-11f302c6dcb3. {{(pid=124407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4957}} May 21 21:46:26.313197 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9505623-c94d-4ade-93be-83576eb7df66 tempest-VolumesActionsTest-1843210645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:46:26.332475 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a9505623-c94d-4ade-93be-83576eb7df66 tempest-VolumesActionsTest-1843210645 None] Flow 'volume_create_manager' (9dcd8bac-e053-401d-9219-0847fdfb1c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:46:26.339602 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a9505623-c94d-4ade-93be-83576eb7df66 tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92b93133-5463-4187-a7d7-5e9e008dd094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:46:26.356613 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a9505623-c94d-4ade-93be-83576eb7df66 tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92b93133-5463-4187-a7d7-5e9e008dd094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:46:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1311981681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=588208c8-6177-436d-8f83-464854ff136f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e77549b3c184b4ba121a88322438858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:46:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:46:26Z,use_quota=True,user_id='5af6cf74a0ee4034891f69eeb773848c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:46:26.362079 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a9505623-c94d-4ade-93be-83576eb7df66 tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dac365b5-c694-49e3-9db4-1368a0588ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:46:26.366170 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a9505623-c94d-4ade-93be-83576eb7df66 tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dac365b5-c694-49e3-9db4-1368a0588ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:46:26.371398 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a9505623-c94d-4ade-93be-83576eb7df66 tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60cb3522-54c8-4397-b719-ad71d975f2cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:46:26.375501 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a9505623-c94d-4ade-93be-83576eb7df66 tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60cb3522-54c8-4397-b719-ad71d975f2cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '588208c8-6177-436d-8f83-464854ff136f', 'volume_name': 'volume-588208c8-6177-436d-8f83-464854ff136f', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:46:26.380363 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a9505623-c94d-4ade-93be-83576eb7df66 tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34bf22ed-a8e3-4191-9712-03b3a79a069d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:46:26.384203 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a9505623-c94d-4ade-93be-83576eb7df66 tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34bf22ed-a8e3-4191-9712-03b3a79a069d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:46:26.388979 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a9505623-c94d-4ade-93be-83576eb7df66 tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57fb88ac-95d5-4638-b72f-bea6ac96fbaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:46:26.390499 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-a9505623-c94d-4ade-93be-83576eb7df66 tempest-VolumesActionsTest-1843210645 None] Volume 588208c8-6177-436d-8f83-464854ff136f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-588208c8-6177-436d-8f83-464854ff136f', 'volume_size': 1} May 21 21:46:26.390499 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a9505623-c94d-4ade-93be-83576eb7df66 tempest-VolumesActionsTest-1843210645 None] creating volume 'volume-588208c8-6177-436d-8f83-464854ff136f' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:46:26.391252 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a9505623-c94d-4ade-93be-83576eb7df66 tempest-VolumesActionsTest-1843210645 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:46:27.421289 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a9505623-c94d-4ade-93be-83576eb7df66 tempest-VolumesActionsTest-1843210645 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:46:27.421939 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a9505623-c94d-4ade-93be-83576eb7df66 tempest-VolumesActionsTest-1843210645 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:46:27.425364 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a9505623-c94d-4ade-93be-83576eb7df66 tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57fb88ac-95d5-4638-b72f-bea6ac96fbaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-588208c8-6177-436d-8f83-464854ff136f', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:46:27.430834 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a9505623-c94d-4ade-93be-83576eb7df66 tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a275d982-22f0-405e-b14d-03dd9206240a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:46:27.435663 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=43,cinder:UPDATE=16,cinder:INSERT=4 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:46:27.567897 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-a9505623-c94d-4ade-93be-83576eb7df66 tempest-VolumesActionsTest-1843210645 None] Volume volume-588208c8-6177-436d-8f83-464854ff136f (588208c8-6177-436d-8f83-464854ff136f): created successfully May 21 21:46:27.571772 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a9505623-c94d-4ade-93be-83576eb7df66 tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a275d982-22f0-405e-b14d-03dd9206240a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:46:27.577442 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a9505623-c94d-4ade-93be-83576eb7df66 tempest-VolumesActionsTest-1843210645 None] Flow 'volume_create_manager' (9dcd8bac-e053-401d-9219-0847fdfb1c3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:46:27.666301 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-a9505623-c94d-4ade-93be-83576eb7df66 tempest-VolumesActionsTest-1843210645 None] Created volume successfully. May 21 21:46:28.213677 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-d2fd4dbf-a74c-476b-a64b-c9716c110d3b tempest-VolumesActionsTest-1843210645 None] Lock "b'cinder-588208c8-6177-436d-8f83-464854ff136f'" acquired by "attach_volume" :: waited 0.009s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:46:28.432534 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-d2fd4dbf-a74c-476b-a64b-c9716c110d3b tempest-VolumesActionsTest-1843210645 None] Attaching volume 588208c8-6177-436d-8f83-464854ff136f to instance 42bac608-99d5-4044-b279-d7feccf1c673 at mountpoint /dev/sdb on host None. May 21 21:46:28.535350 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-d2fd4dbf-a74c-476b-a64b-c9716c110d3b tempest-VolumesActionsTest-1843210645 None] Attach volume completed successfully. May 21 21:46:28.539683 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-d2fd4dbf-a74c-476b-a64b-c9716c110d3b tempest-VolumesActionsTest-1843210645 None] Lock "b'cinder-588208c8-6177-436d-8f83-464854ff136f'" released by "attach_volume" :: held 0.326s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:46:29.037789 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-862597ad-391d-4896-98dd-8260210080d9 tempest-VolumesActionsTest-1641117326 None] Terminate volume connection completed successfully. May 21 21:46:29.069798 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-862597ad-391d-4896-98dd-8260210080d9 tempest-VolumesActionsTest-1641117326 None] Lock "b'cinder-588208c8-6177-436d-8f83-464854ff136f-detach_volume'" acquired by "detach_volume" :: waited 0.008s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:46:29.082099 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-862597ad-391d-4896-98dd-8260210080d9 tempest-VolumesActionsTest-1641117326 None] Detaching volume 588208c8-6177-436d-8f83-464854ff136f from instance 42bac608-99d5-4044-b279-d7feccf1c673. May 21 21:46:29.305759 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-862597ad-391d-4896-98dd-8260210080d9 tempest-VolumesActionsTest-1641117326 None] Detach volume completed successfully. May 21 21:46:29.311054 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-862597ad-391d-4896-98dd-8260210080d9 tempest-VolumesActionsTest-1641117326 None] Lock "b'cinder-588208c8-6177-436d-8f83-464854ff136f-detach_volume'" released by "detach_volume" :: held 0.241s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:46:29.490926 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-c3d9b05d-37ab-4235-b7a1-b3c2b20a4c4a tempest-VolumesActionsTest-1843210645 None] Lock "b'cinder-588208c8-6177-436d-8f83-464854ff136f-detach_volume'" acquired by "detach_volume" :: waited 0.009s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:46:29.490926 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-c3d9b05d-37ab-4235-b7a1-b3c2b20a4c4a tempest-VolumesActionsTest-1843210645 None] Volume detach called, but volume not attached. May 21 21:46:29.490926 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-c3d9b05d-37ab-4235-b7a1-b3c2b20a4c4a tempest-VolumesActionsTest-1843210645 None] Lock "b'cinder-588208c8-6177-436d-8f83-464854ff136f-detach_volume'" released by "detach_volume" :: held 0.011s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:46:30.463778 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-d1b62acc-da5f-42f8-bd78-cec24bb99f02 tempest-VolumesBackupsTest-1124201519 None] Lock "b'cinder-7165abec-f3d0-4873-a873-13811bf90dbd-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:46:30.558900 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d1b62acc-da5f-42f8-bd78-cec24bb99f02 tempest-VolumesBackupsTest-1124201519 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:46:33.394953 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d1b62acc-da5f-42f8-bd78-cec24bb99f02 tempest-VolumesBackupsTest-1124201519 None] Volume volume-7165abec-f3d0-4873-a873-13811bf90dbd is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:46:34.025024 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d1b62acc-da5f-42f8-bd78-cec24bb99f02 tempest-VolumesBackupsTest-1124201519 None] deleting rbd volume volume-7165abec-f3d0-4873-a873-13811bf90dbd {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:46:34.370409 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-343cdbf8-8924-45c1-9034-8f3bfeecb7f3 tempest-VolumesActionsTest-1843210645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:46:34.390604 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-343cdbf8-8924-45c1-9034-8f3bfeecb7f3 tempest-VolumesActionsTest-1843210645 None] Flow 'volume_create_manager' (8a773ba8-d72f-4c8b-91fc-e2ba4d06a9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:46:34.396926 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-343cdbf8-8924-45c1-9034-8f3bfeecb7f3 tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea3b69f3-10b1-4dea-8a10-7bb90bb0ed6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:46:34.413068 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-343cdbf8-8924-45c1-9034-8f3bfeecb7f3 tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea3b69f3-10b1-4dea-8a10-7bb90bb0ed6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-991864619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=726cac5b-02df-4013-95b8-85f3906d9612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e77549b3c184b4ba121a88322438858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:46:34Z,use_quota=True,user_id='5af6cf74a0ee4034891f69eeb773848c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:46:34.418369 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-343cdbf8-8924-45c1-9034-8f3bfeecb7f3 tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3727799a-69f9-4be3-b4b6-eb920367dc1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:46:34.422431 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-343cdbf8-8924-45c1-9034-8f3bfeecb7f3 tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3727799a-69f9-4be3-b4b6-eb920367dc1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:46:34.427692 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-343cdbf8-8924-45c1-9034-8f3bfeecb7f3 tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66ee4be1-d937-4f35-8c4a-68d253e9e944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:46:34.431692 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-343cdbf8-8924-45c1-9034-8f3bfeecb7f3 tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66ee4be1-d937-4f35-8c4a-68d253e9e944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '726cac5b-02df-4013-95b8-85f3906d9612', 'volume_name': 'volume-726cac5b-02df-4013-95b8-85f3906d9612', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:46:34.436712 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-343cdbf8-8924-45c1-9034-8f3bfeecb7f3 tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56471e74-7fea-4954-b5ef-7dd0f12df9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:46:34.441691 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-343cdbf8-8924-45c1-9034-8f3bfeecb7f3 tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56471e74-7fea-4954-b5ef-7dd0f12df9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:46:34.445150 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-343cdbf8-8924-45c1-9034-8f3bfeecb7f3 tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6828a31-6606-4893-af4a-7eb94874f9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:46:34.446189 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-343cdbf8-8924-45c1-9034-8f3bfeecb7f3 tempest-VolumesActionsTest-1843210645 None] Volume 726cac5b-02df-4013-95b8-85f3906d9612: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-726cac5b-02df-4013-95b8-85f3906d9612', 'volume_size': 1} May 21 21:46:34.446574 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-343cdbf8-8924-45c1-9034-8f3bfeecb7f3 tempest-VolumesActionsTest-1843210645 None] creating volume 'volume-726cac5b-02df-4013-95b8-85f3906d9612' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:46:34.447205 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-343cdbf8-8924-45c1-9034-8f3bfeecb7f3 tempest-VolumesActionsTest-1843210645 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:46:35.198869 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-343cdbf8-8924-45c1-9034-8f3bfeecb7f3 tempest-VolumesActionsTest-1843210645 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:46:35.199284 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-343cdbf8-8924-45c1-9034-8f3bfeecb7f3 tempest-VolumesActionsTest-1843210645 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:46:35.203158 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-343cdbf8-8924-45c1-9034-8f3bfeecb7f3 tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6828a31-6606-4893-af4a-7eb94874f9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-726cac5b-02df-4013-95b8-85f3906d9612', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:46:35.207862 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-343cdbf8-8924-45c1-9034-8f3bfeecb7f3 tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (534a2102-3835-4ccd-93af-1dfb1adfc5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:46:35.373993 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-343cdbf8-8924-45c1-9034-8f3bfeecb7f3 tempest-VolumesActionsTest-1843210645 None] Volume volume-726cac5b-02df-4013-95b8-85f3906d9612 (726cac5b-02df-4013-95b8-85f3906d9612): created successfully May 21 21:46:35.377637 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-343cdbf8-8924-45c1-9034-8f3bfeecb7f3 tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (534a2102-3835-4ccd-93af-1dfb1adfc5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:46:35.383224 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-343cdbf8-8924-45c1-9034-8f3bfeecb7f3 tempest-VolumesActionsTest-1843210645 None] Flow 'volume_create_manager' (8a773ba8-d72f-4c8b-91fc-e2ba4d06a9ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:46:35.471246 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-343cdbf8-8924-45c1-9034-8f3bfeecb7f3 tempest-VolumesActionsTest-1843210645 None] Created volume successfully. May 21 21:46:36.647314 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-829c04d3-1075-4973-b5e3-10f616cf7c65 tempest-VolumesActionsTest-1641117326 None] Lock "b'cinder-726cac5b-02df-4013-95b8-85f3906d9612-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:46:36.735603 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-829c04d3-1075-4973-b5e3-10f616cf7c65 tempest-VolumesActionsTest-1641117326 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:46:36.938880 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-829c04d3-1075-4973-b5e3-10f616cf7c65 tempest-VolumesActionsTest-1641117326 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:46:36.939214 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-829c04d3-1075-4973-b5e3-10f616cf7c65 tempest-VolumesActionsTest-1641117326 None] Volume volume-726cac5b-02df-4013-95b8-85f3906d9612 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:46:37.100358 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-829c04d3-1075-4973-b5e3-10f616cf7c65 tempest-VolumesActionsTest-1641117326 None] deleting rbd volume volume-726cac5b-02df-4013-95b8-85f3906d9612 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:46:39.120943 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=42,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:46:39.232799 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-d1b62acc-da5f-42f8-bd78-cec24bb99f02 tempest-VolumesBackupsTest-1124201519 None] Created reservations ['6650f025-d528-4bfa-b2d7-7739bd9233fa', '60e5d23d-a32a-49c1-b5ec-e003e322e8a6', 'd0776189-7fa5-4d0a-805c-879c9eb5cf96', '5f077c41-3f41-4249-b592-f7816da82458'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:46:39.460675 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d1b62acc-da5f-42f8-bd78-cec24bb99f02 tempest-VolumesBackupsTest-1124201519 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:46:39.538786 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d1b62acc-da5f-42f8-bd78-cec24bb99f02 tempest-VolumesBackupsTest-1124201519 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:46:39.564296 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-d1b62acc-da5f-42f8-bd78-cec24bb99f02 tempest-VolumesBackupsTest-1124201519 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:46:39.568514 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-d1b62acc-da5f-42f8-bd78-cec24bb99f02 tempest-VolumesBackupsTest-1124201519 None] Deleted volume successfully. May 21 21:46:39.691852 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-d1b62acc-da5f-42f8-bd78-cec24bb99f02 tempest-VolumesBackupsTest-1124201519 None] Lock "b'cinder-7165abec-f3d0-4873-a873-13811bf90dbd-delete_volume'" released by "delete_volume" :: held 9.228s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:46:40.931543 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-02cb8a6d-7176-4285-9e29-186deda0b4b9 tempest-VolumesBackupsTest-1124201519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:46:40.952427 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-02cb8a6d-7176-4285-9e29-186deda0b4b9 tempest-VolumesBackupsTest-1124201519 None] Flow 'volume_create_manager' (deb03544-6c8a-480d-a3bf-cd0210b401f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:46:40.958840 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-02cb8a6d-7176-4285-9e29-186deda0b4b9 tempest-VolumesBackupsTest-1124201519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3e2f0f6-c03f-46eb-90dc-182d21bec652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:46:40.975205 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-02cb8a6d-7176-4285-9e29-186deda0b4b9 tempest-VolumesBackupsTest-1124201519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3e2f0f6-c03f-46eb-90dc-182d21bec652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:46:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-1505313709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c27e6a73-0caa-455a-a8cd-64afdd8fc3ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3ad039cefcd45fa827017cf6c30c895',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:46:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:46:41Z,use_quota=True,user_id='5c8068f63a974cf09e08695c80e57871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:46:40.980695 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-02cb8a6d-7176-4285-9e29-186deda0b4b9 tempest-VolumesBackupsTest-1124201519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58f82364-d09f-470a-9333-d138764067df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:46:40.985528 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-02cb8a6d-7176-4285-9e29-186deda0b4b9 tempest-VolumesBackupsTest-1124201519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58f82364-d09f-470a-9333-d138764067df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:46:40.990632 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-02cb8a6d-7176-4285-9e29-186deda0b4b9 tempest-VolumesBackupsTest-1124201519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad492a7e-9d84-4f58-a0dc-093e7ca511f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:46:41.071700 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-02cb8a6d-7176-4285-9e29-186deda0b4b9 tempest-VolumesBackupsTest-1124201519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad492a7e-9d84-4f58-a0dc-093e7ca511f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c27e6a73-0caa-455a-a8cd-64afdd8fc3ed', 'volume_name': 'volume-c27e6a73-0caa-455a-a8cd-64afdd8fc3ed', 'volume_size': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5593f8cb452404083dfa177b4ee68b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'created_at': datetime.datetime(2022, 5, 21, 21, 0, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:46:41.076772 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-02cb8a6d-7176-4285-9e29-186deda0b4b9 tempest-VolumesBackupsTest-1124201519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bef34363-8542-489f-8f0a-776f3e04c94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:46:41.080640 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-02cb8a6d-7176-4285-9e29-186deda0b4b9 tempest-VolumesBackupsTest-1124201519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bef34363-8542-489f-8f0a-776f3e04c94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:46:41.085279 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-02cb8a6d-7176-4285-9e29-186deda0b4b9 tempest-VolumesBackupsTest-1124201519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4107d944-dcc3-48b6-82bc-e9af60b4023e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:46:41.086416 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-02cb8a6d-7176-4285-9e29-186deda0b4b9 tempest-VolumesBackupsTest-1124201519 None] Volume c27e6a73-0caa-455a-a8cd-64afdd8fc3ed: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c27e6a73-0caa-455a-a8cd-64afdd8fc3ed', 'volume_size': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5593f8cb452404083dfa177b4ee68b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'created_at': datetime.datetime(2022, 5, 21, 21, 0, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } May 21 21:46:41.086999 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-02cb8a6d-7176-4285-9e29-186deda0b4b9 tempest-VolumesBackupsTest-1124201519 None] Cloning c27e6a73-0caa-455a-a8cd-64afdd8fc3ed from image e570f5eb-6047-4214-a420-fdfdbdf19a4c at location (None, None). {{(pid=124407) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1053}} May 21 21:46:41.096259 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-02cb8a6d-7176-4285-9e29-186deda0b4b9 tempest-VolumesBackupsTest-1124201519 None] Lock "b'cinder-e570f5eb-6047-4214-a420-fdfdbdf19a4c'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:46:41.144669 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-02cb8a6d-7176-4285-9e29-186deda0b4b9 tempest-VolumesBackupsTest-1124201519 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'volume_id': '4057e637-23ba-493f-a45d-eb28c07ac60a', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28), 'last_used': datetime.datetime(2022, 5, 21, 21, 46, 41, 100264)}. {{(pid=124407) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 21 21:46:41.145691 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-02cb8a6d-7176-4285-9e29-186deda0b4b9 tempest-VolumesBackupsTest-1124201519 None] Image-volume cache entry image_update_at = 2022-05-21 21:00:28+00:00, requested image updated_at = 2022-05-21 21:00:28+00:00. {{(pid=124407) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 21 21:46:41.146128 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-02cb8a6d-7176-4285-9e29-186deda0b4b9 tempest-VolumesBackupsTest-1124201519 None] Found cache entry for image = e570f5eb-6047-4214-a420-fdfdbdf19a4c on host ncdv-master-1@ceph#ceph. {{(pid=124407) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:876}} May 21 21:46:41.150459 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-02cb8a6d-7176-4285-9e29-186deda0b4b9 tempest-VolumesBackupsTest-1124201519 None] Lock "b'cinder-e570f5eb-6047-4214-a420-fdfdbdf19a4c'" released by "_prepare_image_cache_entry" :: held 0.054s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:46:41.151426 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-02cb8a6d-7176-4285-9e29-186deda0b4b9 tempest-VolumesBackupsTest-1124201519 None] Attempting to retrieve cache entry for image = e570f5eb-6047-4214-a420-fdfdbdf19a4c on host ncdv-master-1@ceph#ceph. {{(pid=124407) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:817}} May 21 21:46:41.157997 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-02cb8a6d-7176-4285-9e29-186deda0b4b9 tempest-VolumesBackupsTest-1124201519 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'volume_id': '4057e637-23ba-493f-a45d-eb28c07ac60a', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28), 'last_used': datetime.datetime(2022, 5, 21, 21, 46, 41, 155701)}. {{(pid=124407) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 21 21:46:41.158408 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-02cb8a6d-7176-4285-9e29-186deda0b4b9 tempest-VolumesBackupsTest-1124201519 None] Image-volume cache entry image_update_at = 2022-05-21 21:00:28+00:00, requested image updated_at = 2022-05-21 21:00:28+00:00. {{(pid=124407) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 21 21:46:41.158791 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-02cb8a6d-7176-4285-9e29-186deda0b4b9 tempest-VolumesBackupsTest-1124201519 None] Creating from source image-volume 4057e637-23ba-493f-a45d-eb28c07ac60a {{(pid=124407) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:831}} May 21 21:46:41.170974 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-02cb8a6d-7176-4285-9e29-186deda0b4b9 tempest-VolumesBackupsTest-1124201519 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:46:41.298442 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-02cb8a6d-7176-4285-9e29-186deda0b4b9 tempest-VolumesBackupsTest-1124201519 None] creating snapshot='volume-c27e6a73-0caa-455a-a8cd-64afdd8fc3ed.clone_snap' {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 21 21:46:43.169309 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-02cb8a6d-7176-4285-9e29-186deda0b4b9 tempest-VolumesBackupsTest-1124201519 None] cloning 'volume-4057e637-23ba-493f-a45d-eb28c07ac60a@volume-c27e6a73-0caa-455a-a8cd-64afdd8fc3ed.clone_snap' to 'volume-c27e6a73-0caa-455a-a8cd-64afdd8fc3ed' {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:789}} May 21 21:46:43.312216 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-829c04d3-1075-4973-b5e3-10f616cf7c65 tempest-VolumesActionsTest-1641117326 None] Created reservations ['4696a9d2-206c-425f-bdce-3c2ca1b8c991', '5f0b7b01-18ac-4d4b-a56b-1b7ea01b0a7b', '251b48ee-b528-4056-8679-5dd0db713e2c', 'ed8bd5d2-0b93-4be0-96c2-2635b54f9352'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:46:43.702760 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-829c04d3-1075-4973-b5e3-10f616cf7c65 tempest-VolumesActionsTest-1641117326 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:46:43.741403 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-829c04d3-1075-4973-b5e3-10f616cf7c65 tempest-VolumesActionsTest-1641117326 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:46:43.768427 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-829c04d3-1075-4973-b5e3-10f616cf7c65 tempest-VolumesActionsTest-1641117326 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:46:43.774892 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-829c04d3-1075-4973-b5e3-10f616cf7c65 tempest-VolumesActionsTest-1641117326 None] Deleted volume successfully. May 21 21:46:43.777353 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=61,cinder:INSERT=9,cinder:UPDATE=28,cinder:DELETE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:46:43.871740 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-894d1de8-a64d-4bc1-9872-1ed093a70378 tempest-VolumesSnapshotTestJSON-2065732980 None] Created reservations ['96027d57-671c-4f3c-98ca-b604bb0da299', '1ac32a16-5dde-422d-abee-f740d122fb97', '62257092-1476-4e54-880b-637bab5d80bd', '58c9095c-8581-4aad-8e74-a8f76df474fb'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:46:43.880022 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-829c04d3-1075-4973-b5e3-10f616cf7c65 tempest-VolumesActionsTest-1641117326 None] Lock "b'cinder-726cac5b-02df-4013-95b8-85f3906d9612-delete_volume'" released by "delete_volume" :: held 7.233s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:46:44.141773 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-894d1de8-a64d-4bc1-9872-1ed093a70378 tempest-VolumesSnapshotTestJSON-2065732980 None] Delete snapshot completed successfully. May 21 21:46:44.148164 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-894d1de8-a64d-4bc1-9872-1ed093a70378 tempest-VolumesSnapshotTestJSON-2065732980 None] Lock "b'cinder-56d6027d-61c4-48dd-901e-9b9f0b486955-delete_snapshot'" released by "delete_snapshot" :: held 34.344s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:46:44.961861 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-02cb8a6d-7176-4285-9e29-186deda0b4b9 tempest-VolumesBackupsTest-1124201519 None] Volume volume-b9ebacac-5f32-42e3-9194-003aee7e2435.deleted is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:46:44.963422 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-02cb8a6d-7176-4285-9e29-186deda0b4b9 tempest-VolumesBackupsTest-1124201519 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:46:44.963793 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-02cb8a6d-7176-4285-9e29-186deda0b4b9 tempest-VolumesBackupsTest-1124201519 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:46:45.521326 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-02cb8a6d-7176-4285-9e29-186deda0b4b9 tempest-VolumesBackupsTest-1124201519 None] clone created successfully {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:862}} May 21 21:46:45.521983 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.volume_utils [None req-02cb8a6d-7176-4285-9e29-186deda0b4b9 tempest-VolumesBackupsTest-1124201519 None] Marking volume c27e6a73-0caa-455a-a8cd-64afdd8fc3ed as bootable. {{(pid=124407) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} May 21 21:46:45.529178 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-e88610ea-f8a7-4a99-8453-bc2567def720 tempest-VolumesActionsTest-1843210645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:46:45.553582 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-e88610ea-f8a7-4a99-8453-bc2567def720 tempest-VolumesActionsTest-1843210645 None] Flow 'volume_create_manager' (59bb9394-4770-43d4-ac26-263b3c0a5ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:46:45.562647 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-e88610ea-f8a7-4a99-8453-bc2567def720 tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6415c779-ddee-46ab-94eb-1f71b9852c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:46:45.579702 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-e88610ea-f8a7-4a99-8453-bc2567def720 tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6415c779-ddee-46ab-94eb-1f71b9852c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-464975032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ffeb55cf-cd2b-4850-9fb3-745d2d7c1996,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e77549b3c184b4ba121a88322438858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:46:45Z,use_quota=True,user_id='5af6cf74a0ee4034891f69eeb773848c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:46:45.585028 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-e88610ea-f8a7-4a99-8453-bc2567def720 tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14efc22e-9fa4-4524-a735-66c04f085b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:46:45.589080 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-e88610ea-f8a7-4a99-8453-bc2567def720 tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14efc22e-9fa4-4524-a735-66c04f085b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:46:45.595107 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-e88610ea-f8a7-4a99-8453-bc2567def720 tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f87d62b5-ebc9-4c49-a366-19529bf3440d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:46:45.599726 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-e88610ea-f8a7-4a99-8453-bc2567def720 tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f87d62b5-ebc9-4c49-a366-19529bf3440d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffeb55cf-cd2b-4850-9fb3-745d2d7c1996', 'volume_name': 'volume-ffeb55cf-cd2b-4850-9fb3-745d2d7c1996', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:46:45.604671 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-e88610ea-f8a7-4a99-8453-bc2567def720 tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06a036d7-f8ea-41fa-ab47-11f8ea3c281a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:46:45.610468 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-e88610ea-f8a7-4a99-8453-bc2567def720 tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06a036d7-f8ea-41fa-ab47-11f8ea3c281a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:46:45.613503 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-e88610ea-f8a7-4a99-8453-bc2567def720 tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (820d5085-2513-4f5b-8947-c096daf14884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:46:45.614603 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-e88610ea-f8a7-4a99-8453-bc2567def720 tempest-VolumesActionsTest-1843210645 None] Volume ffeb55cf-cd2b-4850-9fb3-745d2d7c1996: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffeb55cf-cd2b-4850-9fb3-745d2d7c1996', 'volume_size': 1} May 21 21:46:45.614985 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-e88610ea-f8a7-4a99-8453-bc2567def720 tempest-VolumesActionsTest-1843210645 None] creating volume 'volume-ffeb55cf-cd2b-4850-9fb3-745d2d7c1996' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:46:45.615725 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-e88610ea-f8a7-4a99-8453-bc2567def720 tempest-VolumesActionsTest-1843210645 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:46:45.636896 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-02cb8a6d-7176-4285-9e29-186deda0b4b9 tempest-VolumesBackupsTest-1124201519 None] Copying metadata from image e570f5eb-6047-4214-a420-fdfdbdf19a4c to c27e6a73-0caa-455a-a8cd-64afdd8fc3ed. {{(pid=124407) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} May 21 21:46:45.637411 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-02cb8a6d-7176-4285-9e29-186deda0b4b9 tempest-VolumesBackupsTest-1124201519 None] Creating volume glance metadata for volume c27e6a73-0caa-455a-a8cd-64afdd8fc3ed backed by image e570f5eb-6047-4214-a420-fdfdbdf19a4c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=124407) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:673}} May 21 21:46:45.788653 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-02cb8a6d-7176-4285-9e29-186deda0b4b9 tempest-VolumesBackupsTest-1124201519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4107d944-dcc3-48b6-82bc-e9af60b4023e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c27e6a73-0caa-455a-a8cd-64afdd8fc3ed', 'volume_size': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5593f8cb452404083dfa177b4ee68b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'created_at': datetime.datetime(2022, 5, 21, 21, 0, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:46:45.793325 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-02cb8a6d-7176-4285-9e29-186deda0b4b9 tempest-VolumesBackupsTest-1124201519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fa95fca-99ee-4f72-a425-76d63264db40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:46:45.812923 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-4e107ed7-1fef-4398-b557-d37436715c08 req-5b52044e-d0a6-44ab-a736-cdd24372663d tempest-VolumesSnapshotTestJSON-2065732980 None] Terminate volume connection completed successfully. May 21 21:46:45.813337 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-4e107ed7-1fef-4398-b557-d37436715c08 req-5b52044e-d0a6-44ab-a736-cdd24372663d tempest-VolumesSnapshotTestJSON-2065732980 None] Deleting attachment 040173a9-6528-4720-9d96-0f31e72dca97. {{(pid=124407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4957}} May 21 21:46:45.885280 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-02cb8a6d-7176-4285-9e29-186deda0b4b9 tempest-VolumesBackupsTest-1124201519 None] Volume volume-c27e6a73-0caa-455a-a8cd-64afdd8fc3ed (c27e6a73-0caa-455a-a8cd-64afdd8fc3ed): created successfully May 21 21:46:45.889118 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-02cb8a6d-7176-4285-9e29-186deda0b4b9 tempest-VolumesBackupsTest-1124201519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fa95fca-99ee-4f72-a425-76d63264db40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:46:45.895691 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-02cb8a6d-7176-4285-9e29-186deda0b4b9 tempest-VolumesBackupsTest-1124201519 None] Flow 'volume_create_manager' (deb03544-6c8a-480d-a3bf-cd0210b401f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:46:45.970443 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-02cb8a6d-7176-4285-9e29-186deda0b4b9 tempest-VolumesBackupsTest-1124201519 None] Created volume successfully. May 21 21:46:46.539017 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-e88610ea-f8a7-4a99-8453-bc2567def720 tempest-VolumesActionsTest-1843210645 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:46:46.539721 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-e88610ea-f8a7-4a99-8453-bc2567def720 tempest-VolumesActionsTest-1843210645 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:46:46.550543 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-e88610ea-f8a7-4a99-8453-bc2567def720 tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (820d5085-2513-4f5b-8947-c096daf14884) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffeb55cf-cd2b-4850-9fb3-745d2d7c1996', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:46:46.555476 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-e88610ea-f8a7-4a99-8453-bc2567def720 tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa987413-1e2e-4dba-bc5a-7c80d1873611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:46:46.678025 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-e88610ea-f8a7-4a99-8453-bc2567def720 tempest-VolumesActionsTest-1843210645 None] Volume volume-ffeb55cf-cd2b-4850-9fb3-745d2d7c1996 (ffeb55cf-cd2b-4850-9fb3-745d2d7c1996): created successfully May 21 21:46:46.681794 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-e88610ea-f8a7-4a99-8453-bc2567def720 tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa987413-1e2e-4dba-bc5a-7c80d1873611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:46:46.687959 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-e88610ea-f8a7-4a99-8453-bc2567def720 tempest-VolumesActionsTest-1843210645 None] Flow 'volume_create_manager' (59bb9394-4770-43d4-ac26-263b3c0a5ae6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:46:46.780599 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-e88610ea-f8a7-4a99-8453-bc2567def720 tempest-VolumesActionsTest-1843210645 None] Created volume successfully. May 21 21:46:47.181104 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-bd760063-0ace-4a89-a9e0-5dae0166ed9e tempest-VolumesActionsTest-1641117326 None] Lock "b'cinder-ffeb55cf-cd2b-4850-9fb3-745d2d7c1996-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:46:47.310040 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-bd760063-0ace-4a89-a9e0-5dae0166ed9e tempest-VolumesActionsTest-1641117326 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:46:47.648631 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-bd760063-0ace-4a89-a9e0-5dae0166ed9e tempest-VolumesActionsTest-1641117326 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:46:47.649057 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-bd760063-0ace-4a89-a9e0-5dae0166ed9e tempest-VolumesActionsTest-1641117326 None] Volume volume-ffeb55cf-cd2b-4850-9fb3-745d2d7c1996 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:46:47.798747 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-bd760063-0ace-4a89-a9e0-5dae0166ed9e tempest-VolumesActionsTest-1641117326 None] deleting rbd volume volume-ffeb55cf-cd2b-4850-9fb3-745d2d7c1996 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:46:47.816322 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-b1d128ac-8798-4544-b467-b59afc2e01c9 tempest-VolumesBackupsTest-1124201519 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-05-21T21:46:47Z,data_timestamp=2022-05-21T21:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-358287741',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=120a6fc9-734f-4922-b4fd-18aa921c6a95,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='a3ad039cefcd45fa827017cf6c30c895',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='5c8068f63a974cf09e08695c80e57871',volume_id=c27e6a73-0caa-455a-a8cd-64afdd8fc3ed) May 21 21:46:47.817175 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.backup.rpcapi [None req-b1d128ac-8798-4544-b467-b59afc2e01c9 tempest-VolumesBackupsTest-1124201519 None] continue_backup in rpcapi backup_id 120a6fc9-734f-4922-b4fd-18aa921c6a95 {{(pid=124407) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} May 21 21:46:47.941653 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [None req-b1d128ac-8798-4544-b467-b59afc2e01c9 tempest-VolumesBackupsTest-1124201519 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:46:48.584568 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [None req-b1d128ac-8798-4544-b467-b59afc2e01c9 tempest-VolumesBackupsTest-1124201519 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.642s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:46:48.585857 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b1d128ac-8798-4544-b467-b59afc2e01c9 tempest-VolumesBackupsTest-1124201519 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c27e6a73-0caa-455a-a8cd-64afdd8fc3ed', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'efef91cd-d8f8-4d93-9ad2-86d0b33251f4', 'volume_id': 'c27e6a73-0caa-455a-a8cd-64afdd8fc3ed', 'discard': True}} {{(pid=124407) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} May 21 21:46:48.606861 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-b1d128ac-8798-4544-b467-b59afc2e01c9 tempest-VolumesBackupsTest-1124201519 None] Initialize volume connection completed successfully. May 21 21:46:50.667422 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3604d89f-318d-4a61-bf67-b65a4c8eb6af tempest-VolumesSnapshotTestJSON-2065732980 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:46:53.506330 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-bd760063-0ace-4a89-a9e0-5dae0166ed9e tempest-VolumesActionsTest-1641117326 None] Created reservations ['2c124875-8523-425d-acec-80af15261aac', '7641695a-2a52-44b9-9c18-c65668ec3600', 'f7ef88ba-f81e-4870-a38f-d5139d54df74', '281ae155-2563-48b8-b072-138b34473930'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:46:53.633164 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=57,cinder:UPDATE=33,cinder:INSERT=9,cinder:DELETE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:46:53.711163 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-bd760063-0ace-4a89-a9e0-5dae0166ed9e tempest-VolumesActionsTest-1641117326 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:46:53.742028 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-bd760063-0ace-4a89-a9e0-5dae0166ed9e tempest-VolumesActionsTest-1641117326 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:46:53.765543 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-bd760063-0ace-4a89-a9e0-5dae0166ed9e tempest-VolumesActionsTest-1641117326 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:46:53.771212 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-bd760063-0ace-4a89-a9e0-5dae0166ed9e tempest-VolumesActionsTest-1641117326 None] Deleted volume successfully. May 21 21:46:53.859242 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-bd760063-0ace-4a89-a9e0-5dae0166ed9e tempest-VolumesActionsTest-1641117326 None] Lock "b'cinder-ffeb55cf-cd2b-4850-9fb3-745d2d7c1996-delete_volume'" released by "delete_volume" :: held 6.678s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:46:54.946007 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-3604d89f-318d-4a61-bf67-b65a4c8eb6af tempest-VolumesSnapshotTestJSON-2065732980 None] Create snapshot completed successfully May 21 21:46:55.456856 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec77a562-b6a4-4c9c-8304-6cdd4bc4a4bc tempest-VolumesActionsTest-1843210645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:46:55.479430 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ec77a562-b6a4-4c9c-8304-6cdd4bc4a4bc tempest-VolumesActionsTest-1843210645 None] Flow 'volume_create_manager' (478bcbf0-1c2e-43fa-b32a-d30c4b110922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:46:55.486267 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ec77a562-b6a4-4c9c-8304-6cdd4bc4a4bc tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7394b537-7c19-4819-93f8-61a6be64fbe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:46:55.503381 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ec77a562-b6a4-4c9c-8304-6cdd4bc4a4bc tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7394b537-7c19-4819-93f8-61a6be64fbe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:46:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-14574416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=302ea53f-82aa-46c2-82b3-64e2b86b256b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e77549b3c184b4ba121a88322438858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:46:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:46:55Z,use_quota=True,user_id='5af6cf74a0ee4034891f69eeb773848c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:46:55.509383 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ec77a562-b6a4-4c9c-8304-6cdd4bc4a4bc tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f56f3cf9-e4c2-4b80-9c9c-4e0e41d6ea53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:46:55.513486 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ec77a562-b6a4-4c9c-8304-6cdd4bc4a4bc tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f56f3cf9-e4c2-4b80-9c9c-4e0e41d6ea53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:46:55.518582 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ec77a562-b6a4-4c9c-8304-6cdd4bc4a4bc tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5762e4c-0bf9-4cfe-b88d-dcb62995a4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:46:55.522715 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ec77a562-b6a4-4c9c-8304-6cdd4bc4a4bc tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5762e4c-0bf9-4cfe-b88d-dcb62995a4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '302ea53f-82aa-46c2-82b3-64e2b86b256b', 'volume_name': 'volume-302ea53f-82aa-46c2-82b3-64e2b86b256b', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:46:55.527540 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ec77a562-b6a4-4c9c-8304-6cdd4bc4a4bc tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a41605cd-99af-4ada-be9d-925c30dee9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:46:55.531445 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ec77a562-b6a4-4c9c-8304-6cdd4bc4a4bc tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a41605cd-99af-4ada-be9d-925c30dee9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:46:55.536335 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ec77a562-b6a4-4c9c-8304-6cdd4bc4a4bc tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b3e95ca-8cc9-445d-a061-509d7fcd546b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:46:55.537408 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-ec77a562-b6a4-4c9c-8304-6cdd4bc4a4bc tempest-VolumesActionsTest-1843210645 None] Volume 302ea53f-82aa-46c2-82b3-64e2b86b256b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-302ea53f-82aa-46c2-82b3-64e2b86b256b', 'volume_size': 1} May 21 21:46:55.540272 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ec77a562-b6a4-4c9c-8304-6cdd4bc4a4bc tempest-VolumesActionsTest-1843210645 None] creating volume 'volume-302ea53f-82aa-46c2-82b3-64e2b86b256b' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:46:55.540272 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ec77a562-b6a4-4c9c-8304-6cdd4bc4a4bc tempest-VolumesActionsTest-1843210645 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:46:55.980383 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-d64e491a-2ac3-417b-a960-a08dff3da3cd tempest-VolumesSnapshotTestJSON-2065732980 None] Lock "b'cinder-aacc9516-0e2f-4f35-99cc-ba8335bd7759-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:46:55.981856 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d64e491a-2ac3-417b-a960-a08dff3da3cd tempest-VolumesSnapshotTestJSON-2065732980 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:46:56.164660 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:46:56.165304 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:46:56.186272 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:46:56.252786 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:46:56.665837 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ec77a562-b6a4-4c9c-8304-6cdd4bc4a4bc tempest-VolumesActionsTest-1843210645 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:46:56.666219 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ec77a562-b6a4-4c9c-8304-6cdd4bc4a4bc tempest-VolumesActionsTest-1843210645 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:46:56.670028 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ec77a562-b6a4-4c9c-8304-6cdd4bc4a4bc tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b3e95ca-8cc9-445d-a061-509d7fcd546b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-302ea53f-82aa-46c2-82b3-64e2b86b256b', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:46:56.674590 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ec77a562-b6a4-4c9c-8304-6cdd4bc4a4bc tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b209f218-e59c-4525-bb0a-8cce47e5a2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:46:56.758014 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-ec77a562-b6a4-4c9c-8304-6cdd4bc4a4bc tempest-VolumesActionsTest-1843210645 None] Volume volume-302ea53f-82aa-46c2-82b3-64e2b86b256b (302ea53f-82aa-46c2-82b3-64e2b86b256b): created successfully May 21 21:46:56.762076 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ec77a562-b6a4-4c9c-8304-6cdd4bc4a4bc tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b209f218-e59c-4525-bb0a-8cce47e5a2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:46:56.767898 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ec77a562-b6a4-4c9c-8304-6cdd4bc4a4bc tempest-VolumesActionsTest-1843210645 None] Flow 'volume_create_manager' (478bcbf0-1c2e-43fa-b32a-d30c4b110922) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:46:56.900038 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-ec77a562-b6a4-4c9c-8304-6cdd4bc4a4bc tempest-VolumesActionsTest-1843210645 None] Created volume successfully. May 21 21:46:57.631972 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-96c2d935-7f28-4dc8-a2a5-b15bce7736d1 tempest-VolumesActionsTest-1641117326 None] Lock "b'cinder-302ea53f-82aa-46c2-82b3-64e2b86b256b-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:46:57.737268 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-96c2d935-7f28-4dc8-a2a5-b15bce7736d1 tempest-VolumesActionsTest-1641117326 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:46:58.055223 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-96c2d935-7f28-4dc8-a2a5-b15bce7736d1 tempest-VolumesActionsTest-1641117326 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:46:58.055677 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-96c2d935-7f28-4dc8-a2a5-b15bce7736d1 tempest-VolumesActionsTest-1641117326 None] Volume volume-302ea53f-82aa-46c2-82b3-64e2b86b256b is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:46:58.226147 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-96c2d935-7f28-4dc8-a2a5-b15bce7736d1 tempest-VolumesActionsTest-1641117326 None] deleting rbd volume volume-302ea53f-82aa-46c2-82b3-64e2b86b256b {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:47:01.489317 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-d64e491a-2ac3-417b-a960-a08dff3da3cd tempest-VolumesSnapshotTestJSON-2065732980 None] Created reservations ['bc9ee08a-dd2d-46ff-b7f7-f5ec4c3620bb', '51d1c20e-489b-45be-8dc3-f398b80bfc75', 'bf3f05bf-dabf-4f55-893e-64b358bd7414', '9d4dc8e7-0f3b-410f-8e5a-4234739b5dd0'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:47:01.672837 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-d64e491a-2ac3-417b-a960-a08dff3da3cd tempest-VolumesSnapshotTestJSON-2065732980 None] Delete snapshot completed successfully. May 21 21:47:01.678322 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-d64e491a-2ac3-417b-a960-a08dff3da3cd tempest-VolumesSnapshotTestJSON-2065732980 None] Lock "b'cinder-aacc9516-0e2f-4f35-99cc-ba8335bd7759-delete_snapshot'" released by "delete_snapshot" :: held 5.698s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:47:02.740503 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3105321d-133b-4e7d-8e65-d3a21469755d tempest-VolumesSnapshotTestJSON-2065732980 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:47:07.333655 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:UPDATE=23,cinder:SELECT=60,cinder:INSERT=14,cinder:DELETE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:47:07.500518 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-96c2d935-7f28-4dc8-a2a5-b15bce7736d1 tempest-VolumesActionsTest-1641117326 None] Created reservations ['b8f9d49e-cfc6-4ea5-8aa6-aa2204f3ef72', '58539792-7a97-4592-9fc2-77a802bd3443', '63e5c555-a4f5-475e-9b87-97577a8d604d', '3a975214-c063-4630-88b0-b226246ff041'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:47:07.628301 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-3105321d-133b-4e7d-8e65-d3a21469755d tempest-VolumesSnapshotTestJSON-2065732980 None] Create snapshot completed successfully May 21 21:47:07.740021 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-96c2d935-7f28-4dc8-a2a5-b15bce7736d1 tempest-VolumesActionsTest-1641117326 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:47:07.762099 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-96c2d935-7f28-4dc8-a2a5-b15bce7736d1 tempest-VolumesActionsTest-1641117326 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:47:07.787529 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-96c2d935-7f28-4dc8-a2a5-b15bce7736d1 tempest-VolumesActionsTest-1641117326 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:47:07.793011 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-96c2d935-7f28-4dc8-a2a5-b15bce7736d1 tempest-VolumesActionsTest-1641117326 None] Deleted volume successfully. May 21 21:47:07.887843 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-96c2d935-7f28-4dc8-a2a5-b15bce7736d1 tempest-VolumesActionsTest-1641117326 None] Lock "b'cinder-302ea53f-82aa-46c2-82b3-64e2b86b256b-delete_volume'" released by "delete_volume" :: held 10.253s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:47:09.214771 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-7885f13d-19b8-4790-9aba-9cc10b44ec25 tempest-VolumesActionsTest-1843210645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:47:09.234480 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-7885f13d-19b8-4790-9aba-9cc10b44ec25 tempest-VolumesActionsTest-1843210645 None] Flow 'volume_create_manager' (e6295fa9-837f-4879-bf5c-0970586b6658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:47:09.241279 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-7885f13d-19b8-4790-9aba-9cc10b44ec25 tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eabaecb4-847a-490a-a3dd-37cb36e80c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:47:09.258023 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-7885f13d-19b8-4790-9aba-9cc10b44ec25 tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eabaecb4-847a-490a-a3dd-37cb36e80c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-908637412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=23c42ce4-4736-4baf-b932-e86ed8721017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e77549b3c184b4ba121a88322438858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:47:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:47:09Z,use_quota=True,user_id='5af6cf74a0ee4034891f69eeb773848c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:47:09.263727 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-7885f13d-19b8-4790-9aba-9cc10b44ec25 tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7da096f7-69dc-49d3-80b3-df6517bfb135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:47:09.270668 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-7885f13d-19b8-4790-9aba-9cc10b44ec25 tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7da096f7-69dc-49d3-80b3-df6517bfb135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:47:09.273606 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-7885f13d-19b8-4790-9aba-9cc10b44ec25 tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a5f6202-d502-4e24-8552-eaac14c9e2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:47:09.278386 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-7885f13d-19b8-4790-9aba-9cc10b44ec25 tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a5f6202-d502-4e24-8552-eaac14c9e2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23c42ce4-4736-4baf-b932-e86ed8721017', 'volume_name': 'volume-23c42ce4-4736-4baf-b932-e86ed8721017', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:47:09.284033 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-7885f13d-19b8-4790-9aba-9cc10b44ec25 tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27a2ed4a-85bb-4205-9382-0a1bdb74fb43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:47:09.287975 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-7885f13d-19b8-4790-9aba-9cc10b44ec25 tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27a2ed4a-85bb-4205-9382-0a1bdb74fb43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:47:09.292662 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-7885f13d-19b8-4790-9aba-9cc10b44ec25 tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a3aa571-fd60-4c27-8ce4-8e8b9002ac41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:47:09.294344 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-7885f13d-19b8-4790-9aba-9cc10b44ec25 tempest-VolumesActionsTest-1843210645 None] Volume 23c42ce4-4736-4baf-b932-e86ed8721017: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23c42ce4-4736-4baf-b932-e86ed8721017', 'volume_size': 1} May 21 21:47:09.294737 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-7885f13d-19b8-4790-9aba-9cc10b44ec25 tempest-VolumesActionsTest-1843210645 None] creating volume 'volume-23c42ce4-4736-4baf-b932-e86ed8721017' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:47:09.295494 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-7885f13d-19b8-4790-9aba-9cc10b44ec25 tempest-VolumesActionsTest-1843210645 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:47:10.590442 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-7885f13d-19b8-4790-9aba-9cc10b44ec25 tempest-VolumesActionsTest-1843210645 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:47:10.591190 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-7885f13d-19b8-4790-9aba-9cc10b44ec25 tempest-VolumesActionsTest-1843210645 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:47:10.594397 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-7885f13d-19b8-4790-9aba-9cc10b44ec25 tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a3aa571-fd60-4c27-8ce4-8e8b9002ac41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23c42ce4-4736-4baf-b932-e86ed8721017', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:47:10.598870 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-7885f13d-19b8-4790-9aba-9cc10b44ec25 tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc1e2294-bf54-4682-9fcc-263e3e391117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:47:10.698869 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-7885f13d-19b8-4790-9aba-9cc10b44ec25 tempest-VolumesActionsTest-1843210645 None] Volume volume-23c42ce4-4736-4baf-b932-e86ed8721017 (23c42ce4-4736-4baf-b932-e86ed8721017): created successfully May 21 21:47:10.702899 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-7885f13d-19b8-4790-9aba-9cc10b44ec25 tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc1e2294-bf54-4682-9fcc-263e3e391117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:47:10.708484 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-7885f13d-19b8-4790-9aba-9cc10b44ec25 tempest-VolumesActionsTest-1843210645 None] Flow 'volume_create_manager' (e6295fa9-837f-4879-bf5c-0970586b6658) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:47:10.780729 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-7885f13d-19b8-4790-9aba-9cc10b44ec25 tempest-VolumesActionsTest-1843210645 None] Created volume successfully. May 21 21:47:11.319152 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-345c64f4-8528-4a01-a90a-355ed264f804 tempest-VolumesActionsTest-1641117326 None] Lock "b'cinder-23c42ce4-4736-4baf-b932-e86ed8721017-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:47:11.424721 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-345c64f4-8528-4a01-a90a-355ed264f804 tempest-VolumesActionsTest-1641117326 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:47:11.739986 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-345c64f4-8528-4a01-a90a-355ed264f804 tempest-VolumesActionsTest-1641117326 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:47:11.741181 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-345c64f4-8528-4a01-a90a-355ed264f804 tempest-VolumesActionsTest-1641117326 None] Volume volume-23c42ce4-4736-4baf-b932-e86ed8721017 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:47:11.999227 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-345c64f4-8528-4a01-a90a-355ed264f804 tempest-VolumesActionsTest-1641117326 None] deleting rbd volume volume-23c42ce4-4736-4baf-b932-e86ed8721017 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:47:21.232583 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-345c64f4-8528-4a01-a90a-355ed264f804 tempest-VolumesActionsTest-1641117326 None] Created reservations ['ebf4b3e3-118e-4bd4-ad3f-8336572f06fc', 'a3519432-e755-453d-9804-0858606d75eb', 'd6981800-4d4d-4a76-9751-ea1f98a21d78', 'adf06435-1472-44ba-995b-098a03b6502e'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:47:21.347442 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=53,cinder:UPDATE=35,cinder:DELETE=5,cinder:INSERT=7 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:47:21.421253 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-345c64f4-8528-4a01-a90a-355ed264f804 tempest-VolumesActionsTest-1641117326 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:47:21.453636 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-345c64f4-8528-4a01-a90a-355ed264f804 tempest-VolumesActionsTest-1641117326 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:47:21.477080 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-345c64f4-8528-4a01-a90a-355ed264f804 tempest-VolumesActionsTest-1641117326 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:47:21.482365 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-345c64f4-8528-4a01-a90a-355ed264f804 tempest-VolumesActionsTest-1641117326 None] Deleted volume successfully. May 21 21:47:21.602245 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-345c64f4-8528-4a01-a90a-355ed264f804 tempest-VolumesActionsTest-1641117326 None] Lock "b'cinder-23c42ce4-4736-4baf-b932-e86ed8721017-delete_volume'" released by "delete_volume" :: held 10.254s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:47:22.008884 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-8b8d86fb-1256-4eae-9fb0-4cbd7022b5a7 req-099c0b3c-1579-4eb7-949e-31e482ea73b1 tempest-VolumesSnapshotTestJSON-2065732980 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:47:22.732048 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddb9044b-4b9a-43d9-bd9d-81d01fc1d5eb tempest-VolumesActionsTest-1843210645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:47:22.752825 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ddb9044b-4b9a-43d9-bd9d-81d01fc1d5eb tempest-VolumesActionsTest-1843210645 None] Flow 'volume_create_manager' (846b1f8e-55c5-454e-8bb9-959841f1ad2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:47:22.759268 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ddb9044b-4b9a-43d9-bd9d-81d01fc1d5eb tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a30c360-65d8-4186-9313-f657dfb2b7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:47:22.762973 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-8b8d86fb-1256-4eae-9fb0-4cbd7022b5a7 req-099c0b3c-1579-4eb7-949e-31e482ea73b1 tempest-VolumesSnapshotTestJSON-2065732980 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.754s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:47:22.765057 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-8b8d86fb-1256-4eae-9fb0-4cbd7022b5a7 req-099c0b3c-1579-4eb7-949e-31e482ea73b1 tempest-VolumesSnapshotTestJSON-2065732980 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-83ee5203-dcde-4e2f-9c30-819d45781c45', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'efef91cd-d8f8-4d93-9ad2-86d0b33251f4', 'volume_id': '83ee5203-dcde-4e2f-9c30-819d45781c45', 'discard': True}} {{(pid=124407) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} May 21 21:47:22.786095 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ddb9044b-4b9a-43d9-bd9d-81d01fc1d5eb tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a30c360-65d8-4186-9313-f657dfb2b7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1942426819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=aefed03a-7ef6-4f34-aff9-24a1d76f9f2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e77549b3c184b4ba121a88322438858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:47:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:47:23Z,use_quota=True,user_id='5af6cf74a0ee4034891f69eeb773848c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:47:22.791449 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ddb9044b-4b9a-43d9-bd9d-81d01fc1d5eb tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f9235df-cc2e-496c-bd80-33fb72e702e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:47:22.796198 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ddb9044b-4b9a-43d9-bd9d-81d01fc1d5eb tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f9235df-cc2e-496c-bd80-33fb72e702e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:47:22.801189 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ddb9044b-4b9a-43d9-bd9d-81d01fc1d5eb tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78286220-c2a1-46ef-8af3-287b9ff3621f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:47:22.805471 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ddb9044b-4b9a-43d9-bd9d-81d01fc1d5eb tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78286220-c2a1-46ef-8af3-287b9ff3621f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aefed03a-7ef6-4f34-aff9-24a1d76f9f2f', 'volume_name': 'volume-aefed03a-7ef6-4f34-aff9-24a1d76f9f2f', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:47:22.810324 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ddb9044b-4b9a-43d9-bd9d-81d01fc1d5eb tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a76ddb62-2f83-4f21-b3a7-0c70208d005a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:47:22.814148 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ddb9044b-4b9a-43d9-bd9d-81d01fc1d5eb tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a76ddb62-2f83-4f21-b3a7-0c70208d005a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:47:22.819221 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ddb9044b-4b9a-43d9-bd9d-81d01fc1d5eb tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb47d657-5511-4043-a82c-4cbc4f9bad40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:47:22.820358 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-ddb9044b-4b9a-43d9-bd9d-81d01fc1d5eb tempest-VolumesActionsTest-1843210645 None] Volume aefed03a-7ef6-4f34-aff9-24a1d76f9f2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aefed03a-7ef6-4f34-aff9-24a1d76f9f2f', 'volume_size': 1} May 21 21:47:22.820784 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ddb9044b-4b9a-43d9-bd9d-81d01fc1d5eb tempest-VolumesActionsTest-1843210645 None] creating volume 'volume-aefed03a-7ef6-4f34-aff9-24a1d76f9f2f' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:47:22.821759 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ddb9044b-4b9a-43d9-bd9d-81d01fc1d5eb tempest-VolumesActionsTest-1843210645 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:47:22.969297 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-8b8d86fb-1256-4eae-9fb0-4cbd7022b5a7 req-099c0b3c-1579-4eb7-949e-31e482ea73b1 tempest-VolumesSnapshotTestJSON-2065732980 None] Connection info returned from driver {'name': 'volumes/volume-83ee5203-dcde-4e2f-9c30-819d45781c45', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '83ee5203-dcde-4e2f-9c30-819d45781c45', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '41391dbe-df18-4c44-8300-7875b6149e82'} {{(pid=124407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4826}} May 21 21:47:23.107184 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-8b8d86fb-1256-4eae-9fb0-4cbd7022b5a7 req-099c0b3c-1579-4eb7-949e-31e482ea73b1 tempest-VolumesSnapshotTestJSON-2065732980 None] attachment_update completed successfully. May 21 21:47:23.990822 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ddb9044b-4b9a-43d9-bd9d-81d01fc1d5eb tempest-VolumesActionsTest-1843210645 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:47:23.991478 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-ddb9044b-4b9a-43d9-bd9d-81d01fc1d5eb tempest-VolumesActionsTest-1843210645 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:47:23.995072 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ddb9044b-4b9a-43d9-bd9d-81d01fc1d5eb tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb47d657-5511-4043-a82c-4cbc4f9bad40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aefed03a-7ef6-4f34-aff9-24a1d76f9f2f', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:47:24.000593 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ddb9044b-4b9a-43d9-bd9d-81d01fc1d5eb tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7670349f-b329-4743-b976-02d4ad2e772d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:47:24.065921 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-ddb9044b-4b9a-43d9-bd9d-81d01fc1d5eb tempest-VolumesActionsTest-1843210645 None] Volume volume-aefed03a-7ef6-4f34-aff9-24a1d76f9f2f (aefed03a-7ef6-4f34-aff9-24a1d76f9f2f): created successfully May 21 21:47:24.070129 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ddb9044b-4b9a-43d9-bd9d-81d01fc1d5eb tempest-VolumesActionsTest-1843210645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7670349f-b329-4743-b976-02d4ad2e772d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:47:24.075565 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-ddb9044b-4b9a-43d9-bd9d-81d01fc1d5eb tempest-VolumesActionsTest-1843210645 None] Flow 'volume_create_manager' (846b1f8e-55c5-454e-8bb9-959841f1ad2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:47:24.127756 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-ddb9044b-4b9a-43d9-bd9d-81d01fc1d5eb tempest-VolumesActionsTest-1843210645 None] Created volume successfully. May 21 21:47:25.553717 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-9ef2b15d-e795-48c5-9b6f-dec773d4d5ea tempest-VolumesActionsTest-1843210645 None] Lock "b'cinder-aefed03a-7ef6-4f34-aff9-24a1d76f9f2f-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:47:25.686414 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-9ef2b15d-e795-48c5-9b6f-dec773d4d5ea tempest-VolumesActionsTest-1843210645 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:47:25.939198 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-9ef2b15d-e795-48c5-9b6f-dec773d4d5ea tempest-VolumesActionsTest-1843210645 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:47:25.940196 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-9ef2b15d-e795-48c5-9b6f-dec773d4d5ea tempest-VolumesActionsTest-1843210645 None] Volume volume-aefed03a-7ef6-4f34-aff9-24a1d76f9f2f is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:47:26.135877 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-9ef2b15d-e795-48c5-9b6f-dec773d4d5ea tempest-VolumesActionsTest-1843210645 None] deleting rbd volume volume-aefed03a-7ef6-4f34-aff9-24a1d76f9f2f {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:47:26.660052 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-f09b5d57-f0b0-4863-8c69-d384e4975cc9 tempest-VolumesSnapshotTestJSON-2065732980 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:47:29.044111 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-f09b5d57-f0b0-4863-8c69-d384e4975cc9 tempest-VolumesSnapshotTestJSON-2065732980 None] Create snapshot completed successfully May 21 21:47:30.208541 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-56585f2d-5b18-4aa6-8ca4-22286e52c05b tempest-VolumesSnapshotTestJSON-2065732980 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:47:32.804463 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-56585f2d-5b18-4aa6-8ca4-22286e52c05b tempest-VolumesSnapshotTestJSON-2065732980 None] Create snapshot completed successfully May 21 21:47:33.272430 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-18024e51-bcbc-42a3-8694-908bacfd776b tempest-VolumesSnapshotTestJSON-2065732980 None] Lock "b'cinder-4d124622-fc37-4b0c-ac50-2eea8feb0a44-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:47:33.273885 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-18024e51-bcbc-42a3-8694-908bacfd776b tempest-VolumesSnapshotTestJSON-2065732980 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:47:33.980743 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-9ef2b15d-e795-48c5-9b6f-dec773d4d5ea tempest-VolumesActionsTest-1843210645 None] Created reservations ['66b68d6c-3513-49f5-ad1d-4bb668b32aa7', 'd2fe7d21-689d-4112-8f19-0723f4441b4b', 'ec841a84-7710-4e6f-b2da-4d1360ab89a2', '27a05949-4669-489b-9241-d805e6a88a54'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:47:34.185538 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-9ef2b15d-e795-48c5-9b6f-dec773d4d5ea tempest-VolumesActionsTest-1843210645 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:47:34.211008 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-9ef2b15d-e795-48c5-9b6f-dec773d4d5ea tempest-VolumesActionsTest-1843210645 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:47:34.234905 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-9ef2b15d-e795-48c5-9b6f-dec773d4d5ea tempest-VolumesActionsTest-1843210645 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:47:34.239832 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-9ef2b15d-e795-48c5-9b6f-dec773d4d5ea tempest-VolumesActionsTest-1843210645 None] Deleted volume successfully. May 21 21:47:34.338537 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-9ef2b15d-e795-48c5-9b6f-dec773d4d5ea tempest-VolumesActionsTest-1843210645 None] Lock "b'cinder-aefed03a-7ef6-4f34-aff9-24a1d76f9f2f-delete_volume'" released by "delete_volume" :: held 8.785s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:47:35.348794 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-3f360a53-a8d9-4420-a599-5bf6835b7049 tempest-VolumesActionsTest-1843210645 None] Lock "b'cinder-588208c8-6177-436d-8f83-464854ff136f-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:47:35.456820 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3f360a53-a8d9-4420-a599-5bf6835b7049 tempest-VolumesActionsTest-1843210645 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:47:35.751971 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3f360a53-a8d9-4420-a599-5bf6835b7049 tempest-VolumesActionsTest-1843210645 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:47:35.753469 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3f360a53-a8d9-4420-a599-5bf6835b7049 tempest-VolumesActionsTest-1843210645 None] Volume volume-588208c8-6177-436d-8f83-464854ff136f is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:47:35.895131 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3f360a53-a8d9-4420-a599-5bf6835b7049 tempest-VolumesActionsTest-1843210645 None] deleting rbd volume volume-588208c8-6177-436d-8f83-464854ff136f {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:47:37.625677 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-b1d128ac-8798-4544-b467-b59afc2e01c9 tempest-VolumesBackupsTest-1124201519 None] Terminate volume connection completed successfully. May 21 21:47:37.641908 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-b1d128ac-8798-4544-b467-b59afc2e01c9 tempest-VolumesBackupsTest-1124201519 None] Remove volume export completed successfully. May 21 21:47:38.719927 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=66,cinder:UPDATE=24,cinder:INSERT=5,cinder:DELETE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:47:38.788142 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-50b8ce87-547d-46da-9c9c-8868696c3446 tempest-VolumesBackupsTest-1124201519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:47:38.807759 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-50b8ce87-547d-46da-9c9c-8868696c3446 tempest-VolumesBackupsTest-1124201519 None] Flow 'volume_create_manager' (85a67103-57f7-4a0c-a8f8-b86569e7bce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:47:38.814123 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-50b8ce87-547d-46da-9c9c-8868696c3446 tempest-VolumesBackupsTest-1124201519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1524bfc-f626-40f5-affe-99709c0790f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:47:38.830654 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-50b8ce87-547d-46da-9c9c-8868696c3446 tempest-VolumesBackupsTest-1124201519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1524bfc-f626-40f5-affe-99709c0790f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:47:38Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_120a6fc9-734f-4922-b4fd-18aa921c6a95',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=cdcd9231-3c54-4c5f-bbba-be95a920c99d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3ad039cefcd45fa827017cf6c30c895',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:47:39Z,use_quota=True,user_id='5c8068f63a974cf09e08695c80e57871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:47:38.836004 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-50b8ce87-547d-46da-9c9c-8868696c3446 tempest-VolumesBackupsTest-1124201519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e6812bf-2338-4673-9fb9-3f4d26da9085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:47:38.840228 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-50b8ce87-547d-46da-9c9c-8868696c3446 tempest-VolumesBackupsTest-1124201519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e6812bf-2338-4673-9fb9-3f4d26da9085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:47:38.845375 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-50b8ce87-547d-46da-9c9c-8868696c3446 tempest-VolumesBackupsTest-1124201519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2857a305-0f3c-46d8-b28e-d37b822758bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:47:38.850033 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-50b8ce87-547d-46da-9c9c-8868696c3446 tempest-VolumesBackupsTest-1124201519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2857a305-0f3c-46d8-b28e-d37b822758bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdcd9231-3c54-4c5f-bbba-be95a920c99d', 'volume_name': 'volume-cdcd9231-3c54-4c5f-bbba-be95a920c99d', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:47:38.855463 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-50b8ce87-547d-46da-9c9c-8868696c3446 tempest-VolumesBackupsTest-1124201519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (098960ab-0819-40ca-a852-a883e79b08e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:47:38.858836 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-50b8ce87-547d-46da-9c9c-8868696c3446 tempest-VolumesBackupsTest-1124201519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (098960ab-0819-40ca-a852-a883e79b08e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:47:38.863868 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-50b8ce87-547d-46da-9c9c-8868696c3446 tempest-VolumesBackupsTest-1124201519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69dbe4b3-f8ae-4e16-8384-49de47a93d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:47:38.864951 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-50b8ce87-547d-46da-9c9c-8868696c3446 tempest-VolumesBackupsTest-1124201519 None] Volume cdcd9231-3c54-4c5f-bbba-be95a920c99d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdcd9231-3c54-4c5f-bbba-be95a920c99d', 'volume_size': 1} May 21 21:47:38.865338 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-50b8ce87-547d-46da-9c9c-8868696c3446 tempest-VolumesBackupsTest-1124201519 None] creating volume 'volume-cdcd9231-3c54-4c5f-bbba-be95a920c99d' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:47:38.866085 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-50b8ce87-547d-46da-9c9c-8868696c3446 tempest-VolumesBackupsTest-1124201519 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:47:39.656609 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-50b8ce87-547d-46da-9c9c-8868696c3446 tempest-VolumesBackupsTest-1124201519 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:47:39.656991 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-50b8ce87-547d-46da-9c9c-8868696c3446 tempest-VolumesBackupsTest-1124201519 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:47:39.660789 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-50b8ce87-547d-46da-9c9c-8868696c3446 tempest-VolumesBackupsTest-1124201519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69dbe4b3-f8ae-4e16-8384-49de47a93d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdcd9231-3c54-4c5f-bbba-be95a920c99d', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:47:39.665338 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-50b8ce87-547d-46da-9c9c-8868696c3446 tempest-VolumesBackupsTest-1124201519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c39698a-05f1-4fa9-a1f8-7a8eec24fa13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:47:39.775111 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-50b8ce87-547d-46da-9c9c-8868696c3446 tempest-VolumesBackupsTest-1124201519 None] Volume volume-cdcd9231-3c54-4c5f-bbba-be95a920c99d (cdcd9231-3c54-4c5f-bbba-be95a920c99d): created successfully May 21 21:47:39.778650 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-50b8ce87-547d-46da-9c9c-8868696c3446 tempest-VolumesBackupsTest-1124201519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c39698a-05f1-4fa9-a1f8-7a8eec24fa13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:47:39.784678 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-50b8ce87-547d-46da-9c9c-8868696c3446 tempest-VolumesBackupsTest-1124201519 None] Flow 'volume_create_manager' (85a67103-57f7-4a0c-a8f8-b86569e7bce8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:47:39.872179 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-50b8ce87-547d-46da-9c9c-8868696c3446 tempest-VolumesBackupsTest-1124201519 None] Created volume successfully. May 21 21:47:40.889318 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [None req-50b8ce87-547d-46da-9c9c-8868696c3446 tempest-VolumesBackupsTest-1124201519 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:47:41.038718 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-3f360a53-a8d9-4420-a599-5bf6835b7049 tempest-VolumesActionsTest-1843210645 None] Created reservations ['65b63800-60df-408b-8681-1676a84b05e2', '2245bee9-f3e3-49e1-8fb4-84d904976672', 'c73b2eb1-fc03-4f9b-bce8-a48155fae15c', '2199dfe3-a1d6-4c56-9b87-19c5a2f781fa'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:47:41.227274 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3f360a53-a8d9-4420-a599-5bf6835b7049 tempest-VolumesActionsTest-1843210645 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:47:41.253678 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3f360a53-a8d9-4420-a599-5bf6835b7049 tempest-VolumesActionsTest-1843210645 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:47:41.386632 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-3f360a53-a8d9-4420-a599-5bf6835b7049 tempest-VolumesActionsTest-1843210645 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:47:41.392005 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-3f360a53-a8d9-4420-a599-5bf6835b7049 tempest-VolumesActionsTest-1843210645 None] Deleted volume successfully. May 21 21:47:41.487847 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-3f360a53-a8d9-4420-a599-5bf6835b7049 tempest-VolumesActionsTest-1843210645 None] Lock "b'cinder-588208c8-6177-436d-8f83-464854ff136f-delete_volume'" released by "delete_volume" :: held 6.139s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:47:41.626255 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [None req-50b8ce87-547d-46da-9c9c-8868696c3446 tempest-VolumesBackupsTest-1124201519 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.737s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:47:41.626996 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-50b8ce87-547d-46da-9c9c-8868696c3446 tempest-VolumesBackupsTest-1124201519 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-cdcd9231-3c54-4c5f-bbba-be95a920c99d', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'efef91cd-d8f8-4d93-9ad2-86d0b33251f4', 'volume_id': 'cdcd9231-3c54-4c5f-bbba-be95a920c99d', 'discard': True}} {{(pid=124407) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} May 21 21:47:41.639517 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-50b8ce87-547d-46da-9c9c-8868696c3446 tempest-VolumesBackupsTest-1124201519 None] Initialize volume connection completed successfully. May 21 21:47:48.134681 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=63,cinder:UPDATE=28,cinder:DELETE=5,cinder:INSERT=4 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:47:48.245108 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-c33c7c9a-fff6-43c3-835d-a359eef4b9a5 tempest-VolumesBackupsAdminTest-93613926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:47:48.267030 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-c33c7c9a-fff6-43c3-835d-a359eef4b9a5 tempest-VolumesBackupsAdminTest-93613926 None] Flow 'volume_create_manager' (22bba446-cae2-438a-b2f5-abe90bd41e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:47:48.274402 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-c33c7c9a-fff6-43c3-835d-a359eef4b9a5 tempest-VolumesBackupsAdminTest-93613926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86c37a2d-c438-4df3-9c7f-9ca735272f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:47:48.291939 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-c33c7c9a-fff6-43c3-835d-a359eef4b9a5 tempest-VolumesBackupsAdminTest-93613926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86c37a2d-c438-4df3-9c7f-9ca735272f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-938628546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=336962e7-0d9e-450f-b17a-be42bd84e9a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='616a8123913f448dbe5c6df99a5d9a29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:47:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:47:48Z,use_quota=True,user_id='7341b4ae02794b8c93dce57baa4d8abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:47:48.297291 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-c33c7c9a-fff6-43c3-835d-a359eef4b9a5 tempest-VolumesBackupsAdminTest-93613926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf2fb839-5751-460b-a2d1-bdf78c117def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:47:48.301648 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-c33c7c9a-fff6-43c3-835d-a359eef4b9a5 tempest-VolumesBackupsAdminTest-93613926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf2fb839-5751-460b-a2d1-bdf78c117def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:47:48.307321 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-c33c7c9a-fff6-43c3-835d-a359eef4b9a5 tempest-VolumesBackupsAdminTest-93613926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0310fa7f-47ec-4bd1-bacd-6c0bd5ff0487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:47:48.311557 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-c33c7c9a-fff6-43c3-835d-a359eef4b9a5 tempest-VolumesBackupsAdminTest-93613926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0310fa7f-47ec-4bd1-bacd-6c0bd5ff0487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '336962e7-0d9e-450f-b17a-be42bd84e9a4', 'volume_name': 'volume-336962e7-0d9e-450f-b17a-be42bd84e9a4', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:47:48.317171 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-c33c7c9a-fff6-43c3-835d-a359eef4b9a5 tempest-VolumesBackupsAdminTest-93613926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bac4d9f-de5e-438c-ad5f-c86317900c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:47:48.321210 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-c33c7c9a-fff6-43c3-835d-a359eef4b9a5 tempest-VolumesBackupsAdminTest-93613926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bac4d9f-de5e-438c-ad5f-c86317900c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:47:48.332453 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-c33c7c9a-fff6-43c3-835d-a359eef4b9a5 tempest-VolumesBackupsAdminTest-93613926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dee79a5f-e608-45b5-b9db-ccd7636c0d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:47:48.332453 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-c33c7c9a-fff6-43c3-835d-a359eef4b9a5 tempest-VolumesBackupsAdminTest-93613926 None] Volume 336962e7-0d9e-450f-b17a-be42bd84e9a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-336962e7-0d9e-450f-b17a-be42bd84e9a4', 'volume_size': 1} May 21 21:47:48.332453 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c33c7c9a-fff6-43c3-835d-a359eef4b9a5 tempest-VolumesBackupsAdminTest-93613926 None] creating volume 'volume-336962e7-0d9e-450f-b17a-be42bd84e9a4' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:47:48.332453 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c33c7c9a-fff6-43c3-835d-a359eef4b9a5 tempest-VolumesBackupsAdminTest-93613926 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:47:49.468862 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c33c7c9a-fff6-43c3-835d-a359eef4b9a5 tempest-VolumesBackupsAdminTest-93613926 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:47:49.469539 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c33c7c9a-fff6-43c3-835d-a359eef4b9a5 tempest-VolumesBackupsAdminTest-93613926 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:47:49.473687 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-c33c7c9a-fff6-43c3-835d-a359eef4b9a5 tempest-VolumesBackupsAdminTest-93613926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dee79a5f-e608-45b5-b9db-ccd7636c0d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-336962e7-0d9e-450f-b17a-be42bd84e9a4', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:47:49.478511 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-c33c7c9a-fff6-43c3-835d-a359eef4b9a5 tempest-VolumesBackupsAdminTest-93613926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (054f3868-7499-4f35-bd2d-40bf037bb882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:47:49.555917 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-c33c7c9a-fff6-43c3-835d-a359eef4b9a5 tempest-VolumesBackupsAdminTest-93613926 None] Volume volume-336962e7-0d9e-450f-b17a-be42bd84e9a4 (336962e7-0d9e-450f-b17a-be42bd84e9a4): created successfully May 21 21:47:49.559444 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-c33c7c9a-fff6-43c3-835d-a359eef4b9a5 tempest-VolumesBackupsAdminTest-93613926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (054f3868-7499-4f35-bd2d-40bf037bb882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:47:49.564888 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-c33c7c9a-fff6-43c3-835d-a359eef4b9a5 tempest-VolumesBackupsAdminTest-93613926 None] Flow 'volume_create_manager' (22bba446-cae2-438a-b2f5-abe90bd41e7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:47:49.657423 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-c33c7c9a-fff6-43c3-835d-a359eef4b9a5 tempest-VolumesBackupsAdminTest-93613926 None] Created volume successfully. May 21 21:47:50.863055 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-499f4327-e044-4614-b76a-c805ee0c4346 tempest-VolumesBackupsAdminTest-93613926 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-05-21T21:47:50Z,data_timestamp=2022-05-21T21:47:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-86683632',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=87b69e6c-4288-4106-8b47-27e6a206202a,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='616a8123913f448dbe5c6df99a5d9a29',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='7341b4ae02794b8c93dce57baa4d8abb',volume_id=336962e7-0d9e-450f-b17a-be42bd84e9a4) May 21 21:47:50.863830 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.backup.rpcapi [None req-499f4327-e044-4614-b76a-c805ee0c4346 tempest-VolumesBackupsAdminTest-93613926 None] continue_backup in rpcapi backup_id 87b69e6c-4288-4106-8b47-27e6a206202a {{(pid=124407) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} May 21 21:47:50.980436 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [None req-499f4327-e044-4614-b76a-c805ee0c4346 tempest-VolumesBackupsAdminTest-93613926 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:47:51.738620 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [None req-499f4327-e044-4614-b76a-c805ee0c4346 tempest-VolumesBackupsAdminTest-93613926 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.758s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:47:51.740327 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-499f4327-e044-4614-b76a-c805ee0c4346 tempest-VolumesBackupsAdminTest-93613926 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-336962e7-0d9e-450f-b17a-be42bd84e9a4', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'efef91cd-d8f8-4d93-9ad2-86d0b33251f4', 'volume_id': '336962e7-0d9e-450f-b17a-be42bd84e9a4', 'discard': True}} {{(pid=124407) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} May 21 21:47:51.762466 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-499f4327-e044-4614-b76a-c805ee0c4346 tempest-VolumesBackupsAdminTest-93613926 None] Initialize volume connection completed successfully. May 21 21:47:56.170124 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:47:56.172311 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:47:56.217444 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:47:56.254743 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:48:00.992109 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-499f4327-e044-4614-b76a-c805ee0c4346 tempest-VolumesBackupsAdminTest-93613926 None] Terminate volume connection completed successfully. May 21 21:48:01.008952 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-499f4327-e044-4614-b76a-c805ee0c4346 tempest-VolumesBackupsAdminTest-93613926 None] Remove volume export completed successfully. May 21 21:48:04.869377 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a21ff20-1b15-4243-aca2-1b13cc96aafa tempest-VolumesBackupsAdminTest-93613926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:48:04.890025 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-2a21ff20-1b15-4243-aca2-1b13cc96aafa tempest-VolumesBackupsAdminTest-93613926 None] Flow 'volume_create_manager' (35022028-8334-45aa-ae15-a1539bf12e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:48:04.896448 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-2a21ff20-1b15-4243-aca2-1b13cc96aafa tempest-VolumesBackupsAdminTest-93613926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (effcef9c-8bb2-4884-860d-6e400c68192d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:48:04.913948 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-2a21ff20-1b15-4243-aca2-1b13cc96aafa tempest-VolumesBackupsAdminTest-93613926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (effcef9c-8bb2-4884-860d-6e400c68192d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:48:04Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_87b69e6c-4288-4106-8b47-27e6a206202a',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a0e45e0a-1ce2-448f-8218-e4d2daea044d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='616a8123913f448dbe5c6df99a5d9a29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:48:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:48:05Z,use_quota=True,user_id='7341b4ae02794b8c93dce57baa4d8abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:48:04.919171 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-2a21ff20-1b15-4243-aca2-1b13cc96aafa tempest-VolumesBackupsAdminTest-93613926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ffd6569-ca26-4054-bceb-3c692cd42707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:48:04.925931 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-2a21ff20-1b15-4243-aca2-1b13cc96aafa tempest-VolumesBackupsAdminTest-93613926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ffd6569-ca26-4054-bceb-3c692cd42707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:48:04.929509 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-2a21ff20-1b15-4243-aca2-1b13cc96aafa tempest-VolumesBackupsAdminTest-93613926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45c64ad3-f24c-4d42-8313-6874fcf5f022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:48:04.933953 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-2a21ff20-1b15-4243-aca2-1b13cc96aafa tempest-VolumesBackupsAdminTest-93613926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45c64ad3-f24c-4d42-8313-6874fcf5f022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0e45e0a-1ce2-448f-8218-e4d2daea044d', 'volume_name': 'volume-a0e45e0a-1ce2-448f-8218-e4d2daea044d', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:48:04.938767 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-2a21ff20-1b15-4243-aca2-1b13cc96aafa tempest-VolumesBackupsAdminTest-93613926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ece76022-cbd3-4787-a975-6b4831f994f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:48:04.942688 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-2a21ff20-1b15-4243-aca2-1b13cc96aafa tempest-VolumesBackupsAdminTest-93613926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ece76022-cbd3-4787-a975-6b4831f994f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:48:04.947644 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-2a21ff20-1b15-4243-aca2-1b13cc96aafa tempest-VolumesBackupsAdminTest-93613926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9763e5ea-c09b-48e7-9576-2764e0c109ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:48:04.948721 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-2a21ff20-1b15-4243-aca2-1b13cc96aafa tempest-VolumesBackupsAdminTest-93613926 None] Volume a0e45e0a-1ce2-448f-8218-e4d2daea044d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0e45e0a-1ce2-448f-8218-e4d2daea044d', 'volume_size': 1} May 21 21:48:04.949126 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-2a21ff20-1b15-4243-aca2-1b13cc96aafa tempest-VolumesBackupsAdminTest-93613926 None] creating volume 'volume-a0e45e0a-1ce2-448f-8218-e4d2daea044d' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:48:04.949901 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-2a21ff20-1b15-4243-aca2-1b13cc96aafa tempest-VolumesBackupsAdminTest-93613926 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:48:05.746799 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-18024e51-bcbc-42a3-8694-908bacfd776b tempest-VolumesSnapshotTestJSON-2065732980 None] Created reservations ['b8e2a320-1358-4b0e-b5dc-c2efb7901a9a', 'd1837d6a-1e60-447a-9d98-5325a3312fe7', 'aa2e9f5a-7bc3-4e0f-a02a-e50d64ea5c9b', 'e5521352-f6df-4225-b642-a83eecef05f0'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:48:05.956410 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-18024e51-bcbc-42a3-8694-908bacfd776b tempest-VolumesSnapshotTestJSON-2065732980 None] Delete snapshot completed successfully. May 21 21:48:05.965533 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-18024e51-bcbc-42a3-8694-908bacfd776b tempest-VolumesSnapshotTestJSON-2065732980 None] Lock "b'cinder-4d124622-fc37-4b0c-ac50-2eea8feb0a44-delete_snapshot'" released by "delete_snapshot" :: held 32.690s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:48:06.312951 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-9ccc5048-f5c7-406f-aae3-9a2ff31a73c3 tempest-VolumesSnapshotTestJSON-2065732980 None] Lock "b'cinder-81a8034a-f25a-428a-a8b4-4746b00d4c63-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:48:06.314914 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-9ccc5048-f5c7-406f-aae3-9a2ff31a73c3 tempest-VolumesSnapshotTestJSON-2065732980 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:48:06.972632 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-2a21ff20-1b15-4243-aca2-1b13cc96aafa tempest-VolumesBackupsAdminTest-93613926 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:48:06.973296 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-2a21ff20-1b15-4243-aca2-1b13cc96aafa tempest-VolumesBackupsAdminTest-93613926 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:48:06.977168 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-2a21ff20-1b15-4243-aca2-1b13cc96aafa tempest-VolumesBackupsAdminTest-93613926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9763e5ea-c09b-48e7-9576-2764e0c109ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0e45e0a-1ce2-448f-8218-e4d2daea044d', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:48:06.981751 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-2a21ff20-1b15-4243-aca2-1b13cc96aafa tempest-VolumesBackupsAdminTest-93613926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65918eea-d057-48fc-95f9-bd4309caedea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:48:07.049367 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-2a21ff20-1b15-4243-aca2-1b13cc96aafa tempest-VolumesBackupsAdminTest-93613926 None] Volume volume-a0e45e0a-1ce2-448f-8218-e4d2daea044d (a0e45e0a-1ce2-448f-8218-e4d2daea044d): created successfully May 21 21:48:07.052985 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-2a21ff20-1b15-4243-aca2-1b13cc96aafa tempest-VolumesBackupsAdminTest-93613926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65918eea-d057-48fc-95f9-bd4309caedea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:48:07.059349 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-2a21ff20-1b15-4243-aca2-1b13cc96aafa tempest-VolumesBackupsAdminTest-93613926 None] Flow 'volume_create_manager' (35022028-8334-45aa-ae15-a1539bf12e6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:48:07.134836 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-2a21ff20-1b15-4243-aca2-1b13cc96aafa tempest-VolumesBackupsAdminTest-93613926 None] Created volume successfully. May 21 21:48:07.889321 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [None req-2a21ff20-1b15-4243-aca2-1b13cc96aafa tempest-VolumesBackupsAdminTest-93613926 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:48:08.528685 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [None req-2a21ff20-1b15-4243-aca2-1b13cc96aafa tempest-VolumesBackupsAdminTest-93613926 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.639s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:48:08.529848 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-2a21ff20-1b15-4243-aca2-1b13cc96aafa tempest-VolumesBackupsAdminTest-93613926 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a0e45e0a-1ce2-448f-8218-e4d2daea044d', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'efef91cd-d8f8-4d93-9ad2-86d0b33251f4', 'volume_id': 'a0e45e0a-1ce2-448f-8218-e4d2daea044d', 'discard': True}} {{(pid=124407) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} May 21 21:48:08.545624 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-2a21ff20-1b15-4243-aca2-1b13cc96aafa tempest-VolumesBackupsAdminTest-93613926 None] Initialize volume connection completed successfully. May 21 21:48:12.816984 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:UPDATE=18,cinder:SELECT=51,cinder:INSERT=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:48:12.826798 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-2a21ff20-1b15-4243-aca2-1b13cc96aafa tempest-VolumesBackupsAdminTest-93613926 None] Terminate volume connection completed successfully. May 21 21:48:12.843674 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-2a21ff20-1b15-4243-aca2-1b13cc96aafa tempest-VolumesBackupsAdminTest-93613926 None] Remove volume export completed successfully. May 21 21:48:14.339861 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-8f04358e-859d-4d15-a3fb-4b327ec225aa tempest-VolumesBackupsAdminTest-93613926 None] Lock "b'cinder-a0e45e0a-1ce2-448f-8218-e4d2daea044d-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:48:14.465568 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8f04358e-859d-4d15-a3fb-4b327ec225aa tempest-VolumesBackupsAdminTest-93613926 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:48:17.077069 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8f04358e-859d-4d15-a3fb-4b327ec225aa tempest-VolumesBackupsAdminTest-93613926 None] Volume volume-a0e45e0a-1ce2-448f-8218-e4d2daea044d is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:48:17.695262 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8f04358e-859d-4d15-a3fb-4b327ec225aa tempest-VolumesBackupsAdminTest-93613926 None] deleting rbd volume volume-a0e45e0a-1ce2-448f-8218-e4d2daea044d {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:48:25.151953 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:UPDATE=9,cinder:SELECT=32,cinder:DELETE=2,cinder:INSERT=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:48:25.267538 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-8f04358e-859d-4d15-a3fb-4b327ec225aa tempest-VolumesBackupsAdminTest-93613926 None] Created reservations ['8637920e-4858-4988-9c75-19d9d6205471', '1076f099-ad1a-491b-af16-a6fdea599f32', '1187b037-9946-4850-b7e2-ccb0ec506e52', '840077f7-3aa1-4004-84ea-3992ad29c52b'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:48:25.529749 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8f04358e-859d-4d15-a3fb-4b327ec225aa tempest-VolumesBackupsAdminTest-93613926 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:48:25.552109 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8f04358e-859d-4d15-a3fb-4b327ec225aa tempest-VolumesBackupsAdminTest-93613926 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:48:25.577421 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-8f04358e-859d-4d15-a3fb-4b327ec225aa tempest-VolumesBackupsAdminTest-93613926 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:48:25.582544 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-8f04358e-859d-4d15-a3fb-4b327ec225aa tempest-VolumesBackupsAdminTest-93613926 None] Deleted volume successfully. May 21 21:48:25.692643 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-8f04358e-859d-4d15-a3fb-4b327ec225aa tempest-VolumesBackupsAdminTest-93613926 None] Lock "b'cinder-a0e45e0a-1ce2-448f-8218-e4d2daea044d-delete_volume'" released by "delete_volume" :: held 11.353s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:48:28.642045 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-50b8ce87-547d-46da-9c9c-8868696c3446 tempest-VolumesBackupsTest-1124201519 None] Terminate volume connection completed successfully. May 21 21:48:28.659664 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-50b8ce87-547d-46da-9c9c-8868696c3446 tempest-VolumesBackupsTest-1124201519 None] Remove volume export completed successfully. May 21 21:48:29.010936 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-a684a767-63e9-4d28-bdb7-5b9ae5f5466b tempest-VolumesBackupsAdminTest-93613926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:48:29.032160 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a684a767-63e9-4d28-bdb7-5b9ae5f5466b tempest-VolumesBackupsAdminTest-93613926 None] Flow 'volume_create_manager' (ceb98351-a54f-4edf-8bc9-7775e05036ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:48:29.039257 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a684a767-63e9-4d28-bdb7-5b9ae5f5466b tempest-VolumesBackupsAdminTest-93613926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3670ddbb-8742-473b-a4b4-71974680c119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:48:29.056565 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a684a767-63e9-4d28-bdb7-5b9ae5f5466b tempest-VolumesBackupsAdminTest-93613926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3670ddbb-8742-473b-a4b4-71974680c119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-2054028846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e4d1d25d-f3eb-46dd-9df2-6771f40e4ce8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='616a8123913f448dbe5c6df99a5d9a29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:48:29Z,use_quota=True,user_id='7341b4ae02794b8c93dce57baa4d8abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:48:29.061876 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a684a767-63e9-4d28-bdb7-5b9ae5f5466b tempest-VolumesBackupsAdminTest-93613926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc53bd64-41c4-4bc7-9e18-c7bbda146a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:48:29.066469 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a684a767-63e9-4d28-bdb7-5b9ae5f5466b tempest-VolumesBackupsAdminTest-93613926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc53bd64-41c4-4bc7-9e18-c7bbda146a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:48:29.071482 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a684a767-63e9-4d28-bdb7-5b9ae5f5466b tempest-VolumesBackupsAdminTest-93613926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8b40577-3dec-449b-98ac-8a0b4f5faa1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:48:29.075473 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a684a767-63e9-4d28-bdb7-5b9ae5f5466b tempest-VolumesBackupsAdminTest-93613926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8b40577-3dec-449b-98ac-8a0b4f5faa1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4d1d25d-f3eb-46dd-9df2-6771f40e4ce8', 'volume_name': 'volume-e4d1d25d-f3eb-46dd-9df2-6771f40e4ce8', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:48:29.081276 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a684a767-63e9-4d28-bdb7-5b9ae5f5466b tempest-VolumesBackupsAdminTest-93613926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1ca8be4-2686-404d-808f-d99c3f72e7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:48:29.085623 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a684a767-63e9-4d28-bdb7-5b9ae5f5466b tempest-VolumesBackupsAdminTest-93613926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1ca8be4-2686-404d-808f-d99c3f72e7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:48:29.090322 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a684a767-63e9-4d28-bdb7-5b9ae5f5466b tempest-VolumesBackupsAdminTest-93613926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76f61032-9183-41a6-be17-23b060fe5a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:48:29.092709 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-a684a767-63e9-4d28-bdb7-5b9ae5f5466b tempest-VolumesBackupsAdminTest-93613926 None] Volume e4d1d25d-f3eb-46dd-9df2-6771f40e4ce8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4d1d25d-f3eb-46dd-9df2-6771f40e4ce8', 'volume_size': 1} May 21 21:48:29.092709 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a684a767-63e9-4d28-bdb7-5b9ae5f5466b tempest-VolumesBackupsAdminTest-93613926 None] creating volume 'volume-e4d1d25d-f3eb-46dd-9df2-6771f40e4ce8' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:48:29.093120 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a684a767-63e9-4d28-bdb7-5b9ae5f5466b tempest-VolumesBackupsAdminTest-93613926 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:48:29.395520 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-3dcfb1b6-5827-46fe-a94f-75c1b5e0a016 tempest-VolumesBackupsTest-1124201519 None] Lock "b'cinder-cdcd9231-3c54-4c5f-bbba-be95a920c99d-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:48:29.502562 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3dcfb1b6-5827-46fe-a94f-75c1b5e0a016 tempest-VolumesBackupsTest-1124201519 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:48:31.978109 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3dcfb1b6-5827-46fe-a94f-75c1b5e0a016 tempest-VolumesBackupsTest-1124201519 None] Volume volume-cdcd9231-3c54-4c5f-bbba-be95a920c99d is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:48:32.416742 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3dcfb1b6-5827-46fe-a94f-75c1b5e0a016 tempest-VolumesBackupsTest-1124201519 None] deleting rbd volume volume-cdcd9231-3c54-4c5f-bbba-be95a920c99d {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:48:32.426174 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a684a767-63e9-4d28-bdb7-5b9ae5f5466b tempest-VolumesBackupsAdminTest-93613926 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:48:32.427928 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a684a767-63e9-4d28-bdb7-5b9ae5f5466b tempest-VolumesBackupsAdminTest-93613926 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:48:32.430635 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a684a767-63e9-4d28-bdb7-5b9ae5f5466b tempest-VolumesBackupsAdminTest-93613926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76f61032-9183-41a6-be17-23b060fe5a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4d1d25d-f3eb-46dd-9df2-6771f40e4ce8', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:48:32.438011 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a684a767-63e9-4d28-bdb7-5b9ae5f5466b tempest-VolumesBackupsAdminTest-93613926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73e5f8e2-d0de-411f-9790-6a182ca60785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:48:32.510415 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-a684a767-63e9-4d28-bdb7-5b9ae5f5466b tempest-VolumesBackupsAdminTest-93613926 None] Volume volume-e4d1d25d-f3eb-46dd-9df2-6771f40e4ce8 (e4d1d25d-f3eb-46dd-9df2-6771f40e4ce8): created successfully May 21 21:48:32.514255 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a684a767-63e9-4d28-bdb7-5b9ae5f5466b tempest-VolumesBackupsAdminTest-93613926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73e5f8e2-d0de-411f-9790-6a182ca60785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:48:32.520550 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-a684a767-63e9-4d28-bdb7-5b9ae5f5466b tempest-VolumesBackupsAdminTest-93613926 None] Flow 'volume_create_manager' (ceb98351-a54f-4edf-8bc9-7775e05036ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:48:32.596316 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-a684a767-63e9-4d28-bdb7-5b9ae5f5466b tempest-VolumesBackupsAdminTest-93613926 None] Created volume successfully. May 21 21:48:33.634705 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-e6024909-d302-4325-ad02-655018fff235 tempest-VolumesBackupsAdminTest-93613926 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-05-21T21:48:33Z,data_timestamp=2022-05-21T21:48:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-1874345924',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=bd21ab44-be55-4e8a-807f-9e340bd445ae,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='616a8123913f448dbe5c6df99a5d9a29',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='7341b4ae02794b8c93dce57baa4d8abb',volume_id=e4d1d25d-f3eb-46dd-9df2-6771f40e4ce8) May 21 21:48:33.635724 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.backup.rpcapi [None req-e6024909-d302-4325-ad02-655018fff235 tempest-VolumesBackupsAdminTest-93613926 None] continue_backup in rpcapi backup_id bd21ab44-be55-4e8a-807f-9e340bd445ae {{(pid=124407) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} May 21 21:48:33.767419 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [None req-e6024909-d302-4325-ad02-655018fff235 tempest-VolumesBackupsAdminTest-93613926 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:48:34.495572 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [None req-e6024909-d302-4325-ad02-655018fff235 tempest-VolumesBackupsAdminTest-93613926 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.728s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:48:34.496661 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-e6024909-d302-4325-ad02-655018fff235 tempest-VolumesBackupsAdminTest-93613926 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e4d1d25d-f3eb-46dd-9df2-6771f40e4ce8', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'efef91cd-d8f8-4d93-9ad2-86d0b33251f4', 'volume_id': 'e4d1d25d-f3eb-46dd-9df2-6771f40e4ce8', 'discard': True}} {{(pid=124407) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} May 21 21:48:34.511791 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-e6024909-d302-4325-ad02-655018fff235 tempest-VolumesBackupsAdminTest-93613926 None] Initialize volume connection completed successfully. May 21 21:48:37.673848 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-9ccc5048-f5c7-406f-aae3-9a2ff31a73c3 tempest-VolumesSnapshotTestJSON-2065732980 None] Created reservations ['65a8779e-a133-40e0-a9e6-9ad9646b22d2', 'a7b7e64f-7212-48c4-8fbe-dff5ecc5ff61', 'f6840345-fb7e-4843-a3d5-d95d20d1a486', 'b261a43d-3bef-42dc-8bac-fc4f3c14feaa'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:48:37.836342 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-9ccc5048-f5c7-406f-aae3-9a2ff31a73c3 tempest-VolumesSnapshotTestJSON-2065732980 None] Delete snapshot completed successfully. May 21 21:48:37.842524 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-9ccc5048-f5c7-406f-aae3-9a2ff31a73c3 tempest-VolumesSnapshotTestJSON-2065732980 None] Lock "b'cinder-81a8034a-f25a-428a-a8b4-4746b00d4c63-delete_snapshot'" released by "delete_snapshot" :: held 31.530s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:48:38.302152 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-80673099-7ba7-44fd-ad3e-9c60959e94f4 tempest-VolumesSnapshotTestJSON-2065732980 None] Lock "b'cinder-8f8fcc52-5029-4da3-ab6a-66e0c31080bd-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.013s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:48:38.304222 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-80673099-7ba7-44fd-ad3e-9c60959e94f4 tempest-VolumesSnapshotTestJSON-2065732980 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:48:39.889257 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-e6024909-d302-4325-ad02-655018fff235 tempest-VolumesBackupsAdminTest-93613926 None] Terminate volume connection completed successfully. May 21 21:48:39.908308 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-e6024909-d302-4325-ad02-655018fff235 tempest-VolumesBackupsAdminTest-93613926 None] Remove volume export completed successfully. May 21 21:48:40.432546 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-3dcfb1b6-5827-46fe-a94f-75c1b5e0a016 tempest-VolumesBackupsTest-1124201519 None] Created reservations ['dedce7fe-6447-4ad3-b7c3-56252d1d3c3e', 'c0783c6b-9103-49d3-9f80-fd66487b825c', '3eccde1a-84e9-436d-bbf2-896cb6fe1e24', '898cc79b-3db4-4e7d-b1e1-567ad371f7ba'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:48:40.612665 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=60,cinder:UPDATE=31,cinder:INSERT=8,cinder:DELETE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:48:40.730199 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3dcfb1b6-5827-46fe-a94f-75c1b5e0a016 tempest-VolumesBackupsTest-1124201519 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:48:40.753555 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3dcfb1b6-5827-46fe-a94f-75c1b5e0a016 tempest-VolumesBackupsTest-1124201519 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:48:40.776650 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-3dcfb1b6-5827-46fe-a94f-75c1b5e0a016 tempest-VolumesBackupsTest-1124201519 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:48:40.781007 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-3dcfb1b6-5827-46fe-a94f-75c1b5e0a016 tempest-VolumesBackupsTest-1124201519 None] Deleted volume successfully. May 21 21:48:40.897399 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-3dcfb1b6-5827-46fe-a94f-75c1b5e0a016 tempest-VolumesBackupsTest-1124201519 None] Lock "b'cinder-cdcd9231-3c54-4c5f-bbba-be95a920c99d-delete_volume'" released by "delete_volume" :: held 11.502s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:48:51.438104 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-5fa965a1-02e7-46b1-81f3-6b7def3a3c3e tempest-VolumesBackupsAdminTest-93613926 None] Lock "b'cinder-e4d1d25d-f3eb-46dd-9df2-6771f40e4ce8-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:48:51.557838 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-5fa965a1-02e7-46b1-81f3-6b7def3a3c3e tempest-VolumesBackupsAdminTest-93613926 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:48:53.754716 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-5fa965a1-02e7-46b1-81f3-6b7def3a3c3e tempest-VolumesBackupsAdminTest-93613926 None] Volume volume-e4d1d25d-f3eb-46dd-9df2-6771f40e4ce8 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:48:54.002335 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-5fa965a1-02e7-46b1-81f3-6b7def3a3c3e tempest-VolumesBackupsAdminTest-93613926 None] deleting rbd volume volume-e4d1d25d-f3eb-46dd-9df2-6771f40e4ce8 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:48:54.017949 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-0ea40bcf-a325-4a67-9495-19b2bd41eaf6 tempest-VolumesBackupsTest-1124201519 None] Lock "b'cinder-c27e6a73-0caa-455a-a8cd-64afdd8fc3ed-delete_volume'" acquired by "delete_volume" :: waited 0.008s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:48:54.126907 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-0ea40bcf-a325-4a67-9495-19b2bd41eaf6 tempest-VolumesBackupsTest-1124201519 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:48:56.892953 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-0ea40bcf-a325-4a67-9495-19b2bd41eaf6 tempest-VolumesBackupsTest-1124201519 None] deleting rbd volume volume-c27e6a73-0caa-455a-a8cd-64afdd8fc3ed {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:48:56.899662 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:48:56.899662 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:48:56.941514 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:48:56.963515 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:48:56.971344 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=46,cinder:DELETE=2,cinder:UPDATE=19,cinder:INSERT=4 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:48:56.980737 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-5b929cd6-8adb-4716-9786-84ed119dec1b req-ddbf0aae-b13d-4406-8bc9-f9ea9239f11e tempest-TestVolumeBootPattern-343249266 None] Terminate volume connection completed successfully. May 21 21:48:56.981151 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-5b929cd6-8adb-4716-9786-84ed119dec1b req-ddbf0aae-b13d-4406-8bc9-f9ea9239f11e tempest-TestVolumeBootPattern-343249266 None] Deleting attachment 0db01838-7d30-46fd-80f0-897b39a1c6b7. {{(pid=124407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4957}} May 21 21:48:57.849414 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-5fa965a1-02e7-46b1-81f3-6b7def3a3c3e tempest-VolumesBackupsAdminTest-93613926 None] Created reservations ['c51f5b3f-1701-459d-a910-8f3d8055b4cf', 'b8128b1c-e348-461d-a077-6a5f21c98496', '2314d53e-0008-439b-83ba-dcc1c126fe5d', 'c0aa4b13-711f-431c-8c76-f240f7154296'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:48:58.071548 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-5fa965a1-02e7-46b1-81f3-6b7def3a3c3e tempest-VolumesBackupsAdminTest-93613926 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:48:58.093302 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-5fa965a1-02e7-46b1-81f3-6b7def3a3c3e tempest-VolumesBackupsAdminTest-93613926 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:48:58.118781 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-5fa965a1-02e7-46b1-81f3-6b7def3a3c3e tempest-VolumesBackupsAdminTest-93613926 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:48:58.122973 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-5fa965a1-02e7-46b1-81f3-6b7def3a3c3e tempest-VolumesBackupsAdminTest-93613926 None] Deleted volume successfully. May 21 21:48:58.208551 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-aec23291-9385-4313-9107-3ab13da6c5f0 tempest-TestVolumeBootPattern-343249266 None] Lock "b'cinder-0e7a744e-a92c-4fa2-bdf3-fe7de7654651-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:48:58.218518 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-5fa965a1-02e7-46b1-81f3-6b7def3a3c3e tempest-VolumesBackupsAdminTest-93613926 None] Lock "b'cinder-e4d1d25d-f3eb-46dd-9df2-6771f40e4ce8-delete_volume'" released by "delete_volume" :: held 6.780s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:48:58.289476 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aec23291-9385-4313-9107-3ab13da6c5f0 tempest-TestVolumeBootPattern-343249266 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:48:58.671875 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aec23291-9385-4313-9107-3ab13da6c5f0 tempest-TestVolumeBootPattern-343249266 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:48:58.781872 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aec23291-9385-4313-9107-3ab13da6c5f0 tempest-TestVolumeBootPattern-343249266 None] deleting rbd volume volume-0e7a744e-a92c-4fa2-bdf3-fe7de7654651 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:48:59.041809 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-7513f578-85e5-4ae0-ab6f-6dfe74e69a10 tempest-VolumesBackupsAdminTest-93613926 None] Lock "b'cinder-336962e7-0d9e-450f-b17a-be42bd84e9a4-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:48:59.133758 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-7513f578-85e5-4ae0-ab6f-6dfe74e69a10 tempest-VolumesBackupsAdminTest-93613926 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:49:01.292802 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-7513f578-85e5-4ae0-ab6f-6dfe74e69a10 tempest-VolumesBackupsAdminTest-93613926 None] Volume volume-336962e7-0d9e-450f-b17a-be42bd84e9a4 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:49:01.724044 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-7513f578-85e5-4ae0-ab6f-6dfe74e69a10 tempest-VolumesBackupsAdminTest-93613926 None] deleting rbd volume volume-336962e7-0d9e-450f-b17a-be42bd84e9a4 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:49:01.725934 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-0ea40bcf-a325-4a67-9495-19b2bd41eaf6 tempest-VolumesBackupsTest-1124201519 None] volume is a clone so cleaning references {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1352}} May 21 21:49:01.865233 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-0ea40bcf-a325-4a67-9495-19b2bd41eaf6 tempest-VolumesBackupsTest-1124201519 None] deleting parent snapshot volume-c27e6a73-0caa-455a-a8cd-64afdd8fc3ed.clone_snap {{(pid=124407) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1243}} May 21 21:49:04.176506 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aec23291-9385-4313-9107-3ab13da6c5f0 tempest-TestVolumeBootPattern-343249266 None] volume is a clone so cleaning references {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1352}} May 21 21:49:04.466892 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aec23291-9385-4313-9107-3ab13da6c5f0 tempest-TestVolumeBootPattern-343249266 None] deleting parent snapshot volume-0e7a744e-a92c-4fa2-bdf3-fe7de7654651.clone_snap {{(pid=124407) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1243}} May 21 21:49:06.969544 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-7513f578-85e5-4ae0-ab6f-6dfe74e69a10 tempest-VolumesBackupsAdminTest-93613926 None] Created reservations ['0dee15af-c38b-443c-89a5-d43adb3c2cf5', 'e02d58ab-41f1-4af2-89aa-4d5abe53ed78', 'a79d1234-3807-4105-9b33-89086d807da8', '1864f625-3f4f-431b-a7f3-33d673475ac1'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:49:06.997866 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-aec23291-9385-4313-9107-3ab13da6c5f0 tempest-TestVolumeBootPattern-343249266 None] Created reservations ['6807c517-2d45-4378-9a3d-412f7a03bfa2', '06e28974-7d0d-4ca7-be53-ac2008f1802d', 'afc54e0a-f272-4720-9e0a-f9755434b1bd', '163cea23-ea89-43f5-859f-8e000b98735f'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:49:07.000631 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-0ea40bcf-a325-4a67-9495-19b2bd41eaf6 tempest-VolumesBackupsTest-1124201519 None] Created reservations ['054b1e12-b446-4a6d-9697-5b9b81eb6f18', 'fee223f6-8c47-4dd9-a702-9a29045c08f1', 'b07908f6-b015-4f46-9c74-af6c2d259189', 'b3602e34-ad78-4489-ad24-992eb71ff31a'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:49:07.137849 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=63,cinder:UPDATE=29,cinder:INSERT=8 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:49:07.158861 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-7513f578-85e5-4ae0-ab6f-6dfe74e69a10 tempest-VolumesBackupsAdminTest-93613926 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:49:07.216544 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-7513f578-85e5-4ae0-ab6f-6dfe74e69a10 tempest-VolumesBackupsAdminTest-93613926 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:49:07.239583 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-7513f578-85e5-4ae0-ab6f-6dfe74e69a10 tempest-VolumesBackupsAdminTest-93613926 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:49:07.245165 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-0ea40bcf-a325-4a67-9495-19b2bd41eaf6 tempest-VolumesBackupsTest-1124201519 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:49:07.265622 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-0ea40bcf-a325-4a67-9495-19b2bd41eaf6 tempest-VolumesBackupsTest-1124201519 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:49:07.380011 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-0ea40bcf-a325-4a67-9495-19b2bd41eaf6 tempest-VolumesBackupsTest-1124201519 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:49:07.384564 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-0ea40bcf-a325-4a67-9495-19b2bd41eaf6 tempest-VolumesBackupsTest-1124201519 None] Deleted volume successfully. May 21 21:49:07.388344 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-7513f578-85e5-4ae0-ab6f-6dfe74e69a10 tempest-VolumesBackupsAdminTest-93613926 None] Deleted volume successfully. May 21 21:49:07.392334 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aec23291-9385-4313-9107-3ab13da6c5f0 tempest-TestVolumeBootPattern-343249266 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:49:07.416737 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aec23291-9385-4313-9107-3ab13da6c5f0 tempest-TestVolumeBootPattern-343249266 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:49:07.455470 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aec23291-9385-4313-9107-3ab13da6c5f0 tempest-TestVolumeBootPattern-343249266 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:49:07.459806 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-aec23291-9385-4313-9107-3ab13da6c5f0 tempest-TestVolumeBootPattern-343249266 None] Deleted volume successfully. May 21 21:49:07.544817 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-0ea40bcf-a325-4a67-9495-19b2bd41eaf6 tempest-VolumesBackupsTest-1124201519 None] Lock "b'cinder-c27e6a73-0caa-455a-a8cd-64afdd8fc3ed-delete_volume'" released by "delete_volume" :: held 13.525s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:49:07.553088 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-aec23291-9385-4313-9107-3ab13da6c5f0 tempest-TestVolumeBootPattern-343249266 None] Lock "b'cinder-0e7a744e-a92c-4fa2-bdf3-fe7de7654651-delete_volume'" released by "delete_volume" :: held 9.345s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:49:07.554758 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-7513f578-85e5-4ae0-ab6f-6dfe74e69a10 tempest-VolumesBackupsAdminTest-93613926 None] Lock "b'cinder-336962e7-0d9e-450f-b17a-be42bd84e9a4-delete_volume'" released by "delete_volume" :: held 8.513s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:49:09.442113 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-80673099-7ba7-44fd-ad3e-9c60959e94f4 tempest-VolumesSnapshotTestJSON-2065732980 None] Created reservations ['57a4ec48-53b1-40b1-ab2a-0f8314e48f58', '18dac8fc-a46e-4f96-bb31-ea8877b9e030', '01baabdf-f886-4546-9e03-a5854f11ef28', '57a88f69-8729-4978-9e99-0b41677b1038'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:49:09.756369 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-80673099-7ba7-44fd-ad3e-9c60959e94f4 tempest-VolumesSnapshotTestJSON-2065732980 None] Delete snapshot completed successfully. May 21 21:49:09.762036 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-80673099-7ba7-44fd-ad3e-9c60959e94f4 tempest-VolumesSnapshotTestJSON-2065732980 None] Lock "b'cinder-8f8fcc52-5029-4da3-ab6a-66e0c31080bd-delete_snapshot'" released by "delete_snapshot" :: held 31.460s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:49:11.507583 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=47,cinder:INSERT=9,cinder:UPDATE=40,cinder:DELETE=4 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:49:11.519405 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-bc4d269f-49dc-42ed-b14c-c57353380612 req-e231086e-dc55-420a-b5a0-cdab6243e26c tempest-VolumesSnapshotTestJSON-2065732980 None] Terminate volume connection completed successfully. May 21 21:49:11.520114 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-bc4d269f-49dc-42ed-b14c-c57353380612 req-e231086e-dc55-420a-b5a0-cdab6243e26c tempest-VolumesSnapshotTestJSON-2065732980 None] Deleting attachment 41391dbe-df18-4c44-8300-7875b6149e82. {{(pid=124407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4957}} May 21 21:49:13.948064 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-15278206-496b-416d-814e-7701ef26543e tempest-VolumesCloneTest-1714101741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:49:13.967497 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-15278206-496b-416d-814e-7701ef26543e tempest-VolumesCloneTest-1714101741 None] Flow 'volume_create_manager' (0462ad6f-db13-44b8-94bc-8c2ffa77aad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:49:13.974745 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-15278206-496b-416d-814e-7701ef26543e tempest-VolumesCloneTest-1714101741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed808de3-51fa-49bb-9588-b3b02646d17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:49:13.991496 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-15278206-496b-416d-814e-7701ef26543e tempest-VolumesCloneTest-1714101741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed808de3-51fa-49bb-9588-b3b02646d17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:49:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-789063945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=cd46fece-9f1b-4ef0-aad7-a5ee369a34e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2dce2f78da04015be522806eda9e1ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:49:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:49:14Z,use_quota=True,user_id='eb796639d18344068f6f202f5c023f87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:49:13.996888 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-15278206-496b-416d-814e-7701ef26543e tempest-VolumesCloneTest-1714101741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f0cdd49-f4de-4c3f-ae94-131f66233d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:49:14.000922 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-15278206-496b-416d-814e-7701ef26543e tempest-VolumesCloneTest-1714101741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f0cdd49-f4de-4c3f-ae94-131f66233d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:49:14.007317 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-15278206-496b-416d-814e-7701ef26543e tempest-VolumesCloneTest-1714101741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9228c9a-969f-4f9c-850c-8d125bc753ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:49:14.112072 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-15278206-496b-416d-814e-7701ef26543e tempest-VolumesCloneTest-1714101741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9228c9a-969f-4f9c-850c-8d125bc753ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cd46fece-9f1b-4ef0-aad7-a5ee369a34e6', 'volume_name': 'volume-cd46fece-9f1b-4ef0-aad7-a5ee369a34e6', 'volume_size': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5593f8cb452404083dfa177b4ee68b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'created_at': datetime.datetime(2022, 5, 21, 21, 0, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:49:14.118601 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-15278206-496b-416d-814e-7701ef26543e tempest-VolumesCloneTest-1714101741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e34843a1-bd2a-47d4-a495-b394009c24ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:49:14.122831 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-15278206-496b-416d-814e-7701ef26543e tempest-VolumesCloneTest-1714101741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e34843a1-bd2a-47d4-a495-b394009c24ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:49:14.128204 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-15278206-496b-416d-814e-7701ef26543e tempest-VolumesCloneTest-1714101741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bbeba61-707b-4911-bf74-939b673ef4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:49:14.129610 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-15278206-496b-416d-814e-7701ef26543e tempest-VolumesCloneTest-1714101741 None] Volume cd46fece-9f1b-4ef0-aad7-a5ee369a34e6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cd46fece-9f1b-4ef0-aad7-a5ee369a34e6', 'volume_size': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5593f8cb452404083dfa177b4ee68b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'created_at': datetime.datetime(2022, 5, 21, 21, 0, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } May 21 21:49:14.130442 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-15278206-496b-416d-814e-7701ef26543e tempest-VolumesCloneTest-1714101741 None] Cloning cd46fece-9f1b-4ef0-aad7-a5ee369a34e6 from image e570f5eb-6047-4214-a420-fdfdbdf19a4c at location (None, None). {{(pid=124407) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1053}} May 21 21:49:14.140722 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-15278206-496b-416d-814e-7701ef26543e tempest-VolumesCloneTest-1714101741 None] Lock "b'cinder-e570f5eb-6047-4214-a420-fdfdbdf19a4c'" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:49:14.214885 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-15278206-496b-416d-814e-7701ef26543e tempest-VolumesCloneTest-1714101741 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'volume_id': '4057e637-23ba-493f-a45d-eb28c07ac60a', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28), 'last_used': datetime.datetime(2022, 5, 21, 21, 49, 14, 144872)}. {{(pid=124407) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 21 21:49:14.215313 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-15278206-496b-416d-814e-7701ef26543e tempest-VolumesCloneTest-1714101741 None] Image-volume cache entry image_update_at = 2022-05-21 21:00:28+00:00, requested image updated_at = 2022-05-21 21:00:28+00:00. {{(pid=124407) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 21 21:49:14.215772 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-15278206-496b-416d-814e-7701ef26543e tempest-VolumesCloneTest-1714101741 None] Found cache entry for image = e570f5eb-6047-4214-a420-fdfdbdf19a4c on host ncdv-master-1@ceph#ceph. {{(pid=124407) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:876}} May 21 21:49:14.224193 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-15278206-496b-416d-814e-7701ef26543e tempest-VolumesCloneTest-1714101741 None] Lock "b'cinder-e570f5eb-6047-4214-a420-fdfdbdf19a4c'" released by "_prepare_image_cache_entry" :: held 0.080s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:49:14.224193 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-15278206-496b-416d-814e-7701ef26543e tempest-VolumesCloneTest-1714101741 None] Attempting to retrieve cache entry for image = e570f5eb-6047-4214-a420-fdfdbdf19a4c on host ncdv-master-1@ceph#ceph. {{(pid=124407) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:817}} May 21 21:49:14.232337 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-15278206-496b-416d-814e-7701ef26543e tempest-VolumesCloneTest-1714101741 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'volume_id': '4057e637-23ba-493f-a45d-eb28c07ac60a', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28), 'last_used': datetime.datetime(2022, 5, 21, 21, 49, 14, 229750)}. {{(pid=124407) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 21 21:49:14.232761 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-15278206-496b-416d-814e-7701ef26543e tempest-VolumesCloneTest-1714101741 None] Image-volume cache entry image_update_at = 2022-05-21 21:00:28+00:00, requested image updated_at = 2022-05-21 21:00:28+00:00. {{(pid=124407) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 21 21:49:14.233154 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-15278206-496b-416d-814e-7701ef26543e tempest-VolumesCloneTest-1714101741 None] Creating from source image-volume 4057e637-23ba-493f-a45d-eb28c07ac60a {{(pid=124407) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:831}} May 21 21:49:14.246404 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-15278206-496b-416d-814e-7701ef26543e tempest-VolumesCloneTest-1714101741 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:49:14.407388 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-15278206-496b-416d-814e-7701ef26543e tempest-VolumesCloneTest-1714101741 None] creating snapshot='volume-cd46fece-9f1b-4ef0-aad7-a5ee369a34e6.clone_snap' {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 21 21:49:16.216149 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-15278206-496b-416d-814e-7701ef26543e tempest-VolumesCloneTest-1714101741 None] cloning 'volume-4057e637-23ba-493f-a45d-eb28c07ac60a@volume-cd46fece-9f1b-4ef0-aad7-a5ee369a34e6.clone_snap' to 'volume-cd46fece-9f1b-4ef0-aad7-a5ee369a34e6' {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:789}} May 21 21:49:17.115379 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-15278206-496b-416d-814e-7701ef26543e tempest-VolumesCloneTest-1714101741 None] Volume volume-b9ebacac-5f32-42e3-9194-003aee7e2435.deleted is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:49:17.116832 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-15278206-496b-416d-814e-7701ef26543e tempest-VolumesCloneTest-1714101741 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:49:17.118641 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-15278206-496b-416d-814e-7701ef26543e tempest-VolumesCloneTest-1714101741 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:49:17.515552 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-15278206-496b-416d-814e-7701ef26543e tempest-VolumesCloneTest-1714101741 None] clone created successfully {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:862}} May 21 21:49:17.516480 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.volume_utils [None req-15278206-496b-416d-814e-7701ef26543e tempest-VolumesCloneTest-1714101741 None] Marking volume cd46fece-9f1b-4ef0-aad7-a5ee369a34e6 as bootable. {{(pid=124407) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} May 21 21:49:17.626842 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-15278206-496b-416d-814e-7701ef26543e tempest-VolumesCloneTest-1714101741 None] Copying metadata from image e570f5eb-6047-4214-a420-fdfdbdf19a4c to cd46fece-9f1b-4ef0-aad7-a5ee369a34e6. {{(pid=124407) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} May 21 21:49:17.627270 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-15278206-496b-416d-814e-7701ef26543e tempest-VolumesCloneTest-1714101741 None] Creating volume glance metadata for volume cd46fece-9f1b-4ef0-aad7-a5ee369a34e6 backed by image e570f5eb-6047-4214-a420-fdfdbdf19a4c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=124407) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:673}} May 21 21:49:17.659795 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-284cd871-4a7b-4182-a668-c1cf56d42471 tempest-VolumesSnapshotTestJSON-2065732980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:49:17.695556 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-284cd871-4a7b-4182-a668-c1cf56d42471 tempest-VolumesSnapshotTestJSON-2065732980 None] Flow 'volume_create_manager' (21b597e2-cc70-4637-aefd-da2cb9b82d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:49:17.702436 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-284cd871-4a7b-4182-a668-c1cf56d42471 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e283f689-519c-417e-8558-b23273791d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:49:17.736485 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-284cd871-4a7b-4182-a668-c1cf56d42471 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e283f689-519c-417e-8558-b23273791d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-379026944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=df9f47ad-f950-4e27-aef0-0b978004fae9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e046067a8e4197b18860f9b9e1e344',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:49:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:49:17Z,use_quota=True,user_id='88d6ab0c56ae4b16805f265728e20ed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:49:17.742339 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-284cd871-4a7b-4182-a668-c1cf56d42471 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd0fbeee-a504-47dd-a109-5351856fec21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:49:17.746766 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-284cd871-4a7b-4182-a668-c1cf56d42471 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd0fbeee-a504-47dd-a109-5351856fec21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:49:17.752679 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-284cd871-4a7b-4182-a668-c1cf56d42471 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09a4d188-3e39-4fc4-bc84-2496c54c4ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:49:17.758147 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-284cd871-4a7b-4182-a668-c1cf56d42471 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09a4d188-3e39-4fc4-bc84-2496c54c4ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df9f47ad-f950-4e27-aef0-0b978004fae9', 'volume_name': 'volume-df9f47ad-f950-4e27-aef0-0b978004fae9', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:49:17.762813 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-284cd871-4a7b-4182-a668-c1cf56d42471 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcef9bad-9f5b-4491-ad8b-59a985c2c6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:49:17.767657 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-284cd871-4a7b-4182-a668-c1cf56d42471 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcef9bad-9f5b-4491-ad8b-59a985c2c6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:49:17.773353 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-284cd871-4a7b-4182-a668-c1cf56d42471 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60b678a9-a001-4166-933e-bde86e2ccd34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:49:17.774193 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-284cd871-4a7b-4182-a668-c1cf56d42471 tempest-VolumesSnapshotTestJSON-2065732980 None] Volume df9f47ad-f950-4e27-aef0-0b978004fae9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df9f47ad-f950-4e27-aef0-0b978004fae9', 'volume_size': 1} May 21 21:49:17.774795 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-284cd871-4a7b-4182-a668-c1cf56d42471 tempest-VolumesSnapshotTestJSON-2065732980 None] creating volume 'volume-df9f47ad-f950-4e27-aef0-0b978004fae9' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:49:17.775775 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-284cd871-4a7b-4182-a668-c1cf56d42471 tempest-VolumesSnapshotTestJSON-2065732980 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:49:17.930449 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-15278206-496b-416d-814e-7701ef26543e tempest-VolumesCloneTest-1714101741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bbeba61-707b-4911-bf74-939b673ef4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd46fece-9f1b-4ef0-aad7-a5ee369a34e6', 'volume_size': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5593f8cb452404083dfa177b4ee68b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'created_at': datetime.datetime(2022, 5, 21, 21, 0, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:49:17.951067 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-15278206-496b-416d-814e-7701ef26543e tempest-VolumesCloneTest-1714101741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6300af42-0f10-4324-a97d-2a3eea231f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:49:18.050317 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-15278206-496b-416d-814e-7701ef26543e tempest-VolumesCloneTest-1714101741 None] Volume volume-cd46fece-9f1b-4ef0-aad7-a5ee369a34e6 (cd46fece-9f1b-4ef0-aad7-a5ee369a34e6): created successfully May 21 21:49:18.058603 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-15278206-496b-416d-814e-7701ef26543e tempest-VolumesCloneTest-1714101741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6300af42-0f10-4324-a97d-2a3eea231f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:49:18.067783 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-15278206-496b-416d-814e-7701ef26543e tempest-VolumesCloneTest-1714101741 None] Flow 'volume_create_manager' (0462ad6f-db13-44b8-94bc-8c2ffa77aad6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:49:18.158521 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-15278206-496b-416d-814e-7701ef26543e tempest-VolumesCloneTest-1714101741 None] Created volume successfully. May 21 21:49:18.249462 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-284cd871-4a7b-4182-a668-c1cf56d42471 tempest-VolumesSnapshotTestJSON-2065732980 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:49:18.249846 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-284cd871-4a7b-4182-a668-c1cf56d42471 tempest-VolumesSnapshotTestJSON-2065732980 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:49:18.259846 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-284cd871-4a7b-4182-a668-c1cf56d42471 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60b678a9-a001-4166-933e-bde86e2ccd34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df9f47ad-f950-4e27-aef0-0b978004fae9', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:49:18.272167 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-284cd871-4a7b-4182-a668-c1cf56d42471 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4012d0ed-ae59-479c-8a6e-da4c5c93d700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:49:18.392814 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-284cd871-4a7b-4182-a668-c1cf56d42471 tempest-VolumesSnapshotTestJSON-2065732980 None] Volume volume-df9f47ad-f950-4e27-aef0-0b978004fae9 (df9f47ad-f950-4e27-aef0-0b978004fae9): created successfully May 21 21:49:18.396819 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-284cd871-4a7b-4182-a668-c1cf56d42471 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4012d0ed-ae59-479c-8a6e-da4c5c93d700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:49:18.402737 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-284cd871-4a7b-4182-a668-c1cf56d42471 tempest-VolumesSnapshotTestJSON-2065732980 None] Flow 'volume_create_manager' (21b597e2-cc70-4637-aefd-da2cb9b82d4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:49:18.475959 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-284cd871-4a7b-4182-a668-c1cf56d42471 tempest-VolumesSnapshotTestJSON-2065732980 None] Created volume successfully. May 21 21:49:19.915154 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d0bb0715-95d5-4ad7-b497-022db9397af1 tempest-VolumesSnapshotTestJSON-2065732980 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:49:20.177299 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d834719-d938-4bfe-8622-d883572f4500 tempest-VolumesCloneTest-1714101741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:49:20.224632 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6d834719-d938-4bfe-8622-d883572f4500 tempest-VolumesCloneTest-1714101741 None] Flow 'volume_create_manager' (c8f943e1-8e66-44d9-81fd-3524684ed3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:49:20.232645 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6d834719-d938-4bfe-8622-d883572f4500 tempest-VolumesCloneTest-1714101741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b5dbd96-c787-4488-a70e-13b2cfa84bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:49:20.251190 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6d834719-d938-4bfe-8622-d883572f4500 tempest-VolumesCloneTest-1714101741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b5dbd96-c787-4488-a70e-13b2cfa84bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:49:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-575977130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f9ee3508-c71c-427a-b97d-c52d95e67f3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2dce2f78da04015be522806eda9e1ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:49:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=cd46fece-9f1b-4ef0-aad7-a5ee369a34e6,status='creating',terminated_at=None,updated_at=2022-05-21T21:49:20Z,use_quota=True,user_id='eb796639d18344068f6f202f5c023f87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:49:20.257189 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6d834719-d938-4bfe-8622-d883572f4500 tempest-VolumesCloneTest-1714101741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2158aed6-f1f3-471f-9f97-8d27cc5879fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:49:20.262438 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6d834719-d938-4bfe-8622-d883572f4500 tempest-VolumesCloneTest-1714101741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2158aed6-f1f3-471f-9f97-8d27cc5879fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:49:20.268206 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6d834719-d938-4bfe-8622-d883572f4500 tempest-VolumesCloneTest-1714101741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea23289e-544d-4d3f-8e0b-cc8964107fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:49:20.288347 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6d834719-d938-4bfe-8622-d883572f4500 tempest-VolumesCloneTest-1714101741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea23289e-544d-4d3f-8e0b-cc8964107fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f9ee3508-c71c-427a-b97d-c52d95e67f3b', 'volume_name': 'volume-f9ee3508-c71c-427a-b97d-c52d95e67f3b', 'volume_size': 1, 'source_volid': 'cd46fece-9f1b-4ef0-aad7-a5ee369a34e6', 'source_volstatus': 'available'}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:49:20.294726 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6d834719-d938-4bfe-8622-d883572f4500 tempest-VolumesCloneTest-1714101741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccf21494-a137-4a31-91bb-f3fcf5c9d2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:49:20.299505 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6d834719-d938-4bfe-8622-d883572f4500 tempest-VolumesCloneTest-1714101741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccf21494-a137-4a31-91bb-f3fcf5c9d2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:49:20.305150 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6d834719-d938-4bfe-8622-d883572f4500 tempest-VolumesCloneTest-1714101741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d4001d0-f9dd-433b-9038-fb92b0b1aecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:49:20.306755 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-6d834719-d938-4bfe-8622-d883572f4500 tempest-VolumesCloneTest-1714101741 None] Volume f9ee3508-c71c-427a-b97d-c52d95e67f3b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f9ee3508-c71c-427a-b97d-c52d95e67f3b', 'volume_size': 1, 'source_volid': 'cd46fece-9f1b-4ef0-aad7-a5ee369a34e6', 'source_volstatus': 'available'} May 21 21:49:20.320963 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6d834719-d938-4bfe-8622-d883572f4500 tempest-VolumesCloneTest-1714101741 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:49:20.472874 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6d834719-d938-4bfe-8622-d883572f4500 tempest-VolumesCloneTest-1714101741 None] creating snapshot='volume-f9ee3508-c71c-427a-b97d-c52d95e67f3b.clone_snap' {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 21 21:49:21.870691 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6d834719-d938-4bfe-8622-d883572f4500 tempest-VolumesCloneTest-1714101741 None] cloning 'volume-cd46fece-9f1b-4ef0-aad7-a5ee369a34e6@volume-f9ee3508-c71c-427a-b97d-c52d95e67f3b.clone_snap' to 'volume-f9ee3508-c71c-427a-b97d-c52d95e67f3b' {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:789}} May 21 21:49:22.700835 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-d0bb0715-95d5-4ad7-b497-022db9397af1 tempest-VolumesSnapshotTestJSON-2065732980 None] Create snapshot completed successfully May 21 21:49:23.147866 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6d834719-d938-4bfe-8622-d883572f4500 tempest-VolumesCloneTest-1714101741 None] Volume volume-b9ebacac-5f32-42e3-9194-003aee7e2435.deleted is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:49:23.149695 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6d834719-d938-4bfe-8622-d883572f4500 tempest-VolumesCloneTest-1714101741 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:49:23.150236 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6d834719-d938-4bfe-8622-d883572f4500 tempest-VolumesCloneTest-1714101741 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:49:23.509573 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6d834719-d938-4bfe-8622-d883572f4500 tempest-VolumesCloneTest-1714101741 None] clone created successfully {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:862}} May 21 21:49:23.510335 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.volume_utils [None req-6d834719-d938-4bfe-8622-d883572f4500 tempest-VolumesCloneTest-1714101741 None] Marking volume f9ee3508-c71c-427a-b97d-c52d95e67f3b as bootable. {{(pid=124407) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} May 21 21:49:23.621403 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d834719-d938-4bfe-8622-d883572f4500 tempest-VolumesCloneTest-1714101741 None] Copying metadata from source volume cd46fece-9f1b-4ef0-aad7-a5ee369a34e6 to f9ee3508-c71c-427a-b97d-c52d95e67f3b. {{(pid=124407) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:438}} May 21 21:49:23.721964 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6d834719-d938-4bfe-8622-d883572f4500 tempest-VolumesCloneTest-1714101741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d4001d0-f9dd-433b-9038-fb92b0b1aecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9ee3508-c71c-427a-b97d-c52d95e67f3b', 'volume_size': 1, 'source_volid': 'cd46fece-9f1b-4ef0-aad7-a5ee369a34e6', 'source_volstatus': 'available'}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:49:23.728000 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6d834719-d938-4bfe-8622-d883572f4500 tempest-VolumesCloneTest-1714101741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b59c61d3-baaf-4b6e-888d-8759f0c43faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:49:23.856537 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-6d834719-d938-4bfe-8622-d883572f4500 tempest-VolumesCloneTest-1714101741 None] Volume volume-f9ee3508-c71c-427a-b97d-c52d95e67f3b (f9ee3508-c71c-427a-b97d-c52d95e67f3b): created successfully May 21 21:49:23.863956 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6d834719-d938-4bfe-8622-d883572f4500 tempest-VolumesCloneTest-1714101741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b59c61d3-baaf-4b6e-888d-8759f0c43faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:49:23.881707 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-6d834719-d938-4bfe-8622-d883572f4500 tempest-VolumesCloneTest-1714101741 None] Flow 'volume_create_manager' (c8f943e1-8e66-44d9-81fd-3524684ed3e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:49:23.969209 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9a6400a-b7be-4a77-af70-29d83fde0583 tempest-VolumesSnapshotTestJSON-2065732980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:49:23.980579 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-6d834719-d938-4bfe-8622-d883572f4500 tempest-VolumesCloneTest-1714101741 None] Created volume successfully. May 21 21:49:24.016717 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-f9a6400a-b7be-4a77-af70-29d83fde0583 tempest-VolumesSnapshotTestJSON-2065732980 None] Flow 'volume_create_manager' (070f8f95-1126-4141-b0c8-1c8a3f5a3efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:49:24.038330 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-f9a6400a-b7be-4a77-af70-29d83fde0583 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4310b962-e810-4435-a92c-6619d332f967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:49:24.078666 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-f9a6400a-b7be-4a77-af70-29d83fde0583 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4310b962-e810-4435-a92c-6619d332f967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:49:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-122573529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=59be7f2c-dd86-4995-8f05-570b67c6b0a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e046067a8e4197b18860f9b9e1e344',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:49:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=5d8539e4-71bf-4bc4-8b5b-89bcd88516c3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:49:24Z,use_quota=True,user_id='88d6ab0c56ae4b16805f265728e20ed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:49:24.087760 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-f9a6400a-b7be-4a77-af70-29d83fde0583 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75dcbe05-ee54-440b-abb5-8eadc8794ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:49:24.097720 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-f9a6400a-b7be-4a77-af70-29d83fde0583 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75dcbe05-ee54-440b-abb5-8eadc8794ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:49:24.103846 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-f9a6400a-b7be-4a77-af70-29d83fde0583 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fd19bc5-331a-47dd-91b0-c139ad65cc29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:49:24.108941 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-f9a6400a-b7be-4a77-af70-29d83fde0583 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fd19bc5-331a-47dd-91b0-c139ad65cc29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '59be7f2c-dd86-4995-8f05-570b67c6b0a9', 'volume_name': 'volume-59be7f2c-dd86-4995-8f05-570b67c6b0a9', 'volume_size': 2, 'snapshot_id': '5d8539e4-71bf-4bc4-8b5b-89bcd88516c3'}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:49:24.116476 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-f9a6400a-b7be-4a77-af70-29d83fde0583 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34e10d23-8520-4d4d-bf7d-74ab6225f579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:49:24.124309 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-f9a6400a-b7be-4a77-af70-29d83fde0583 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34e10d23-8520-4d4d-bf7d-74ab6225f579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:49:24.135573 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-f9a6400a-b7be-4a77-af70-29d83fde0583 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f804fa86-48b2-4ffc-9d4a-da1671f88da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:49:24.135573 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-f9a6400a-b7be-4a77-af70-29d83fde0583 tempest-VolumesSnapshotTestJSON-2065732980 None] Volume 59be7f2c-dd86-4995-8f05-570b67c6b0a9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-59be7f2c-dd86-4995-8f05-570b67c6b0a9', 'volume_size': 2, 'snapshot_id': '5d8539e4-71bf-4bc4-8b5b-89bcd88516c3'} May 21 21:49:24.197674 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-f9a6400a-b7be-4a77-af70-29d83fde0583 tempest-VolumesSnapshotTestJSON-2065732980 None] cloning volumes/volume-df9f47ad-f950-4e27-aef0-0b978004fae9@snapshot-5d8539e4-71bf-4bc4-8b5b-89bcd88516c3 to volume-59be7f2c-dd86-4995-8f05-570b67c6b0a9 {{(pid=124407) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1098}} May 21 21:49:24.200120 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-f9a6400a-b7be-4a77-af70-29d83fde0583 tempest-VolumesSnapshotTestJSON-2065732980 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:49:24.271964 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-f9a6400a-b7be-4a77-af70-29d83fde0583 tempest-VolumesSnapshotTestJSON-2065732980 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:49:25.178308 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-f9a6400a-b7be-4a77-af70-29d83fde0583 tempest-VolumesSnapshotTestJSON-2065732980 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:49:25.178802 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-f9a6400a-b7be-4a77-af70-29d83fde0583 tempest-VolumesSnapshotTestJSON-2065732980 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:49:25.194935 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-f9a6400a-b7be-4a77-af70-29d83fde0583 tempest-VolumesSnapshotTestJSON-2065732980 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:49:25.323395 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-097329c3-94b3-4d96-892d-152f94a62aa3 tempest-VolumesCloneTest-1714101741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:49:25.369128 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-097329c3-94b3-4d96-892d-152f94a62aa3 tempest-VolumesCloneTest-1714101741 None] Flow 'volume_create_manager' (4fe17743-dafc-4301-b831-4340e6a67a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:49:25.375744 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-097329c3-94b3-4d96-892d-152f94a62aa3 tempest-VolumesCloneTest-1714101741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3c5baa2-0ee2-47c9-900d-53481fc81b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:49:25.401112 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-097329c3-94b3-4d96-892d-152f94a62aa3 tempest-VolumesCloneTest-1714101741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3c5baa2-0ee2-47c9-900d-53481fc81b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1900285824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=44043c6d-81c9-402c-9b0a-12796f378014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2dce2f78da04015be522806eda9e1ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:49:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:49:25Z,use_quota=True,user_id='eb796639d18344068f6f202f5c023f87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:49:25.407342 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-097329c3-94b3-4d96-892d-152f94a62aa3 tempest-VolumesCloneTest-1714101741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (533c606a-344e-4512-8269-6a955969578b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:49:25.412196 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-097329c3-94b3-4d96-892d-152f94a62aa3 tempest-VolumesCloneTest-1714101741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (533c606a-344e-4512-8269-6a955969578b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:49:25.417711 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-097329c3-94b3-4d96-892d-152f94a62aa3 tempest-VolumesCloneTest-1714101741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe3d73e9-bb21-47bd-8d0f-74091b34fcf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:49:25.421780 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-097329c3-94b3-4d96-892d-152f94a62aa3 tempest-VolumesCloneTest-1714101741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe3d73e9-bb21-47bd-8d0f-74091b34fcf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44043c6d-81c9-402c-9b0a-12796f378014', 'volume_name': 'volume-44043c6d-81c9-402c-9b0a-12796f378014', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:49:25.427287 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-097329c3-94b3-4d96-892d-152f94a62aa3 tempest-VolumesCloneTest-1714101741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ac5dc1e-756e-4994-b6fd-7fdd72be9abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:49:25.432081 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-097329c3-94b3-4d96-892d-152f94a62aa3 tempest-VolumesCloneTest-1714101741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ac5dc1e-756e-4994-b6fd-7fdd72be9abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:49:25.437126 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-097329c3-94b3-4d96-892d-152f94a62aa3 tempest-VolumesCloneTest-1714101741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (452add80-3395-43da-a005-24ce5a185662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:49:25.438219 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-097329c3-94b3-4d96-892d-152f94a62aa3 tempest-VolumesCloneTest-1714101741 None] Volume 44043c6d-81c9-402c-9b0a-12796f378014: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44043c6d-81c9-402c-9b0a-12796f378014', 'volume_size': 1} May 21 21:49:25.439324 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-097329c3-94b3-4d96-892d-152f94a62aa3 tempest-VolumesCloneTest-1714101741 None] creating volume 'volume-44043c6d-81c9-402c-9b0a-12796f378014' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:49:25.444488 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-097329c3-94b3-4d96-892d-152f94a62aa3 tempest-VolumesCloneTest-1714101741 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:49:26.451072 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-097329c3-94b3-4d96-892d-152f94a62aa3 tempest-VolumesCloneTest-1714101741 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:49:26.451072 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-097329c3-94b3-4d96-892d-152f94a62aa3 tempest-VolumesCloneTest-1714101741 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:49:26.451072 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-097329c3-94b3-4d96-892d-152f94a62aa3 tempest-VolumesCloneTest-1714101741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (452add80-3395-43da-a005-24ce5a185662) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44043c6d-81c9-402c-9b0a-12796f378014', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:49:26.454823 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-097329c3-94b3-4d96-892d-152f94a62aa3 tempest-VolumesCloneTest-1714101741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea9c74ed-202c-4141-9fdf-37a9acf60913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:49:26.538478 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-f9a6400a-b7be-4a77-af70-29d83fde0583 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f804fa86-48b2-4ffc-9d4a-da1671f88da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59be7f2c-dd86-4995-8f05-570b67c6b0a9', 'volume_size': 2, 'snapshot_id': '5d8539e4-71bf-4bc4-8b5b-89bcd88516c3'}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:49:26.542969 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-f9a6400a-b7be-4a77-af70-29d83fde0583 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50bbce40-f547-49e4-8a2d-0a8ff77c1ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:49:26.552109 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-097329c3-94b3-4d96-892d-152f94a62aa3 tempest-VolumesCloneTest-1714101741 None] Volume volume-44043c6d-81c9-402c-9b0a-12796f378014 (44043c6d-81c9-402c-9b0a-12796f378014): created successfully May 21 21:49:26.556438 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-097329c3-94b3-4d96-892d-152f94a62aa3 tempest-VolumesCloneTest-1714101741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea9c74ed-202c-4141-9fdf-37a9acf60913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:49:26.565631 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-097329c3-94b3-4d96-892d-152f94a62aa3 tempest-VolumesCloneTest-1714101741 None] Flow 'volume_create_manager' (4fe17743-dafc-4301-b831-4340e6a67a84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:49:26.641609 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-f9a6400a-b7be-4a77-af70-29d83fde0583 tempest-VolumesSnapshotTestJSON-2065732980 None] Volume volume-59be7f2c-dd86-4995-8f05-570b67c6b0a9 (59be7f2c-dd86-4995-8f05-570b67c6b0a9): created successfully May 21 21:49:26.645982 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-f9a6400a-b7be-4a77-af70-29d83fde0583 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50bbce40-f547-49e4-8a2d-0a8ff77c1ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:49:26.651824 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-f9a6400a-b7be-4a77-af70-29d83fde0583 tempest-VolumesSnapshotTestJSON-2065732980 None] Flow 'volume_create_manager' (070f8f95-1126-4141-b0c8-1c8a3f5a3efa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:49:26.675181 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-097329c3-94b3-4d96-892d-152f94a62aa3 tempest-VolumesCloneTest-1714101741 None] Created volume successfully. May 21 21:49:26.718014 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-f9a6400a-b7be-4a77-af70-29d83fde0583 tempest-VolumesSnapshotTestJSON-2065732980 None] Created volume successfully. May 21 21:49:27.073084 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-d1e2cc76-e349-4297-8740-8cd41e87c472 tempest-VolumesSnapshotTestJSON-2065732980 None] Lock "b'cinder-59be7f2c-dd86-4995-8f05-570b67c6b0a9-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:49:27.191054 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d1e2cc76-e349-4297-8740-8cd41e87c472 tempest-VolumesSnapshotTestJSON-2065732980 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:49:27.317997 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d1e2cc76-e349-4297-8740-8cd41e87c472 tempest-VolumesSnapshotTestJSON-2065732980 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:49:27.393946 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d1e2cc76-e349-4297-8740-8cd41e87c472 tempest-VolumesSnapshotTestJSON-2065732980 None] deleting rbd volume volume-59be7f2c-dd86-4995-8f05-570b67c6b0a9 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:49:27.941106 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-56341359-5433-4541-b0bd-356e12dc6b0c tempest-VolumesCloneTest-1714101741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:49:27.972714 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-56341359-5433-4541-b0bd-356e12dc6b0c tempest-VolumesCloneTest-1714101741 None] Flow 'volume_create_manager' (0440c088-589a-4a62-b8fb-b658d6baf13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:49:27.979238 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-56341359-5433-4541-b0bd-356e12dc6b0c tempest-VolumesCloneTest-1714101741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c20dc573-10f0-458f-826e-8dca3fe4e7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:49:27.982448 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=69,cinder:UPDATE=21,cinder:INSERT=7,cinder:DELETE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:49:27.996671 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-56341359-5433-4541-b0bd-356e12dc6b0c tempest-VolumesCloneTest-1714101741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c20dc573-10f0-458f-826e-8dca3fe4e7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-331041107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a947dc3f-99d5-481a-b66c-c1b63f9862a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2dce2f78da04015be522806eda9e1ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:49:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=44043c6d-81c9-402c-9b0a-12796f378014,status='creating',terminated_at=None,updated_at=2022-05-21T21:49:28Z,use_quota=True,user_id='eb796639d18344068f6f202f5c023f87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:49:28.002857 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-56341359-5433-4541-b0bd-356e12dc6b0c tempest-VolumesCloneTest-1714101741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e2e550a-1f13-4013-b633-8ec93a4790a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:49:28.007051 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-56341359-5433-4541-b0bd-356e12dc6b0c tempest-VolumesCloneTest-1714101741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e2e550a-1f13-4013-b633-8ec93a4790a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:49:28.012275 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-56341359-5433-4541-b0bd-356e12dc6b0c tempest-VolumesCloneTest-1714101741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b32d60ca-1546-49b6-a388-1f23e14b0e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:49:28.028426 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-56341359-5433-4541-b0bd-356e12dc6b0c tempest-VolumesCloneTest-1714101741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b32d60ca-1546-49b6-a388-1f23e14b0e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'a947dc3f-99d5-481a-b66c-c1b63f9862a5', 'volume_name': 'volume-a947dc3f-99d5-481a-b66c-c1b63f9862a5', 'volume_size': 2, 'source_volid': '44043c6d-81c9-402c-9b0a-12796f378014', 'source_volstatus': 'available'}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:49:28.033988 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-56341359-5433-4541-b0bd-356e12dc6b0c tempest-VolumesCloneTest-1714101741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6c7c219-9e78-4a11-8c52-1de0bb4d99bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:49:28.037950 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-56341359-5433-4541-b0bd-356e12dc6b0c tempest-VolumesCloneTest-1714101741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6c7c219-9e78-4a11-8c52-1de0bb4d99bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:49:28.042708 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-56341359-5433-4541-b0bd-356e12dc6b0c tempest-VolumesCloneTest-1714101741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d15b176-e61b-4f79-ae9c-a6a09fc50a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:49:28.043774 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-56341359-5433-4541-b0bd-356e12dc6b0c tempest-VolumesCloneTest-1714101741 None] Volume a947dc3f-99d5-481a-b66c-c1b63f9862a5: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-a947dc3f-99d5-481a-b66c-c1b63f9862a5', 'volume_size': 2, 'source_volid': '44043c6d-81c9-402c-9b0a-12796f378014', 'source_volstatus': 'available'} May 21 21:49:28.056859 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-56341359-5433-4541-b0bd-356e12dc6b0c tempest-VolumesCloneTest-1714101741 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:49:28.249269 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-56341359-5433-4541-b0bd-356e12dc6b0c tempest-VolumesCloneTest-1714101741 None] creating snapshot='volume-a947dc3f-99d5-481a-b66c-c1b63f9862a5.clone_snap' {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 21 21:49:29.587574 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-56341359-5433-4541-b0bd-356e12dc6b0c tempest-VolumesCloneTest-1714101741 None] cloning 'volume-44043c6d-81c9-402c-9b0a-12796f378014@volume-a947dc3f-99d5-481a-b66c-c1b63f9862a5.clone_snap' to 'volume-a947dc3f-99d5-481a-b66c-c1b63f9862a5' {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:789}} May 21 21:49:30.866873 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-56341359-5433-4541-b0bd-356e12dc6b0c tempest-VolumesCloneTest-1714101741 None] Volume volume-44043c6d-81c9-402c-9b0a-12796f378014 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:49:30.867970 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-56341359-5433-4541-b0bd-356e12dc6b0c tempest-VolumesCloneTest-1714101741 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:49:30.868410 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-56341359-5433-4541-b0bd-356e12dc6b0c tempest-VolumesCloneTest-1714101741 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:49:31.278265 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-56341359-5433-4541-b0bd-356e12dc6b0c tempest-VolumesCloneTest-1714101741 None] resize volume 'volume-a947dc3f-99d5-481a-b66c-c1b63f9862a5' from 1 to 2 {{(pid=124407) _extend_if_required /opt/stack/cinder/cinder/volume/drivers/rbd.py:749}} May 21 21:49:31.278992 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-56341359-5433-4541-b0bd-356e12dc6b0c tempest-VolumesCloneTest-1714101741 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:49:31.668468 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-d1e2cc76-e349-4297-8740-8cd41e87c472 tempest-VolumesSnapshotTestJSON-2065732980 None] Created reservations ['1b31c0d9-8101-4ad3-aec6-7201958a1331', 'cc61fba8-9f64-464f-95c6-1e7907798f0d', 'a71f0de2-fe42-4b3e-9288-1c3c1bd4f753', '4ec8d734-0383-42cf-aff9-8d2a6d0b0d57'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:49:31.691929 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=61,cinder:UPDATE=14,cinder:INSERT=22,cinder:DELETE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:49:31.901837 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d1e2cc76-e349-4297-8740-8cd41e87c472 tempest-VolumesSnapshotTestJSON-2065732980 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:49:31.928904 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d1e2cc76-e349-4297-8740-8cd41e87c472 tempest-VolumesSnapshotTestJSON-2065732980 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:49:31.954066 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-d1e2cc76-e349-4297-8740-8cd41e87c472 tempest-VolumesSnapshotTestJSON-2065732980 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:49:31.962260 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-d1e2cc76-e349-4297-8740-8cd41e87c472 tempest-VolumesSnapshotTestJSON-2065732980 None] Deleted volume successfully. May 21 21:49:32.065932 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-d1e2cc76-e349-4297-8740-8cd41e87c472 tempest-VolumesSnapshotTestJSON-2065732980 None] Lock "b'cinder-59be7f2c-dd86-4995-8f05-570b67c6b0a9-delete_volume'" released by "delete_volume" :: held 4.993s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:49:32.247019 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-56341359-5433-4541-b0bd-356e12dc6b0c tempest-VolumesCloneTest-1714101741 None] clone created successfully {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:862}} May 21 21:49:32.251690 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-56341359-5433-4541-b0bd-356e12dc6b0c tempest-VolumesCloneTest-1714101741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d15b176-e61b-4f79-ae9c-a6a09fc50a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a947dc3f-99d5-481a-b66c-c1b63f9862a5', 'volume_size': 2, 'source_volid': '44043c6d-81c9-402c-9b0a-12796f378014', 'source_volstatus': 'available'}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:49:32.256606 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-56341359-5433-4541-b0bd-356e12dc6b0c tempest-VolumesCloneTest-1714101741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ae00a43-137c-4fa9-a0ce-ee0a572c5ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:49:32.339382 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-56341359-5433-4541-b0bd-356e12dc6b0c tempest-VolumesCloneTest-1714101741 None] Volume volume-a947dc3f-99d5-481a-b66c-c1b63f9862a5 (a947dc3f-99d5-481a-b66c-c1b63f9862a5): created successfully May 21 21:49:32.346432 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-56341359-5433-4541-b0bd-356e12dc6b0c tempest-VolumesCloneTest-1714101741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ae00a43-137c-4fa9-a0ce-ee0a572c5ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:49:32.353404 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-56341359-5433-4541-b0bd-356e12dc6b0c tempest-VolumesCloneTest-1714101741 None] Flow 'volume_create_manager' (0440c088-589a-4a62-b8fb-b658d6baf13f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:49:32.447171 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-56341359-5433-4541-b0bd-356e12dc6b0c tempest-VolumesCloneTest-1714101741 None] Created volume successfully. May 21 21:49:33.151577 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fb84529-60be-43eb-8962-5cf272aec7a7 tempest-VolumesSnapshotTestJSON-2065732980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:49:33.174128 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-9fb84529-60be-43eb-8962-5cf272aec7a7 tempest-VolumesSnapshotTestJSON-2065732980 None] Flow 'volume_create_manager' (c68461e5-d99a-45a2-a2da-5e8145bc6902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:49:33.180571 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-9fb84529-60be-43eb-8962-5cf272aec7a7 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6d13e7f-2cf6-473a-8d22-f217956bccd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:49:33.204063 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-9fb84529-60be-43eb-8962-5cf272aec7a7 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6d13e7f-2cf6-473a-8d22-f217956bccd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1300589234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=928891e7-2bca-4e1b-8f2b-e9123825ad74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e046067a8e4197b18860f9b9e1e344',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:49:33Z,use_quota=True,user_id='88d6ab0c56ae4b16805f265728e20ed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:49:33.210095 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-9fb84529-60be-43eb-8962-5cf272aec7a7 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbb0272e-8fa4-42fb-9e38-6f0ed2f0fde3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:49:33.221397 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-9fb84529-60be-43eb-8962-5cf272aec7a7 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbb0272e-8fa4-42fb-9e38-6f0ed2f0fde3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:49:33.221397 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-9fb84529-60be-43eb-8962-5cf272aec7a7 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c3f452e-1b82-4a4d-8a8b-b6e91afd4721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:49:33.224261 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-9fb84529-60be-43eb-8962-5cf272aec7a7 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c3f452e-1b82-4a4d-8a8b-b6e91afd4721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '928891e7-2bca-4e1b-8f2b-e9123825ad74', 'volume_name': 'volume-928891e7-2bca-4e1b-8f2b-e9123825ad74', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:49:33.229087 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-9fb84529-60be-43eb-8962-5cf272aec7a7 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98067670-06ba-48dd-8ef6-85f1f83e4e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:49:33.232908 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-9fb84529-60be-43eb-8962-5cf272aec7a7 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98067670-06ba-48dd-8ef6-85f1f83e4e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:49:33.238116 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-9fb84529-60be-43eb-8962-5cf272aec7a7 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee500363-fde4-46ca-bbcc-67c7b9a9619a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:49:33.239228 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-9fb84529-60be-43eb-8962-5cf272aec7a7 tempest-VolumesSnapshotTestJSON-2065732980 None] Volume 928891e7-2bca-4e1b-8f2b-e9123825ad74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-928891e7-2bca-4e1b-8f2b-e9123825ad74', 'volume_size': 1} May 21 21:49:33.239619 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-9fb84529-60be-43eb-8962-5cf272aec7a7 tempest-VolumesSnapshotTestJSON-2065732980 None] creating volume 'volume-928891e7-2bca-4e1b-8f2b-e9123825ad74' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:49:33.240407 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-9fb84529-60be-43eb-8962-5cf272aec7a7 tempest-VolumesSnapshotTestJSON-2065732980 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:49:33.264674 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-c3dee216-b286-4fe4-a8ac-38af433b195c tempest-VolumesCloneTest-1714101741 None] Lock "b'cinder-a947dc3f-99d5-481a-b66c-c1b63f9862a5-delete_volume'" acquired by "delete_volume" :: waited 0.078s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:49:33.349069 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c3dee216-b286-4fe4-a8ac-38af433b195c tempest-VolumesCloneTest-1714101741 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:49:33.740546 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c3dee216-b286-4fe4-a8ac-38af433b195c tempest-VolumesCloneTest-1714101741 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:49:33.910897 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c3dee216-b286-4fe4-a8ac-38af433b195c tempest-VolumesCloneTest-1714101741 None] deleting rbd volume volume-a947dc3f-99d5-481a-b66c-c1b63f9862a5 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:49:34.091416 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-9fb84529-60be-43eb-8962-5cf272aec7a7 tempest-VolumesSnapshotTestJSON-2065732980 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:49:34.091801 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-9fb84529-60be-43eb-8962-5cf272aec7a7 tempest-VolumesSnapshotTestJSON-2065732980 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:49:34.096557 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-9fb84529-60be-43eb-8962-5cf272aec7a7 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee500363-fde4-46ca-bbcc-67c7b9a9619a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-928891e7-2bca-4e1b-8f2b-e9123825ad74', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:49:34.101172 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-9fb84529-60be-43eb-8962-5cf272aec7a7 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (546361c9-c648-4d4a-a8c5-a6c991754e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:49:34.169772 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-9fb84529-60be-43eb-8962-5cf272aec7a7 tempest-VolumesSnapshotTestJSON-2065732980 None] Volume volume-928891e7-2bca-4e1b-8f2b-e9123825ad74 (928891e7-2bca-4e1b-8f2b-e9123825ad74): created successfully May 21 21:49:34.173748 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-9fb84529-60be-43eb-8962-5cf272aec7a7 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (546361c9-c648-4d4a-a8c5-a6c991754e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:49:34.179704 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-9fb84529-60be-43eb-8962-5cf272aec7a7 tempest-VolumesSnapshotTestJSON-2065732980 None] Flow 'volume_create_manager' (c68461e5-d99a-45a2-a2da-5e8145bc6902) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:49:34.281873 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-9fb84529-60be-43eb-8962-5cf272aec7a7 tempest-VolumesSnapshotTestJSON-2065732980 None] Created volume successfully. May 21 21:49:35.749817 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-668b6629-14e0-4621-81e7-b46b6aee008e tempest-VolumesSnapshotTestJSON-2065732980 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:49:37.740547 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c3dee216-b286-4fe4-a8ac-38af433b195c tempest-VolumesCloneTest-1714101741 None] volume is a clone so cleaning references {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1352}} May 21 21:49:37.883479 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c3dee216-b286-4fe4-a8ac-38af433b195c tempest-VolumesCloneTest-1714101741 None] Volume volume-44043c6d-81c9-402c-9b0a-12796f378014 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:49:37.887741 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c3dee216-b286-4fe4-a8ac-38af433b195c tempest-VolumesCloneTest-1714101741 None] deleting parent snapshot volume-a947dc3f-99d5-481a-b66c-c1b63f9862a5.clone_snap {{(pid=124407) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1243}} May 21 21:49:40.969693 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-c3dee216-b286-4fe4-a8ac-38af433b195c tempest-VolumesCloneTest-1714101741 None] Created reservations ['7dae0304-3c89-47ba-b481-dd96a9fe005d', '2c7a797e-bfa3-4ec3-b7e1-75df6e7bf3b5', '3510f04e-8659-402a-ba3b-9b1ad3831440', 'bc700018-975c-4482-8b37-7dcec75fd19a'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:49:41.168111 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c3dee216-b286-4fe4-a8ac-38af433b195c tempest-VolumesCloneTest-1714101741 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:49:41.190419 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c3dee216-b286-4fe4-a8ac-38af433b195c tempest-VolumesCloneTest-1714101741 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:49:41.214579 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-c3dee216-b286-4fe4-a8ac-38af433b195c tempest-VolumesCloneTest-1714101741 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:49:41.225365 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-c3dee216-b286-4fe4-a8ac-38af433b195c tempest-VolumesCloneTest-1714101741 None] Deleted volume successfully. May 21 21:49:41.299386 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-c3dee216-b286-4fe4-a8ac-38af433b195c tempest-VolumesCloneTest-1714101741 None] Lock "b'cinder-a947dc3f-99d5-481a-b66c-c1b63f9862a5-delete_volume'" released by "delete_volume" :: held 8.035s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:49:41.312257 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-668b6629-14e0-4621-81e7-b46b6aee008e tempest-VolumesSnapshotTestJSON-2065732980 None] Create snapshot completed successfully May 21 21:49:41.830047 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-b68c9f91-2bbf-47f9-b7c2-b04104737c4d tempest-VolumesCloneTest-1714101741 None] Lock "b'cinder-44043c6d-81c9-402c-9b0a-12796f378014-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:49:41.965558 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b68c9f91-2bbf-47f9-b7c2-b04104737c4d tempest-VolumesCloneTest-1714101741 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:49:42.094599 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b68c9f91-2bbf-47f9-b7c2-b04104737c4d tempest-VolumesCloneTest-1714101741 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:49:42.095308 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b68c9f91-2bbf-47f9-b7c2-b04104737c4d tempest-VolumesCloneTest-1714101741 None] Volume volume-44043c6d-81c9-402c-9b0a-12796f378014 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:49:42.191435 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b68c9f91-2bbf-47f9-b7c2-b04104737c4d tempest-VolumesCloneTest-1714101741 None] deleting rbd volume volume-44043c6d-81c9-402c-9b0a-12796f378014 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:49:42.611050 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-41654c6a-d59a-4523-93c1-daba272f68e4 tempest-VolumesSnapshotTestJSON-2065732980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:49:42.638376 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-41654c6a-d59a-4523-93c1-daba272f68e4 tempest-VolumesSnapshotTestJSON-2065732980 None] Flow 'volume_create_manager' (793c7ad9-9343-4361-b7b5-09d9b7ae6394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:49:42.645419 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-41654c6a-d59a-4523-93c1-daba272f68e4 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7378e7ca-45a5-45e4-99f1-bc04d7541409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:49:42.661101 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-41654c6a-d59a-4523-93c1-daba272f68e4 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7378e7ca-45a5-45e4-99f1-bc04d7541409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-967265692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=96744d8a-b1a1-441f-b1b4-d768225b7832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e046067a8e4197b18860f9b9e1e344',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=277ee502-b184-4d02-8efe-52d090e9e65f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:49:42Z,use_quota=True,user_id='88d6ab0c56ae4b16805f265728e20ed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:49:42.666560 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-41654c6a-d59a-4523-93c1-daba272f68e4 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc1e1030-2d9a-474b-a4fc-e647539d13f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:49:42.670771 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-41654c6a-d59a-4523-93c1-daba272f68e4 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc1e1030-2d9a-474b-a4fc-e647539d13f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:49:42.675724 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-41654c6a-d59a-4523-93c1-daba272f68e4 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3013f7db-cd76-49ce-8d45-5bd900e465ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:49:42.679757 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-41654c6a-d59a-4523-93c1-daba272f68e4 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3013f7db-cd76-49ce-8d45-5bd900e465ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '96744d8a-b1a1-441f-b1b4-d768225b7832', 'volume_name': 'volume-96744d8a-b1a1-441f-b1b4-d768225b7832', 'volume_size': 1, 'snapshot_id': '277ee502-b184-4d02-8efe-52d090e9e65f'}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:49:42.684940 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-41654c6a-d59a-4523-93c1-daba272f68e4 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcbff1de-f536-4784-83d6-bb5ce3e9ea03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:49:42.689368 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-41654c6a-d59a-4523-93c1-daba272f68e4 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcbff1de-f536-4784-83d6-bb5ce3e9ea03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:49:42.694088 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-41654c6a-d59a-4523-93c1-daba272f68e4 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eadc4d00-61df-4293-abe9-b006ed808a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:49:42.695157 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-41654c6a-d59a-4523-93c1-daba272f68e4 tempest-VolumesSnapshotTestJSON-2065732980 None] Volume 96744d8a-b1a1-441f-b1b4-d768225b7832: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-96744d8a-b1a1-441f-b1b4-d768225b7832', 'volume_size': 1, 'snapshot_id': '277ee502-b184-4d02-8efe-52d090e9e65f'} May 21 21:49:42.714951 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-41654c6a-d59a-4523-93c1-daba272f68e4 tempest-VolumesSnapshotTestJSON-2065732980 None] cloning volumes/volume-928891e7-2bca-4e1b-8f2b-e9123825ad74@snapshot-277ee502-b184-4d02-8efe-52d090e9e65f to volume-96744d8a-b1a1-441f-b1b4-d768225b7832 {{(pid=124407) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1098}} May 21 21:49:42.715593 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-41654c6a-d59a-4523-93c1-daba272f68e4 tempest-VolumesSnapshotTestJSON-2065732980 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:49:42.747185 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-41654c6a-d59a-4523-93c1-daba272f68e4 tempest-VolumesSnapshotTestJSON-2065732980 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:49:44.062464 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-41654c6a-d59a-4523-93c1-daba272f68e4 tempest-VolumesSnapshotTestJSON-2065732980 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:49:44.063207 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-41654c6a-d59a-4523-93c1-daba272f68e4 tempest-VolumesSnapshotTestJSON-2065732980 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:49:44.082783 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-41654c6a-d59a-4523-93c1-daba272f68e4 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eadc4d00-61df-4293-abe9-b006ed808a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96744d8a-b1a1-441f-b1b4-d768225b7832', 'volume_size': 1, 'snapshot_id': '277ee502-b184-4d02-8efe-52d090e9e65f'}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:49:44.087363 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-41654c6a-d59a-4523-93c1-daba272f68e4 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (520d0c46-e18d-49c2-9523-743b9d654dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:49:44.158202 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-41654c6a-d59a-4523-93c1-daba272f68e4 tempest-VolumesSnapshotTestJSON-2065732980 None] Volume volume-96744d8a-b1a1-441f-b1b4-d768225b7832 (96744d8a-b1a1-441f-b1b4-d768225b7832): created successfully May 21 21:49:44.161802 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-41654c6a-d59a-4523-93c1-daba272f68e4 tempest-VolumesSnapshotTestJSON-2065732980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (520d0c46-e18d-49c2-9523-743b9d654dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:49:44.167192 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-41654c6a-d59a-4523-93c1-daba272f68e4 tempest-VolumesSnapshotTestJSON-2065732980 None] Flow 'volume_create_manager' (793c7ad9-9343-4361-b7b5-09d9b7ae6394) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:49:44.247409 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-41654c6a-d59a-4523-93c1-daba272f68e4 tempest-VolumesSnapshotTestJSON-2065732980 None] Created volume successfully. May 21 21:49:44.699076 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-c2c5fb0d-0906-41e4-a8d8-9369e4bc0d13 tempest-VolumesSnapshotTestJSON-2065732980 None] Lock "b'cinder-96744d8a-b1a1-441f-b1b4-d768225b7832-delete_volume'" acquired by "delete_volume" :: waited 0.008s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:49:44.779222 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c2c5fb0d-0906-41e4-a8d8-9369e4bc0d13 tempest-VolumesSnapshotTestJSON-2065732980 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:49:44.938531 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c2c5fb0d-0906-41e4-a8d8-9369e4bc0d13 tempest-VolumesSnapshotTestJSON-2065732980 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:49:45.105532 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c2c5fb0d-0906-41e4-a8d8-9369e4bc0d13 tempest-VolumesSnapshotTestJSON-2065732980 None] deleting rbd volume volume-96744d8a-b1a1-441f-b1b4-d768225b7832 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:49:45.527619 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-b68c9f91-2bbf-47f9-b7c2-b04104737c4d tempest-VolumesCloneTest-1714101741 None] Created reservations ['7dd5dac2-6d0d-40dd-8507-94e73ec00c7c', '928c38b2-46b0-43f0-a21e-3270bfedb9b9', '85392370-21c4-432e-926c-2df89a23b153', 'edd5d3d9-7b15-481c-a9c1-466a15e83377'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:49:45.625889 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=59,cinder:INSERT=7,cinder:UPDATE=31,cinder:DELETE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:49:45.712948 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b68c9f91-2bbf-47f9-b7c2-b04104737c4d tempest-VolumesCloneTest-1714101741 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:49:45.735833 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b68c9f91-2bbf-47f9-b7c2-b04104737c4d tempest-VolumesCloneTest-1714101741 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:49:45.762285 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-b68c9f91-2bbf-47f9-b7c2-b04104737c4d tempest-VolumesCloneTest-1714101741 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:49:45.766508 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-b68c9f91-2bbf-47f9-b7c2-b04104737c4d tempest-VolumesCloneTest-1714101741 None] Deleted volume successfully. May 21 21:49:45.862964 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-b68c9f91-2bbf-47f9-b7c2-b04104737c4d tempest-VolumesCloneTest-1714101741 None] Lock "b'cinder-44043c6d-81c9-402c-9b0a-12796f378014-delete_volume'" released by "delete_volume" :: held 4.034s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:49:46.237002 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-57a64e6b-6d97-482a-a5a2-6ab664d81595 tempest-VolumesCloneTest-1714101741 None] Lock "b'cinder-f9ee3508-c71c-427a-b97d-c52d95e67f3b-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:49:46.330756 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-57a64e6b-6d97-482a-a5a2-6ab664d81595 tempest-VolumesCloneTest-1714101741 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:49:46.603111 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-57a64e6b-6d97-482a-a5a2-6ab664d81595 tempest-VolumesCloneTest-1714101741 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:49:46.817373 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-57a64e6b-6d97-482a-a5a2-6ab664d81595 tempest-VolumesCloneTest-1714101741 None] deleting rbd volume volume-f9ee3508-c71c-427a-b97d-c52d95e67f3b {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:49:49.208085 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-c2c5fb0d-0906-41e4-a8d8-9369e4bc0d13 tempest-VolumesSnapshotTestJSON-2065732980 None] Created reservations ['92c67cc5-3f7c-43d7-8788-14c4fd1de30f', 'c32ddd2a-fbec-4786-a49b-126154124cfa', 'f2ff383c-3610-400b-8b2e-7d3b108fb020', 'd2bf629d-55ff-4ca1-889b-9651df21fd3c'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:49:49.313173 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=62,cinder:UPDATE=29,cinder:DELETE=4,cinder:INSERT=5 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:49:49.413742 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c2c5fb0d-0906-41e4-a8d8-9369e4bc0d13 tempest-VolumesSnapshotTestJSON-2065732980 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:49:49.519970 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c2c5fb0d-0906-41e4-a8d8-9369e4bc0d13 tempest-VolumesSnapshotTestJSON-2065732980 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:49:49.542877 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-c2c5fb0d-0906-41e4-a8d8-9369e4bc0d13 tempest-VolumesSnapshotTestJSON-2065732980 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:49:49.546958 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-c2c5fb0d-0906-41e4-a8d8-9369e4bc0d13 tempest-VolumesSnapshotTestJSON-2065732980 None] Deleted volume successfully. May 21 21:49:49.620413 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-c2c5fb0d-0906-41e4-a8d8-9369e4bc0d13 tempest-VolumesSnapshotTestJSON-2065732980 None] Lock "b'cinder-96744d8a-b1a1-441f-b1b4-d768225b7832-delete_volume'" released by "delete_volume" :: held 4.921s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:49:50.059896 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-57a64e6b-6d97-482a-a5a2-6ab664d81595 tempest-VolumesCloneTest-1714101741 None] volume is a clone so cleaning references {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1352}} May 21 21:49:50.203254 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-57a64e6b-6d97-482a-a5a2-6ab664d81595 tempest-VolumesCloneTest-1714101741 None] deleting parent snapshot volume-f9ee3508-c71c-427a-b97d-c52d95e67f3b.clone_snap {{(pid=124407) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1243}} May 21 21:49:52.487356 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-e5f92a64-1aba-4323-937c-d0829d1daa5f tempest-VolumesSnapshotTestJSON-2065732980 None] Lock "b'cinder-277ee502-b184-4d02-8efe-52d090e9e65f-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.016s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:49:52.489843 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-e5f92a64-1aba-4323-937c-d0829d1daa5f tempest-VolumesSnapshotTestJSON-2065732980 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:49:52.695098 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-57a64e6b-6d97-482a-a5a2-6ab664d81595 tempest-VolumesCloneTest-1714101741 None] Created reservations ['52a749ac-c87a-4e4b-b053-62155d79a92b', '1d6cd167-7276-4055-8c3d-1a6db825618d', 'cc3cb5cd-25cd-4f62-bdf5-8fad3a17cb26', 'f7019c8e-3fa9-4aba-b95a-a67c1cd98c77'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:49:52.935884 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-57a64e6b-6d97-482a-a5a2-6ab664d81595 tempest-VolumesCloneTest-1714101741 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:49:53.003230 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-57a64e6b-6d97-482a-a5a2-6ab664d81595 tempest-VolumesCloneTest-1714101741 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:49:53.025868 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-57a64e6b-6d97-482a-a5a2-6ab664d81595 tempest-VolumesCloneTest-1714101741 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:49:53.029804 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-57a64e6b-6d97-482a-a5a2-6ab664d81595 tempest-VolumesCloneTest-1714101741 None] Deleted volume successfully. May 21 21:49:53.081676 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-57a64e6b-6d97-482a-a5a2-6ab664d81595 tempest-VolumesCloneTest-1714101741 None] Lock "b'cinder-f9ee3508-c71c-427a-b97d-c52d95e67f3b-delete_volume'" released by "delete_volume" :: held 6.845s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:49:53.806573 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-6a658ae9-a01f-4a20-b2c4-9c2bae4ead9c tempest-VolumesCloneTest-1714101741 None] Lock "b'cinder-cd46fece-9f1b-4ef0-aad7-a5ee369a34e6-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:49:53.899252 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6a658ae9-a01f-4a20-b2c4-9c2bae4ead9c tempest-VolumesCloneTest-1714101741 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:49:54.041025 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6a658ae9-a01f-4a20-b2c4-9c2bae4ead9c tempest-VolumesCloneTest-1714101741 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:49:54.133902 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6a658ae9-a01f-4a20-b2c4-9c2bae4ead9c tempest-VolumesCloneTest-1714101741 None] deleting rbd volume volume-cd46fece-9f1b-4ef0-aad7-a5ee369a34e6 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:49:55.123690 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-e5f92a64-1aba-4323-937c-d0829d1daa5f tempest-VolumesSnapshotTestJSON-2065732980 None] Created reservations ['2430e1f6-ac6a-4161-8a24-784f69080679', '73f9719b-4c01-4c57-894e-a9a380df4ce2', '215ea012-948d-445c-9576-19733d0837db', 'fd8c815b-7d4f-44f6-8668-f59a10923832'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:49:55.335098 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-e5f92a64-1aba-4323-937c-d0829d1daa5f tempest-VolumesSnapshotTestJSON-2065732980 None] Delete snapshot completed successfully. May 21 21:49:55.341269 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-e5f92a64-1aba-4323-937c-d0829d1daa5f tempest-VolumesSnapshotTestJSON-2065732980 None] Lock "b'cinder-277ee502-b184-4d02-8efe-52d090e9e65f-delete_snapshot'" released by "delete_snapshot" :: held 2.854s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:49:55.523375 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-0a8a14be-b92e-40c8-b568-1993ef89d207 tempest-VolumesSnapshotTestJSON-2065732980 None] Lock "b'cinder-928891e7-2bca-4e1b-8f2b-e9123825ad74-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:49:55.656624 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-0a8a14be-b92e-40c8-b568-1993ef89d207 tempest-VolumesSnapshotTestJSON-2065732980 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:49:55.860111 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-0a8a14be-b92e-40c8-b568-1993ef89d207 tempest-VolumesSnapshotTestJSON-2065732980 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:49:55.860577 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-0a8a14be-b92e-40c8-b568-1993ef89d207 tempest-VolumesSnapshotTestJSON-2065732980 None] Volume volume-928891e7-2bca-4e1b-8f2b-e9123825ad74 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:49:56.030552 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-0a8a14be-b92e-40c8-b568-1993ef89d207 tempest-VolumesSnapshotTestJSON-2065732980 None] deleting rbd volume volume-928891e7-2bca-4e1b-8f2b-e9123825ad74 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:49:56.901959 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:49:56.902699 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:49:56.925698 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:49:56.948963 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:49:57.591086 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6a658ae9-a01f-4a20-b2c4-9c2bae4ead9c tempest-VolumesCloneTest-1714101741 None] volume is a clone so cleaning references {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1352}} May 21 21:49:57.795706 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6a658ae9-a01f-4a20-b2c4-9c2bae4ead9c tempest-VolumesCloneTest-1714101741 None] deleting parent snapshot volume-cd46fece-9f1b-4ef0-aad7-a5ee369a34e6.clone_snap {{(pid=124407) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1243}} May 21 21:50:00.415164 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-0a8a14be-b92e-40c8-b568-1993ef89d207 tempest-VolumesSnapshotTestJSON-2065732980 None] Created reservations ['41a6928d-7b8d-44a6-a050-b16d0d682bf8', '8387dadd-2a5f-41c2-94b8-b6db07dcdd30', '5df39828-266c-4b61-ba1b-564d8654723d', '89f70732-e332-4eb8-8972-50ef834d5a89'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:50:00.435452 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-6a658ae9-a01f-4a20-b2c4-9c2bae4ead9c tempest-VolumesCloneTest-1714101741 None] Created reservations ['eddd0b7c-3082-4f5c-957e-62f3474f58a0', 'd0e33644-d83e-40c8-accc-36a0cdb824f2', '62c6a0b4-7519-452b-945c-c4ba4e87032d', '3976698b-451f-4333-bc84-d1c9d7f85e20'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:50:00.513831 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=50,cinder:UPDATE=39,cinder:INSERT=9,cinder:DELETE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:50:00.572290 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-0a8a14be-b92e-40c8-b568-1993ef89d207 tempest-VolumesSnapshotTestJSON-2065732980 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:50:00.594775 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-0a8a14be-b92e-40c8-b568-1993ef89d207 tempest-VolumesSnapshotTestJSON-2065732980 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:50:00.618770 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-0a8a14be-b92e-40c8-b568-1993ef89d207 tempest-VolumesSnapshotTestJSON-2065732980 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:50:00.627432 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-0a8a14be-b92e-40c8-b568-1993ef89d207 tempest-VolumesSnapshotTestJSON-2065732980 None] Deleted volume successfully. May 21 21:50:00.714061 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6a658ae9-a01f-4a20-b2c4-9c2bae4ead9c tempest-VolumesCloneTest-1714101741 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:50:00.817725 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-6a658ae9-a01f-4a20-b2c4-9c2bae4ead9c tempest-VolumesCloneTest-1714101741 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:50:00.843215 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-6a658ae9-a01f-4a20-b2c4-9c2bae4ead9c tempest-VolumesCloneTest-1714101741 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:50:00.853235 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-6a658ae9-a01f-4a20-b2c4-9c2bae4ead9c tempest-VolumesCloneTest-1714101741 None] Deleted volume successfully. May 21 21:50:00.853235 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-0a8a14be-b92e-40c8-b568-1993ef89d207 tempest-VolumesSnapshotTestJSON-2065732980 None] Lock "b'cinder-928891e7-2bca-4e1b-8f2b-e9123825ad74-delete_volume'" released by "delete_volume" :: held 5.329s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:50:00.945470 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-a628e8a5-b035-4c84-8cf0-6ec2bbc43ff3 tempest-VolumesSnapshotTestJSON-2065732980 None] Lock "b'cinder-5d8539e4-71bf-4bc4-8b5b-89bcd88516c3-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:50:00.947008 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a628e8a5-b035-4c84-8cf0-6ec2bbc43ff3 tempest-VolumesSnapshotTestJSON-2065732980 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:50:01.118026 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-6a658ae9-a01f-4a20-b2c4-9c2bae4ead9c tempest-VolumesCloneTest-1714101741 None] Lock "b'cinder-cd46fece-9f1b-4ef0-aad7-a5ee369a34e6-delete_volume'" released by "delete_volume" :: held 7.311s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:50:02.707287 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=55,cinder:INSERT=9,cinder:UPDATE=34,cinder:DELETE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:50:02.767273 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-a628e8a5-b035-4c84-8cf0-6ec2bbc43ff3 tempest-VolumesSnapshotTestJSON-2065732980 None] Created reservations ['4fe6fad5-6807-4d49-91bd-1ecd25e668d7', 'f6ad2b84-cb54-4977-a183-062da8309856', 'e63d3eba-aaa1-4e3c-ad89-6993ad353e45', '9115d045-eeb0-4ba3-b60f-856833ffffff'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:50:02.974902 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-a628e8a5-b035-4c84-8cf0-6ec2bbc43ff3 tempest-VolumesSnapshotTestJSON-2065732980 None] Delete snapshot completed successfully. May 21 21:50:02.980081 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-a628e8a5-b035-4c84-8cf0-6ec2bbc43ff3 tempest-VolumesSnapshotTestJSON-2065732980 None] Lock "b'cinder-5d8539e4-71bf-4bc4-8b5b-89bcd88516c3-delete_snapshot'" released by "delete_snapshot" :: held 2.035s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:50:03.227586 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-20d9631d-4f63-49d2-bc60-9c59d8775b73 tempest-VolumesSnapshotTestJSON-2065732980 None] Lock "b'cinder-df9f47ad-f950-4e27-aef0-0b978004fae9-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:50:03.359582 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-20d9631d-4f63-49d2-bc60-9c59d8775b73 tempest-VolumesSnapshotTestJSON-2065732980 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:50:03.458603 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-20d9631d-4f63-49d2-bc60-9c59d8775b73 tempest-VolumesSnapshotTestJSON-2065732980 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:50:03.458963 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-20d9631d-4f63-49d2-bc60-9c59d8775b73 tempest-VolumesSnapshotTestJSON-2065732980 None] Volume volume-df9f47ad-f950-4e27-aef0-0b978004fae9 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:50:03.535625 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-20d9631d-4f63-49d2-bc60-9c59d8775b73 tempest-VolumesSnapshotTestJSON-2065732980 None] deleting rbd volume volume-df9f47ad-f950-4e27-aef0-0b978004fae9 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:50:06.190467 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-20d9631d-4f63-49d2-bc60-9c59d8775b73 tempest-VolumesSnapshotTestJSON-2065732980 None] Created reservations ['10390262-511f-4461-b854-680cde23dc06', '217562d1-f1b6-42a0-a60c-652b0128071e', 'f0a2bf1f-84e5-499a-bbea-96a15c58b18a', '140981c4-a3c4-40e5-a35e-da51850e78af'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:50:06.368846 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-20d9631d-4f63-49d2-bc60-9c59d8775b73 tempest-VolumesSnapshotTestJSON-2065732980 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:50:06.425263 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-20d9631d-4f63-49d2-bc60-9c59d8775b73 tempest-VolumesSnapshotTestJSON-2065732980 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:50:06.478878 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-20d9631d-4f63-49d2-bc60-9c59d8775b73 tempest-VolumesSnapshotTestJSON-2065732980 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:50:06.483772 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-20d9631d-4f63-49d2-bc60-9c59d8775b73 tempest-VolumesSnapshotTestJSON-2065732980 None] Deleted volume successfully. May 21 21:50:06.583134 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-20d9631d-4f63-49d2-bc60-9c59d8775b73 tempest-VolumesSnapshotTestJSON-2065732980 None] Lock "b'cinder-df9f47ad-f950-4e27-aef0-0b978004fae9-delete_volume'" released by "delete_volume" :: held 3.356s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:50:06.700183 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7261f41-62cc-4f3f-b1e1-a4b2ca6b154e tempest-VolumesNegativeTest-593522334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:50:06.719287 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b7261f41-62cc-4f3f-b1e1-a4b2ca6b154e tempest-VolumesNegativeTest-593522334 None] Flow 'volume_create_manager' (c8dfabbe-3be8-404a-80b6-0e0dff6fdbfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:50:06.726358 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b7261f41-62cc-4f3f-b1e1-a4b2ca6b154e tempest-VolumesNegativeTest-593522334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dc2fbd6-a4ea-4e71-ad56-1de5e8d973e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:50:06.742363 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b7261f41-62cc-4f3f-b1e1-a4b2ca6b154e tempest-VolumesNegativeTest-593522334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dc2fbd6-a4ea-4e71-ad56-1de5e8d973e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:50:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-790125536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=396d8c6a-0660-455c-83b5-8454889067cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbc286a0828448e6960f83d60b98a646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:50:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:50:07Z,use_quota=True,user_id='aac93e7b93bc46f68fe4c14122d95a69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:50:06.747732 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b7261f41-62cc-4f3f-b1e1-a4b2ca6b154e tempest-VolumesNegativeTest-593522334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa105711-1689-4b11-b28c-6b88c4b0ea30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:50:06.751782 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b7261f41-62cc-4f3f-b1e1-a4b2ca6b154e tempest-VolumesNegativeTest-593522334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa105711-1689-4b11-b28c-6b88c4b0ea30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:50:06.756947 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b7261f41-62cc-4f3f-b1e1-a4b2ca6b154e tempest-VolumesNegativeTest-593522334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b9e0e70-ae6e-4cbd-9d1c-259c9277260c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:50:06.760958 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b7261f41-62cc-4f3f-b1e1-a4b2ca6b154e tempest-VolumesNegativeTest-593522334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b9e0e70-ae6e-4cbd-9d1c-259c9277260c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '396d8c6a-0660-455c-83b5-8454889067cc', 'volume_name': 'volume-396d8c6a-0660-455c-83b5-8454889067cc', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:50:06.765809 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b7261f41-62cc-4f3f-b1e1-a4b2ca6b154e tempest-VolumesNegativeTest-593522334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de8b6312-787b-4541-883c-4f66f5928370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:50:06.771475 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b7261f41-62cc-4f3f-b1e1-a4b2ca6b154e tempest-VolumesNegativeTest-593522334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de8b6312-787b-4541-883c-4f66f5928370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:50:06.776878 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b7261f41-62cc-4f3f-b1e1-a4b2ca6b154e tempest-VolumesNegativeTest-593522334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (720ceb55-6537-40aa-869f-dce30d270212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:50:06.779897 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-b7261f41-62cc-4f3f-b1e1-a4b2ca6b154e tempest-VolumesNegativeTest-593522334 None] Volume 396d8c6a-0660-455c-83b5-8454889067cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-396d8c6a-0660-455c-83b5-8454889067cc', 'volume_size': 1} May 21 21:50:06.779897 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b7261f41-62cc-4f3f-b1e1-a4b2ca6b154e tempest-VolumesNegativeTest-593522334 None] creating volume 'volume-396d8c6a-0660-455c-83b5-8454889067cc' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:50:06.779897 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b7261f41-62cc-4f3f-b1e1-a4b2ca6b154e tempest-VolumesNegativeTest-593522334 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:50:06.815060 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-a99f79a8-77a0-4149-80b5-e0a071cb9458 tempest-VolumesSnapshotTestJSON-2065732980 None] Lock "b'cinder-0073fe3d-0903-4f84-8e07-7e6bd96bbf32-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:50:07.031817 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a99f79a8-77a0-4149-80b5-e0a071cb9458 tempest-VolumesSnapshotTestJSON-2065732980 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:50:07.277734 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a99f79a8-77a0-4149-80b5-e0a071cb9458 tempest-VolumesSnapshotTestJSON-2065732980 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:50:07.425706 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a99f79a8-77a0-4149-80b5-e0a071cb9458 tempest-VolumesSnapshotTestJSON-2065732980 None] deleting rbd volume volume-0073fe3d-0903-4f84-8e07-7e6bd96bbf32 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:50:07.539317 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b7261f41-62cc-4f3f-b1e1-a4b2ca6b154e tempest-VolumesNegativeTest-593522334 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:50:07.539688 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b7261f41-62cc-4f3f-b1e1-a4b2ca6b154e tempest-VolumesNegativeTest-593522334 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:50:07.543452 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b7261f41-62cc-4f3f-b1e1-a4b2ca6b154e tempest-VolumesNegativeTest-593522334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (720ceb55-6537-40aa-869f-dce30d270212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-396d8c6a-0660-455c-83b5-8454889067cc', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:50:07.548026 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b7261f41-62cc-4f3f-b1e1-a4b2ca6b154e tempest-VolumesNegativeTest-593522334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b68f2f31-7880-4ed9-b8d0-5220b7c0b06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:50:07.637881 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-b7261f41-62cc-4f3f-b1e1-a4b2ca6b154e tempest-VolumesNegativeTest-593522334 None] Volume volume-396d8c6a-0660-455c-83b5-8454889067cc (396d8c6a-0660-455c-83b5-8454889067cc): created successfully May 21 21:50:07.641578 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b7261f41-62cc-4f3f-b1e1-a4b2ca6b154e tempest-VolumesNegativeTest-593522334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b68f2f31-7880-4ed9-b8d0-5220b7c0b06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:50:07.647663 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b7261f41-62cc-4f3f-b1e1-a4b2ca6b154e tempest-VolumesNegativeTest-593522334 None] Flow 'volume_create_manager' (c8dfabbe-3be8-404a-80b6-0e0dff6fdbfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:50:07.734763 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-b7261f41-62cc-4f3f-b1e1-a4b2ca6b154e tempest-VolumesNegativeTest-593522334 None] Created volume successfully. May 21 21:50:09.764608 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a99f79a8-77a0-4149-80b5-e0a071cb9458 tempest-VolumesSnapshotTestJSON-2065732980 None] volume is a clone so cleaning references {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1352}} May 21 21:50:09.856304 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a99f79a8-77a0-4149-80b5-e0a071cb9458 tempest-VolumesSnapshotTestJSON-2065732980 None] deleting parent snapshot volume-0073fe3d-0903-4f84-8e07-7e6bd96bbf32.clone_snap {{(pid=124407) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1243}} May 21 21:50:11.336699 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-a99f79a8-77a0-4149-80b5-e0a071cb9458 tempest-VolumesSnapshotTestJSON-2065732980 None] Created reservations ['eb651365-cdac-43f7-a6a2-63570fcf90ef', '8d2a000e-e98a-41c6-89a1-593c02b942a4', '962e5c0c-3c49-4a98-a46c-acc4d5a83a79', '2994fa51-7a4f-4cf4-8f3b-e1444eca3428'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:50:11.535630 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a99f79a8-77a0-4149-80b5-e0a071cb9458 tempest-VolumesSnapshotTestJSON-2065732980 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:50:11.620717 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-a99f79a8-77a0-4149-80b5-e0a071cb9458 tempest-VolumesSnapshotTestJSON-2065732980 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:50:11.656256 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-a99f79a8-77a0-4149-80b5-e0a071cb9458 tempest-VolumesSnapshotTestJSON-2065732980 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:50:11.662097 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-a99f79a8-77a0-4149-80b5-e0a071cb9458 tempest-VolumesSnapshotTestJSON-2065732980 None] Deleted volume successfully. May 21 21:50:11.733478 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-a99f79a8-77a0-4149-80b5-e0a071cb9458 tempest-VolumesSnapshotTestJSON-2065732980 None] Lock "b'cinder-0073fe3d-0903-4f84-8e07-7e6bd96bbf32-delete_volume'" released by "delete_volume" :: held 4.918s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:50:12.188292 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-d3bf1a18-7932-4463-baad-161936aff9fd tempest-VolumesSnapshotTestJSON-2065732980 None] Lock "b'cinder-f865fa4a-2d95-4bc7-93b8-9be17f58dd00-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:50:12.190042 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d3bf1a18-7932-4463-baad-161936aff9fd tempest-VolumesSnapshotTestJSON-2065732980 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:50:14.727167 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-d3bf1a18-7932-4463-baad-161936aff9fd tempest-VolumesSnapshotTestJSON-2065732980 None] Created reservations ['3d2d2475-b706-4bc0-989f-efe677365130', '83a0cf38-7ed5-42fb-a2c2-543ca9dd0da2', '06b7520f-b6a1-4b7b-acbc-a0cd87ead277', 'b0899504-b7e8-4161-8e8f-78252b814a79'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:50:14.918277 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-d3bf1a18-7932-4463-baad-161936aff9fd tempest-VolumesSnapshotTestJSON-2065732980 None] Delete snapshot completed successfully. May 21 21:50:14.923105 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-d3bf1a18-7932-4463-baad-161936aff9fd tempest-VolumesSnapshotTestJSON-2065732980 None] Lock "b'cinder-f865fa4a-2d95-4bc7-93b8-9be17f58dd00-delete_snapshot'" released by "delete_snapshot" :: held 2.735s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:50:15.515025 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-21e5063e-ac06-482c-a7c9-ad14a398d3d5 tempest-VolumesSnapshotTestJSON-2065732980 None] Lock "b'cinder-83ee5203-dcde-4e2f-9c30-819d45781c45-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:50:15.625805 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-21e5063e-ac06-482c-a7c9-ad14a398d3d5 tempest-VolumesSnapshotTestJSON-2065732980 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:50:15.792062 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-21e5063e-ac06-482c-a7c9-ad14a398d3d5 tempest-VolumesSnapshotTestJSON-2065732980 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:50:15.792714 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-21e5063e-ac06-482c-a7c9-ad14a398d3d5 tempest-VolumesSnapshotTestJSON-2065732980 None] Volume volume-83ee5203-dcde-4e2f-9c30-819d45781c45 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:50:16.116818 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-21e5063e-ac06-482c-a7c9-ad14a398d3d5 tempest-VolumesSnapshotTestJSON-2065732980 None] deleting rbd volume volume-83ee5203-dcde-4e2f-9c30-819d45781c45 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:50:18.657146 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=56,cinder:INSERT=8,cinder:UPDATE=35,cinder:DELETE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:50:18.775433 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-21e5063e-ac06-482c-a7c9-ad14a398d3d5 tempest-VolumesSnapshotTestJSON-2065732980 None] Created reservations ['a20c440d-43a8-45d8-be7b-575ed650478f', '514ed1c0-4c31-493a-973c-2f5ee0d84450', '6633c36e-fe99-41ee-a654-9baf0db2df58', 'a136fbbb-81dc-45bc-be87-d018ec4b47f5'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:50:18.861077 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=55,cinder:INSERT=12,cinder:UPDATE=31,cinder:DELETE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:50:18.927335 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-21e5063e-ac06-482c-a7c9-ad14a398d3d5 tempest-VolumesSnapshotTestJSON-2065732980 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:50:18.950828 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-21e5063e-ac06-482c-a7c9-ad14a398d3d5 tempest-VolumesSnapshotTestJSON-2065732980 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:50:18.973764 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-21e5063e-ac06-482c-a7c9-ad14a398d3d5 tempest-VolumesSnapshotTestJSON-2065732980 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:50:18.978651 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-21e5063e-ac06-482c-a7c9-ad14a398d3d5 tempest-VolumesSnapshotTestJSON-2065732980 None] Deleted volume successfully. May 21 21:50:19.040071 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-21e5063e-ac06-482c-a7c9-ad14a398d3d5 tempest-VolumesSnapshotTestJSON-2065732980 None] Lock "b'cinder-83ee5203-dcde-4e2f-9c30-819d45781c45-delete_volume'" released by "delete_volume" :: held 3.525s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:50:34.595024 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-d9875244-42fd-42af-a41b-a26f033ebbeb tempest-VolumesNegativeTest-593522334 None] Lock "b'cinder-396d8c6a-0660-455c-83b5-8454889067cc-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:50:34.745545 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d9875244-42fd-42af-a41b-a26f033ebbeb tempest-VolumesNegativeTest-593522334 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:50:34.917897 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d9875244-42fd-42af-a41b-a26f033ebbeb tempest-VolumesNegativeTest-593522334 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 21:50:34.918567 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d9875244-42fd-42af-a41b-a26f033ebbeb tempest-VolumesNegativeTest-593522334 None] Volume volume-396d8c6a-0660-455c-83b5-8454889067cc is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:50:35.003515 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d9875244-42fd-42af-a41b-a26f033ebbeb tempest-VolumesNegativeTest-593522334 None] deleting rbd volume volume-396d8c6a-0660-455c-83b5-8454889067cc {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:50:38.049618 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-d9875244-42fd-42af-a41b-a26f033ebbeb tempest-VolumesNegativeTest-593522334 None] Created reservations ['17eba432-b6c8-4475-a3d2-ea2b9d01d65e', 'ba0cd2f9-a757-46f6-bf7f-143057aa319c', 'a4ef4542-5bcf-4dbf-898b-6eb7b7c184b3', 'e9049db0-482a-4001-8261-9e0d9243eb11'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:50:38.227138 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d9875244-42fd-42af-a41b-a26f033ebbeb tempest-VolumesNegativeTest-593522334 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:50:38.252745 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d9875244-42fd-42af-a41b-a26f033ebbeb tempest-VolumesNegativeTest-593522334 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:50:38.289919 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-d9875244-42fd-42af-a41b-a26f033ebbeb tempest-VolumesNegativeTest-593522334 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:50:38.294471 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-d9875244-42fd-42af-a41b-a26f033ebbeb tempest-VolumesNegativeTest-593522334 None] Deleted volume successfully. May 21 21:50:38.367964 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-d9875244-42fd-42af-a41b-a26f033ebbeb tempest-VolumesNegativeTest-593522334 None] Lock "b'cinder-396d8c6a-0660-455c-83b5-8454889067cc-delete_volume'" released by "delete_volume" :: held 3.773s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:50:51.239963 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=22,cinder:UPDATE=7,cinder:INSERT=1,cinder:DELETE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:50:51.248642 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=17,cinder:UPDATE=20,cinder:DELETE=1,cinder:INSERT=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:50:56.905554 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:50:56.907990 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:50:56.971206 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:50:57.073397 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:51:11.264820 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:51:16.217072 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dce8edd-d266-4185-a689-f290b6f53148 tempest-TestVolumeBackupRestore-1087879388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:51:16.236132 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8dce8edd-d266-4185-a689-f290b6f53148 tempest-TestVolumeBackupRestore-1087879388 None] Flow 'volume_create_manager' (3c7cafaa-f589-429d-9df0-988b2a149a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:51:16.243055 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8dce8edd-d266-4185-a689-f290b6f53148 tempest-TestVolumeBackupRestore-1087879388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (986c1bc4-8ed8-4c26-b4ff-c082cee417b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:51:16.258842 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8dce8edd-d266-4185-a689-f290b6f53148 tempest-TestVolumeBackupRestore-1087879388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (986c1bc4-8ed8-4c26-b4ff-c082cee417b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-volume-2049087075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=79a2e2bf-63e7-4dba-976f-a08410a5580c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e89f6a9532254e5e80e19ae3e367bceb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:51:16Z,use_quota=True,user_id='bb0237a781634974ba77b9ef00d52643',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:51:16.264147 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8dce8edd-d266-4185-a689-f290b6f53148 tempest-TestVolumeBackupRestore-1087879388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32c64ec8-9861-46e7-a39f-45155df12a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:51:16.268228 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8dce8edd-d266-4185-a689-f290b6f53148 tempest-TestVolumeBackupRestore-1087879388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32c64ec8-9861-46e7-a39f-45155df12a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:51:16.273326 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8dce8edd-d266-4185-a689-f290b6f53148 tempest-TestVolumeBackupRestore-1087879388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (982d5865-08b2-44a8-be12-be993e0ca8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:51:16.362104 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8dce8edd-d266-4185-a689-f290b6f53148 tempest-TestVolumeBackupRestore-1087879388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (982d5865-08b2-44a8-be12-be993e0ca8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '79a2e2bf-63e7-4dba-976f-a08410a5580c', 'volume_name': 'volume-79a2e2bf-63e7-4dba-976f-a08410a5580c', 'volume_size': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5593f8cb452404083dfa177b4ee68b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'created_at': datetime.datetime(2022, 5, 21, 21, 0, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:51:16.367472 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8dce8edd-d266-4185-a689-f290b6f53148 tempest-TestVolumeBackupRestore-1087879388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb6dfa00-91d8-4f3d-9b2a-07b20e127ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:51:16.371379 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8dce8edd-d266-4185-a689-f290b6f53148 tempest-TestVolumeBackupRestore-1087879388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb6dfa00-91d8-4f3d-9b2a-07b20e127ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:51:16.376021 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8dce8edd-d266-4185-a689-f290b6f53148 tempest-TestVolumeBackupRestore-1087879388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (144ec3e0-e9b4-409e-8bf0-93a61a49fdf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:51:16.378241 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-8dce8edd-d266-4185-a689-f290b6f53148 tempest-TestVolumeBackupRestore-1087879388 None] Volume 79a2e2bf-63e7-4dba-976f-a08410a5580c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-79a2e2bf-63e7-4dba-976f-a08410a5580c', 'volume_size': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5593f8cb452404083dfa177b4ee68b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'created_at': datetime.datetime(2022, 5, 21, 21, 0, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } May 21 21:51:16.378241 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dce8edd-d266-4185-a689-f290b6f53148 tempest-TestVolumeBackupRestore-1087879388 None] Cloning 79a2e2bf-63e7-4dba-976f-a08410a5580c from image e570f5eb-6047-4214-a420-fdfdbdf19a4c at location (None, None). {{(pid=124407) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1053}} May 21 21:51:16.386836 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-8dce8edd-d266-4185-a689-f290b6f53148 tempest-TestVolumeBackupRestore-1087879388 None] Lock "b'cinder-e570f5eb-6047-4214-a420-fdfdbdf19a4c'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:51:16.475709 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-8dce8edd-d266-4185-a689-f290b6f53148 tempest-TestVolumeBackupRestore-1087879388 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'volume_id': '4057e637-23ba-493f-a45d-eb28c07ac60a', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28), 'last_used': datetime.datetime(2022, 5, 21, 21, 51, 16, 390949)}. {{(pid=124407) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 21 21:51:16.476211 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-8dce8edd-d266-4185-a689-f290b6f53148 tempest-TestVolumeBackupRestore-1087879388 None] Image-volume cache entry image_update_at = 2022-05-21 21:00:28+00:00, requested image updated_at = 2022-05-21 21:00:28+00:00. {{(pid=124407) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 21 21:51:16.476715 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dce8edd-d266-4185-a689-f290b6f53148 tempest-TestVolumeBackupRestore-1087879388 None] Found cache entry for image = e570f5eb-6047-4214-a420-fdfdbdf19a4c on host ncdv-master-1@ceph#ceph. {{(pid=124407) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:876}} May 21 21:51:16.483328 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-8dce8edd-d266-4185-a689-f290b6f53148 tempest-TestVolumeBackupRestore-1087879388 None] Lock "b'cinder-e570f5eb-6047-4214-a420-fdfdbdf19a4c'" released by "_prepare_image_cache_entry" :: held 0.094s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:51:16.483328 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dce8edd-d266-4185-a689-f290b6f53148 tempest-TestVolumeBackupRestore-1087879388 None] Attempting to retrieve cache entry for image = e570f5eb-6047-4214-a420-fdfdbdf19a4c on host ncdv-master-1@ceph#ceph. {{(pid=124407) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:817}} May 21 21:51:16.488652 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-8dce8edd-d266-4185-a689-f290b6f53148 tempest-TestVolumeBackupRestore-1087879388 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'volume_id': '4057e637-23ba-493f-a45d-eb28c07ac60a', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28), 'last_used': datetime.datetime(2022, 5, 21, 21, 51, 16, 486219)}. {{(pid=124407) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 21 21:51:16.489061 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-8dce8edd-d266-4185-a689-f290b6f53148 tempest-TestVolumeBackupRestore-1087879388 None] Image-volume cache entry image_update_at = 2022-05-21 21:00:28+00:00, requested image updated_at = 2022-05-21 21:00:28+00:00. {{(pid=124407) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 21 21:51:16.489450 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dce8edd-d266-4185-a689-f290b6f53148 tempest-TestVolumeBackupRestore-1087879388 None] Creating from source image-volume 4057e637-23ba-493f-a45d-eb28c07ac60a {{(pid=124407) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:831}} May 21 21:51:16.504132 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8dce8edd-d266-4185-a689-f290b6f53148 tempest-TestVolumeBackupRestore-1087879388 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:51:16.640554 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8dce8edd-d266-4185-a689-f290b6f53148 tempest-TestVolumeBackupRestore-1087879388 None] creating snapshot='volume-79a2e2bf-63e7-4dba-976f-a08410a5580c.clone_snap' {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 21 21:51:17.969737 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8dce8edd-d266-4185-a689-f290b6f53148 tempest-TestVolumeBackupRestore-1087879388 None] cloning 'volume-4057e637-23ba-493f-a45d-eb28c07ac60a@volume-79a2e2bf-63e7-4dba-976f-a08410a5580c.clone_snap' to 'volume-79a2e2bf-63e7-4dba-976f-a08410a5580c' {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:789}} May 21 21:51:19.098134 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8dce8edd-d266-4185-a689-f290b6f53148 tempest-TestVolumeBackupRestore-1087879388 None] Volume volume-b9ebacac-5f32-42e3-9194-003aee7e2435.deleted is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:51:19.099199 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8dce8edd-d266-4185-a689-f290b6f53148 tempest-TestVolumeBackupRestore-1087879388 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:51:19.100268 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8dce8edd-d266-4185-a689-f290b6f53148 tempest-TestVolumeBackupRestore-1087879388 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:51:19.273880 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8dce8edd-d266-4185-a689-f290b6f53148 tempest-TestVolumeBackupRestore-1087879388 None] clone created successfully {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:862}} May 21 21:51:19.274670 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.volume_utils [None req-8dce8edd-d266-4185-a689-f290b6f53148 tempest-TestVolumeBackupRestore-1087879388 None] Marking volume 79a2e2bf-63e7-4dba-976f-a08410a5580c as bootable. {{(pid=124407) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} May 21 21:51:19.332335 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dce8edd-d266-4185-a689-f290b6f53148 tempest-TestVolumeBackupRestore-1087879388 None] Copying metadata from image e570f5eb-6047-4214-a420-fdfdbdf19a4c to 79a2e2bf-63e7-4dba-976f-a08410a5580c. {{(pid=124407) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} May 21 21:51:19.332826 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dce8edd-d266-4185-a689-f290b6f53148 tempest-TestVolumeBackupRestore-1087879388 None] Creating volume glance metadata for volume 79a2e2bf-63e7-4dba-976f-a08410a5580c backed by image e570f5eb-6047-4214-a420-fdfdbdf19a4c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=124407) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:673}} May 21 21:51:19.452536 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8dce8edd-d266-4185-a689-f290b6f53148 tempest-TestVolumeBackupRestore-1087879388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (144ec3e0-e9b4-409e-8bf0-93a61a49fdf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79a2e2bf-63e7-4dba-976f-a08410a5580c', 'volume_size': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5593f8cb452404083dfa177b4ee68b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'created_at': datetime.datetime(2022, 5, 21, 21, 0, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:51:19.457040 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8dce8edd-d266-4185-a689-f290b6f53148 tempest-TestVolumeBackupRestore-1087879388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b974920b-b08c-49a3-93f6-d0468dc96af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:51:19.546479 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-8dce8edd-d266-4185-a689-f290b6f53148 tempest-TestVolumeBackupRestore-1087879388 None] Volume volume-79a2e2bf-63e7-4dba-976f-a08410a5580c (79a2e2bf-63e7-4dba-976f-a08410a5580c): created successfully May 21 21:51:19.551045 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8dce8edd-d266-4185-a689-f290b6f53148 tempest-TestVolumeBackupRestore-1087879388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b974920b-b08c-49a3-93f6-d0468dc96af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:51:19.557322 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-8dce8edd-d266-4185-a689-f290b6f53148 tempest-TestVolumeBackupRestore-1087879388 None] Flow 'volume_create_manager' (3c7cafaa-f589-429d-9df0-988b2a149a0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:51:19.664798 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-8dce8edd-d266-4185-a689-f290b6f53148 tempest-TestVolumeBackupRestore-1087879388 None] Created volume successfully. May 21 21:51:21.080196 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-766407b3-a5d0-4b35-a66b-76951286dcfa tempest-TestVolumeBackupRestore-1087879388 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-05-21T21:51:20Z,data_timestamp=2022-05-21T21:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name=None,encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=a6cf8b3b-4cb7-457b-b275-f7494d0389fc,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='e89f6a9532254e5e80e19ae3e367bceb',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='bb0237a781634974ba77b9ef00d52643',volume_id=79a2e2bf-63e7-4dba-976f-a08410a5580c) May 21 21:51:21.082040 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.backup.rpcapi [None req-766407b3-a5d0-4b35-a66b-76951286dcfa tempest-TestVolumeBackupRestore-1087879388 None] continue_backup in rpcapi backup_id a6cf8b3b-4cb7-457b-b275-f7494d0389fc {{(pid=124407) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} May 21 21:51:21.219699 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [None req-766407b3-a5d0-4b35-a66b-76951286dcfa tempest-TestVolumeBackupRestore-1087879388 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:51:22.069310 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [None req-766407b3-a5d0-4b35-a66b-76951286dcfa tempest-TestVolumeBackupRestore-1087879388 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.849s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:51:22.070583 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-766407b3-a5d0-4b35-a66b-76951286dcfa tempest-TestVolumeBackupRestore-1087879388 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-79a2e2bf-63e7-4dba-976f-a08410a5580c', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'efef91cd-d8f8-4d93-9ad2-86d0b33251f4', 'volume_id': '79a2e2bf-63e7-4dba-976f-a08410a5580c', 'discard': True}} {{(pid=124407) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} May 21 21:51:22.074031 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=25,cinder:UPDATE=5,cinder:INSERT=7,cinder:DELETE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:51:22.086628 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-766407b3-a5d0-4b35-a66b-76951286dcfa tempest-TestVolumeBackupRestore-1087879388 None] Initialize volume connection completed successfully. May 21 21:51:41.251663 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=25,cinder:UPDATE=4,cinder:INSERT=5 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:51:56.911166 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:51:56.912803 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:51:56.979558 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:51:57.008913 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:52:00.797512 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:52:00.805976 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-766407b3-a5d0-4b35-a66b-76951286dcfa tempest-TestVolumeBackupRestore-1087879388 None] Terminate volume connection completed successfully. May 21 21:52:00.825152 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-766407b3-a5d0-4b35-a66b-76951286dcfa tempest-TestVolumeBackupRestore-1087879388 None] Remove volume export completed successfully. May 21 21:52:01.987483 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8d79120-48f7-470a-aa2b-94917e8b7b93 tempest-TestVolumeBackupRestore-1087879388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 21:52:02.007298 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b8d79120-48f7-470a-aa2b-94917e8b7b93 tempest-TestVolumeBackupRestore-1087879388 None] Flow 'volume_create_manager' (4728e93f-843d-48e6-8da3-48bf6a78839c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:52:02.014797 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b8d79120-48f7-470a-aa2b-94917e8b7b93 tempest-TestVolumeBackupRestore-1087879388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (965bc32a-627e-4eae-8bd5-a42c15b17d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:52:02.029361 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b8d79120-48f7-470a-aa2b-94917e8b7b93 tempest-TestVolumeBackupRestore-1087879388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (965bc32a-627e-4eae-8bd5-a42c15b17d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T21:52:01Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_a6cf8b3b-4cb7-457b-b275-f7494d0389fc',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=559981b5-4f79-4798-aa87-ec08274169ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e89f6a9532254e5e80e19ae3e367bceb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T21:52:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T21:52:02Z,use_quota=True,user_id='bb0237a781634974ba77b9ef00d52643',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:52:02.034492 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b8d79120-48f7-470a-aa2b-94917e8b7b93 tempest-TestVolumeBackupRestore-1087879388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3cda089-37a0-4d40-8521-b35ce03308ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:52:02.038569 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b8d79120-48f7-470a-aa2b-94917e8b7b93 tempest-TestVolumeBackupRestore-1087879388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3cda089-37a0-4d40-8521-b35ce03308ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:52:02.043530 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b8d79120-48f7-470a-aa2b-94917e8b7b93 tempest-TestVolumeBackupRestore-1087879388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (766bac17-3147-4f3a-ab19-af363d34adae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:52:02.047467 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b8d79120-48f7-470a-aa2b-94917e8b7b93 tempest-TestVolumeBackupRestore-1087879388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (766bac17-3147-4f3a-ab19-af363d34adae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '559981b5-4f79-4798-aa87-ec08274169ac', 'volume_name': 'volume-559981b5-4f79-4798-aa87-ec08274169ac', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:52:02.052534 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b8d79120-48f7-470a-aa2b-94917e8b7b93 tempest-TestVolumeBackupRestore-1087879388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60d136cb-c359-46a1-a5f1-d29bd8a39b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:52:02.056495 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b8d79120-48f7-470a-aa2b-94917e8b7b93 tempest-TestVolumeBackupRestore-1087879388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60d136cb-c359-46a1-a5f1-d29bd8a39b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:52:02.061310 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b8d79120-48f7-470a-aa2b-94917e8b7b93 tempest-TestVolumeBackupRestore-1087879388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc0c36a6-b69d-4039-8ce9-600b295f7e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:52:02.062344 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-b8d79120-48f7-470a-aa2b-94917e8b7b93 tempest-TestVolumeBackupRestore-1087879388 None] Volume 559981b5-4f79-4798-aa87-ec08274169ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-559981b5-4f79-4798-aa87-ec08274169ac', 'volume_size': 1} May 21 21:52:02.062743 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b8d79120-48f7-470a-aa2b-94917e8b7b93 tempest-TestVolumeBackupRestore-1087879388 None] creating volume 'volume-559981b5-4f79-4798-aa87-ec08274169ac' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 21:52:02.063468 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b8d79120-48f7-470a-aa2b-94917e8b7b93 tempest-TestVolumeBackupRestore-1087879388 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:52:02.435022 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b8d79120-48f7-470a-aa2b-94917e8b7b93 tempest-TestVolumeBackupRestore-1087879388 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 21:52:02.435488 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b8d79120-48f7-470a-aa2b-94917e8b7b93 tempest-TestVolumeBackupRestore-1087879388 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 21:52:02.439224 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b8d79120-48f7-470a-aa2b-94917e8b7b93 tempest-TestVolumeBackupRestore-1087879388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc0c36a6-b69d-4039-8ce9-600b295f7e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-559981b5-4f79-4798-aa87-ec08274169ac', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:52:02.444949 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b8d79120-48f7-470a-aa2b-94917e8b7b93 tempest-TestVolumeBackupRestore-1087879388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d2b16ec-73a1-4f08-a9c1-57a6922db19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 21:52:02.497532 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-b8d79120-48f7-470a-aa2b-94917e8b7b93 tempest-TestVolumeBackupRestore-1087879388 None] Volume volume-559981b5-4f79-4798-aa87-ec08274169ac (559981b5-4f79-4798-aa87-ec08274169ac): created successfully May 21 21:52:02.501011 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b8d79120-48f7-470a-aa2b-94917e8b7b93 tempest-TestVolumeBackupRestore-1087879388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d2b16ec-73a1-4f08-a9c1-57a6922db19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 21:52:02.507258 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-b8d79120-48f7-470a-aa2b-94917e8b7b93 tempest-TestVolumeBackupRestore-1087879388 None] Flow 'volume_create_manager' (4728e93f-843d-48e6-8da3-48bf6a78839c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 21:52:02.577616 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-b8d79120-48f7-470a-aa2b-94917e8b7b93 tempest-TestVolumeBackupRestore-1087879388 None] Created volume successfully. May 21 21:52:02.920527 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [None req-b8d79120-48f7-470a-aa2b-94917e8b7b93 tempest-TestVolumeBackupRestore-1087879388 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:52:03.559025 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [None req-b8d79120-48f7-470a-aa2b-94917e8b7b93 tempest-TestVolumeBackupRestore-1087879388 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.638s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:52:03.560068 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-b8d79120-48f7-470a-aa2b-94917e8b7b93 tempest-TestVolumeBackupRestore-1087879388 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-559981b5-4f79-4798-aa87-ec08274169ac', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'efef91cd-d8f8-4d93-9ad2-86d0b33251f4', 'volume_id': '559981b5-4f79-4798-aa87-ec08274169ac', 'discard': True}} {{(pid=124407) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} May 21 21:52:03.577104 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-b8d79120-48f7-470a-aa2b-94917e8b7b93 tempest-TestVolumeBackupRestore-1087879388 None] Initialize volume connection completed successfully. May 21 21:52:21.285448 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=13,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:52:21.286172 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:52:40.611472 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-b8d79120-48f7-470a-aa2b-94917e8b7b93 tempest-TestVolumeBackupRestore-1087879388 None] Terminate volume connection completed successfully. May 21 21:52:40.662930 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-b8d79120-48f7-470a-aa2b-94917e8b7b93 tempest-TestVolumeBackupRestore-1087879388 None] Remove volume export completed successfully. May 21 21:52:49.451701 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-cb06d6aa-7726-474d-abd0-c17272a4a75e req-53aa3d0a-7382-46ac-916a-555a7f8ce5d4 tempest-TestVolumeBackupRestore-1087879388 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 21:52:50.134974 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-cb06d6aa-7726-474d-abd0-c17272a4a75e req-53aa3d0a-7382-46ac-916a-555a7f8ce5d4 tempest-TestVolumeBackupRestore-1087879388 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.682s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 21:52:50.136583 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-cb06d6aa-7726-474d-abd0-c17272a4a75e req-53aa3d0a-7382-46ac-916a-555a7f8ce5d4 tempest-TestVolumeBackupRestore-1087879388 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-559981b5-4f79-4798-aa87-ec08274169ac', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'efef91cd-d8f8-4d93-9ad2-86d0b33251f4', 'volume_id': '559981b5-4f79-4798-aa87-ec08274169ac', 'discard': True}} {{(pid=124407) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} May 21 21:52:50.254291 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-cb06d6aa-7726-474d-abd0-c17272a4a75e req-53aa3d0a-7382-46ac-916a-555a7f8ce5d4 tempest-TestVolumeBackupRestore-1087879388 None] Connection info returned from driver {'name': 'volumes/volume-559981b5-4f79-4798-aa87-ec08274169ac', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '559981b5-4f79-4798-aa87-ec08274169ac', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '85e275f9-74f3-4f24-a5bd-f156ac48b0a6'} {{(pid=124407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4826}} May 21 21:52:50.364223 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-cb06d6aa-7726-474d-abd0-c17272a4a75e req-53aa3d0a-7382-46ac-916a-555a7f8ce5d4 tempest-TestVolumeBackupRestore-1087879388 None] attachment_update completed successfully. May 21 21:52:56.915178 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:52:56.916921 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:52:56.939872 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:52:56.962123 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:53:00.359802 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=18,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:53:01.283825 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=20,cinder:UPDATE=5 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:53:11.292692 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:53:31.295909 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:53:41.295271 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:53:56.918770 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:53:56.919514 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:53:56.974097 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:53:57.107198 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:54:01.290730 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:54:21.292328 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:54:31.292326 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:54:41.299292 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:54:56.918618 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:54:56.920406 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:54:56.990029 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:54:57.035000 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:55:01.302949 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:55:11.333910 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:55:21.302387 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:55:51.300958 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:55:56.915397 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:55:56.916071 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:55:56.938263 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:55:56.961130 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:56:11.297966 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:56:31.300536 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:56:51.301950 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:56:51.303347 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:56:56.916257 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:56:56.917099 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:56:56.940603 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:56:56.963899 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:57:11.310694 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:57:29.069744 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:57:29.081108 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-65a0a027-8009-4d4a-934a-808486afbd26 req-bdc7958b-0fbe-4308-a2af-94bcd15e11a5 tempest-TestVolumeBackupRestore-1087879388 None] Terminate volume connection completed successfully. May 21 21:57:29.081108 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-65a0a027-8009-4d4a-934a-808486afbd26 req-bdc7958b-0fbe-4308-a2af-94bcd15e11a5 tempest-TestVolumeBackupRestore-1087879388 None] Deleting attachment 85e275f9-74f3-4f24-a5bd-f156ac48b0a6. {{(pid=124407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4957}} May 21 21:57:30.816763 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-c281936d-7d6d-409c-9738-7eedbae30839 tempest-TestVolumeBackupRestore-1087879388 None] Lock "b'cinder-559981b5-4f79-4798-aa87-ec08274169ac-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:57:30.943868 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c281936d-7d6d-409c-9738-7eedbae30839 tempest-TestVolumeBackupRestore-1087879388 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:57:32.668179 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c281936d-7d6d-409c-9738-7eedbae30839 tempest-TestVolumeBackupRestore-1087879388 None] Volume volume-559981b5-4f79-4798-aa87-ec08274169ac is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 21:57:33.063995 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c281936d-7d6d-409c-9738-7eedbae30839 tempest-TestVolumeBackupRestore-1087879388 None] deleting rbd volume volume-559981b5-4f79-4798-aa87-ec08274169ac {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:57:33.084838 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-d17ea8ae-4130-4b42-96ac-18360c78c062 tempest-TestVolumeBackupRestore-1087879388 None] Lock "b'cinder-79a2e2bf-63e7-4dba-976f-a08410a5580c-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 21:57:33.275749 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d17ea8ae-4130-4b42-96ac-18360c78c062 tempest-TestVolumeBackupRestore-1087879388 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:57:35.978051 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d17ea8ae-4130-4b42-96ac-18360c78c062 tempest-TestVolumeBackupRestore-1087879388 None] deleting rbd volume volume-79a2e2bf-63e7-4dba-976f-a08410a5580c {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 21:57:40.691737 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-c281936d-7d6d-409c-9738-7eedbae30839 tempest-TestVolumeBackupRestore-1087879388 None] Created reservations ['7cc7845c-6b8c-4dcd-85f1-ed98bf00c1b5', '640491b3-64f1-4dba-9c6c-16c7a2d51d6a', 'dff2a9fc-1064-450e-8e93-933dfa6b98a5', 'a75ec81b-2cb4-4835-9be5-96c22cbafdce'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:57:40.948014 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c281936d-7d6d-409c-9738-7eedbae30839 tempest-TestVolumeBackupRestore-1087879388 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:57:40.971682 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-c281936d-7d6d-409c-9738-7eedbae30839 tempest-TestVolumeBackupRestore-1087879388 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:57:40.995085 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-c281936d-7d6d-409c-9738-7eedbae30839 tempest-TestVolumeBackupRestore-1087879388 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:57:40.997590 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d17ea8ae-4130-4b42-96ac-18360c78c062 tempest-TestVolumeBackupRestore-1087879388 None] volume is a clone so cleaning references {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1352}} May 21 21:57:41.087431 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d17ea8ae-4130-4b42-96ac-18360c78c062 tempest-TestVolumeBackupRestore-1087879388 None] deleting parent snapshot volume-79a2e2bf-63e7-4dba-976f-a08410a5580c.clone_snap {{(pid=124407) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1243}} May 21 21:57:43.409371 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-c281936d-7d6d-409c-9738-7eedbae30839 tempest-TestVolumeBackupRestore-1087879388 None] Deleted volume successfully. May 21 21:57:43.413532 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=29,cinder:UPDATE=10,cinder:INSERT=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:57:43.493033 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-c281936d-7d6d-409c-9738-7eedbae30839 tempest-TestVolumeBackupRestore-1087879388 None] Lock "b'cinder-559981b5-4f79-4798-aa87-ec08274169ac-delete_volume'" released by "delete_volume" :: held 12.676s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:57:43.498636 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-d17ea8ae-4130-4b42-96ac-18360c78c062 tempest-TestVolumeBackupRestore-1087879388 None] Created reservations ['f37ba9db-2ff3-42af-be4f-b69f876bb3f1', '529741fd-f998-4084-ae90-03c960e4515f', 'faea81f9-a546-4179-9e07-2642f99706be', '5be70063-027a-42f3-836f-aabda200910b'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 21:57:43.617591 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d17ea8ae-4130-4b42-96ac-18360c78c062 tempest-TestVolumeBackupRestore-1087879388 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:57:43.659606 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-d17ea8ae-4130-4b42-96ac-18360c78c062 tempest-TestVolumeBackupRestore-1087879388 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:57:43.690521 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-d17ea8ae-4130-4b42-96ac-18360c78c062 tempest-TestVolumeBackupRestore-1087879388 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:57:43.691860 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-d17ea8ae-4130-4b42-96ac-18360c78c062 tempest-TestVolumeBackupRestore-1087879388 None] Deleted volume successfully. May 21 21:57:43.782675 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-d17ea8ae-4130-4b42-96ac-18360c78c062 tempest-TestVolumeBackupRestore-1087879388 None] Lock "b'cinder-79a2e2bf-63e7-4dba-976f-a08410a5580c-delete_volume'" released by "delete_volume" :: held 10.698s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 21:57:56.919650 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:57:56.920365 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:57:56.944193 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:57:56.967979 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:58:03.418536 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:UPDATE=21,cinder:SELECT=33,cinder:INSERT=7,cinder:DELETE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:58:23.423683 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:58:23.427797 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=8,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:58:33.455999 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:58:53.428272 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:58:56.922950 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:58:56.923664 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:58:56.945851 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:58:56.969827 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 21:59:03.422893 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:59:23.432102 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:59:33.441001 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 21:59:56.926313 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 21:59:56.926944 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:59:56.948945 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 21:59:56.972483 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 22:00:03.429749 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:00:03.433182 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:00:23.441828 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:00:43.440842 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:00:56.927836 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 22:00:56.928672 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:00:56.951596 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:00:56.979075 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 22:01:03.443573 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:01:23.444371 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:01:43.442233 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:02:13.435319 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:02:23.430273 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:02:43.428101 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:02:53.435123 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:02:56.925850 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 22:02:56.926549 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:02:56.948093 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:02:56.970272 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 22:03:23.437206 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:03:33.438474 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:03:43.445717 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:03:56.925327 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 22:03:56.926004 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:03:56.947905 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:03:56.969779 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 22:04:03.448127 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:04:13.457475 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:04:33.455929 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:04:43.455933 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:04:56.928012 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 22:04:56.928012 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:04:56.974286 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:04:57.012297 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 22:05:03.456550 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:05:23.451510 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:05:33.459256 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:05:42.395350 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-07c80da9-d3eb-4439-8594-719764da714c tempest-ServerActionsTestJSON-532218768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 22:05:42.415603 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-07c80da9-d3eb-4439-8594-719764da714c tempest-ServerActionsTestJSON-532218768 None] Flow 'volume_create_manager' (bdc9fd70-e454-4bbd-ba2a-e94b36eac0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 22:05:42.421977 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-07c80da9-d3eb-4439-8594-719764da714c tempest-ServerActionsTestJSON-532218768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb9069c3-e1b1-4359-ac4c-34458afeb13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 22:05:42.437375 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-07c80da9-d3eb-4439-8594-719764da714c tempest-ServerActionsTestJSON-532218768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb9069c3-e1b1-4359-ac4c-34458afeb13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T22:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1176435239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1f320a0f-8268-4b9e-b044-577130bdcaa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb9f2d0a8dca4c85a47c2d138d1b39cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T22:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T22:05:42Z,use_quota=True,user_id='1fd1bb72fc464808988a1579524c7939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 22:05:42.442944 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-07c80da9-d3eb-4439-8594-719764da714c tempest-ServerActionsTestJSON-532218768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16000445-b002-4757-872e-901d871eba97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 22:05:42.447709 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-07c80da9-d3eb-4439-8594-719764da714c tempest-ServerActionsTestJSON-532218768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16000445-b002-4757-872e-901d871eba97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 22:05:42.452776 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-07c80da9-d3eb-4439-8594-719764da714c tempest-ServerActionsTestJSON-532218768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4257380-e7c7-4e00-b96d-b5b227daa78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 22:05:42.456752 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-07c80da9-d3eb-4439-8594-719764da714c tempest-ServerActionsTestJSON-532218768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4257380-e7c7-4e00-b96d-b5b227daa78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f320a0f-8268-4b9e-b044-577130bdcaa2', 'volume_name': 'volume-1f320a0f-8268-4b9e-b044-577130bdcaa2', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 22:05:42.462449 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-07c80da9-d3eb-4439-8594-719764da714c tempest-ServerActionsTestJSON-532218768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4839bf3a-a89b-446d-9b4e-5d20d5852fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 22:05:42.466275 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-07c80da9-d3eb-4439-8594-719764da714c tempest-ServerActionsTestJSON-532218768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4839bf3a-a89b-446d-9b4e-5d20d5852fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 22:05:42.470851 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-07c80da9-d3eb-4439-8594-719764da714c tempest-ServerActionsTestJSON-532218768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (970c62d5-7bd3-4ebf-959e-f5509888aafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 22:05:42.471898 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-07c80da9-d3eb-4439-8594-719764da714c tempest-ServerActionsTestJSON-532218768 None] Volume 1f320a0f-8268-4b9e-b044-577130bdcaa2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f320a0f-8268-4b9e-b044-577130bdcaa2', 'volume_size': 1} May 21 22:05:42.472306 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-07c80da9-d3eb-4439-8594-719764da714c tempest-ServerActionsTestJSON-532218768 None] creating volume 'volume-1f320a0f-8268-4b9e-b044-577130bdcaa2' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 22:05:42.473077 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-07c80da9-d3eb-4439-8594-719764da714c tempest-ServerActionsTestJSON-532218768 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:05:42.940907 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-07c80da9-d3eb-4439-8594-719764da714c tempest-ServerActionsTestJSON-532218768 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 22:05:42.941207 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-07c80da9-d3eb-4439-8594-719764da714c tempest-ServerActionsTestJSON-532218768 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 22:05:42.945331 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-07c80da9-d3eb-4439-8594-719764da714c tempest-ServerActionsTestJSON-532218768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (970c62d5-7bd3-4ebf-959e-f5509888aafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f320a0f-8268-4b9e-b044-577130bdcaa2', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 22:05:42.949642 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-07c80da9-d3eb-4439-8594-719764da714c tempest-ServerActionsTestJSON-532218768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a532c4ea-cbe2-47f7-8788-d79bde1b6d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 22:05:42.994620 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-07c80da9-d3eb-4439-8594-719764da714c tempest-ServerActionsTestJSON-532218768 None] Volume volume-1f320a0f-8268-4b9e-b044-577130bdcaa2 (1f320a0f-8268-4b9e-b044-577130bdcaa2): created successfully May 21 22:05:42.998177 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-07c80da9-d3eb-4439-8594-719764da714c tempest-ServerActionsTestJSON-532218768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a532c4ea-cbe2-47f7-8788-d79bde1b6d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 22:05:43.003582 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-07c80da9-d3eb-4439-8594-719764da714c tempest-ServerActionsTestJSON-532218768 None] Flow 'volume_create_manager' (bdc9fd70-e454-4bbd-ba2a-e94b36eac0f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 22:05:43.063070 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-07c80da9-d3eb-4439-8594-719764da714c tempest-ServerActionsTestJSON-532218768 None] Created volume successfully. May 21 22:05:44.442871 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-6ee50af8-e283-471c-9392-3b66f6b7075f req-f02bd0b1-dc55-4161-b637-65e3f3c56050 tempest-ServerActionsTestJSON-532218768 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 22:05:45.079962 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-6ee50af8-e283-471c-9392-3b66f6b7075f req-f02bd0b1-dc55-4161-b637-65e3f3c56050 tempest-ServerActionsTestJSON-532218768 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.637s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 22:05:45.080771 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-6ee50af8-e283-471c-9392-3b66f6b7075f req-f02bd0b1-dc55-4161-b637-65e3f3c56050 tempest-ServerActionsTestJSON-532218768 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1f320a0f-8268-4b9e-b044-577130bdcaa2', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'efef91cd-d8f8-4d93-9ad2-86d0b33251f4', 'volume_id': '1f320a0f-8268-4b9e-b044-577130bdcaa2', 'discard': True}} {{(pid=124407) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} May 21 22:05:45.160576 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-6ee50af8-e283-471c-9392-3b66f6b7075f req-f02bd0b1-dc55-4161-b637-65e3f3c56050 tempest-ServerActionsTestJSON-532218768 None] Connection info returned from driver {'name': 'volumes/volume-1f320a0f-8268-4b9e-b044-577130bdcaa2', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1f320a0f-8268-4b9e-b044-577130bdcaa2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '72106d54-6112-4552-8034-80305873a86d'} {{(pid=124407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4826}} May 21 22:05:45.281269 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-6ee50af8-e283-471c-9392-3b66f6b7075f req-f02bd0b1-dc55-4161-b637-65e3f3c56050 tempest-ServerActionsTestJSON-532218768 None] attachment_update completed successfully. May 21 22:05:56.928005 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 22:05:56.928899 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:05:56.952832 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:05:56.975249 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 22:06:03.457565 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=23,cinder:UPDATE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:06:09.644693 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=19,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:06:09.655114 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-97ff870c-0bc1-4f51-b3d7-f74434a3bb15 req-7cd92026-9492-43dd-ad76-45d86a993b46 tempest-ServerActionsTestJSON-532218768 None] Terminate volume connection completed successfully. May 21 22:06:09.655535 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-97ff870c-0bc1-4f51-b3d7-f74434a3bb15 req-7cd92026-9492-43dd-ad76-45d86a993b46 tempest-ServerActionsTestJSON-532218768 None] Deleting attachment 72106d54-6112-4552-8034-80305873a86d. {{(pid=124407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4957}} May 21 22:06:12.976483 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-97ff870c-0bc1-4f51-b3d7-f74434a3bb15 req-e4733d24-834c-461d-965d-9f3d4d6dcc7e tempest-ServerActionsTestJSON-532218768 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 22:06:13.608528 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-97ff870c-0bc1-4f51-b3d7-f74434a3bb15 req-e4733d24-834c-461d-965d-9f3d4d6dcc7e tempest-ServerActionsTestJSON-532218768 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.632s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 22:06:13.609301 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-97ff870c-0bc1-4f51-b3d7-f74434a3bb15 req-e4733d24-834c-461d-965d-9f3d4d6dcc7e tempest-ServerActionsTestJSON-532218768 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1f320a0f-8268-4b9e-b044-577130bdcaa2', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'efef91cd-d8f8-4d93-9ad2-86d0b33251f4', 'volume_id': '1f320a0f-8268-4b9e-b044-577130bdcaa2', 'discard': True}} {{(pid=124407) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} May 21 22:06:13.674612 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-97ff870c-0bc1-4f51-b3d7-f74434a3bb15 req-e4733d24-834c-461d-965d-9f3d4d6dcc7e tempest-ServerActionsTestJSON-532218768 None] Connection info returned from driver {'name': 'volumes/volume-1f320a0f-8268-4b9e-b044-577130bdcaa2', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1f320a0f-8268-4b9e-b044-577130bdcaa2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0a180a70-5f2e-4c85-928f-55bafa8297f0'} {{(pid=124407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4826}} May 21 22:06:13.818588 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-97ff870c-0bc1-4f51-b3d7-f74434a3bb15 req-e4733d24-834c-461d-965d-9f3d4d6dcc7e tempest-ServerActionsTestJSON-532218768 None] attachment_update completed successfully. May 21 22:06:20.864652 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-fba2b5fb-3498-4a24-a01a-2c700041349e req-2e12f674-2342-4902-8d9e-25eadcfd9bf7 tempest-ServerActionsTestJSON-532218768 None] Terminate volume connection completed successfully. May 21 22:06:20.865288 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-fba2b5fb-3498-4a24-a01a-2c700041349e req-2e12f674-2342-4902-8d9e-25eadcfd9bf7 tempest-ServerActionsTestJSON-532218768 None] Deleting attachment 0a180a70-5f2e-4c85-928f-55bafa8297f0. {{(pid=124407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4957}} May 21 22:06:24.216785 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-fba2b5fb-3498-4a24-a01a-2c700041349e req-97b28c5a-e17e-4065-af4b-4784874208eb tempest-ServerActionsTestJSON-532218768 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 22:06:24.842156 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-fba2b5fb-3498-4a24-a01a-2c700041349e req-97b28c5a-e17e-4065-af4b-4784874208eb tempest-ServerActionsTestJSON-532218768 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.625s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 22:06:24.843064 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-fba2b5fb-3498-4a24-a01a-2c700041349e req-97b28c5a-e17e-4065-af4b-4784874208eb tempest-ServerActionsTestJSON-532218768 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1f320a0f-8268-4b9e-b044-577130bdcaa2', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'efef91cd-d8f8-4d93-9ad2-86d0b33251f4', 'volume_id': '1f320a0f-8268-4b9e-b044-577130bdcaa2', 'discard': True}} {{(pid=124407) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} May 21 22:06:24.948760 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-fba2b5fb-3498-4a24-a01a-2c700041349e req-97b28c5a-e17e-4065-af4b-4784874208eb tempest-ServerActionsTestJSON-532218768 None] Connection info returned from driver {'name': 'volumes/volume-1f320a0f-8268-4b9e-b044-577130bdcaa2', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1f320a0f-8268-4b9e-b044-577130bdcaa2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '44633adb-41e0-48ce-8f6b-6e4928a2b283'} {{(pid=124407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4826}} May 21 22:06:25.065889 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-fba2b5fb-3498-4a24-a01a-2c700041349e req-97b28c5a-e17e-4065-af4b-4784874208eb tempest-ServerActionsTestJSON-532218768 None] attachment_update completed successfully. May 21 22:06:32.797009 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-03a0902f-2721-4596-a8aa-696695ed2cba req-98ef7506-2ace-4eb8-aac8-0f731592c2fa tempest-ServerActionsTestJSON-532218768 None] Terminate volume connection completed successfully. May 21 22:06:32.797670 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-03a0902f-2721-4596-a8aa-696695ed2cba req-98ef7506-2ace-4eb8-aac8-0f731592c2fa tempest-ServerActionsTestJSON-532218768 None] Deleting attachment 44633adb-41e0-48ce-8f6b-6e4928a2b283. {{(pid=124407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4957}} May 21 22:06:34.905221 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-8b9137a9-7a63-42ed-b32d-eec4defb9620 tempest-ServerActionsTestJSON-532218768 None] Lock "b'cinder-1f320a0f-8268-4b9e-b044-577130bdcaa2-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 22:06:34.907750 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=34,cinder:UPDATE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:06:35.024592 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8b9137a9-7a63-42ed-b32d-eec4defb9620 tempest-ServerActionsTestJSON-532218768 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:06:35.130486 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8b9137a9-7a63-42ed-b32d-eec4defb9620 tempest-ServerActionsTestJSON-532218768 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 22:06:35.130930 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8b9137a9-7a63-42ed-b32d-eec4defb9620 tempest-ServerActionsTestJSON-532218768 None] Volume volume-1f320a0f-8268-4b9e-b044-577130bdcaa2 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 22:06:35.199482 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8b9137a9-7a63-42ed-b32d-eec4defb9620 tempest-ServerActionsTestJSON-532218768 None] deleting rbd volume volume-1f320a0f-8268-4b9e-b044-577130bdcaa2 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 22:06:37.759012 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-8b9137a9-7a63-42ed-b32d-eec4defb9620 tempest-ServerActionsTestJSON-532218768 None] Created reservations ['1056473b-c001-4cc8-a90b-6d68c5d504ff', '1efd979b-e55d-452e-9ef2-f93bfd3876d1', '8fbf2730-8b39-4cdb-82d7-aed16e9c11cf', '368b9856-3fba-45be-9609-ad3a7507d5b2'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 22:06:37.936761 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8b9137a9-7a63-42ed-b32d-eec4defb9620 tempest-ServerActionsTestJSON-532218768 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:06:37.958874 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-8b9137a9-7a63-42ed-b32d-eec4defb9620 tempest-ServerActionsTestJSON-532218768 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:06:37.982930 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-8b9137a9-7a63-42ed-b32d-eec4defb9620 tempest-ServerActionsTestJSON-532218768 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 22:06:37.987632 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-8b9137a9-7a63-42ed-b32d-eec4defb9620 tempest-ServerActionsTestJSON-532218768 None] Deleted volume successfully. May 21 22:06:38.066244 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-8b9137a9-7a63-42ed-b32d-eec4defb9620 tempest-ServerActionsTestJSON-532218768 None] Lock "b'cinder-1f320a0f-8268-4b9e-b044-577130bdcaa2-delete_volume'" released by "delete_volume" :: held 3.161s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 22:06:43.456437 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=45,cinder:UPDATE=14,cinder:INSERT=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:06:56.931860 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 22:06:56.933266 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:06:56.958696 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:06:56.989524 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 22:07:13.451945 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=16,cinder:INSERT=2,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:07:23.453330 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:07:33.459664 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:07:53.467128 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:07:56.936021 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 22:07:56.936688 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:07:56.959661 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:07:56.983613 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 22:08:03.460457 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:08:23.458153 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:08:33.470605 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:08:42.419154 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-3123f762-caf1-4b73-8c53-ca03c1766eb2 tempest-TestMinimumBasicScenario-1935883925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 22:08:42.440791 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3123f762-caf1-4b73-8c53-ca03c1766eb2 tempest-TestMinimumBasicScenario-1935883925 None] Flow 'volume_create_manager' (5df58877-9866-4527-888f-82c484915a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 22:08:42.447347 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3123f762-caf1-4b73-8c53-ca03c1766eb2 tempest-TestMinimumBasicScenario-1935883925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (851804c9-d87e-430c-ac1b-86a34a8fbd56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 22:08:42.485682 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3123f762-caf1-4b73-8c53-ca03c1766eb2 tempest-TestMinimumBasicScenario-1935883925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (851804c9-d87e-430c-ac1b-86a34a8fbd56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T22:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-222637553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=05c746d6-3606-4737-8f9e-b03843e60040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06eadd4f12e0405b851488d45af54d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T22:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T22:08:42Z,use_quota=True,user_id='cd056abbbc444b36aad548923b8ff985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 22:08:42.490982 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3123f762-caf1-4b73-8c53-ca03c1766eb2 tempest-TestMinimumBasicScenario-1935883925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dffd177b-3f73-4c04-ada6-c4c4a2a858c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 22:08:42.495085 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3123f762-caf1-4b73-8c53-ca03c1766eb2 tempest-TestMinimumBasicScenario-1935883925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dffd177b-3f73-4c04-ada6-c4c4a2a858c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 22:08:42.500105 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3123f762-caf1-4b73-8c53-ca03c1766eb2 tempest-TestMinimumBasicScenario-1935883925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3b95b59-87eb-42df-a575-77d799d53de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 22:08:42.504180 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3123f762-caf1-4b73-8c53-ca03c1766eb2 tempest-TestMinimumBasicScenario-1935883925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3b95b59-87eb-42df-a575-77d799d53de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05c746d6-3606-4737-8f9e-b03843e60040', 'volume_name': 'volume-05c746d6-3606-4737-8f9e-b03843e60040', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 22:08:42.509072 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3123f762-caf1-4b73-8c53-ca03c1766eb2 tempest-TestMinimumBasicScenario-1935883925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (553ccdce-1573-45df-92c6-fabd37280c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 22:08:42.512906 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3123f762-caf1-4b73-8c53-ca03c1766eb2 tempest-TestMinimumBasicScenario-1935883925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (553ccdce-1573-45df-92c6-fabd37280c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 22:08:42.517532 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3123f762-caf1-4b73-8c53-ca03c1766eb2 tempest-TestMinimumBasicScenario-1935883925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d007b8b-fb85-43b6-9adf-9f189d8d1aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 22:08:42.518591 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-3123f762-caf1-4b73-8c53-ca03c1766eb2 tempest-TestMinimumBasicScenario-1935883925 None] Volume 05c746d6-3606-4737-8f9e-b03843e60040: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05c746d6-3606-4737-8f9e-b03843e60040', 'volume_size': 1} May 21 22:08:42.518993 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3123f762-caf1-4b73-8c53-ca03c1766eb2 tempest-TestMinimumBasicScenario-1935883925 None] creating volume 'volume-05c746d6-3606-4737-8f9e-b03843e60040' {{(pid=124407) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1044}} May 21 22:08:42.519761 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3123f762-caf1-4b73-8c53-ca03c1766eb2 tempest-TestMinimumBasicScenario-1935883925 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:08:42.936112 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3123f762-caf1-4b73-8c53-ca03c1766eb2 tempest-TestMinimumBasicScenario-1935883925 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 22:08:42.936444 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-3123f762-caf1-4b73-8c53-ca03c1766eb2 tempest-TestMinimumBasicScenario-1935883925 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 22:08:42.940337 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3123f762-caf1-4b73-8c53-ca03c1766eb2 tempest-TestMinimumBasicScenario-1935883925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d007b8b-fb85-43b6-9adf-9f189d8d1aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05c746d6-3606-4737-8f9e-b03843e60040', 'volume_size': 1}' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 22:08:42.944840 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3123f762-caf1-4b73-8c53-ca03c1766eb2 tempest-TestMinimumBasicScenario-1935883925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48278373-ad0e-4309-9fef-39738d1e842a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 22:08:43.007399 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-3123f762-caf1-4b73-8c53-ca03c1766eb2 tempest-TestMinimumBasicScenario-1935883925 None] Volume volume-05c746d6-3606-4737-8f9e-b03843e60040 (05c746d6-3606-4737-8f9e-b03843e60040): created successfully May 21 22:08:43.011615 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3123f762-caf1-4b73-8c53-ca03c1766eb2 tempest-TestMinimumBasicScenario-1935883925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48278373-ad0e-4309-9fef-39738d1e842a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 22:08:43.017034 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-3123f762-caf1-4b73-8c53-ca03c1766eb2 tempest-TestMinimumBasicScenario-1935883925 None] Flow 'volume_create_manager' (5df58877-9866-4527-888f-82c484915a5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 22:08:43.081607 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-3123f762-caf1-4b73-8c53-ca03c1766eb2 tempest-TestMinimumBasicScenario-1935883925 None] Created volume successfully. May 21 22:08:44.386751 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-4aa0af82-2be8-48dd-b4a6-f1bf45505121 req-aadde526-f44f-479c-9573-d2202ea3dd5b tempest-TestMinimumBasicScenario-1935883925 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 22:08:45.023153 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-4aa0af82-2be8-48dd-b4a6-f1bf45505121 req-aadde526-f44f-479c-9573-d2202ea3dd5b tempest-TestMinimumBasicScenario-1935883925 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.636s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 22:08:45.023917 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-4aa0af82-2be8-48dd-b4a6-f1bf45505121 req-aadde526-f44f-479c-9573-d2202ea3dd5b tempest-TestMinimumBasicScenario-1935883925 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-05c746d6-3606-4737-8f9e-b03843e60040', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'efef91cd-d8f8-4d93-9ad2-86d0b33251f4', 'volume_id': '05c746d6-3606-4737-8f9e-b03843e60040', 'discard': True}} {{(pid=124407) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} May 21 22:08:45.116362 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-4aa0af82-2be8-48dd-b4a6-f1bf45505121 req-aadde526-f44f-479c-9573-d2202ea3dd5b tempest-TestMinimumBasicScenario-1935883925 None] Connection info returned from driver {'name': 'volumes/volume-05c746d6-3606-4737-8f9e-b03843e60040', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '05c746d6-3606-4737-8f9e-b03843e60040', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '79dbab93-5d3c-4ea7-b906-9063e8efce30'} {{(pid=124407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4826}} May 21 22:08:45.234053 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-4aa0af82-2be8-48dd-b4a6-f1bf45505121 req-aadde526-f44f-479c-9573-d2202ea3dd5b tempest-TestMinimumBasicScenario-1935883925 None] attachment_update completed successfully. May 21 22:08:55.233348 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=17,cinder:UPDATE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:08:56.939822 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 22:08:56.940643 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:08:56.964531 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:08:56.987097 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 22:09:03.466761 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=22,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:09:33.458574 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=4 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:09:33.461359 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:09:53.470970 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:09:56.943624 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 22:09:56.944307 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:09:56.965188 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:09:56.986296 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 22:10:09.062562 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:10:09.071517 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-0967dfa8-f47a-4c15-9b77-1d5703dc0a6e req-bb0d38df-b467-478c-b257-fcbf5d66664f tempest-TestMinimumBasicScenario-1935883925 None] Terminate volume connection completed successfully. May 21 22:10:09.075781 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-0967dfa8-f47a-4c15-9b77-1d5703dc0a6e req-bb0d38df-b467-478c-b257-fcbf5d66664f tempest-TestMinimumBasicScenario-1935883925 None] Deleting attachment 79dbab93-5d3c-4ea7-b906-9063e8efce30. {{(pid=124407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4957}} May 21 22:10:09.803922 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-4b60de18-f16f-477d-82b9-740f8d38985b tempest-TestMinimumBasicScenario-1935883925 None] Lock "b'cinder-05c746d6-3606-4737-8f9e-b03843e60040-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 22:10:09.906182 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-4b60de18-f16f-477d-82b9-740f8d38985b tempest-TestMinimumBasicScenario-1935883925 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:10:10.020163 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-4b60de18-f16f-477d-82b9-740f8d38985b tempest-TestMinimumBasicScenario-1935883925 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 22:10:10.020699 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-4b60de18-f16f-477d-82b9-740f8d38985b tempest-TestMinimumBasicScenario-1935883925 None] Volume volume-05c746d6-3606-4737-8f9e-b03843e60040 is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 22:10:10.072380 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-4b60de18-f16f-477d-82b9-740f8d38985b tempest-TestMinimumBasicScenario-1935883925 None] deleting rbd volume volume-05c746d6-3606-4737-8f9e-b03843e60040 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 22:10:12.277537 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [None req-4b60de18-f16f-477d-82b9-740f8d38985b tempest-TestMinimumBasicScenario-1935883925 None] Created reservations ['76488bbb-d107-46ad-a77a-70518cc4973d', '1db33107-df75-4432-ad59-6be7f4140bb5', 'a363baeb-0b0e-43d8-8dd7-6017da60dc8e', 'e55498ee-a466-455e-abc0-45abbe203619'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 22:10:12.449408 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-4b60de18-f16f-477d-82b9-740f8d38985b tempest-TestMinimumBasicScenario-1935883925 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:10:12.471368 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-4b60de18-f16f-477d-82b9-740f8d38985b tempest-TestMinimumBasicScenario-1935883925 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:10:12.494353 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-4b60de18-f16f-477d-82b9-740f8d38985b tempest-TestMinimumBasicScenario-1935883925 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 22:10:12.498515 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-4b60de18-f16f-477d-82b9-740f8d38985b tempest-TestMinimumBasicScenario-1935883925 None] Deleted volume successfully. May 21 22:10:12.561266 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-4b60de18-f16f-477d-82b9-740f8d38985b tempest-TestMinimumBasicScenario-1935883925 None] Lock "b'cinder-05c746d6-3606-4737-8f9e-b03843e60040-delete_volume'" released by "delete_volume" :: held 2.757s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 22:10:23.480651 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=22,cinder:UPDATE=7,cinder:INSERT=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:10:43.482682 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=18,cinder:INSERT=1,cinder:UPDATE=12,cinder:DELETE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:10:56.942282 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 22:10:56.942958 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:10:56.984726 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:10:57.011646 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 22:11:03.482201 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:UPDATE=3,cinder:SELECT=5 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:11:23.475840 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:11:43.480984 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:11:53.482874 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:11:56.944323 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 22:11:56.944975 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:11:56.966811 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:11:56.988544 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 22:12:23.472789 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:12:23.475265 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:12:53.481038 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:12:56.944936 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 22:12:56.945569 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:12:56.967037 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:12:56.989711 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 22:13:03.470598 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:13:33.469212 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:13:43.463326 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:13:53.470962 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:13:56.945581 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 22:13:56.946240 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:13:56.969282 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:13:56.993590 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 22:14:13.463801 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:14:23.454623 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:14:53.457316 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:14:56.949455 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 22:14:56.950075 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:14:56.971577 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:14:56.993432 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 22:15:13.452806 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:15:33.465894 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:15:53.457441 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:15:56.950031 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 22:15:56.950655 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:15:56.971990 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:15:56.994251 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 22:16:03.460994 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:16:33.464222 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:16:43.460164 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:16:56.949250 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 22:16:56.949960 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:16:56.972449 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:16:56.994626 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 22:17:13.460401 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:17:23.465372 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:17:33.466572 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:17:56.951358 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 22:17:56.952021 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:17:56.975094 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:17:56.997820 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 22:18:03.457279 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:18:13.453685 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:18:33.456886 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:18:43.457922 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:18:53.464096 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:18:56.952734 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 22:18:56.954488 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:18:56.987300 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:18:57.013123 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 22:19:03.466946 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:19:23.457683 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:19:33.461424 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:19:53.472467 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:19:56.958810 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 22:19:56.959467 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:19:57.014545 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:19:57.038989 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 22:20:03.470372 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:20:23.464698 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:20:33.471745 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:20:53.469538 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:20:56.955192 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 22:20:56.956341 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:20:56.978307 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:20:57.000682 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 22:21:13.483444 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:21:33.483094 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:21:53.483004 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:21:56.956271 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 22:21:56.956933 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:21:56.979520 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:21:57.001768 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 22:22:03.489801 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:22:23.483731 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:22:33.484811 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:22:53.496575 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:22:56.958391 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 22:22:56.959036 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:22:56.981782 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:22:57.004207 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 22:23:13.041065 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:23:13.131011 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdec2982-509c-40ac-8c51-72d2fbe1135a tempest-TestShelveInstance-602987168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=124407) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1350}} May 21 22:23:13.152250 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-bdec2982-509c-40ac-8c51-72d2fbe1135a tempest-TestShelveInstance-602987168 None] Flow 'volume_create_manager' (e174d10b-12d6-4d1f-8bf1-4cc182f0ac9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 22:23:13.158730 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-bdec2982-509c-40ac-8c51-72d2fbe1135a tempest-TestShelveInstance-602987168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f41da520-fa59-4526-86ad-223741bc8bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 22:23:13.175166 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-bdec2982-509c-40ac-8c51-72d2fbe1135a tempest-TestShelveInstance-602987168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f41da520-fa59-4526-86ad-223741bc8bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-21T22:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-659795220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=620904ee-0a1f-40d1-8c74-79af6b3c3f40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e815c24f93db46a691126111c7d92a1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-21T22:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-21T22:23:13Z,use_quota=True,user_id='cacdb9b294ad482ba157fbb6ba4889ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a50b958-f250-4971-b588-7e8b741444ba),volume_type_id=2a50b958-f250-4971-b588-7e8b741444ba)' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 22:23:13.180357 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-bdec2982-509c-40ac-8c51-72d2fbe1135a tempest-TestShelveInstance-602987168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0dcc0fc-e134-46df-95d3-62c7ac01b664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 22:23:13.184446 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-bdec2982-509c-40ac-8c51-72d2fbe1135a tempest-TestShelveInstance-602987168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0dcc0fc-e134-46df-95d3-62c7ac01b664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 22:23:13.189556 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-bdec2982-509c-40ac-8c51-72d2fbe1135a tempest-TestShelveInstance-602987168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e837fbd0-8789-4be3-a3eb-35f32c844440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 22:23:13.269347 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-bdec2982-509c-40ac-8c51-72d2fbe1135a tempest-TestShelveInstance-602987168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e837fbd0-8789-4be3-a3eb-35f32c844440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '620904ee-0a1f-40d1-8c74-79af6b3c3f40', 'volume_name': 'volume-620904ee-0a1f-40d1-8c74-79af6b3c3f40', 'volume_size': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5593f8cb452404083dfa177b4ee68b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'created_at': datetime.datetime(2022, 5, 21, 21, 0, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 22:23:13.274498 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-bdec2982-509c-40ac-8c51-72d2fbe1135a tempest-TestShelveInstance-602987168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d7355ae-70ad-4117-92dc-94b9547e54bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 22:23:13.278740 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-bdec2982-509c-40ac-8c51-72d2fbe1135a tempest-TestShelveInstance-602987168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d7355ae-70ad-4117-92dc-94b9547e54bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 22:23:13.283795 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-bdec2982-509c-40ac-8c51-72d2fbe1135a tempest-TestShelveInstance-602987168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (090a8b8a-6ed9-4063-9b1c-554d3575383b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 22:23:13.284952 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-bdec2982-509c-40ac-8c51-72d2fbe1135a tempest-TestShelveInstance-602987168 None] Volume 620904ee-0a1f-40d1-8c74-79af6b3c3f40: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-620904ee-0a1f-40d1-8c74-79af6b3c3f40', 'volume_size': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5593f8cb452404083dfa177b4ee68b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'created_at': datetime.datetime(2022, 5, 21, 21, 0, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } May 21 22:23:13.285531 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdec2982-509c-40ac-8c51-72d2fbe1135a tempest-TestShelveInstance-602987168 None] Cloning 620904ee-0a1f-40d1-8c74-79af6b3c3f40 from image e570f5eb-6047-4214-a420-fdfdbdf19a4c at location (None, None). {{(pid=124407) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1053}} May 21 22:23:13.294306 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-bdec2982-509c-40ac-8c51-72d2fbe1135a tempest-TestShelveInstance-602987168 None] Lock "b'cinder-e570f5eb-6047-4214-a420-fdfdbdf19a4c'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 22:23:13.351828 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-bdec2982-509c-40ac-8c51-72d2fbe1135a tempest-TestShelveInstance-602987168 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'volume_id': '4057e637-23ba-493f-a45d-eb28c07ac60a', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28), 'last_used': datetime.datetime(2022, 5, 21, 22, 23, 13, 298470)}. {{(pid=124407) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 21 22:23:13.352259 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-bdec2982-509c-40ac-8c51-72d2fbe1135a tempest-TestShelveInstance-602987168 None] Image-volume cache entry image_update_at = 2022-05-21 21:00:28+00:00, requested image updated_at = 2022-05-21 21:00:28+00:00. {{(pid=124407) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 21 22:23:13.352714 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdec2982-509c-40ac-8c51-72d2fbe1135a tempest-TestShelveInstance-602987168 None] Found cache entry for image = e570f5eb-6047-4214-a420-fdfdbdf19a4c on host ncdv-master-1@ceph#ceph. {{(pid=124407) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:876}} May 21 22:23:13.357706 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [None req-bdec2982-509c-40ac-8c51-72d2fbe1135a tempest-TestShelveInstance-602987168 None] Lock "b'cinder-e570f5eb-6047-4214-a420-fdfdbdf19a4c'" released by "_prepare_image_cache_entry" :: held 0.063s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 22:23:13.358618 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdec2982-509c-40ac-8c51-72d2fbe1135a tempest-TestShelveInstance-602987168 None] Attempting to retrieve cache entry for image = e570f5eb-6047-4214-a420-fdfdbdf19a4c on host ncdv-master-1@ceph#ceph. {{(pid=124407) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:817}} May 21 22:23:13.365103 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-bdec2982-509c-40ac-8c51-72d2fbe1135a tempest-TestShelveInstance-602987168 None] Found image-volume cache entry: {'id': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'volume_id': '4057e637-23ba-493f-a45d-eb28c07ac60a', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28), 'last_used': datetime.datetime(2022, 5, 21, 22, 23, 13, 362742)}. {{(pid=124407) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 21 22:23:13.366712 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.image.cache [None req-bdec2982-509c-40ac-8c51-72d2fbe1135a tempest-TestShelveInstance-602987168 None] Image-volume cache entry image_update_at = 2022-05-21 21:00:28+00:00, requested image updated_at = 2022-05-21 21:00:28+00:00. {{(pid=124407) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 21 22:23:13.366712 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdec2982-509c-40ac-8c51-72d2fbe1135a tempest-TestShelveInstance-602987168 None] Creating from source image-volume 4057e637-23ba-493f-a45d-eb28c07ac60a {{(pid=124407) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:831}} May 21 22:23:13.378013 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-bdec2982-509c-40ac-8c51-72d2fbe1135a tempest-TestShelveInstance-602987168 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:23:13.546393 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-bdec2982-509c-40ac-8c51-72d2fbe1135a tempest-TestShelveInstance-602987168 None] creating snapshot='volume-620904ee-0a1f-40d1-8c74-79af6b3c3f40.clone_snap' {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 21 22:23:14.695658 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-bdec2982-509c-40ac-8c51-72d2fbe1135a tempest-TestShelveInstance-602987168 None] cloning 'volume-4057e637-23ba-493f-a45d-eb28c07ac60a@volume-620904ee-0a1f-40d1-8c74-79af6b3c3f40.clone_snap' to 'volume-620904ee-0a1f-40d1-8c74-79af6b3c3f40' {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:789}} May 21 22:23:15.417409 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-bdec2982-509c-40ac-8c51-72d2fbe1135a tempest-TestShelveInstance-602987168 None] Volume volume-b9ebacac-5f32-42e3-9194-003aee7e2435.deleted is not a clone. {{(pid=124407) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} May 21 22:23:15.418535 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-bdec2982-509c-40ac-8c51-72d2fbe1135a tempest-TestShelveInstance-602987168 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:919}} May 21 22:23:15.418911 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-bdec2982-509c-40ac-8c51-72d2fbe1135a tempest-TestShelveInstance-602987168 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=124407) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:928}} May 21 22:23:15.573390 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-bdec2982-509c-40ac-8c51-72d2fbe1135a tempest-TestShelveInstance-602987168 None] clone created successfully {{(pid=124407) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:862}} May 21 22:23:15.573929 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.volume_utils [None req-bdec2982-509c-40ac-8c51-72d2fbe1135a tempest-TestShelveInstance-602987168 None] Marking volume 620904ee-0a1f-40d1-8c74-79af6b3c3f40 as bootable. {{(pid=124407) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} May 21 22:23:15.626219 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdec2982-509c-40ac-8c51-72d2fbe1135a tempest-TestShelveInstance-602987168 None] Copying metadata from image e570f5eb-6047-4214-a420-fdfdbdf19a4c to 620904ee-0a1f-40d1-8c74-79af6b3c3f40. {{(pid=124407) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} May 21 22:23:15.626764 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdec2982-509c-40ac-8c51-72d2fbe1135a tempest-TestShelveInstance-602987168 None] Creating volume glance metadata for volume 620904ee-0a1f-40d1-8c74-79af6b3c3f40 backed by image e570f5eb-6047-4214-a420-fdfdbdf19a4c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=124407) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:673}} May 21 22:23:15.744039 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-bdec2982-509c-40ac-8c51-72d2fbe1135a tempest-TestShelveInstance-602987168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (090a8b8a-6ed9-4063-9b1c-554d3575383b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-620904ee-0a1f-40d1-8c74-79af6b3c3f40', 'volume_size': 1, 'image_id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5593f8cb452404083dfa177b4ee68b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'e570f5eb-6047-4214-a420-fdfdbdf19a4c', 'created_at': datetime.datetime(2022, 5, 21, 21, 0, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 21, 21, 0, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e570f5eb-6047-4214-a420-fdfdbdf19a4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 22:23:15.749355 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-bdec2982-509c-40ac-8c51-72d2fbe1135a tempest-TestShelveInstance-602987168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e1a5899-6687-451c-9e2b-978eefe771a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 21 22:23:15.797651 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.flows.manager.create_volume [None req-bdec2982-509c-40ac-8c51-72d2fbe1135a tempest-TestShelveInstance-602987168 None] Volume volume-620904ee-0a1f-40d1-8c74-79af6b3c3f40 (620904ee-0a1f-40d1-8c74-79af6b3c3f40): created successfully May 21 22:23:15.801235 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-bdec2982-509c-40ac-8c51-72d2fbe1135a tempest-TestShelveInstance-602987168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e1a5899-6687-451c-9e2b-978eefe771a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=124407) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 21 22:23:15.806655 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [None req-bdec2982-509c-40ac-8c51-72d2fbe1135a tempest-TestShelveInstance-602987168 None] Flow 'volume_create_manager' (e174d10b-12d6-4d1f-8bf1-4cc182f0ac9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=124407) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 21 22:23:15.860574 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [None req-bdec2982-509c-40ac-8c51-72d2fbe1135a tempest-TestShelveInstance-602987168 None] Created volume successfully. May 21 22:23:20.153729 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-d23b1690-189a-43a1-9704-ad9309e2f049 req-9a624d03-de49-4b93-901b-761b03ad72d3 tempest-TestShelveInstance-602987168 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 21 22:23:20.810044 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_concurrency.processutils [req-d23b1690-189a-43a1-9704-ad9309e2f049 req-9a624d03-de49-4b93-901b-761b03ad72d3 tempest-TestShelveInstance-602987168 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.656s {{(pid=124407) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 21 22:23:20.810891 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-d23b1690-189a-43a1-9704-ad9309e2f049 req-9a624d03-de49-4b93-901b-761b03ad72d3 tempest-TestShelveInstance-602987168 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-620904ee-0a1f-40d1-8c74-79af6b3c3f40', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'efef91cd-d8f8-4d93-9ad2-86d0b33251f4', 'volume_id': '620904ee-0a1f-40d1-8c74-79af6b3c3f40', 'discard': True}} {{(pid=124407) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1657}} May 21 22:23:20.884256 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-d23b1690-189a-43a1-9704-ad9309e2f049 req-9a624d03-de49-4b93-901b-761b03ad72d3 tempest-TestShelveInstance-602987168 None] Connection info returned from driver {'name': 'volumes/volume-620904ee-0a1f-40d1-8c74-79af6b3c3f40', 'hosts': ['10.222.0.49'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '620904ee-0a1f-40d1-8c74-79af6b3c3f40', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '5fad4617-fddb-4d9d-bbe9-7aafd357bff4'} {{(pid=124407) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4826}} May 21 22:23:20.995403 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-d23b1690-189a-43a1-9704-ad9309e2f049 req-9a624d03-de49-4b93-901b-761b03ad72d3 tempest-TestShelveInstance-602987168 None] attachment_update completed successfully. May 21 22:23:24.702212 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=31,cinder:UPDATE=8,cinder:INSERT=5 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:23:44.703486 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=28,cinder:INSERT=7,cinder:DELETE=1,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:23:56.959332 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 22:23:56.960202 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:23:56.984161 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:23:57.008066 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 22:24:04.700636 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:24:24.701740 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:24:44.709097 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:24:54.715908 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:24:56.964202 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 22:24:56.964916 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:24:56.987929 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:24:57.010689 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 22:25:24.716048 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=4 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:25:24.717215 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:25:44.715710 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:25:56.967050 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 22:25:56.967766 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:25:56.990126 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:25:57.012929 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 22:26:04.720484 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:26:24.719784 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:26:44.720921 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:26:56.969339 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 22:26:56.970047 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:26:57.014995 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:26:57.037851 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 22:27:04.726232 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:27:04.726851 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:27:09.173381 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-b82e814c-a7e6-42d9-a8ac-fae12535f96c req-2253981f-88d2-4d08-ad52-f6348bb5aa74 tempest-TestShelveInstance-602987168 None] Terminate volume connection completed successfully. May 21 22:27:09.174037 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.manager [req-b82e814c-a7e6-42d9-a8ac-fae12535f96c req-2253981f-88d2-4d08-ad52-f6348bb5aa74 tempest-TestShelveInstance-602987168 None] Deleting attachment 5fad4617-fddb-4d9d-bbe9-7aafd357bff4. {{(pid=124407) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4957}} May 21 22:27:09.522574 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [req-b82e814c-a7e6-42d9-a8ac-fae12535f96c req-30ca97b6-93fa-4e9c-b1b0-92906a1dcb35 tempest-TestShelveInstance-602987168 None] Lock "b'cinder-620904ee-0a1f-40d1-8c74-79af6b3c3f40-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 21 22:27:09.724152 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-b82e814c-a7e6-42d9-a8ac-fae12535f96c req-30ca97b6-93fa-4e9c-b1b0-92906a1dcb35 tempest-TestShelveInstance-602987168 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:27:09.908679 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-b82e814c-a7e6-42d9-a8ac-fae12535f96c req-30ca97b6-93fa-4e9c-b1b0-92906a1dcb35 tempest-TestShelveInstance-602987168 None] volume has no backup snaps {{(pid=124407) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1177}} May 21 22:27:09.985504 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-b82e814c-a7e6-42d9-a8ac-fae12535f96c req-30ca97b6-93fa-4e9c-b1b0-92906a1dcb35 tempest-TestShelveInstance-602987168 None] deleting rbd volume volume-620904ee-0a1f-40d1-8c74-79af6b3c3f40 {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1331}} May 21 22:27:12.968832 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-b82e814c-a7e6-42d9-a8ac-fae12535f96c req-30ca97b6-93fa-4e9c-b1b0-92906a1dcb35 tempest-TestShelveInstance-602987168 None] volume is a clone so cleaning references {{(pid=124407) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1352}} May 21 22:27:13.109790 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-b82e814c-a7e6-42d9-a8ac-fae12535f96c req-30ca97b6-93fa-4e9c-b1b0-92906a1dcb35 tempest-TestShelveInstance-602987168 None] deleting parent snapshot volume-620904ee-0a1f-40d1-8c74-79af6b3c3f40.clone_snap {{(pid=124407) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1243}} May 21 22:27:14.858872 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.quota [req-b82e814c-a7e6-42d9-a8ac-fae12535f96c req-30ca97b6-93fa-4e9c-b1b0-92906a1dcb35 tempest-TestShelveInstance-602987168 None] Created reservations ['32e97f6d-ac17-4840-aafc-55bcc1c76d8d', 'b6ac586e-aa88-46ce-9a96-dbda1ce9f81f', 'e1310bd9-f307-4b40-9489-17b30996fafd', '444cf5a7-5f08-47c0-8ea9-b4697777fdaa'] {{(pid=124407) reserve /opt/stack/cinder/cinder/quota.py:755}} May 21 22:27:15.003303 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-b82e814c-a7e6-42d9-a8ac-fae12535f96c req-30ca97b6-93fa-4e9c-b1b0-92906a1dcb35 tempest-TestShelveInstance-602987168 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:27:15.053540 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [req-b82e814c-a7e6-42d9-a8ac-fae12535f96c req-30ca97b6-93fa-4e9c-b1b0-92906a1dcb35 tempest-TestShelveInstance-602987168 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:27:15.090177 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [req-b82e814c-a7e6-42d9-a8ac-fae12535f96c req-30ca97b6-93fa-4e9c-b1b0-92906a1dcb35 tempest-TestShelveInstance-602987168 None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 22:27:15.097455 ncdv-master-1 cinder-volume[124407]: INFO cinder.volume.manager [req-b82e814c-a7e6-42d9-a8ac-fae12535f96c req-30ca97b6-93fa-4e9c-b1b0-92906a1dcb35 tempest-TestShelveInstance-602987168 None] Deleted volume successfully. May 21 22:27:15.207141 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.coordination [req-b82e814c-a7e6-42d9-a8ac-fae12535f96c req-30ca97b6-93fa-4e9c-b1b0-92906a1dcb35 tempest-TestShelveInstance-602987168 None] Lock "b'cinder-620904ee-0a1f-40d1-8c74-79af6b3c3f40-delete_volume'" released by "delete_volume" :: held 5.685s {{(pid=124407) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 21 22:27:34.779365 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=16,cinder:UPDATE=11,cinder:INSERT=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:27:44.786332 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=25,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:27:54.793805 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:27:56.973997 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 22:27:56.974680 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:27:57.007171 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:27:57.040864 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 22:28:14.799828 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:28:24.787985 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:28:44.799211 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:28:54.803320 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:28:56.976822 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 22:28:56.977469 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:28:56.999245 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:28:57.021275 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 22:29:24.809295 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:UPDATE=1,cinder:SELECT=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:29:24.809954 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:29:54.818349 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:29:56.976797 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 22:29:56.977459 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:29:57.028018 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:29:57.095664 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 22:30:04.846767 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:30:34.814919 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:30:44.821908 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:30:56.981671 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 22:30:56.982602 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:30:57.006193 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:30:57.031181 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 22:31:14.821420 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:31:24.819079 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:UPDATE=3,cinder:SELECT=5 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:31:54.820215 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:31:56.986684 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 22:31:56.987321 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:31:57.009668 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:31:57.036337 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 22:32:04.821118 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:32:24.821539 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:32:34.829737 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:32:44.831546 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:32:56.992416 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 22:32:56.993071 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:32:57.015355 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:32:57.038271 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 22:33:14.828942 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:33:24.822083 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:33:44.830150 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:33:56.993767 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 22:33:56.994438 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:33:57.015941 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:33:57.037995 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 22:34:04.822637 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:34:24.825100 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:34:44.821143 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:34:56.993121 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 22:34:56.993766 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:34:57.015063 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:34:57.036258 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 22:35:04.823855 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:35:04.826369 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:35:24.836720 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:35:44.826219 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:35:56.993005 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 22:35:56.993676 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:35:57.015252 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:35:57.038344 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 22:36:04.827575 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:36:24.828265 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:36:44.830246 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:36:56.993064 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 22:36:56.993724 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:36:57.014862 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:36:57.036139 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 22:37:04.834221 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:37:24.833734 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:37:44.839344 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:37:54.846080 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:37:56.992590 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 22:37:56.993271 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:37:57.014202 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:37:57.035919 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 22:38:14.845802 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:38:34.847023 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:38:54.847894 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:38:56.991458 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 22:38:56.992661 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:38:57.014354 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:38:57.076469 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 22:39:14.849944 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:39:34.846777 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:39:44.855370 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:39:54.857745 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:39:56.991449 ncdv-master-1 cinder-volume[124407]: DEBUG oslo_service.periodic_task [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=124407) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 21 22:39:56.992108 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:39:57.012875 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.volume.drivers.rbd [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=124407) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:527}} May 21 22:39:57.034848 ncdv-master-1 cinder-volume[124407]: DEBUG cinder.manager [None req-aadbef2a-57b1-4393-9feb-3c69786e417c None None] Notifying Schedulers of capabilities ... {{(pid=124407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 21 22:40:04.860668 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:40:14.864402 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:40:44.857877 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=5 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 21 22:40:44.858611 ncdv-master-1 cinder-volume[124407]: DEBUG dbcounter [-] [124407] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=124407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}