-- Logs begin at Sat 2022-05-07 20:01:27 UTC, end at Sat 2022-05-07 23:01:55 UTC. -- May 07 21:36:33.824070 ncdv-master-1 systemd[1]: Started Devstack devstack@c-vol.service. May 07 21:36:37.252621 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=129775) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 07 21:36:37.253239 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=129775) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 07 21:36:37.637956 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_db.sqlalchemy.engines [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129775) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 07 21:36:37.853686 ncdv-master-1 cinder-volume[129775]: INFO cinder.rpc [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. May 07 21:36:37.858284 ncdv-master-1 cinder-volume[129775]: INFO cinder.rpc [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. May 07 21:36:37.866407 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_db.sqlalchemy.engines [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129775) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 07 21:36:38.034480 ncdv-master-1 cinder-volume[129775]: INFO cinder.volume.manager [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] Determined volume DB was empty at startup. May 07 21:36:38.035124 ncdv-master-1 cinder-volume[129775]: DEBUG cinder.volume.manager [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=129775) __init__ /opt/stack/cinder/cinder/volume/manager.py:286}} May 07 21:36:38.044092 ncdv-master-1 cinder-volume[129775]: INFO cinder.volume.manager [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] Service not found for updating active_backend_id, assuming default for driver init. May 07 21:36:38.044859 ncdv-master-1 cinder-volume[129775]: WARNING stevedore.named [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 07 21:36:38.045288 ncdv-master-1 cinder-volume[129775]: WARNING castellan.key_manager [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 07 21:36:38.046388 ncdv-master-1 cinder-volume[129775]: WARNING cinder.keymgr.conf_key_mgr [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 07 21:36:38.063006 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_db.sqlalchemy.engines [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129775) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 07 21:36:38.067532 ncdv-master-1 cinder-volume[129775]: INFO cinder.rpc [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. May 07 21:36:38.071646 ncdv-master-1 cinder-volume[129775]: INFO cinder.rpc [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] Automatically selected cinder-volume RPC version 3.18 as minimum service version. May 07 21:36:38.072499 ncdv-master-1 cinder-volume[129775]: WARNING stevedore.named [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager May 07 21:36:38.072899 ncdv-master-1 cinder-volume[129775]: WARNING castellan.key_manager [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' May 07 21:36:38.074608 ncdv-master-1 cinder-volume[129775]: INFO cinder.volume.manager [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] Image-volume cache enabled for host ncdv-master-1@ceph. May 07 21:36:38.080477 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_db.sqlalchemy.engines [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129775) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 07 21:36:38.099116 ncdv-master-1 cinder-volume[129775]: INFO oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] Starting 1 workers May 07 21:36:38.104649 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] Started child 129946 {{(pid=129775) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} May 07 21:36:38.105842 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] Full set of CONF: {{(pid=129775) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} May 07 21:36:38.106211 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ******************************************************************************** {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 07 21:36:38.106525 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] Configuration options gathered from: {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 07 21:36:38.106903 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 07 21:36:38.107553 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 07 21:36:38.107899 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ================================================================================ {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 07 21:36:38.108672 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] allow_availability_zone_fallback = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.109064 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] allow_compression_on_image_upload = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.109644 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] allowed_direct_url_schemes = [] {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.110068 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] api_rate_limit = True {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.110404 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] auth_strategy = keystone {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.110889 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] az_cache_duration = 3600 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.111267 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_availability_zone = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.111649 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_host = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.112027 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_name = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.112430 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_stats_polling_interval = 60 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.112795 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backup_api_class = cinder.backup.api.API {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.113178 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.113568 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backup_name_template = backup-%s {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.113949 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backup_use_same_host = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.114341 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backup_use_temp_snapshot = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.114795 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] chap_password = **** {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.115177 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] chap_username = {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.115686 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.116123 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] cinder_internal_tenant_project_id = 758d4dea899344b883971712aebe042f {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.116500 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] cinder_internal_tenant_user_id = cf4eae7f407e44ecbe525049b262e3a5 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.117063 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] cloned_volume_same_az = True {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.117429 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] cluster = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.117816 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] compression_format = gzip {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.118217 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] compute_api_class = cinder.compute.nova.API {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.118643 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] config_dir = [] {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.118982 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.119388 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] config_source = [] {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.119761 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.120162 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] control_exchange = openstack {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.120577 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] debug = True {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.120947 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] default_availability_zone = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.121293 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] default_group_type = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.121811 ncdv-master-1 cinder-volume[129946]: INFO cinder.service [-] Starting cinder-volume node (version 20.1.0) May 07 21:36:38.122396 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.122396 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] default_volume_type = ceph {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.122799 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] driver_client_cert = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.123076 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] driver_client_cert_key = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.123693 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] driver_data_namespace = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.124288 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] driver_ssl_cert_path = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.124677 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] driver_ssl_cert_verify = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.125046 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] driver_use_ssl = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.125440 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] enable_force_upload = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.125870 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] enable_new_services = True {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.126225 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] enable_unsupported_driver = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.126632 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] enabled_backends = ['ceph'] {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.127045 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] enforce_multipath_for_image_xfer = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.127438 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] filter_function = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.127745 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] glance_api_insecure = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.135632 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] glance_api_servers = ['http://10.222.0.32/image'] {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.135632 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] glance_api_ssl_compression = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.135632 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] glance_ca_certificates_file = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.135632 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] glance_catalog_info = image:glance:publicURL {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.135632 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] glance_certfile = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.135632 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.136196 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] glance_keyfile = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.136196 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] glance_num_retries = 3 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.136196 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] glance_request_timeout = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.136196 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] goodness_function = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.136196 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] graceful_shutdown_timeout = 5 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.136196 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] group_api_class = cinder.group.api.API {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.136196 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] host = ncdv-master-1 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.136661 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] iet_conf = /etc/iet/ietd.conf {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.136661 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] image_compress_on_upload = True {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.136661 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] image_conversion_address_space_limit = 1 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.136661 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] image_conversion_cpu_limit = 60 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.136661 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.136661 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] image_upload_use_cinder_backend = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.137046 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] image_upload_use_internal_tenant = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.137046 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] image_volume_cache_enabled = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.137046 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] image_volume_cache_max_count = 0 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.137046 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] image_volume_cache_max_size_gb = 0 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.137305 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] init_host_max_objects_retrieval = 0 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.137435 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] instance_format = [instance: %(uuid)s] {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.137963 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.138501 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] iscsi_iotype = fileio {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.139050 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] iscsi_secondary_ip_addresses = [] {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.139585 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] iscsi_target_flags = {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.139960 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] iscsi_write_cache = on {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.140492 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] iser_helper = tgtadm {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.141246 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] iser_ip_address = 10.222.0.32 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.141817 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] iser_port = 3260 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.142328 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.142863 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] log_config_append = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.143390 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.143891 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] log_dir = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.144376 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] log_file = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.144817 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] log_options = True {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.145315 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] log_rotate_interval = 1 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.145981 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] log_rotate_interval_type = days {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.147172 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] log_rotation_type = none {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.147625 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.148275 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.185668 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.185668 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.185668 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.185668 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] max_age = 0 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.185668 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] max_logfile_count = 30 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.185668 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] max_logfile_size_mb = 200 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.187156 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] max_over_subscription_ratio = 20.0 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.187156 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] message_reap_interval = 86400 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.187156 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] message_ttl = 2592000 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.187156 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] migration_create_volume_timeout_secs = 300 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.187156 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] monkey_patch = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.187156 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] monkey_patch_modules = [] {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.187156 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] my_ip = 10.222.0.32 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.187756 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] no_snapshot_gb_quota = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.187756 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] num_iser_scan_tries = 3 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.187933 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-017c7538-905a-456a-a7b9-54b72355b3be None None] Starting volume driver RBDDriver (1.2.0) May 07 21:36:38.188030 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] num_shell_tries = 3 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.188030 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] num_volume_device_scan_tries = 3 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.188030 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] nvmet_ns_id = 10 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.188030 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] nvmet_port_id = 1 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.188030 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] osapi_max_limit = 1000 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.188030 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] osapi_volume_ext_list = [] {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.188874 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-017c7538-905a-456a-a7b9-54b72355b3be None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:36:38.189152 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.189152 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] osapi_volume_listen = 0.0.0.0 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.189152 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] osapi_volume_listen_port = 8776 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.189152 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] osapi_volume_use_ssl = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.189152 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] osapi_volume_workers = 2 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.189152 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] per_volume_size_limit = -1 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.189639 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] periodic_fuzzy_delay = 60 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.189639 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] periodic_interval = 60 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.189639 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] project_id_regex = [0-9a-f\-]+ {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.189639 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] public_endpoint = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.189639 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] publish_errors = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.189639 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] quota_backup_gigabytes = 1000 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.189639 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] quota_backups = 10 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.190169 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] quota_consistencygroups = 10 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.190169 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.190169 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] quota_gigabytes = 1000 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.190169 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] quota_groups = 10 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.190169 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] quota_snapshots = 10 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.190169 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] quota_volumes = 10 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.190169 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] rate_limit_burst = 0 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.190883 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] rate_limit_except_level = CRITICAL {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.190883 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] rate_limit_interval = 0 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.190883 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] reinit_driver_count = 3 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.190883 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] replication_device = **** {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.190883 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] report_discard_supported = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.190883 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] report_interval = 10 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.190883 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] reservation_clean_interval = 86400 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.191787 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] reservation_expire = 86400 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.191787 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] reserved_percentage = 0 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.191787 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.191787 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.191787 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] rpc_response_timeout = 120 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.191787 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] run_external_periodic_tasks = True {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.192551 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.192551 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] scst_target_driver = iscsi {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.192551 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] scst_target_iqn_name = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.192551 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] service_down_time = 60 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.192551 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] snapshot_name_template = snapshot-%s {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.192551 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] snapshot_same_host = True {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.198449 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] split_loggers = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.198449 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] state_path = /opt/stack/data/cinder {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.198449 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] storage_availability_zone = nova {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.198449 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] storage_protocol = iSCSI {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.198449 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] syslog_log_facility = LOG_USER {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.198449 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] target_helper = lioadm {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.199021 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] target_ip_address = 10.222.0.32 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.199021 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] target_port = 3260 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.199021 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.199021 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] target_protocol = iscsi {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.199021 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] trace_flags = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.199021 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] transfer_api_class = cinder.transfer.api.API {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.199512 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] transport_url = **** {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.199512 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] until_refresh = 0 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.199512 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] use_chap_auth = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.199512 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] use_default_quota_class = True {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.199512 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] use_eventlog = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.199512 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] use_journal = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.199512 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] use_json = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.200043 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] use_multipath_for_image_xfer = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.200043 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] use_stderr = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.200043 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] use_syslog = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.200043 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] verify_glance_signatures = enabled {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.200043 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] volume_api_class = cinder.volume.api.API {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.200043 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] volume_backend_name = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.200043 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] volume_clear = zero {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.200590 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] volume_clear_ionice = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.200590 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] volume_clear_size = 0 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.200590 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.200590 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] volume_copy_bps_limit = 0 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.200590 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] volume_dd_blocksize = 1M {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.200590 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.201067 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] volume_name_template = volume-%s {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.201067 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] volume_service_inithost_offload = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.201067 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] volume_usage_audit_period = month {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.201067 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.201067 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] watch_log_file = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.201067 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] zoning_mode = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:36:38.201523 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.201523 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.201523 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_concurrency.disable_process_locking = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.201523 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.201523 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.201523 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.201975 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.201975 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.201975 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.201975 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] keystone_authtoken.admin_password = **** {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.201975 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] keystone_authtoken.admin_tenant_name = admin {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.201975 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] keystone_authtoken.admin_token = **** {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.202439 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] keystone_authtoken.admin_user = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.202439 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] keystone_authtoken.auth_admin_prefix = {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.202439 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.202439 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] keystone_authtoken.auth_port = 35357 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.202439 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] keystone_authtoken.auth_protocol = https {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.202439 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] keystone_authtoken.auth_section = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.202439 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] keystone_authtoken.auth_type = password {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.203003 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] keystone_authtoken.auth_uri = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.203003 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] keystone_authtoken.auth_version = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.203003 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] keystone_authtoken.cache = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.203003 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.203003 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] keystone_authtoken.certfile = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.203003 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] keystone_authtoken.delay_auth_decision = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.203469 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.203469 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] keystone_authtoken.http_connect_timeout = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.203469 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.203469 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] keystone_authtoken.identity_uri = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.203469 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] keystone_authtoken.include_service_catalog = True {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.203469 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] keystone_authtoken.insecure = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.203961 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] keystone_authtoken.interface = public {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.203961 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] keystone_authtoken.keyfile = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.203961 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.203961 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.203961 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.203961 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.204445 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.204445 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.204445 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.204445 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.204445 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.204445 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] keystone_authtoken.region_name = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.204922 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.204922 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] keystone_authtoken.service_token_roles_required = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.204922 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] keystone_authtoken.service_type = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.204922 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] keystone_authtoken.token_cache_time = 300 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.204922 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] keystone_authtoken.www_authenticate_uri = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.204922 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] cache.backend = dogpile.cache.null {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.205402 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] cache.backend_argument = **** {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.205402 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] cache.config_prefix = cache.oslo {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.205402 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] cache.dead_timeout = 60.0 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.205652 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] cache.debug_cache_backend = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.208102 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] cache.enable_retry_client = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.208102 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] cache.enable_socket_keepalive = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.208102 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] cache.enabled = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.208102 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] cache.expiration_time = 600 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.208102 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] cache.hashclient_retry_attempts = 2 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.208102 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] cache.hashclient_retry_delay = 1.0 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.209336 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] cache.memcache_dead_retry = 300 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.209336 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.209504 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.214141 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] cache.memcache_pool_maxsize = 10 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.214141 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.214141 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.214141 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] cache.memcache_socket_timeout = 1.0 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.214141 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] cache.proxies = [] {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.214141 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] cache.retry_attempts = 2 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.214141 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] cache.retry_delay = 0.0 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.214792 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] cache.socket_keepalive_count = 1 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.214792 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] cache.socket_keepalive_idle = 1 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.214792 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] cache.socket_keepalive_interval = 1 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.214792 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] cache.tls_allowed_ciphers = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.214792 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] cache.tls_cafile = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.214792 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] cache.tls_certfile = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.214792 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] cache.tls_enabled = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.215464 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] cache.tls_keyfile = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.215464 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] coordination.backend_url = etcd3+http://10.222.0.32:2379 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.215464 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] database.backend = sqlalchemy {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.217454 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] database.connection = **** {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.217454 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] database.connection_debug = 0 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.217454 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] database.connection_parameters = {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.217454 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] database.connection_recycle_time = 3600 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.217454 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] database.connection_trace = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.217974 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] database.db_inc_retry_interval = True {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.217974 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] database.db_max_retries = 20 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.218486 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] database.db_max_retry_interval = 10 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.218666 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] database.db_retry_interval = 1 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.219045 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] database.max_overflow = 50 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.219393 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] database.max_pool_size = 5 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.220296 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] database.max_retries = 10 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.220296 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] database.mysql_enable_ndb = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.220597 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.220761 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] database.pool_timeout = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.221113 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] database.retry_interval = 10 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.221447 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] database.slave_connection = **** {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.221814 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] database.sqlite_synchronous = True {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.222117 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] database.use_db_reconnect = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.222543 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_policy.enforce_new_defaults = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.222933 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_policy.enforce_scope = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.223323 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_policy.policy_default_rule = default {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.223712 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.224396 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_policy.policy_file = policy.yaml {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.224570 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.224891 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.225198 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.225750 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.226115 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.226534 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] profiler.connection_string = messaging:// {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.226838 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] profiler.enabled = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.227197 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] profiler.es_doc_type = notification {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.227561 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] profiler.es_scroll_size = 10000 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.227937 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] profiler.es_scroll_time = 2m {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.228287 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] profiler.filter_error_trace = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.228635 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] profiler.hmac_keys = SECRET_KEY {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.228984 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] profiler.sentinel_service_name = mymaster {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.229333 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] profiler.socket_timeout = 0.1 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.229671 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] profiler.trace_sqlalchemy = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.230096 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] privsep_osbrick.capabilities = [21] {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.230463 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] privsep_osbrick.group = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.230824 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] privsep_osbrick.helper_command = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.231177 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] privsep_osbrick.logger_name = oslo_privsep.daemon {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.231525 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.231876 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] privsep_osbrick.user = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.232267 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.232613 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] cinder_sys_admin.group = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.232947 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] cinder_sys_admin.helper_command = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.233293 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.234114 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.234456 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] cinder_sys_admin.user = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.234862 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] service_user.auth_section = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.236875 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] service_user.auth_type = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.237277 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] service_user.cafile = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.237645 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] service_user.certfile = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.238084 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] service_user.collect_timing = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.238445 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] service_user.insecure = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.238836 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] service_user.keyfile = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.239377 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] service_user.send_service_user_token = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.239920 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] service_user.split_loggers = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.240420 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] service_user.timeout = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.240975 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.backend_availability_zone = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.241515 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.242021 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.242529 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.chap_password = **** {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.243138 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.chap_username = {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.243680 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.244214 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.deferred_deletion_delay = 0 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.244744 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.deferred_deletion_purge_interval = 60 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.245238 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.driver_client_cert = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.245743 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.driver_client_cert_key = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.246231 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.driver_data_namespace = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.246713 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.247250 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.247790 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.driver_use_ssl = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.248328 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.enable_deferred_deletion = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.248826 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.enable_unsupported_driver = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.249327 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.249851 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.extra_capabilities = {} {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.250206 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.filter_function = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.250549 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.goodness_function = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.250952 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.iet_conf = /etc/iet/ietd.conf {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.251324 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.251678 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.252024 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-017c7538-905a-456a-a7b9-54b72355b3be None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:36:38.252125 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.252377 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.252732 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.253310 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.iscsi_iotype = fileio {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.253448 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.iscsi_secondary_ip_addresses = [] {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.253951 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.iscsi_target_flags = {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.254480 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.iscsi_write_cache = on {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.254877 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.iser_helper = tgtadm {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.255972 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.iser_ip_address = 10.222.0.32 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.256335 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.iser_port = 3260 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.256703 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.257069 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.257420 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.257767 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.num_shell_tries = 3 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.258115 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.258483 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.258873 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.nvmet_port_id = 1 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.259210 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.rados_connect_timeout = -1 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.259561 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.rados_connection_interval = 5 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.259920 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.rados_connection_retries = 3 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.260278 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.rbd_ceph_conf = {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.260643 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.rbd_cluster_name = ceph {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.260989 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.rbd_exclusive_cinder_pool = True {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.261361 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.rbd_flatten_volume_from_snapshot = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.261738 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.rbd_max_clone_depth = 5 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.262103 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.rbd_pool = rbd {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.262442 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.rbd_secret_uuid = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.262982 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.rbd_store_chunk_size = 4 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.263475 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.rbd_user = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.263834 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.replication_connect_timeout = 5 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.264184 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.replication_device = **** {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.264555 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.report_discard_supported = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.268359 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.report_dynamic_total_capacity = True {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.268768 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.reserved_percentage = 0 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.269161 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.scst_target_driver = iscsi {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.269527 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.scst_target_iqn_name = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.269905 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.storage_protocol = iSCSI {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.270263 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.270642 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.target_helper = tgtadm {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.272979 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.target_ip_address = 10.222.0.32 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.275067 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.target_port = 3260 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.275067 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.275067 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.target_protocol = iscsi {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.275067 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.trace_flags = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.275067 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.unique_fqdn_network = True {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.275459 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.use_chap_auth = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.275622 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.276126 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.volume_backend_name = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.276649 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.volume_clear = zero {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.277170 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.volume_clear_ionice = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.277664 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.volume_clear_size = 0 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.278228 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.278589 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.278980 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.279550 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.280266 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.280897 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_reports.file_event_handler = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.281690 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.282387 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_reports.log_dir = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.283026 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.backend_availability_zone = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.283595 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.backend_host = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.284182 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.backend_native_threads_pool_size = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.284809 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.backup_use_temp_snapshot = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.285499 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.chap_password = **** {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.286074 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.chap_username = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.286681 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.chiscsi_conf = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.287269 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.deferred_deletion_delay = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.287853 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.deferred_deletion_purge_interval = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.288409 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.driver_client_cert = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.289029 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.driver_client_cert_key = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.289453 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.driver_data_namespace = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.289778 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.driver_ssl_cert_path = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.290038 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.driver_ssl_cert_verify = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.290609 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.driver_use_ssl = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.290959 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.enable_deferred_deletion = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.291315 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.enable_unsupported_driver = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.291745 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.enforce_multipath_for_image_xfer = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.292035 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.extra_capabilities = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.292609 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.filter_function = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.292957 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.goodness_function = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.293327 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.iet_conf = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.293678 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.image_upload_use_cinder_backend = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.294021 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.image_upload_use_internal_tenant = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.294385 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.image_volume_cache_enabled = True {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.294728 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.image_volume_cache_max_count = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.295092 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.image_volume_cache_max_size_gb = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.295631 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.iscsi_iotype = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.295972 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.iscsi_secondary_ip_addresses = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.296518 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.iscsi_target_flags = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.297074 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.iscsi_write_cache = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.297494 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.iser_helper = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.297910 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.iser_ip_address = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.298262 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.iser_port = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.298620 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.iser_target_prefix = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.299144 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.max_over_subscription_ratio = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.299626 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.num_iser_scan_tries = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.300140 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.num_shell_tries = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.300638 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.num_volume_device_scan_tries = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.301154 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.nvmet_ns_id = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.301696 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.nvmet_port_id = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.302289 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.rados_connect_timeout = -1 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.302871 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.rados_connection_interval = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.303418 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.rados_connection_retries = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.303969 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.rbd_ceph_conf = /etc/ceph/ceph.conf {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.304512 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.rbd_cluster_name = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.305059 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.rbd_exclusive_cinder_pool = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.305602 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.rbd_flatten_volume_from_snapshot = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.306290 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.rbd_max_clone_depth = 5 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.306873 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.rbd_pool = volumes {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.307434 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.rbd_secret_uuid = 3ca0b836-1cfe-436a-b0fa-deb74d3203d9 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.307994 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.rbd_store_chunk_size = 4 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.308480 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-017c7538-905a-456a-a7b9-54b72355b3be None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:36:38.308746 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.rbd_user = cinder {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.309269 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.replication_connect_timeout = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.309808 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.replication_device = **** {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.310372 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.report_discard_supported = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.310933 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.report_dynamic_total_capacity = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.311478 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.reserved_percentage = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.312014 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.scst_target_driver = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.312536 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.scst_target_iqn_name = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.313059 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.storage_protocol = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.313582 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.suppress_requests_ssl_warnings = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.314106 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.target_helper = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.314664 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.target_ip_address = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.315409 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.target_port = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.315947 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.target_prefix = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.316482 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.target_protocol = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.317157 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.trace_flags = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.317694 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.unique_fqdn_network = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.318746 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.use_chap_auth = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.319303 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.use_multipath_for_image_xfer = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.319857 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.volume_backend_name = ceph {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.320201 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.volume_clear = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.320726 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.volume_clear_ionice = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.321075 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.volume_clear_size = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.321425 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.volume_copy_blkio_cgroup_name = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.321770 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.volume_copy_bps_limit = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.322112 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.volume_dd_blocksize = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.322481 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.volume_driver = cinder.volume.drivers.rbd.RBDDriver {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.322857 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ceph.volumes_dir = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.323308 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.323692 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.324063 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.324427 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.324819 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.325164 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.325595 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.325871 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.326459 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.326904 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.327373 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.327801 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.328268 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.328692 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.329120 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.329558 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.329975 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.330399 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.331011 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.331436 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.331872 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.332589 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.333032 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_messaging_rabbit.ssl = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.333626 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.334627 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.335041 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.335424 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_messaging_rabbit.ssl_version = {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.335764 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_messaging_notifications.driver = [] {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.336136 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_messaging_notifications.retry = -1 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.336566 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.336920 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] oslo_messaging_notifications.transport_url = **** {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.337253 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.337780 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] key_manager.fixed_key = **** {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.337983 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.338350 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] barbican.barbican_api_version = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.338687 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] barbican.barbican_endpoint = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.339270 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] barbican.barbican_endpoint_type = public {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.339779 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] barbican.barbican_region_name = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.340124 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] barbican.cafile = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.340483 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] barbican.certfile = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.340861 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] barbican.collect_timing = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.341226 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] barbican.insecure = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.341561 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] barbican.keyfile = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.341907 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] barbican.number_of_retries = 60 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.342270 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] barbican.retry_delay = 1 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.342637 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] barbican.send_service_user_token = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.343015 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] barbican.split_loggers = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.343526 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] barbican.timeout = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.344060 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] barbican.verify_ssl = True {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.344742 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] barbican.verify_ssl_path = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.345271 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] barbican_service_user.auth_section = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.345769 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] barbican_service_user.auth_type = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.346266 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] barbican_service_user.cafile = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.347840 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] barbican_service_user.certfile = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.348290 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] barbican_service_user.collect_timing = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.348725 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] barbican_service_user.insecure = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.349309 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] barbican_service_user.keyfile = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.349846 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] barbican_service_user.split_loggers = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.350377 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] barbican_service_user.timeout = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.350998 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] vault.approle_role_id = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.351529 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] vault.approle_secret_id = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.351879 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] vault.cafile = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.352224 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] vault.certfile = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.352574 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] vault.collect_timing = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.352923 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] vault.insecure = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.353262 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] vault.keyfile = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.353632 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] vault.kv_mountpoint = secret {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.353984 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] vault.kv_version = 2 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.354345 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] vault.namespace = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.354688 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] vault.root_token_id = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.355060 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] vault.split_loggers = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.355758 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] vault.ssl_ca_crt_file = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.355758 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] vault.timeout = None {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.356082 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] vault.use_ssl = False {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.356444 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:36:38.356726 ncdv-master-1 cinder-volume[129775]: DEBUG oslo_service.service [None req-ba03b957-623c-4fe3-aa17-3c3b5361ea2e None None] ******************************************************************************** {{(pid=129775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 07 21:36:38.370693 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.driver [None req-017c7538-905a-456a-a7b9-54b72355b3be None None] Driver hasn't implemented _init_vendor_properties() May 07 21:36:38.371690 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.driver [None req-017c7538-905a-456a-a7b9-54b72355b3be None None] Initialized capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:b276a158-7afa-4eaf-b0c1-f56c55c080c6:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=129946) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:812}} May 07 21:36:38.387177 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_db.sqlalchemy.engines [None req-017c7538-905a-456a-a7b9-54b72355b3be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129946) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 07 21:36:38.424999 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.db.sqlalchemy.api [None req-017c7538-905a-456a-a7b9-54b72355b3be None None] Building query based on filter {{(pid=129946) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3459}} May 07 21:36:38.447407 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.image_utils [None req-017c7538-905a-456a-a7b9-54b72355b3be None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=129946) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:955}} May 07 21:36:38.454449 ncdv-master-1 cinder-volume[129946]: INFO cinder.keymgr.migration [None req-4060289f-43df-47bd-8b70-6fffcee9def5 None None] Not migrating encryption keys because the ConfKeyManager is still in use. May 07 21:36:38.464043 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-017c7538-905a-456a-a7b9-54b72355b3be None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:36:38.502640 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-017c7538-905a-456a-a7b9-54b72355b3be None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:36:38.539178 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-017c7538-905a-456a-a7b9-54b72355b3be None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 21:36:38.571156 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-017c7538-905a-456a-a7b9-54b72355b3be None None] Driver initialization completed successfully. May 07 21:36:38.571907 ncdv-master-1 cinder-volume[129946]: INFO cinder.manager [None req-017c7538-905a-456a-a7b9-54b72355b3be None None] Initiating service 3 cleanup May 07 21:36:38.585118 ncdv-master-1 cinder-volume[129946]: INFO cinder.manager [None req-017c7538-905a-456a-a7b9-54b72355b3be None None] Service 3 cleanup completed. May 07 21:36:38.585792 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.service [None req-017c7538-905a-456a-a7b9-54b72355b3be None None] Creating RPC server for service cinder-volume {{(pid=129946) start /opt/stack/cinder/cinder/service.py:231}} May 07 21:36:38.594129 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.service [None req-017c7538-905a-456a-a7b9-54b72355b3be None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=129946) start /opt/stack/cinder/cinder/service.py:237}} May 07 21:36:38.643719 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-017c7538-905a-456a-a7b9-54b72355b3be None None] Initializing RPC dependent components of volume driver RBDDriver (1.2.0) May 07 21:36:38.644878 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-017c7538-905a-456a-a7b9-54b72355b3be None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:36:38.680319 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-017c7538-905a-456a-a7b9-54b72355b3be None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:36:38.732774 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-017c7538-905a-456a-a7b9-54b72355b3be None None] Driver post RPC initialization completed successfully. May 07 21:38:30.735200 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 21:38:30.736024 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:38:30.758152 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:38:30.781795 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 21:39:30.736954 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 21:39:30.737652 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:39:30.758764 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:39:30.781548 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 21:40:30.737580 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 21:40:30.738279 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:40:30.759055 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:40:30.780124 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 21:41:30.736593 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 21:41:30.738339 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:41:30.764952 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:41:30.788090 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 21:42:30.736532 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 21:42:30.737233 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:42:30.759300 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:42:30.780624 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 21:43:30.736101 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 21:43:30.736854 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:43:30.761764 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:43:30.784044 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 21:44:30.740187 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 21:44:30.740934 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:44:30.765301 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:44:30.789628 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 21:45:30.745018 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 21:45:30.746124 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:45:30.768120 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:45:30.796467 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 21:46:30.740952 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 21:46:30.741692 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:46:30.821751 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:46:30.897089 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 21:47:30.742506 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 21:47:30.743438 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:47:30.804050 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:47:30.851892 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 21:47:47.302827 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-23723d16-bbfb-4957-a278-eda0912361a3 tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 21:47:47.392406 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-23723d16-bbfb-4957-a278-eda0912361a3 tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Flow 'volume_create_manager' (f19b34e6-66a3-4fdb-ae7b-5f9194a5a730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 21:47:47.399365 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-23723d16-bbfb-4957-a278-eda0912361a3 tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7839e5f0-59b9-4dd2-81de-1315e2d66e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:47:47.451873 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-23723d16-bbfb-4957-a278-eda0912361a3 tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7839e5f0-59b9-4dd2-81de-1315e2d66e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T21:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveAutoBlockMigrationV225Test-volume-1885182200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d3458b74-afb7-4186-a1a5-393c8c9767c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4db49857a44d4f399959ac625886505a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T21:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T21:47:47Z,use_quota=True,user_id='99e9b91d4fb949f18cc61bf2bbd63ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:47:47.458193 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-23723d16-bbfb-4957-a278-eda0912361a3 tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54583bcf-48e6-4c87-8c2e-53b0015163de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:47:47.462601 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-23723d16-bbfb-4957-a278-eda0912361a3 tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54583bcf-48e6-4c87-8c2e-53b0015163de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:47:47.467996 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-23723d16-bbfb-4957-a278-eda0912361a3 tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b827a7a2-d1df-4049-9e34-b7c8f0f66bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:47:47.473151 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-23723d16-bbfb-4957-a278-eda0912361a3 tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b827a7a2-d1df-4049-9e34-b7c8f0f66bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3458b74-afb7-4186-a1a5-393c8c9767c1', 'volume_name': 'volume-d3458b74-afb7-4186-a1a5-393c8c9767c1', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:47:47.482118 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-23723d16-bbfb-4957-a278-eda0912361a3 tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4705b9a2-49cd-41c8-ab8a-271e701b63a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:47:47.486907 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-23723d16-bbfb-4957-a278-eda0912361a3 tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4705b9a2-49cd-41c8-ab8a-271e701b63a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:47:47.492317 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-23723d16-bbfb-4957-a278-eda0912361a3 tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94d0fb78-6eb3-49ec-b75d-cf73c624d95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:47:47.493526 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-23723d16-bbfb-4957-a278-eda0912361a3 tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Volume d3458b74-afb7-4186-a1a5-393c8c9767c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3458b74-afb7-4186-a1a5-393c8c9767c1', 'volume_size': 1} May 07 21:47:47.494155 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-23723d16-bbfb-4957-a278-eda0912361a3 tempest-LiveAutoBlockMigrationV225Test-1194124795 None] creating volume 'volume-d3458b74-afb7-4186-a1a5-393c8c9767c1' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 21:47:47.495362 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-23723d16-bbfb-4957-a278-eda0912361a3 tempest-LiveAutoBlockMigrationV225Test-1194124795 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:47:47.837490 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-23723d16-bbfb-4957-a278-eda0912361a3 tempest-LiveAutoBlockMigrationV225Test-1194124795 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 21:47:47.838166 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-23723d16-bbfb-4957-a278-eda0912361a3 tempest-LiveAutoBlockMigrationV225Test-1194124795 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 21:47:47.853977 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-23723d16-bbfb-4957-a278-eda0912361a3 tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94d0fb78-6eb3-49ec-b75d-cf73c624d95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3458b74-afb7-4186-a1a5-393c8c9767c1', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:47:47.861748 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-23723d16-bbfb-4957-a278-eda0912361a3 tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acf5c5c1-961c-41d6-9f48-dff64a7b6b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:47:47.884112 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-23723d16-bbfb-4957-a278-eda0912361a3 tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Volume volume-d3458b74-afb7-4186-a1a5-393c8c9767c1 (d3458b74-afb7-4186-a1a5-393c8c9767c1): created successfully May 07 21:47:47.888776 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-23723d16-bbfb-4957-a278-eda0912361a3 tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acf5c5c1-961c-41d6-9f48-dff64a7b6b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:47:47.895723 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-23723d16-bbfb-4957-a278-eda0912361a3 tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Flow 'volume_create_manager' (f19b34e6-66a3-4fdb-ae7b-5f9194a5a730) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 21:47:47.909334 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-23723d16-bbfb-4957-a278-eda0912361a3 tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Created volume successfully. May 07 21:47:49.368617 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-ed181d26-4047-4e13-b16d-3c51757602c7 req-b0d43119-6e40-47bb-b362-a831296b62b4 tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 21:47:50.396964 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-ed181d26-4047-4e13-b16d-3c51757602c7 req-b0d43119-6e40-47bb-b362-a831296b62b4 tempest-LiveAutoBlockMigrationV225Test-1194124795 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.028s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 21:47:50.397810 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-ed181d26-4047-4e13-b16d-3c51757602c7 req-b0d43119-6e40-47bb-b362-a831296b62b4 tempest-LiveAutoBlockMigrationV225Test-1194124795 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d3458b74-afb7-4186-a1a5-393c8c9767c1', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3ca0b836-1cfe-436a-b0fa-deb74d3203d9', 'volume_id': 'd3458b74-afb7-4186-a1a5-393c8c9767c1', 'discard': True}} {{(pid=129946) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 07 21:47:50.450813 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-ed181d26-4047-4e13-b16d-3c51757602c7 req-b0d43119-6e40-47bb-b362-a831296b62b4 tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Connection info returned from driver {'name': 'volumes/volume-d3458b74-afb7-4186-a1a5-393c8c9767c1', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd3458b74-afb7-4186-a1a5-393c8c9767c1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '3e90e96a-e6e7-40c3-aaca-9e91e2b42862'} {{(pid=129946) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 07 21:47:50.620225 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-ed181d26-4047-4e13-b16d-3c51757602c7 req-b0d43119-6e40-47bb-b362-a831296b62b4 tempest-LiveAutoBlockMigrationV225Test-1194124795 None] attachment_update completed successfully. May 07 21:48:04.795304 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-b6dc88d4-9ba9-42f9-bd26-151dc0dfaa3b req-ffe8981c-f034-4ab4-ad5d-a8066a0769aa tempest-LiveAutoBlockMigrationV225Test-638033416 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 21:48:06.177655 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-b6dc88d4-9ba9-42f9-bd26-151dc0dfaa3b req-ffe8981c-f034-4ab4-ad5d-a8066a0769aa tempest-LiveAutoBlockMigrationV225Test-638033416 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.385s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 21:48:06.178559 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-b6dc88d4-9ba9-42f9-bd26-151dc0dfaa3b req-ffe8981c-f034-4ab4-ad5d-a8066a0769aa tempest-LiveAutoBlockMigrationV225Test-638033416 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d3458b74-afb7-4186-a1a5-393c8c9767c1', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3ca0b836-1cfe-436a-b0fa-deb74d3203d9', 'volume_id': 'd3458b74-afb7-4186-a1a5-393c8c9767c1', 'discard': True}} {{(pid=129946) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 07 21:48:06.241305 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-b6dc88d4-9ba9-42f9-bd26-151dc0dfaa3b req-ffe8981c-f034-4ab4-ad5d-a8066a0769aa tempest-LiveAutoBlockMigrationV225Test-638033416 None] Connection info returned from driver {'name': 'volumes/volume-d3458b74-afb7-4186-a1a5-393c8c9767c1', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd3458b74-afb7-4186-a1a5-393c8c9767c1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f6d856e0-dfe0-41e5-9e4c-ab97c35a40bc'} {{(pid=129946) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 07 21:48:06.332642 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-b6dc88d4-9ba9-42f9-bd26-151dc0dfaa3b req-ffe8981c-f034-4ab4-ad5d-a8066a0769aa tempest-LiveAutoBlockMigrationV225Test-638033416 None] attachment_update completed successfully. May 07 21:48:21.353294 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-b6dc88d4-9ba9-42f9-bd26-151dc0dfaa3b req-b13ddfbd-40e1-4d32-94bc-693c8711c697 tempest-LiveAutoBlockMigrationV225Test-638033416 None] Terminate volume connection completed successfully. May 07 21:48:21.358642 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-b6dc88d4-9ba9-42f9-bd26-151dc0dfaa3b req-b13ddfbd-40e1-4d32-94bc-693c8711c697 tempest-LiveAutoBlockMigrationV225Test-638033416 None] Deleting attachment 3e90e96a-e6e7-40c3-aaca-9e91e2b42862. {{(pid=129946) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 07 21:48:30.745039 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 21:48:30.747177 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:48:30.824780 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:48:30.913862 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 21:48:33.025175 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c46078f-5798-4b15-b496-63c0e0862682 tempest-LiveMigrationTest-1138711820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 21:48:33.050825 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-0c46078f-5798-4b15-b496-63c0e0862682 tempest-LiveMigrationTest-1138711820 None] Flow 'volume_create_manager' (c08e3f76-da09-4ba0-a805-af42aeb4144f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 21:48:33.057952 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-0c46078f-5798-4b15-b496-63c0e0862682 tempest-LiveMigrationTest-1138711820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae3af558-128f-4483-8876-1f902239c834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:48:33.078557 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-0c46078f-5798-4b15-b496-63c0e0862682 tempest-LiveMigrationTest-1138711820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae3af558-128f-4483-8876-1f902239c834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T21:48:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveMigrationTest-volume-1201471927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d6dda630-1042-46d5-94d9-9909cca2be3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bcaffad5d3447b98f0216d3481045e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T21:48:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T21:48:33Z,use_quota=True,user_id='7dd9c30816a7410f94b10294234c1dc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:48:33.086434 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-0c46078f-5798-4b15-b496-63c0e0862682 tempest-LiveMigrationTest-1138711820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f88ada7e-e859-48ea-8c23-165b5b42b92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:48:33.093561 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-0c46078f-5798-4b15-b496-63c0e0862682 tempest-LiveMigrationTest-1138711820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f88ada7e-e859-48ea-8c23-165b5b42b92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:48:33.102899 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-0c46078f-5798-4b15-b496-63c0e0862682 tempest-LiveMigrationTest-1138711820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad3186b9-4758-43a2-9a02-021df4699fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:48:33.108653 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-0c46078f-5798-4b15-b496-63c0e0862682 tempest-LiveMigrationTest-1138711820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad3186b9-4758-43a2-9a02-021df4699fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6dda630-1042-46d5-94d9-9909cca2be3c', 'volume_name': 'volume-d6dda630-1042-46d5-94d9-9909cca2be3c', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:48:33.117479 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-0c46078f-5798-4b15-b496-63c0e0862682 tempest-LiveMigrationTest-1138711820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (595d36e2-abe2-4709-99d5-e25676027f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:48:33.122176 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-0c46078f-5798-4b15-b496-63c0e0862682 tempest-LiveMigrationTest-1138711820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (595d36e2-abe2-4709-99d5-e25676027f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:48:33.141732 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-0c46078f-5798-4b15-b496-63c0e0862682 tempest-LiveMigrationTest-1138711820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8864f48b-f1bd-4741-baaf-325cf2f79aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:48:33.143664 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-0c46078f-5798-4b15-b496-63c0e0862682 tempest-LiveMigrationTest-1138711820 None] Volume d6dda630-1042-46d5-94d9-9909cca2be3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6dda630-1042-46d5-94d9-9909cca2be3c', 'volume_size': 1} May 07 21:48:33.144268 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0c46078f-5798-4b15-b496-63c0e0862682 tempest-LiveMigrationTest-1138711820 None] creating volume 'volume-d6dda630-1042-46d5-94d9-9909cca2be3c' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 21:48:33.145139 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0c46078f-5798-4b15-b496-63c0e0862682 tempest-LiveMigrationTest-1138711820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:48:33.284355 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0c46078f-5798-4b15-b496-63c0e0862682 tempest-LiveMigrationTest-1138711820 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 21:48:33.285571 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0c46078f-5798-4b15-b496-63c0e0862682 tempest-LiveMigrationTest-1138711820 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 21:48:33.289484 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-0c46078f-5798-4b15-b496-63c0e0862682 tempest-LiveMigrationTest-1138711820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8864f48b-f1bd-4741-baaf-325cf2f79aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6dda630-1042-46d5-94d9-9909cca2be3c', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:48:33.294457 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-0c46078f-5798-4b15-b496-63c0e0862682 tempest-LiveMigrationTest-1138711820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f85ada6-ee89-47c7-8b4e-b246ba7081e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:48:33.304727 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-0c46078f-5798-4b15-b496-63c0e0862682 tempest-LiveMigrationTest-1138711820 None] Volume volume-d6dda630-1042-46d5-94d9-9909cca2be3c (d6dda630-1042-46d5-94d9-9909cca2be3c): created successfully May 07 21:48:33.309968 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-0c46078f-5798-4b15-b496-63c0e0862682 tempest-LiveMigrationTest-1138711820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f85ada6-ee89-47c7-8b4e-b246ba7081e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:48:33.318008 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-0c46078f-5798-4b15-b496-63c0e0862682 tempest-LiveMigrationTest-1138711820 None] Flow 'volume_create_manager' (c08e3f76-da09-4ba0-a805-af42aeb4144f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 21:48:33.329561 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-0c46078f-5798-4b15-b496-63c0e0862682 tempest-LiveMigrationTest-1138711820 None] Created volume successfully. May 07 21:48:35.627325 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-8bb93c74-0be0-42f6-9967-fef7c46a147b req-8437284f-39c1-412b-8772-e0fb7d87d7b9 tempest-LiveMigrationTest-1138711820 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 21:48:36.850840 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-8bb93c74-0be0-42f6-9967-fef7c46a147b req-8437284f-39c1-412b-8772-e0fb7d87d7b9 tempest-LiveMigrationTest-1138711820 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.224s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 21:48:36.852755 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-8bb93c74-0be0-42f6-9967-fef7c46a147b req-8437284f-39c1-412b-8772-e0fb7d87d7b9 tempest-LiveMigrationTest-1138711820 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d6dda630-1042-46d5-94d9-9909cca2be3c', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3ca0b836-1cfe-436a-b0fa-deb74d3203d9', 'volume_id': 'd6dda630-1042-46d5-94d9-9909cca2be3c', 'discard': True}} {{(pid=129946) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 07 21:48:36.891882 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-8bb93c74-0be0-42f6-9967-fef7c46a147b req-8437284f-39c1-412b-8772-e0fb7d87d7b9 tempest-LiveMigrationTest-1138711820 None] Connection info returned from driver {'name': 'volumes/volume-d6dda630-1042-46d5-94d9-9909cca2be3c', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd6dda630-1042-46d5-94d9-9909cca2be3c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b1094824-15b6-4e42-8d08-ee0f10063f0e'} {{(pid=129946) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 07 21:48:36.953491 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-8bb93c74-0be0-42f6-9967-fef7c46a147b req-8437284f-39c1-412b-8772-e0fb7d87d7b9 tempest-LiveMigrationTest-1138711820 None] attachment_update completed successfully. May 07 21:48:38.269488 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-ddb8552e-00ad-4f57-b39b-b8636e639810 req-5abe1a71-f174-4d3d-b343-ede25e9e64d8 tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Terminate volume connection completed successfully. May 07 21:48:38.270603 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-ddb8552e-00ad-4f57-b39b-b8636e639810 req-5abe1a71-f174-4d3d-b343-ede25e9e64d8 tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Deleting attachment f6d856e0-dfe0-41e5-9e4c-ab97c35a40bc. {{(pid=129946) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 07 21:48:40.952287 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 21:48:40.975259 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Flow 'volume_create_manager' (ad941452-bf82-4b63-bfb8-42cd1e187b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 21:48:40.983420 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcc4e999-6008-40e5-8398-769d1bf56e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:48:41.000854 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcc4e999-6008-40e5-8398-769d1bf56e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T21:48:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1033903176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3864f924-91b4-4015-ab37-8bdbf8ad652d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4db49857a44d4f399959ac625886505a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T21:48:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T21:48:41Z,use_quota=True,user_id='99e9b91d4fb949f18cc61bf2bbd63ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:48:41.006951 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c28e12e5-f788-4b42-bbeb-74e409b5b29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:48:41.011522 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c28e12e5-f788-4b42-bbeb-74e409b5b29c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:48:41.020690 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26ebf1d0-26ef-4e04-8331-520572cb6cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:48:41.176025 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26ebf1d0-26ef-4e04-8331-520572cb6cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3864f924-91b4-4015-ab37-8bdbf8ad652d', 'volume_name': 'volume-3864f924-91b4-4015-ab37-8bdbf8ad652d', 'volume_size': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e2f828af0706465883131e16cb564d05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'created_at': datetime.datetime(2022, 5, 7, 21, 36, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:48:41.183401 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23f9ed70-d6b9-4748-98de-31b209e057c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:48:41.190443 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23f9ed70-d6b9-4748-98de-31b209e057c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:48:41.197458 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1c2b433-4f9d-4f69-9d59-bd1b8547c8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:48:41.201300 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Volume 3864f924-91b4-4015-ab37-8bdbf8ad652d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3864f924-91b4-4015-ab37-8bdbf8ad652d', 'volume_size': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e2f828af0706465883131e16cb564d05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'created_at': datetime.datetime(2022, 5, 7, 21, 36, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } May 07 21:48:41.202392 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Cloning 3864f924-91b4-4015-ab37-8bdbf8ad652d from image 3756ae98-5c12-48e7-920e-ef5d1dd5543c at location (None, None). {{(pid=129946) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} May 07 21:48:41.224880 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Lock "b'cinder-3756ae98-5c12-48e7-920e-ef5d1dd5543c'" acquired by "_prepare_image_cache_entry" :: waited 0.021s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 21:48:41.242059 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Preparing cache entry for image = 3756ae98-5c12-48e7-920e-ef5d1dd5543c on host ncdv-master-1@ceph#ceph. {{(pid=129946) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:879}} May 07 21:48:41.243618 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Attempting to retrieve cache entry for image = 3756ae98-5c12-48e7-920e-ef5d1dd5543c on host ncdv-master-1@ceph#ceph. {{(pid=129946) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} May 07 21:48:43.590591 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-2f9147f0-951f-4461-8597-f57b4ffc4f6e req-fddddc39-c218-46d6-9abd-2fa1d45246ac tempest-LiveMigrationTest-1060990445 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 21:48:44.677778 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-2f9147f0-951f-4461-8597-f57b4ffc4f6e req-fddddc39-c218-46d6-9abd-2fa1d45246ac tempest-LiveMigrationTest-1060990445 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.087s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 21:48:44.682219 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-2f9147f0-951f-4461-8597-f57b4ffc4f6e req-fddddc39-c218-46d6-9abd-2fa1d45246ac tempest-LiveMigrationTest-1060990445 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d6dda630-1042-46d5-94d9-9909cca2be3c', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3ca0b836-1cfe-436a-b0fa-deb74d3203d9', 'volume_id': 'd6dda630-1042-46d5-94d9-9909cca2be3c', 'discard': True}} {{(pid=129946) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 07 21:48:44.718065 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-2f9147f0-951f-4461-8597-f57b4ffc4f6e req-fddddc39-c218-46d6-9abd-2fa1d45246ac tempest-LiveMigrationTest-1060990445 None] Connection info returned from driver {'name': 'volumes/volume-d6dda630-1042-46d5-94d9-9909cca2be3c', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd6dda630-1042-46d5-94d9-9909cca2be3c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a290106b-7d6b-476d-af2b-5d8dd827bf13'} {{(pid=129946) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 07 21:48:44.811677 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-2f9147f0-951f-4461-8597-f57b4ffc4f6e req-fddddc39-c218-46d6-9abd-2fa1d45246ac tempest-LiveMigrationTest-1060990445 None] attachment_update completed successfully. May 07 21:48:57.116775 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-2f9147f0-951f-4461-8597-f57b4ffc4f6e req-29c28940-71bb-462b-b57d-62b1fd318afd tempest-LiveMigrationTest-1060990445 None] Terminate volume connection completed successfully. May 07 21:48:57.117511 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-2f9147f0-951f-4461-8597-f57b4ffc4f6e req-29c28940-71bb-462b-b57d-62b1fd318afd tempest-LiveMigrationTest-1060990445 None] Deleting attachment b1094824-15b6-4e42-8d08-ee0f10063f0e. {{(pid=129946) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 07 21:48:58.987834 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.image_utils [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3756ae98-5c12-48e7-920e-ef5d1dd5543c__ifj3p63ncdv-master-1@ceph, size 616.00 MB, duration 17.73 sec {{(pid=129946) fetch /opt/stack/cinder/cinder/image/image_utils.py:580}} May 07 21:48:58.989148 ncdv-master-1 cinder-volume[129946]: INFO cinder.image.image_utils [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Image download 616.00 MB at 34.74 MB/s May 07 21:48:59.101899 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_3756ae98-5c12-48e7-920e-ef5d1dd5543c__ifj3p63ncdv-master-1@ceph {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 21:48:59.323686 ncdv-master-1 sudo[139788]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_3756ae98-5c12-48e7-920e-ef5d1dd5543c__ifj3p63ncdv-master-1@ceph May 07 21:48:59.324528 ncdv-master-1 sudo[139788]: pam_unix(sudo:session): session opened for user root by (uid=0) May 07 21:49:01.660079 ncdv-master-1 sudo[139788]: pam_unix(sudo:session): session closed for user root May 07 21:49:01.662224 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_3756ae98-5c12-48e7-920e-ef5d1dd5543c__ifj3p63ncdv-master-1@ceph" returned: 0 in 2.560s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 21:49:01.671570 ncdv-master-1 cinder-volume[129946]: WARNING py.warnings [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' May 07 21:49:01.671570 ncdv-master-1 cinder-volume[129946]: debtcollector.deprecate( May 07 21:49:01.671570 ncdv-master-1 cinder-volume[129946]: May 07 21:49:01.672329 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.image_utils [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Temporary image 3756ae98-5c12-48e7-920e-ef5d1dd5543c is fetched for user 99e9b91d4fb949f18cc61bf2bbd63ab6. {{(pid=129946) fetch /opt/stack/cinder/cinder/image/image_utils.py:1088}} May 07 21:49:01.792175 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_3756ae98-5c12-48e7-920e-ef5d1dd5543c__ifj3p63ncdv-master-1@ceph {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 21:49:01.960674 ncdv-master-1 sudo[139804]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_3756ae98-5c12-48e7-920e-ef5d1dd5543c__ifj3p63ncdv-master-1@ceph May 07 21:49:01.961496 ncdv-master-1 sudo[139804]: pam_unix(sudo:session): session opened for user root by (uid=0) May 07 21:49:04.208523 ncdv-master-1 sudo[139804]: pam_unix(sudo:session): session closed for user root May 07 21:49:04.220645 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_3756ae98-5c12-48e7-920e-ef5d1dd5543c__ifj3p63ncdv-master-1@ceph" returned: 0 in 2.428s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 21:49:04.221808 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] creating volume 'volume-3864f924-91b4-4015-ab37-8bdbf8ad652d' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 21:49:04.223746 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:49:04.399902 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 21:49:04.400201 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 21:49:04.452377 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.volume_utils [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Attempting download of 3756ae98-5c12-48e7-920e-ef5d1dd5543c ((None, None)) to volume 3864f924-91b4-4015-ab37-8bdbf8ad652d. {{(pid=129946) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} May 07 21:49:04.501474 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_3756ae98-5c12-48e7-920e-ef5d1dd5543c_tdq440t7 {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 21:49:04.728098 ncdv-master-1 sudo[139830]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_3756ae98-5c12-48e7-920e-ef5d1dd5543c_tdq440t7 May 07 21:49:04.728988 ncdv-master-1 sudo[139830]: pam_unix(sudo:session): session opened for user root by (uid=0) May 07 21:49:06.393400 ncdv-master-1 sudo[139830]: pam_unix(sudo:session): session closed for user root May 07 21:49:06.396931 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_3756ae98-5c12-48e7-920e-ef5d1dd5543c_tdq440t7" returned: 0 in 1.895s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 21:49:06.400807 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_3756ae98-5c12-48e7-920e-ef5d1dd5543c__ifj3p63ncdv-master-1@ceph {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 21:49:06.531732 ncdv-master-1 sudo[139845]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_3756ae98-5c12-48e7-920e-ef5d1dd5543c__ifj3p63ncdv-master-1@ceph May 07 21:49:06.533475 ncdv-master-1 sudo[139845]: pam_unix(sudo:session): session opened for user root by (uid=0) May 07 21:49:07.086755 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-2c484223-c3a3-479d-a0fd-d412e2df5c85 req-e0bbd742-fdea-40e0-a302-3b63befc5175 tempest-LiveMigrationTest-1138711820 None] Terminate volume connection completed successfully. May 07 21:49:07.088012 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-2c484223-c3a3-479d-a0fd-d412e2df5c85 req-e0bbd742-fdea-40e0-a302-3b63befc5175 tempest-LiveMigrationTest-1138711820 None] Deleting attachment a290106b-7d6b-476d-af2b-5d8dd827bf13. {{(pid=129946) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 07 21:49:08.960923 ncdv-master-1 sudo[139845]: pam_unix(sudo:session): session closed for user root May 07 21:49:08.963538 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_3756ae98-5c12-48e7-920e-ef5d1dd5543c__ifj3p63ncdv-master-1@ceph" returned: 0 in 2.564s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 21:49:08.964342 ncdv-master-1 cinder-volume[129946]: WARNING py.warnings [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' May 07 21:49:08.964342 ncdv-master-1 cinder-volume[129946]: debtcollector.deprecate( May 07 21:49:08.964342 ncdv-master-1 cinder-volume[129946]: May 07 21:49:08.965811 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.image_utils [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] 3756ae98-5c12-48e7-920e-ef5d1dd5543c was vhdx, converting to raw {{(pid=129946) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:793}} May 07 21:49:08.967605 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_3756ae98-5c12-48e7-920e-ef5d1dd5543c__ifj3p63ncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmp7k7vh98f {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 21:49:09.012542 ncdv-master-1 sudo[139872]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_3756ae98-5c12-48e7-920e-ef5d1dd5543c__ifj3p63ncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmp7k7vh98f May 07 21:49:09.013389 ncdv-master-1 sudo[139872]: pam_unix(sudo:session): session opened for user root by (uid=0) May 07 21:49:09.669451 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-603e00c3-ffe8-4713-b0c4-aa8e279b64a8 tempest-LiveMigrationTest-1138711820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 21:49:09.722191 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-603e00c3-ffe8-4713-b0c4-aa8e279b64a8 tempest-LiveMigrationTest-1138711820 None] Flow 'volume_create_manager' (a308beaa-8c6c-479b-aab7-d5efc88ae020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 21:49:09.761087 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-603e00c3-ffe8-4713-b0c4-aa8e279b64a8 tempest-LiveMigrationTest-1138711820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcf37cba-8b16-4de5-ba80-11626f76a096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:49:09.806225 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-603e00c3-ffe8-4713-b0c4-aa8e279b64a8 tempest-LiveMigrationTest-1138711820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcf37cba-8b16-4de5-ba80-11626f76a096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T21:49:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-443517691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=bc15f6da-d437-4012-98cf-feca629acbf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bcaffad5d3447b98f0216d3481045e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T21:49:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T21:49:10Z,use_quota=True,user_id='7dd9c30816a7410f94b10294234c1dc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:49:09.839785 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-603e00c3-ffe8-4713-b0c4-aa8e279b64a8 tempest-LiveMigrationTest-1138711820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98d25446-7c7c-405c-8a9e-26d15a9421fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:49:09.850515 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-603e00c3-ffe8-4713-b0c4-aa8e279b64a8 tempest-LiveMigrationTest-1138711820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98d25446-7c7c-405c-8a9e-26d15a9421fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:49:09.862159 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-603e00c3-ffe8-4713-b0c4-aa8e279b64a8 tempest-LiveMigrationTest-1138711820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17d4e317-9bcc-4ab7-aa08-7a5a787f338f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:49:10.230366 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-603e00c3-ffe8-4713-b0c4-aa8e279b64a8 tempest-LiveMigrationTest-1138711820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17d4e317-9bcc-4ab7-aa08-7a5a787f338f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bc15f6da-d437-4012-98cf-feca629acbf3', 'volume_name': 'volume-bc15f6da-d437-4012-98cf-feca629acbf3', 'volume_size': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e2f828af0706465883131e16cb564d05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'created_at': datetime.datetime(2022, 5, 7, 21, 36, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:49:10.243643 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-603e00c3-ffe8-4713-b0c4-aa8e279b64a8 tempest-LiveMigrationTest-1138711820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b93e60-94b7-42c5-8c19-3f3022124901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:49:10.264285 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-603e00c3-ffe8-4713-b0c4-aa8e279b64a8 tempest-LiveMigrationTest-1138711820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b93e60-94b7-42c5-8c19-3f3022124901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:49:10.274386 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-603e00c3-ffe8-4713-b0c4-aa8e279b64a8 tempest-LiveMigrationTest-1138711820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcfca027-2e45-417f-b4c6-9cfd41b5ba3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:49:10.278214 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-603e00c3-ffe8-4713-b0c4-aa8e279b64a8 tempest-LiveMigrationTest-1138711820 None] Volume bc15f6da-d437-4012-98cf-feca629acbf3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bc15f6da-d437-4012-98cf-feca629acbf3', 'volume_size': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e2f828af0706465883131e16cb564d05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'created_at': datetime.datetime(2022, 5, 7, 21, 36, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } May 07 21:49:10.280903 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-603e00c3-ffe8-4713-b0c4-aa8e279b64a8 tempest-LiveMigrationTest-1138711820 None] Cloning bc15f6da-d437-4012-98cf-feca629acbf3 from image 3756ae98-5c12-48e7-920e-ef5d1dd5543c at location (None, None). {{(pid=129946) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} May 07 21:49:12.253102 ncdv-master-1 sudo[139872]: pam_unix(sudo:session): session closed for user root May 07 21:49:12.254940 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_3756ae98-5c12-48e7-920e-ef5d1dd5543c__ifj3p63ncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmp7k7vh98f" returned: 0 in 3.287s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 21:49:12.255963 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_3756ae98-5c12-48e7-920e-ef5d1dd5543c__ifj3p63ncdv-master-1@ceph {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 21:49:12.589121 ncdv-master-1 sudo[139902]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_3756ae98-5c12-48e7-920e-ef5d1dd5543c__ifj3p63ncdv-master-1@ceph May 07 21:49:12.591840 ncdv-master-1 sudo[139902]: pam_unix(sudo:session): session opened for user root by (uid=0) May 07 21:49:15.004896 ncdv-master-1 sudo[139902]: pam_unix(sudo:session): session closed for user root May 07 21:49:15.007938 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_3756ae98-5c12-48e7-920e-ef5d1dd5543c__ifj3p63ncdv-master-1@ceph" returned: 0 in 2.751s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 21:49:15.009292 ncdv-master-1 cinder-volume[129946]: WARNING py.warnings [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' May 07 21:49:15.009292 ncdv-master-1 cinder-volume[129946]: debtcollector.deprecate( May 07 21:49:15.009292 ncdv-master-1 cinder-volume[129946]: May 07 21:49:15.010214 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.image_utils [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3756ae98-5c12-48e7-920e-ef5d1dd5543c__ifj3p63ncdv-master-1@ceph, size 700.00 MB, duration 3.29 sec, destination /opt/stack/data/cinder/conversion/tmp7k7vh98f {{(pid=129946) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:412}} May 07 21:49:15.010798 ncdv-master-1 cinder-volume[129946]: INFO cinder.image.image_utils [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Converted 700.00 MB image at 212.88 MB/s May 07 21:49:15.013064 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:49:15.250243 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 21:49:15.259053 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Volume volume-3864f924-91b4-4015-ab37-8bdbf8ad652d is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 21:49:15.301336 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] deleting rbd volume volume-3864f924-91b4-4015-ab37-8bdbf8ad652d {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 21:49:15.739008 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Running cmd (subprocess): rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmp7k7vh98f volume-3864f924-91b4-4015-ab37-8bdbf8ad652d --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 21:49:22.906401 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] CMD "rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmp7k7vh98f volume-3864f924-91b4-4015-ab37-8bdbf8ad652d --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 7.168s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 21:49:23.081188 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:49:23.250927 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 21:49:23.251431 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 21:49:23.252162 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.volume_utils [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Downloaded image 3756ae98-5c12-48e7-920e-ef5d1dd5543c ((None, None)) to volume 3864f924-91b4-4015-ab37-8bdbf8ad652d successfully. {{(pid=129946) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1218}} May 07 21:49:23.326401 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.image_utils [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Temporary image 3756ae98-5c12-48e7-920e-ef5d1dd5543c for user 99e9b91d4fb949f18cc61bf2bbd63ab6 is deleted. {{(pid=129946) fetch /opt/stack/cinder/cinder/image/image_utils.py:1092}} May 07 21:49:23.393661 ncdv-master-1 cinder-volume[129946]: WARNING cinder.quota [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Deprecated: Default quota for resource: volumes_ceph is set by the default quota flag: quota_volumes_ceph, it is now deprecated. Please use the default quota class for default quota. May 07 21:49:23.395082 ncdv-master-1 cinder-volume[129946]: WARNING cinder.quota [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Deprecated: Default quota for resource: gigabytes_ceph is set by the default quota flag: quota_gigabytes_ceph, it is now deprecated. Please use the default quota class for default quota. May 07 21:49:23.577002 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Created reservations ['915fc31e-5d19-4791-82c4-6862ee2af028', '4a0d7a76-49a4-4125-b46a-766327a79a76', '7fefa502-e1b0-42d8-850b-3bf47ad3a193', '0280cbcd-e641-4201-8670-05a127d5ba1b'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 21:49:23.593655 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Creating image volume entry: {'group_id': None, 'cluster_name': None, 'volume_glance_metadata': [{'key': 'signature_verified', 'value': 'False'}], 'consistencygroup_id': None, 'availability_zone': 'nova', 'display_description': None, 'volume_admin_metadata': [], 'volume_metadata': [], 'provider_location': None, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'deleted_at': None, 'replication_status': None, 'metadata': {}, 'encryption_key_id': None, 'created_at': datetime.datetime(2022, 5, 7, 21, 48, 41, tzinfo=datetime.timezone.utc), 'replication_driver_data': None, 'shared_targets': True, 'deleted': False, 'provider_geometry': None, 'replication_extended_status': None, 'launched_at': None, 'terminated_at': None, 'scheduled_at': datetime.datetime(2022, 5, 7, 21, 48, 41, tzinfo=datetime.timezone.utc), 'multiattach': False, 'host': 'ncdv-master-1@ceph#ceph', 'previous_status': None, 'provider_auth': None, 'provider_id': None, 'ec2_id': None, 'display_name': 'image-3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'updated_at': datetime.datetime(2022, 5, 7, 21, 48, 41, tzinfo=datetime.timezone.utc), 'project_id': '758d4dea899344b883971712aebe042f', 'service_uuid': None, 'bootable': False, 'volume_type_id': '1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e', 'size': 1, 'attach_status': 'detached', 'status': 'creating', 'source_volid': '3864f924-91b4-4015-ab37-8bdbf8ad652d'}. {{(pid=129946) _clone_image_volume /opt/stack/cinder/cinder/volume/manager.py:1616}} May 07 21:49:23.707456 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Volume reschedule parameters: False retry: None {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 21:49:23.751078 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Flow 'volume_create_manager' (83d15b6a-a224-47cc-b9bf-833df29849a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 21:49:23.762973 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7113f5cb-51ca-4c71-a3c4-614df96653af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:49:23.781183 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7113f5cb-51ca-4c71-a3c4-614df96653af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T21:48:41Z,deleted=False,deleted_at=None,display_description=None,display_name='image-3756ae98-5c12-48e7-920e-ef5d1dd5543c',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=82279f40-9683-441f-a541-0db8b9177f48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='758d4dea899344b883971712aebe042f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T21:48:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=3864f924-91b4-4015-ab37-8bdbf8ad652d,status='creating',terminated_at=None,updated_at=2022-05-07T21:48:41Z,use_quota=True,user_id='99e9b91d4fb949f18cc61bf2bbd63ab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:49:23.788838 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23e51fb9-9cc5-4c78-83db-d34ff9aa1ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:49:23.796163 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23e51fb9-9cc5-4c78-83db-d34ff9aa1ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:49:23.802029 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (414ed6ee-06fc-4112-aa28-d9f31a2d66dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:49:23.822644 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (414ed6ee-06fc-4112-aa28-d9f31a2d66dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '82279f40-9683-441f-a541-0db8b9177f48', 'volume_name': 'volume-82279f40-9683-441f-a541-0db8b9177f48', 'volume_size': 1, 'source_volid': '3864f924-91b4-4015-ab37-8bdbf8ad652d', 'source_volstatus': 'downloading'}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:49:23.830183 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5330081f-7704-403d-94bd-8f5df4a5e5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:49:23.836688 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5330081f-7704-403d-94bd-8f5df4a5e5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:49:23.842870 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c61ea2ba-7c8a-44b3-a081-8f3a3fa9b4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:49:23.844357 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Volume 82279f40-9683-441f-a541-0db8b9177f48: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-82279f40-9683-441f-a541-0db8b9177f48', 'volume_size': 1, 'source_volid': '3864f924-91b4-4015-ab37-8bdbf8ad652d', 'source_volstatus': 'downloading'} May 07 21:49:23.860927 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:49:23.971750 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] creating snapshot='volume-82279f40-9683-441f-a541-0db8b9177f48.clone_snap' {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} May 07 21:49:24.387467 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] cloning 'volume-3864f924-91b4-4015-ab37-8bdbf8ad652d@volume-82279f40-9683-441f-a541-0db8b9177f48.clone_snap' to 'volume-82279f40-9683-441f-a541-0db8b9177f48' {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 07 21:49:24.539994 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Volume volume-3864f924-91b4-4015-ab37-8bdbf8ad652d is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 21:49:24.541280 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 21:49:24.541865 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 21:49:24.593815 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] clone created successfully {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} May 07 21:49:24.598125 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c61ea2ba-7c8a-44b3-a081-8f3a3fa9b4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82279f40-9683-441f-a541-0db8b9177f48', 'volume_size': 1, 'source_volid': '3864f924-91b4-4015-ab37-8bdbf8ad652d', 'source_volstatus': 'downloading'}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:49:24.603027 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cdb2200-5eec-4d26-9a74-557bbc365e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:49:24.629462 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Volume volume-82279f40-9683-441f-a541-0db8b9177f48 (82279f40-9683-441f-a541-0db8b9177f48): created successfully May 07 21:49:24.647348 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cdb2200-5eec-4d26-9a74-557bbc365e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:49:24.661100 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Flow 'volume_create_manager' (83d15b6a-a224-47cc-b9bf-833df29849a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 21:49:24.677462 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Created volume successfully. May 07 21:49:24.737200 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Creating new image-volume cache entry for image 3756ae98-5c12-48e7-920e-ef5d1dd5543c on ncdv-master-1@ceph#ceph {{(pid=129946) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:104}} May 07 21:49:24.747221 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] New image-volume cache entry created: {'id': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'volume_id': '82279f40-9683-441f-a541-0db8b9177f48', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9), 'last_used': datetime.datetime(2022, 5, 7, 21, 49, 24, 740030)}. {{(pid=129946) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:129}} May 07 21:49:24.752914 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Lock "b'cinder-3756ae98-5c12-48e7-920e-ef5d1dd5543c'" released by "_prepare_image_cache_entry" :: held 43.528s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 21:49:24.753673 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.volume_utils [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Marking volume 3864f924-91b4-4015-ab37-8bdbf8ad652d as bootable. {{(pid=129946) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} May 07 21:49:24.768992 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Copying metadata from image 3756ae98-5c12-48e7-920e-ef5d1dd5543c to 3864f924-91b4-4015-ab37-8bdbf8ad652d. {{(pid=129946) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} May 07 21:49:24.769589 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Creating volume glance metadata for volume 3864f924-91b4-4015-ab37-8bdbf8ad652d backed by image 3756ae98-5c12-48e7-920e-ef5d1dd5543c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129946) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} May 07 21:49:24.847855 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1c2b433-4f9d-4f69-9d59-bd1b8547c8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3864f924-91b4-4015-ab37-8bdbf8ad652d', 'volume_size': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e2f828af0706465883131e16cb564d05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'created_at': datetime.datetime(2022, 5, 7, 21, 36, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:49:24.855314 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b572674e-5c9c-41be-81c6-caec2e4916be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:49:24.868802 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Volume volume-3864f924-91b4-4015-ab37-8bdbf8ad652d (3864f924-91b4-4015-ab37-8bdbf8ad652d): created successfully May 07 21:49:24.876169 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b572674e-5c9c-41be-81c6-caec2e4916be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:49:24.901574 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Flow 'volume_create_manager' (ad941452-bf82-4b63-bfb8-42cd1e187b44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 21:49:24.924443 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-36813437-a1ab-4ee5-83d0-e2353ee1cb0b tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Created volume successfully. May 07 21:49:25.678101 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-603e00c3-ffe8-4713-b0c4-aa8e279b64a8 tempest-LiveMigrationTest-1138711820 None] Lock "b'cinder-3756ae98-5c12-48e7-920e-ef5d1dd5543c'" acquired by "_prepare_image_cache_entry" :: waited 15.396s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 21:49:25.698073 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-603e00c3-ffe8-4713-b0c4-aa8e279b64a8 tempest-LiveMigrationTest-1138711820 None] Found image-volume cache entry: {'id': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'volume_id': '82279f40-9683-441f-a541-0db8b9177f48', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9), 'last_used': datetime.datetime(2022, 5, 7, 21, 49, 25, 683122)}. {{(pid=129946) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 07 21:49:25.698526 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-603e00c3-ffe8-4713-b0c4-aa8e279b64a8 tempest-LiveMigrationTest-1138711820 None] Image-volume cache entry image_update_at = 2022-05-07 21:37:09+00:00, requested image updated_at = 2022-05-07 21:37:09+00:00. {{(pid=129946) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 07 21:49:25.702414 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-603e00c3-ffe8-4713-b0c4-aa8e279b64a8 tempest-LiveMigrationTest-1138711820 None] Found cache entry for image = 3756ae98-5c12-48e7-920e-ef5d1dd5543c on host ncdv-master-1@ceph#ceph. {{(pid=129946) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} May 07 21:49:25.718218 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-603e00c3-ffe8-4713-b0c4-aa8e279b64a8 tempest-LiveMigrationTest-1138711820 None] Lock "b'cinder-3756ae98-5c12-48e7-920e-ef5d1dd5543c'" released by "_prepare_image_cache_entry" :: held 0.037s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 21:49:25.722857 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-603e00c3-ffe8-4713-b0c4-aa8e279b64a8 tempest-LiveMigrationTest-1138711820 None] Attempting to retrieve cache entry for image = 3756ae98-5c12-48e7-920e-ef5d1dd5543c on host ncdv-master-1@ceph#ceph. {{(pid=129946) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} May 07 21:49:25.751969 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-603e00c3-ffe8-4713-b0c4-aa8e279b64a8 tempest-LiveMigrationTest-1138711820 None] Found image-volume cache entry: {'id': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'volume_id': '82279f40-9683-441f-a541-0db8b9177f48', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9), 'last_used': datetime.datetime(2022, 5, 7, 21, 49, 25, 738381)}. {{(pid=129946) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 07 21:49:25.752388 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-603e00c3-ffe8-4713-b0c4-aa8e279b64a8 tempest-LiveMigrationTest-1138711820 None] Image-volume cache entry image_update_at = 2022-05-07 21:37:09+00:00, requested image updated_at = 2022-05-07 21:37:09+00:00. {{(pid=129946) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 07 21:49:25.752788 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-603e00c3-ffe8-4713-b0c4-aa8e279b64a8 tempest-LiveMigrationTest-1138711820 None] Creating from source image-volume 82279f40-9683-441f-a541-0db8b9177f48 {{(pid=129946) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} May 07 21:49:25.785168 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-603e00c3-ffe8-4713-b0c4-aa8e279b64a8 tempest-LiveMigrationTest-1138711820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:49:25.893190 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-603e00c3-ffe8-4713-b0c4-aa8e279b64a8 tempest-LiveMigrationTest-1138711820 None] creating snapshot='volume-bc15f6da-d437-4012-98cf-feca629acbf3.clone_snap' {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} May 07 21:49:26.465520 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-603e00c3-ffe8-4713-b0c4-aa8e279b64a8 tempest-LiveMigrationTest-1138711820 None] cloning 'volume-82279f40-9683-441f-a541-0db8b9177f48@volume-bc15f6da-d437-4012-98cf-feca629acbf3.clone_snap' to 'volume-bc15f6da-d437-4012-98cf-feca629acbf3' {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 07 21:49:26.747329 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-603e00c3-ffe8-4713-b0c4-aa8e279b64a8 tempest-LiveMigrationTest-1138711820 None] Volume volume-3864f924-91b4-4015-ab37-8bdbf8ad652d is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 21:49:26.748294 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-603e00c3-ffe8-4713-b0c4-aa8e279b64a8 tempest-LiveMigrationTest-1138711820 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 21:49:26.748679 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-603e00c3-ffe8-4713-b0c4-aa8e279b64a8 tempest-LiveMigrationTest-1138711820 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 21:49:26.799676 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-603e00c3-ffe8-4713-b0c4-aa8e279b64a8 tempest-LiveMigrationTest-1138711820 None] clone created successfully {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} May 07 21:49:26.801506 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.volume_utils [None req-603e00c3-ffe8-4713-b0c4-aa8e279b64a8 tempest-LiveMigrationTest-1138711820 None] Marking volume bc15f6da-d437-4012-98cf-feca629acbf3 as bootable. {{(pid=129946) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} May 07 21:49:26.820969 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-603e00c3-ffe8-4713-b0c4-aa8e279b64a8 tempest-LiveMigrationTest-1138711820 None] Copying metadata from image 3756ae98-5c12-48e7-920e-ef5d1dd5543c to bc15f6da-d437-4012-98cf-feca629acbf3. {{(pid=129946) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} May 07 21:49:26.822101 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-603e00c3-ffe8-4713-b0c4-aa8e279b64a8 tempest-LiveMigrationTest-1138711820 None] Creating volume glance metadata for volume bc15f6da-d437-4012-98cf-feca629acbf3 backed by image 3756ae98-5c12-48e7-920e-ef5d1dd5543c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129946) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} May 07 21:49:26.990873 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-603e00c3-ffe8-4713-b0c4-aa8e279b64a8 tempest-LiveMigrationTest-1138711820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcfca027-2e45-417f-b4c6-9cfd41b5ba3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc15f6da-d437-4012-98cf-feca629acbf3', 'volume_size': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e2f828af0706465883131e16cb564d05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'created_at': datetime.datetime(2022, 5, 7, 21, 36, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:49:27.007067 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-603e00c3-ffe8-4713-b0c4-aa8e279b64a8 tempest-LiveMigrationTest-1138711820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef9a0ea3-2010-445a-a2d6-982447db2bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:49:27.035642 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-603e00c3-ffe8-4713-b0c4-aa8e279b64a8 tempest-LiveMigrationTest-1138711820 None] Volume volume-bc15f6da-d437-4012-98cf-feca629acbf3 (bc15f6da-d437-4012-98cf-feca629acbf3): created successfully May 07 21:49:27.040213 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-603e00c3-ffe8-4713-b0c4-aa8e279b64a8 tempest-LiveMigrationTest-1138711820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef9a0ea3-2010-445a-a2d6-982447db2bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:49:27.053146 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-603e00c3-ffe8-4713-b0c4-aa8e279b64a8 tempest-LiveMigrationTest-1138711820 None] Flow 'volume_create_manager' (a308beaa-8c6c-479b-aab7-d5efc88ae020) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 21:49:27.077005 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-603e00c3-ffe8-4713-b0c4-aa8e279b64a8 tempest-LiveMigrationTest-1138711820 None] Created volume successfully. May 07 21:49:29.894248 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-a71eddce-80d9-47b9-a3a4-829c27add257 req-0b14fcc7-c864-43e6-9091-628a7dfd9729 tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 21:49:30.744585 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 21:49:30.756964 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:49:30.869212 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:49:30.984401 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 21:49:31.193329 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-a71eddce-80d9-47b9-a3a4-829c27add257 req-0b14fcc7-c864-43e6-9091-628a7dfd9729 tempest-LiveAutoBlockMigrationV225Test-1194124795 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.299s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 21:49:31.194888 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-a71eddce-80d9-47b9-a3a4-829c27add257 req-0b14fcc7-c864-43e6-9091-628a7dfd9729 tempest-LiveAutoBlockMigrationV225Test-1194124795 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-3864f924-91b4-4015-ab37-8bdbf8ad652d', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3ca0b836-1cfe-436a-b0fa-deb74d3203d9', 'volume_id': '3864f924-91b4-4015-ab37-8bdbf8ad652d', 'discard': True}} {{(pid=129946) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 07 21:49:31.235129 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-a71eddce-80d9-47b9-a3a4-829c27add257 req-0b14fcc7-c864-43e6-9091-628a7dfd9729 tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Connection info returned from driver {'name': 'volumes/volume-3864f924-91b4-4015-ab37-8bdbf8ad652d', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '3864f924-91b4-4015-ab37-8bdbf8ad652d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c719a7d2-656d-4ac4-bb5a-be1a24a6d4ea'} {{(pid=129946) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 07 21:49:31.305943 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-a71eddce-80d9-47b9-a3a4-829c27add257 req-0b14fcc7-c864-43e6-9091-628a7dfd9729 tempest-LiveAutoBlockMigrationV225Test-1194124795 None] attachment_update completed successfully. May 07 21:49:32.460768 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-139c68b9-cec4-4a7d-8cc8-c7a0dd4f34f1 req-e78a60aa-d073-413c-8717-82963e3fddb3 tempest-LiveMigrationTest-1138711820 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 21:49:33.499683 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-139c68b9-cec4-4a7d-8cc8-c7a0dd4f34f1 req-e78a60aa-d073-413c-8717-82963e3fddb3 tempest-LiveMigrationTest-1138711820 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.039s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 21:49:33.500648 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-139c68b9-cec4-4a7d-8cc8-c7a0dd4f34f1 req-e78a60aa-d073-413c-8717-82963e3fddb3 tempest-LiveMigrationTest-1138711820 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-bc15f6da-d437-4012-98cf-feca629acbf3', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3ca0b836-1cfe-436a-b0fa-deb74d3203d9', 'volume_id': 'bc15f6da-d437-4012-98cf-feca629acbf3', 'discard': True}} {{(pid=129946) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 07 21:49:33.532696 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-139c68b9-cec4-4a7d-8cc8-c7a0dd4f34f1 req-e78a60aa-d073-413c-8717-82963e3fddb3 tempest-LiveMigrationTest-1138711820 None] Connection info returned from driver {'name': 'volumes/volume-bc15f6da-d437-4012-98cf-feca629acbf3', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'bc15f6da-d437-4012-98cf-feca629acbf3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '9b2463f5-be81-41ea-966e-00073136c5d8'} {{(pid=129946) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 07 21:49:33.646695 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-139c68b9-cec4-4a7d-8cc8-c7a0dd4f34f1 req-e78a60aa-d073-413c-8717-82963e3fddb3 tempest-LiveMigrationTest-1138711820 None] attachment_update completed successfully. May 07 21:49:52.975687 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-846d25e0-1db9-4aa1-8a0f-46a803bf6cbc req-5eb12ae2-9ac0-4872-a141-0c370d1c40a7 tempest-LiveAutoBlockMigrationV225Test-638033416 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 21:49:54.119859 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-846d25e0-1db9-4aa1-8a0f-46a803bf6cbc req-5eb12ae2-9ac0-4872-a141-0c370d1c40a7 tempest-LiveAutoBlockMigrationV225Test-638033416 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.146s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 21:49:54.121745 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-846d25e0-1db9-4aa1-8a0f-46a803bf6cbc req-5eb12ae2-9ac0-4872-a141-0c370d1c40a7 tempest-LiveAutoBlockMigrationV225Test-638033416 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-3864f924-91b4-4015-ab37-8bdbf8ad652d', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3ca0b836-1cfe-436a-b0fa-deb74d3203d9', 'volume_id': '3864f924-91b4-4015-ab37-8bdbf8ad652d', 'discard': True}} {{(pid=129946) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 07 21:49:54.174100 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-846d25e0-1db9-4aa1-8a0f-46a803bf6cbc req-5eb12ae2-9ac0-4872-a141-0c370d1c40a7 tempest-LiveAutoBlockMigrationV225Test-638033416 None] Connection info returned from driver {'name': 'volumes/volume-3864f924-91b4-4015-ab37-8bdbf8ad652d', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '3864f924-91b4-4015-ab37-8bdbf8ad652d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '4e997ff6-7ad1-444a-8db3-24207d886dae'} {{(pid=129946) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 07 21:49:54.239358 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-846d25e0-1db9-4aa1-8a0f-46a803bf6cbc req-5eb12ae2-9ac0-4872-a141-0c370d1c40a7 tempest-LiveAutoBlockMigrationV225Test-638033416 None] attachment_update completed successfully. May 07 21:50:03.769971 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-846d25e0-1db9-4aa1-8a0f-46a803bf6cbc req-5fc7a669-0be5-4380-9877-eff9151197ea tempest-LiveAutoBlockMigrationV225Test-638033416 None] Terminate volume connection completed successfully. May 07 21:50:03.770695 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-846d25e0-1db9-4aa1-8a0f-46a803bf6cbc req-5fc7a669-0be5-4380-9877-eff9151197ea tempest-LiveAutoBlockMigrationV225Test-638033416 None] Deleting attachment c719a7d2-656d-4ac4-bb5a-be1a24a6d4ea. {{(pid=129946) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 07 21:50:16.257327 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-98d062fd-674c-49ce-aa03-dd86c5cdf8a1 req-2ae1fa67-d9be-4f2d-b357-af6eee2d1e76 tempest-LiveMigrationTest-1060990445 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 21:50:17.484874 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-98d062fd-674c-49ce-aa03-dd86c5cdf8a1 req-2ae1fa67-d9be-4f2d-b357-af6eee2d1e76 tempest-LiveMigrationTest-1060990445 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.227s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 21:50:17.485786 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-98d062fd-674c-49ce-aa03-dd86c5cdf8a1 req-2ae1fa67-d9be-4f2d-b357-af6eee2d1e76 tempest-LiveMigrationTest-1060990445 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-bc15f6da-d437-4012-98cf-feca629acbf3', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3ca0b836-1cfe-436a-b0fa-deb74d3203d9', 'volume_id': 'bc15f6da-d437-4012-98cf-feca629acbf3', 'discard': True}} {{(pid=129946) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 07 21:50:17.537920 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-98d062fd-674c-49ce-aa03-dd86c5cdf8a1 req-2ae1fa67-d9be-4f2d-b357-af6eee2d1e76 tempest-LiveMigrationTest-1060990445 None] Connection info returned from driver {'name': 'volumes/volume-bc15f6da-d437-4012-98cf-feca629acbf3', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'bc15f6da-d437-4012-98cf-feca629acbf3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '44e3112f-af0a-427e-83f6-abfbf49edfe1'} {{(pid=129946) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 07 21:50:17.648372 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-98d062fd-674c-49ce-aa03-dd86c5cdf8a1 req-2ae1fa67-d9be-4f2d-b357-af6eee2d1e76 tempest-LiveMigrationTest-1060990445 None] attachment_update completed successfully. May 07 21:50:18.626066 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-3ff7f2bd-02e6-4752-b65f-bbce8c8e5185 req-2da93d7f-638d-4b0a-8151-baff81dfddae tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Terminate volume connection completed successfully. May 07 21:50:18.627509 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-3ff7f2bd-02e6-4752-b65f-bbce8c8e5185 req-2da93d7f-638d-4b0a-8151-baff81dfddae tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Deleting attachment 4e997ff6-7ad1-444a-8db3-24207d886dae. {{(pid=129946) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 07 21:50:19.052797 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [req-3ff7f2bd-02e6-4752-b65f-bbce8c8e5185 req-df0e8d88-bfbc-47d0-9b4a-1b12c655b6d0 tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Lock "b'cinder-3864f924-91b4-4015-ab37-8bdbf8ad652d-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 21:50:19.102571 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-3ff7f2bd-02e6-4752-b65f-bbce8c8e5185 req-df0e8d88-bfbc-47d0-9b4a-1b12c655b6d0 tempest-LiveAutoBlockMigrationV225Test-1194124795 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:50:19.230576 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-3ff7f2bd-02e6-4752-b65f-bbce8c8e5185 req-df0e8d88-bfbc-47d0-9b4a-1b12c655b6d0 tempest-LiveAutoBlockMigrationV225Test-1194124795 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 21:50:19.231085 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-3ff7f2bd-02e6-4752-b65f-bbce8c8e5185 req-df0e8d88-bfbc-47d0-9b4a-1b12c655b6d0 tempest-LiveAutoBlockMigrationV225Test-1194124795 None] volume has clone snapshot(s) {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1285}} May 07 21:50:19.232468 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-3ff7f2bd-02e6-4752-b65f-bbce8c8e5185 req-df0e8d88-bfbc-47d0-9b4a-1b12c655b6d0 tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Volume volume-3864f924-91b4-4015-ab37-8bdbf8ad652d is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 21:50:19.589777 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [req-3ff7f2bd-02e6-4752-b65f-bbce8c8e5185 req-df0e8d88-bfbc-47d0-9b4a-1b12c655b6d0 tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Created reservations ['c8b2575d-acb4-4e2d-a484-e40c1a86964a', '97903c13-7524-4dd9-a1ec-10cf12c21934', '516a0336-0a51-4ebe-a181-076323e56462', '3ed14a06-46c9-49c4-9afb-0bbedb208157'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 21:50:19.741470 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-3ff7f2bd-02e6-4752-b65f-bbce8c8e5185 req-df0e8d88-bfbc-47d0-9b4a-1b12c655b6d0 tempest-LiveAutoBlockMigrationV225Test-1194124795 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:50:19.803377 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-3ff7f2bd-02e6-4752-b65f-bbce8c8e5185 req-df0e8d88-bfbc-47d0-9b4a-1b12c655b6d0 tempest-LiveAutoBlockMigrationV225Test-1194124795 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:50:19.934088 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [req-3ff7f2bd-02e6-4752-b65f-bbce8c8e5185 req-df0e8d88-bfbc-47d0-9b4a-1b12c655b6d0 tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 21:50:19.938841 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-3ff7f2bd-02e6-4752-b65f-bbce8c8e5185 req-df0e8d88-bfbc-47d0-9b4a-1b12c655b6d0 tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Deleted volume successfully. May 07 21:50:19.956493 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [req-3ff7f2bd-02e6-4752-b65f-bbce8c8e5185 req-df0e8d88-bfbc-47d0-9b4a-1b12c655b6d0 tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Lock "b'cinder-3864f924-91b4-4015-ab37-8bdbf8ad652d-delete_volume'" released by "delete_volume" :: held 0.904s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 21:50:21.452830 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-050dabbc-3370-4bbf-9be2-3b9afa7cef9a tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Lock "b'cinder-d3458b74-afb7-4186-a1a5-393c8c9767c1-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 21:50:21.555584 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-050dabbc-3370-4bbf-9be2-3b9afa7cef9a tempest-LiveAutoBlockMigrationV225Test-1194124795 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:50:21.677536 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-050dabbc-3370-4bbf-9be2-3b9afa7cef9a tempest-LiveAutoBlockMigrationV225Test-1194124795 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 21:50:21.678004 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-050dabbc-3370-4bbf-9be2-3b9afa7cef9a tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Volume volume-d3458b74-afb7-4186-a1a5-393c8c9767c1 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 21:50:21.705851 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-050dabbc-3370-4bbf-9be2-3b9afa7cef9a tempest-LiveAutoBlockMigrationV225Test-1194124795 None] deleting rbd volume volume-d3458b74-afb7-4186-a1a5-393c8c9767c1 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 21:50:22.598317 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-050dabbc-3370-4bbf-9be2-3b9afa7cef9a tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Created reservations ['39af3e3e-430a-40eb-8d59-6c916c1ecee2', 'dd11e9a4-c85e-47ff-9989-1638b198eac7', '61708973-4816-4fce-be53-ccb05eeef24d', 'e58414c6-2e4f-4896-a4e5-929a06050efc'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 21:50:22.773990 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-050dabbc-3370-4bbf-9be2-3b9afa7cef9a tempest-LiveAutoBlockMigrationV225Test-1194124795 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:50:22.880843 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-050dabbc-3370-4bbf-9be2-3b9afa7cef9a tempest-LiveAutoBlockMigrationV225Test-1194124795 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:50:22.955025 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-050dabbc-3370-4bbf-9be2-3b9afa7cef9a tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 21:50:22.971469 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-050dabbc-3370-4bbf-9be2-3b9afa7cef9a tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Deleted volume successfully. May 07 21:50:22.992133 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-050dabbc-3370-4bbf-9be2-3b9afa7cef9a tempest-LiveAutoBlockMigrationV225Test-1194124795 None] Lock "b'cinder-d3458b74-afb7-4186-a1a5-393c8c9767c1-delete_volume'" released by "delete_volume" :: held 1.539s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 21:50:26.633164 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-98d062fd-674c-49ce-aa03-dd86c5cdf8a1 req-2942f613-2c23-4d93-bedb-b4ede165e54a tempest-LiveMigrationTest-1060990445 None] Terminate volume connection completed successfully. May 07 21:50:26.634554 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-98d062fd-674c-49ce-aa03-dd86c5cdf8a1 req-2942f613-2c23-4d93-bedb-b4ede165e54a tempest-LiveMigrationTest-1060990445 None] Deleting attachment 9b2463f5-be81-41ea-966e-00073136c5d8. {{(pid=129946) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 07 21:50:30.742578 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 21:50:30.744140 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:50:30.830357 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:50:30.907064 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 21:50:37.159717 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-86986444-aa11-466c-bdfb-b42fa8d535c8 req-074a17cd-afed-4ade-b3e9-4ff047326d73 tempest-LiveMigrationTest-1138711820 None] Terminate volume connection completed successfully. May 07 21:50:37.160913 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-86986444-aa11-466c-bdfb-b42fa8d535c8 req-074a17cd-afed-4ade-b3e9-4ff047326d73 tempest-LiveMigrationTest-1138711820 None] Deleting attachment 44e3112f-af0a-427e-83f6-abfbf49edfe1. {{(pid=129946) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 07 21:50:37.325662 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [req-86986444-aa11-466c-bdfb-b42fa8d535c8 req-5edd2571-6307-41bb-8ab1-3a2e1eef6315 tempest-LiveMigrationTest-1138711820 None] Lock "b'cinder-bc15f6da-d437-4012-98cf-feca629acbf3-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 21:50:37.362980 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-86986444-aa11-466c-bdfb-b42fa8d535c8 req-5edd2571-6307-41bb-8ab1-3a2e1eef6315 tempest-LiveMigrationTest-1138711820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:50:37.438811 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-86986444-aa11-466c-bdfb-b42fa8d535c8 req-5edd2571-6307-41bb-8ab1-3a2e1eef6315 tempest-LiveMigrationTest-1138711820 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 21:50:37.449605 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-86986444-aa11-466c-bdfb-b42fa8d535c8 req-5edd2571-6307-41bb-8ab1-3a2e1eef6315 tempest-LiveMigrationTest-1138711820 None] deleting rbd volume volume-bc15f6da-d437-4012-98cf-feca629acbf3 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 21:50:37.779854 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-86986444-aa11-466c-bdfb-b42fa8d535c8 req-5edd2571-6307-41bb-8ab1-3a2e1eef6315 tempest-LiveMigrationTest-1138711820 None] volume is a clone so cleaning references {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} May 07 21:50:37.811939 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-86986444-aa11-466c-bdfb-b42fa8d535c8 req-5edd2571-6307-41bb-8ab1-3a2e1eef6315 tempest-LiveMigrationTest-1138711820 None] deleting parent snapshot volume-bc15f6da-d437-4012-98cf-feca629acbf3.clone_snap {{(pid=129946) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} May 07 21:50:38.430430 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [req-86986444-aa11-466c-bdfb-b42fa8d535c8 req-5edd2571-6307-41bb-8ab1-3a2e1eef6315 tempest-LiveMigrationTest-1138711820 None] Created reservations ['172e7294-2d4e-4a97-b604-5138d477859f', '49682307-3348-48cb-ac2b-229f86d0a8b4', '3c471c1d-89f0-456f-9c96-205fe23f99d3', 'c110ce88-3ea7-4fc0-80df-a33d531e3e6d'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 21:50:38.491576 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-86986444-aa11-466c-bdfb-b42fa8d535c8 req-5edd2571-6307-41bb-8ab1-3a2e1eef6315 tempest-LiveMigrationTest-1138711820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:50:38.538434 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-86986444-aa11-466c-bdfb-b42fa8d535c8 req-5edd2571-6307-41bb-8ab1-3a2e1eef6315 tempest-LiveMigrationTest-1138711820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:50:38.567782 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [req-86986444-aa11-466c-bdfb-b42fa8d535c8 req-5edd2571-6307-41bb-8ab1-3a2e1eef6315 tempest-LiveMigrationTest-1138711820 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 21:50:38.574425 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-86986444-aa11-466c-bdfb-b42fa8d535c8 req-5edd2571-6307-41bb-8ab1-3a2e1eef6315 tempest-LiveMigrationTest-1138711820 None] Deleted volume successfully. May 07 21:50:38.592554 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [req-86986444-aa11-466c-bdfb-b42fa8d535c8 req-5edd2571-6307-41bb-8ab1-3a2e1eef6315 tempest-LiveMigrationTest-1138711820 None] Lock "b'cinder-bc15f6da-d437-4012-98cf-feca629acbf3-delete_volume'" released by "delete_volume" :: held 1.267s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 21:50:38.739363 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-2754dd1b-0196-4d5c-bcb5-148dbe3ede6e tempest-LiveMigrationTest-1138711820 None] Lock "b'cinder-d6dda630-1042-46d5-94d9-9909cca2be3c-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 21:50:38.799881 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-2754dd1b-0196-4d5c-bcb5-148dbe3ede6e tempest-LiveMigrationTest-1138711820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:50:38.853546 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-2754dd1b-0196-4d5c-bcb5-148dbe3ede6e tempest-LiveMigrationTest-1138711820 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 21:50:38.854355 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-2754dd1b-0196-4d5c-bcb5-148dbe3ede6e tempest-LiveMigrationTest-1138711820 None] Volume volume-d6dda630-1042-46d5-94d9-9909cca2be3c is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 21:50:38.861760 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-2754dd1b-0196-4d5c-bcb5-148dbe3ede6e tempest-LiveMigrationTest-1138711820 None] deleting rbd volume volume-d6dda630-1042-46d5-94d9-9909cca2be3c {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 21:50:39.178579 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-2754dd1b-0196-4d5c-bcb5-148dbe3ede6e tempest-LiveMigrationTest-1138711820 None] Created reservations ['802a240f-07d3-4ccd-aba3-565df8340dfb', '29ed53d7-1506-4200-9b90-3c7dce9d910b', '4f98e6e9-ecf8-4539-a7d5-3ccff0eacd86', '6677fd05-3fb2-4369-a321-a2ff381342bf'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 21:50:39.249033 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-2754dd1b-0196-4d5c-bcb5-148dbe3ede6e tempest-LiveMigrationTest-1138711820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:50:39.303316 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-2754dd1b-0196-4d5c-bcb5-148dbe3ede6e tempest-LiveMigrationTest-1138711820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:50:39.363418 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-2754dd1b-0196-4d5c-bcb5-148dbe3ede6e tempest-LiveMigrationTest-1138711820 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 21:50:39.376711 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-2754dd1b-0196-4d5c-bcb5-148dbe3ede6e tempest-LiveMigrationTest-1138711820 None] Deleted volume successfully. May 07 21:50:39.404125 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-2754dd1b-0196-4d5c-bcb5-148dbe3ede6e tempest-LiveMigrationTest-1138711820 None] Lock "b'cinder-d6dda630-1042-46d5-94d9-9909cca2be3c-delete_volume'" released by "delete_volume" :: held 0.665s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 21:51:30.742531 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 21:51:30.744237 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:51:30.819623 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:51:30.887215 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 21:52:11.464781 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-bec57c79-8dc3-45db-b65f-4e8816b0c82e tempest-VolumesAdminNegativeTest-1445857849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 21:52:11.515805 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-bec57c79-8dc3-45db-b65f-4e8816b0c82e tempest-VolumesAdminNegativeTest-1445857849 None] Flow 'volume_create_manager' (2e2f2b81-cad9-449d-bca8-89c74022d17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 21:52:11.528551 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-bec57c79-8dc3-45db-b65f-4e8816b0c82e tempest-VolumesAdminNegativeTest-1445857849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cee54d1-b636-48bb-92a2-502e5402887d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:52:11.563737 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-bec57c79-8dc3-45db-b65f-4e8816b0c82e tempest-VolumesAdminNegativeTest-1445857849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cee54d1-b636-48bb-92a2-502e5402887d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T21:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-858174129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3a97af2f-9f40-4145-9032-48c7ab72900c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85f29512cce1477d94e91ae394ecbbcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T21:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T21:52:11Z,use_quota=True,user_id='809d6c48e931489cba4e521b9a42e097',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:52:11.572940 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-bec57c79-8dc3-45db-b65f-4e8816b0c82e tempest-VolumesAdminNegativeTest-1445857849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea01344f-5fa2-4df5-ad43-f5421e02bfbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:52:11.579457 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-bec57c79-8dc3-45db-b65f-4e8816b0c82e tempest-VolumesAdminNegativeTest-1445857849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea01344f-5fa2-4df5-ad43-f5421e02bfbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:52:11.588371 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-bec57c79-8dc3-45db-b65f-4e8816b0c82e tempest-VolumesAdminNegativeTest-1445857849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d61b6b49-214f-4fb2-9fbd-d612c97e66d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:52:11.593742 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-bec57c79-8dc3-45db-b65f-4e8816b0c82e tempest-VolumesAdminNegativeTest-1445857849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d61b6b49-214f-4fb2-9fbd-d612c97e66d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a97af2f-9f40-4145-9032-48c7ab72900c', 'volume_name': 'volume-3a97af2f-9f40-4145-9032-48c7ab72900c', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:52:11.605027 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-bec57c79-8dc3-45db-b65f-4e8816b0c82e tempest-VolumesAdminNegativeTest-1445857849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f078444b-223c-4b8b-94da-b3a55a63f1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:52:11.611348 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-bec57c79-8dc3-45db-b65f-4e8816b0c82e tempest-VolumesAdminNegativeTest-1445857849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f078444b-223c-4b8b-94da-b3a55a63f1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:52:11.623129 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-bec57c79-8dc3-45db-b65f-4e8816b0c82e tempest-VolumesAdminNegativeTest-1445857849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ed0acf4-8932-466d-b6b0-78213b381cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:52:11.638874 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-bec57c79-8dc3-45db-b65f-4e8816b0c82e tempest-VolumesAdminNegativeTest-1445857849 None] Volume 3a97af2f-9f40-4145-9032-48c7ab72900c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a97af2f-9f40-4145-9032-48c7ab72900c', 'volume_size': 1} May 07 21:52:11.639480 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-bec57c79-8dc3-45db-b65f-4e8816b0c82e tempest-VolumesAdminNegativeTest-1445857849 None] creating volume 'volume-3a97af2f-9f40-4145-9032-48c7ab72900c' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 21:52:11.640993 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-bec57c79-8dc3-45db-b65f-4e8816b0c82e tempest-VolumesAdminNegativeTest-1445857849 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:52:11.792990 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-bec57c79-8dc3-45db-b65f-4e8816b0c82e tempest-VolumesAdminNegativeTest-1445857849 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 21:52:11.793598 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-bec57c79-8dc3-45db-b65f-4e8816b0c82e tempest-VolumesAdminNegativeTest-1445857849 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 21:52:11.797333 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-bec57c79-8dc3-45db-b65f-4e8816b0c82e tempest-VolumesAdminNegativeTest-1445857849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ed0acf4-8932-466d-b6b0-78213b381cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a97af2f-9f40-4145-9032-48c7ab72900c', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:52:11.805528 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-bec57c79-8dc3-45db-b65f-4e8816b0c82e tempest-VolumesAdminNegativeTest-1445857849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a8ad345-b2ce-4e01-ab18-1a41e888694d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:52:11.835120 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-bec57c79-8dc3-45db-b65f-4e8816b0c82e tempest-VolumesAdminNegativeTest-1445857849 None] Volume volume-3a97af2f-9f40-4145-9032-48c7ab72900c (3a97af2f-9f40-4145-9032-48c7ab72900c): created successfully May 07 21:52:11.839795 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-bec57c79-8dc3-45db-b65f-4e8816b0c82e tempest-VolumesAdminNegativeTest-1445857849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a8ad345-b2ce-4e01-ab18-1a41e888694d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:52:11.845690 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-bec57c79-8dc3-45db-b65f-4e8816b0c82e tempest-VolumesAdminNegativeTest-1445857849 None] Flow 'volume_create_manager' (2e2f2b81-cad9-449d-bca8-89c74022d17b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 21:52:11.869795 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-bec57c79-8dc3-45db-b65f-4e8816b0c82e tempest-VolumesAdminNegativeTest-1445857849 None] Created volume successfully. May 07 21:52:13.455737 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-dc7d17cd-d310-40b2-91f5-3efe4133a1fa req-c4861266-ace8-4d43-b73a-340ad5f9293a tempest-VolumesAdminNegativeTest-1445857849 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 21:52:15.063188 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-dc7d17cd-d310-40b2-91f5-3efe4133a1fa req-c4861266-ace8-4d43-b73a-340ad5f9293a tempest-VolumesAdminNegativeTest-1445857849 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.607s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 21:52:15.064691 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-dc7d17cd-d310-40b2-91f5-3efe4133a1fa req-c4861266-ace8-4d43-b73a-340ad5f9293a tempest-VolumesAdminNegativeTest-1445857849 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-3a97af2f-9f40-4145-9032-48c7ab72900c', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3ca0b836-1cfe-436a-b0fa-deb74d3203d9', 'volume_id': '3a97af2f-9f40-4145-9032-48c7ab72900c', 'discard': True}} {{(pid=129946) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 07 21:52:15.127691 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-dc7d17cd-d310-40b2-91f5-3efe4133a1fa req-c4861266-ace8-4d43-b73a-340ad5f9293a tempest-VolumesAdminNegativeTest-1445857849 None] Connection info returned from driver {'name': 'volumes/volume-3a97af2f-9f40-4145-9032-48c7ab72900c', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '3a97af2f-9f40-4145-9032-48c7ab72900c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'e1b31bf5-f498-430b-964b-402a7b987390'} {{(pid=129946) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 07 21:52:15.280471 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-dc7d17cd-d310-40b2-91f5-3efe4133a1fa req-c4861266-ace8-4d43-b73a-340ad5f9293a tempest-VolumesAdminNegativeTest-1445857849 None] attachment_update completed successfully. May 07 21:52:19.991654 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-86037b7a-adcb-424c-bd63-a7e39e1519ff req-cdbe5683-7f7c-4163-8296-b3c3a8570617 tempest-VolumesAdminNegativeTest-1445857849 None] Terminate volume connection completed successfully. May 07 21:52:19.992871 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-86037b7a-adcb-424c-bd63-a7e39e1519ff req-cdbe5683-7f7c-4163-8296-b3c3a8570617 tempest-VolumesAdminNegativeTest-1445857849 None] Deleting attachment e1b31bf5-f498-430b-964b-402a7b987390. {{(pid=129946) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 07 21:52:22.305356 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f612e86-f50b-4dc5-af02-10367f4d47f0 tempest-VolumesAdminNegativeTest-1445857849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 21:52:22.334426 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-2f612e86-f50b-4dc5-af02-10367f4d47f0 tempest-VolumesAdminNegativeTest-1445857849 None] Flow 'volume_create_manager' (2812168e-8b6a-4725-a5ff-b290e4de5bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 21:52:22.343132 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-2f612e86-f50b-4dc5-af02-10367f4d47f0 tempest-VolumesAdminNegativeTest-1445857849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40095daa-5d84-4786-a4b9-7aa1ce88ae11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:52:22.361642 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-2f612e86-f50b-4dc5-af02-10367f4d47f0 tempest-VolumesAdminNegativeTest-1445857849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40095daa-5d84-4786-a4b9-7aa1ce88ae11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T21:52:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1761230443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=81adfd75-e86e-4ab0-a95b-5663589c83d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85f29512cce1477d94e91ae394ecbbcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T21:52:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T21:52:22Z,use_quota=True,user_id='809d6c48e931489cba4e521b9a42e097',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:52:22.367363 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-2f612e86-f50b-4dc5-af02-10367f4d47f0 tempest-VolumesAdminNegativeTest-1445857849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3011078d-5cb1-461c-9736-4870fb5b5766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:52:22.372110 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-2f612e86-f50b-4dc5-af02-10367f4d47f0 tempest-VolumesAdminNegativeTest-1445857849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3011078d-5cb1-461c-9736-4870fb5b5766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:52:22.377541 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-2f612e86-f50b-4dc5-af02-10367f4d47f0 tempest-VolumesAdminNegativeTest-1445857849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d85a03a-9b3b-4259-8c9f-6a99095cd09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:52:22.381911 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-2f612e86-f50b-4dc5-af02-10367f4d47f0 tempest-VolumesAdminNegativeTest-1445857849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d85a03a-9b3b-4259-8c9f-6a99095cd09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81adfd75-e86e-4ab0-a95b-5663589c83d6', 'volume_name': 'volume-81adfd75-e86e-4ab0-a95b-5663589c83d6', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:52:22.387371 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-2f612e86-f50b-4dc5-af02-10367f4d47f0 tempest-VolumesAdminNegativeTest-1445857849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3197d11a-cd1e-4bd2-a103-4f246cc48eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:52:22.392988 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-2f612e86-f50b-4dc5-af02-10367f4d47f0 tempest-VolumesAdminNegativeTest-1445857849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3197d11a-cd1e-4bd2-a103-4f246cc48eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:52:22.397793 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-2f612e86-f50b-4dc5-af02-10367f4d47f0 tempest-VolumesAdminNegativeTest-1445857849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afa73ea4-1103-4934-bf5d-b37ebe6a9932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:52:22.399690 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-2f612e86-f50b-4dc5-af02-10367f4d47f0 tempest-VolumesAdminNegativeTest-1445857849 None] Volume 81adfd75-e86e-4ab0-a95b-5663589c83d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81adfd75-e86e-4ab0-a95b-5663589c83d6', 'volume_size': 1} May 07 21:52:22.400099 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-2f612e86-f50b-4dc5-af02-10367f4d47f0 tempest-VolumesAdminNegativeTest-1445857849 None] creating volume 'volume-81adfd75-e86e-4ab0-a95b-5663589c83d6' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 21:52:22.400923 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-2f612e86-f50b-4dc5-af02-10367f4d47f0 tempest-VolumesAdminNegativeTest-1445857849 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:52:22.529731 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-2f612e86-f50b-4dc5-af02-10367f4d47f0 tempest-VolumesAdminNegativeTest-1445857849 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 21:52:22.530485 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-2f612e86-f50b-4dc5-af02-10367f4d47f0 tempest-VolumesAdminNegativeTest-1445857849 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 21:52:22.534702 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-2f612e86-f50b-4dc5-af02-10367f4d47f0 tempest-VolumesAdminNegativeTest-1445857849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afa73ea4-1103-4934-bf5d-b37ebe6a9932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81adfd75-e86e-4ab0-a95b-5663589c83d6', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:52:22.546340 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-2f612e86-f50b-4dc5-af02-10367f4d47f0 tempest-VolumesAdminNegativeTest-1445857849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16998146-4e71-4bed-b8da-902cfb0c6216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:52:22.566932 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-2f612e86-f50b-4dc5-af02-10367f4d47f0 tempest-VolumesAdminNegativeTest-1445857849 None] Volume volume-81adfd75-e86e-4ab0-a95b-5663589c83d6 (81adfd75-e86e-4ab0-a95b-5663589c83d6): created successfully May 07 21:52:22.572318 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-2f612e86-f50b-4dc5-af02-10367f4d47f0 tempest-VolumesAdminNegativeTest-1445857849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16998146-4e71-4bed-b8da-902cfb0c6216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:52:22.583752 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-2f612e86-f50b-4dc5-af02-10367f4d47f0 tempest-VolumesAdminNegativeTest-1445857849 None] Flow 'volume_create_manager' (2812168e-8b6a-4725-a5ff-b290e4de5bd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 21:52:22.595233 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-2f612e86-f50b-4dc5-af02-10367f4d47f0 tempest-VolumesAdminNegativeTest-1445857849 None] Created volume successfully. May 07 21:52:23.675939 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-944d9dbf-6611-48e1-9199-20201106ca6d tempest-VolumesAdminNegativeTest-1445857849 None] Lock "b'cinder-81adfd75-e86e-4ab0-a95b-5663589c83d6-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 21:52:23.773224 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-944d9dbf-6611-48e1-9199-20201106ca6d tempest-VolumesAdminNegativeTest-1445857849 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:52:23.900075 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-944d9dbf-6611-48e1-9199-20201106ca6d tempest-VolumesAdminNegativeTest-1445857849 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 21:52:23.900749 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-944d9dbf-6611-48e1-9199-20201106ca6d tempest-VolumesAdminNegativeTest-1445857849 None] Volume volume-81adfd75-e86e-4ab0-a95b-5663589c83d6 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 21:52:23.918846 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-944d9dbf-6611-48e1-9199-20201106ca6d tempest-VolumesAdminNegativeTest-1445857849 None] deleting rbd volume volume-81adfd75-e86e-4ab0-a95b-5663589c83d6 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 21:52:24.541048 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-944d9dbf-6611-48e1-9199-20201106ca6d tempest-VolumesAdminNegativeTest-1445857849 None] Created reservations ['ac9a3047-7c50-4e75-9b46-7275700115a4', '3cb11989-53aa-417a-9e51-7d39cb54bf70', '0da0e58b-f420-43c2-96a2-dc8e7903b9c6', 'd99a4ef6-44e6-4624-85a2-9089f6396b57'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 21:52:24.648500 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-944d9dbf-6611-48e1-9199-20201106ca6d tempest-VolumesAdminNegativeTest-1445857849 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:52:24.792580 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-944d9dbf-6611-48e1-9199-20201106ca6d tempest-VolumesAdminNegativeTest-1445857849 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:52:24.875482 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-944d9dbf-6611-48e1-9199-20201106ca6d tempest-VolumesAdminNegativeTest-1445857849 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 21:52:24.884268 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-944d9dbf-6611-48e1-9199-20201106ca6d tempest-VolumesAdminNegativeTest-1445857849 None] Deleted volume successfully. May 07 21:52:24.913558 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-944d9dbf-6611-48e1-9199-20201106ca6d tempest-VolumesAdminNegativeTest-1445857849 None] Lock "b'cinder-81adfd75-e86e-4ab0-a95b-5663589c83d6-delete_volume'" released by "delete_volume" :: held 1.238s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 21:52:25.026527 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-602b1f31-f990-43e7-8336-0e5f699ec3e7 tempest-VolumesAdminNegativeTest-1445857849 None] Lock "b'cinder-3a97af2f-9f40-4145-9032-48c7ab72900c-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 21:52:25.089143 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-602b1f31-f990-43e7-8336-0e5f699ec3e7 tempest-VolumesAdminNegativeTest-1445857849 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:52:25.221782 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-602b1f31-f990-43e7-8336-0e5f699ec3e7 tempest-VolumesAdminNegativeTest-1445857849 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 21:52:25.222217 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-602b1f31-f990-43e7-8336-0e5f699ec3e7 tempest-VolumesAdminNegativeTest-1445857849 None] Volume volume-3a97af2f-9f40-4145-9032-48c7ab72900c is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 21:52:25.232765 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-602b1f31-f990-43e7-8336-0e5f699ec3e7 tempest-VolumesAdminNegativeTest-1445857849 None] deleting rbd volume volume-3a97af2f-9f40-4145-9032-48c7ab72900c {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 21:52:25.950210 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-602b1f31-f990-43e7-8336-0e5f699ec3e7 tempest-VolumesAdminNegativeTest-1445857849 None] Created reservations ['6890b03c-d2c5-4e48-bf16-fb573464912d', '2cfc9915-e645-49ba-bbab-a9a0b6dde52b', '335d5158-ad82-4563-9c5d-1474c2420011', '5261bfa3-0a89-48ef-9300-7e75b36025a3'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 21:52:26.111630 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-602b1f31-f990-43e7-8336-0e5f699ec3e7 tempest-VolumesAdminNegativeTest-1445857849 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:52:26.235008 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-602b1f31-f990-43e7-8336-0e5f699ec3e7 tempest-VolumesAdminNegativeTest-1445857849 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:52:26.356572 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-602b1f31-f990-43e7-8336-0e5f699ec3e7 tempest-VolumesAdminNegativeTest-1445857849 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 21:52:26.361027 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-602b1f31-f990-43e7-8336-0e5f699ec3e7 tempest-VolumesAdminNegativeTest-1445857849 None] Deleted volume successfully. May 07 21:52:26.383683 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-602b1f31-f990-43e7-8336-0e5f699ec3e7 tempest-VolumesAdminNegativeTest-1445857849 None] Lock "b'cinder-3a97af2f-9f40-4145-9032-48c7ab72900c-delete_volume'" released by "delete_volume" :: held 1.357s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 21:52:30.743418 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 21:52:30.744103 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:52:30.850648 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:52:30.940463 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 21:52:47.966731 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7daa488-7416-41a6-946d-401f8ce259cd tempest-TaggedBootDevicesTest_v242-1845920429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 21:52:48.002355 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d7daa488-7416-41a6-946d-401f8ce259cd tempest-TaggedBootDevicesTest_v242-1845920429 None] Flow 'volume_create_manager' (a512bc65-e6cd-466d-8a09-ffc50172eff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 21:52:48.015653 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d7daa488-7416-41a6-946d-401f8ce259cd tempest-TaggedBootDevicesTest_v242-1845920429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (535b17b5-4b44-4369-a8be-abcd51d68397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:52:48.042703 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d7daa488-7416-41a6-946d-401f8ce259cd tempest-TaggedBootDevicesTest_v242-1845920429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (535b17b5-4b44-4369-a8be-abcd51d68397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T21:52:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-402099613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f7cbb2f4-5220-49cb-8e45-26c45c23a1b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f75cb675742543209bcbb75d99b60e97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T21:52:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T21:52:48Z,use_quota=True,user_id='60446154374c4fac9315543687cdc0b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:52:48.051985 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d7daa488-7416-41a6-946d-401f8ce259cd tempest-TaggedBootDevicesTest_v242-1845920429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8674b466-eca2-4b7f-a74d-687f3c5fadb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:52:48.062420 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d7daa488-7416-41a6-946d-401f8ce259cd tempest-TaggedBootDevicesTest_v242-1845920429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8674b466-eca2-4b7f-a74d-687f3c5fadb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:52:48.071320 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d7daa488-7416-41a6-946d-401f8ce259cd tempest-TaggedBootDevicesTest_v242-1845920429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (821099d1-32f2-4855-ac72-d9ca9e92609a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:52:48.309554 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d7daa488-7416-41a6-946d-401f8ce259cd tempest-TaggedBootDevicesTest_v242-1845920429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (821099d1-32f2-4855-ac72-d9ca9e92609a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f7cbb2f4-5220-49cb-8e45-26c45c23a1b0', 'volume_name': 'volume-f7cbb2f4-5220-49cb-8e45-26c45c23a1b0', 'volume_size': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e2f828af0706465883131e16cb564d05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'created_at': datetime.datetime(2022, 5, 7, 21, 36, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:52:48.355249 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d7daa488-7416-41a6-946d-401f8ce259cd tempest-TaggedBootDevicesTest_v242-1845920429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99e6d1aa-f12d-490b-b125-c38116efb3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:52:48.385097 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d7daa488-7416-41a6-946d-401f8ce259cd tempest-TaggedBootDevicesTest_v242-1845920429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99e6d1aa-f12d-490b-b125-c38116efb3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:52:48.395025 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d7daa488-7416-41a6-946d-401f8ce259cd tempest-TaggedBootDevicesTest_v242-1845920429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0828dcb5-b55d-418d-accc-642705b6586e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:52:48.407332 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-d7daa488-7416-41a6-946d-401f8ce259cd tempest-TaggedBootDevicesTest_v242-1845920429 None] Volume f7cbb2f4-5220-49cb-8e45-26c45c23a1b0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f7cbb2f4-5220-49cb-8e45-26c45c23a1b0', 'volume_size': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e2f828af0706465883131e16cb564d05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'created_at': datetime.datetime(2022, 5, 7, 21, 36, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } May 07 21:52:48.408124 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7daa488-7416-41a6-946d-401f8ce259cd tempest-TaggedBootDevicesTest_v242-1845920429 None] Cloning f7cbb2f4-5220-49cb-8e45-26c45c23a1b0 from image 3756ae98-5c12-48e7-920e-ef5d1dd5543c at location (None, None). {{(pid=129946) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} May 07 21:52:48.427590 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-d7daa488-7416-41a6-946d-401f8ce259cd tempest-TaggedBootDevicesTest_v242-1845920429 None] Lock "b'cinder-3756ae98-5c12-48e7-920e-ef5d1dd5543c'" acquired by "_prepare_image_cache_entry" :: waited 0.017s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 21:52:48.457827 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-d7daa488-7416-41a6-946d-401f8ce259cd tempest-TaggedBootDevicesTest_v242-1845920429 None] Found image-volume cache entry: {'id': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'volume_id': '82279f40-9683-441f-a541-0db8b9177f48', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9), 'last_used': datetime.datetime(2022, 5, 7, 21, 52, 48, 444127)}. {{(pid=129946) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 07 21:52:48.458283 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-d7daa488-7416-41a6-946d-401f8ce259cd tempest-TaggedBootDevicesTest_v242-1845920429 None] Image-volume cache entry image_update_at = 2022-05-07 21:37:09+00:00, requested image updated_at = 2022-05-07 21:37:09+00:00. {{(pid=129946) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 07 21:52:48.458679 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7daa488-7416-41a6-946d-401f8ce259cd tempest-TaggedBootDevicesTest_v242-1845920429 None] Found cache entry for image = 3756ae98-5c12-48e7-920e-ef5d1dd5543c on host ncdv-master-1@ceph#ceph. {{(pid=129946) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} May 07 21:52:48.474424 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-d7daa488-7416-41a6-946d-401f8ce259cd tempest-TaggedBootDevicesTest_v242-1845920429 None] Lock "b'cinder-3756ae98-5c12-48e7-920e-ef5d1dd5543c'" released by "_prepare_image_cache_entry" :: held 0.040s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 21:52:48.475577 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7daa488-7416-41a6-946d-401f8ce259cd tempest-TaggedBootDevicesTest_v242-1845920429 None] Attempting to retrieve cache entry for image = 3756ae98-5c12-48e7-920e-ef5d1dd5543c on host ncdv-master-1@ceph#ceph. {{(pid=129946) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} May 07 21:52:48.496212 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-d7daa488-7416-41a6-946d-401f8ce259cd tempest-TaggedBootDevicesTest_v242-1845920429 None] Found image-volume cache entry: {'id': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'volume_id': '82279f40-9683-441f-a541-0db8b9177f48', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9), 'last_used': datetime.datetime(2022, 5, 7, 21, 52, 48, 493625)}. {{(pid=129946) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 07 21:52:48.496638 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-d7daa488-7416-41a6-946d-401f8ce259cd tempest-TaggedBootDevicesTest_v242-1845920429 None] Image-volume cache entry image_update_at = 2022-05-07 21:37:09+00:00, requested image updated_at = 2022-05-07 21:37:09+00:00. {{(pid=129946) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 07 21:52:48.497039 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7daa488-7416-41a6-946d-401f8ce259cd tempest-TaggedBootDevicesTest_v242-1845920429 None] Creating from source image-volume 82279f40-9683-441f-a541-0db8b9177f48 {{(pid=129946) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} May 07 21:52:48.566818 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d7daa488-7416-41a6-946d-401f8ce259cd tempest-TaggedBootDevicesTest_v242-1845920429 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:52:48.675338 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d7daa488-7416-41a6-946d-401f8ce259cd tempest-TaggedBootDevicesTest_v242-1845920429 None] creating snapshot='volume-f7cbb2f4-5220-49cb-8e45-26c45c23a1b0.clone_snap' {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} May 07 21:52:49.497362 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d7daa488-7416-41a6-946d-401f8ce259cd tempest-TaggedBootDevicesTest_v242-1845920429 None] cloning 'volume-82279f40-9683-441f-a541-0db8b9177f48@volume-f7cbb2f4-5220-49cb-8e45-26c45c23a1b0.clone_snap' to 'volume-f7cbb2f4-5220-49cb-8e45-26c45c23a1b0' {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 07 21:52:49.756540 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d7daa488-7416-41a6-946d-401f8ce259cd tempest-TaggedBootDevicesTest_v242-1845920429 None] Volume volume-3864f924-91b4-4015-ab37-8bdbf8ad652d.deleted is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 21:52:49.758161 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d7daa488-7416-41a6-946d-401f8ce259cd tempest-TaggedBootDevicesTest_v242-1845920429 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 21:52:49.758818 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d7daa488-7416-41a6-946d-401f8ce259cd tempest-TaggedBootDevicesTest_v242-1845920429 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 21:52:49.806166 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d7daa488-7416-41a6-946d-401f8ce259cd tempest-TaggedBootDevicesTest_v242-1845920429 None] clone created successfully {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} May 07 21:52:49.806816 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.volume_utils [None req-d7daa488-7416-41a6-946d-401f8ce259cd tempest-TaggedBootDevicesTest_v242-1845920429 None] Marking volume f7cbb2f4-5220-49cb-8e45-26c45c23a1b0 as bootable. {{(pid=129946) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} May 07 21:52:49.824375 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7daa488-7416-41a6-946d-401f8ce259cd tempest-TaggedBootDevicesTest_v242-1845920429 None] Copying metadata from image 3756ae98-5c12-48e7-920e-ef5d1dd5543c to f7cbb2f4-5220-49cb-8e45-26c45c23a1b0. {{(pid=129946) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} May 07 21:52:49.825062 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7daa488-7416-41a6-946d-401f8ce259cd tempest-TaggedBootDevicesTest_v242-1845920429 None] Creating volume glance metadata for volume f7cbb2f4-5220-49cb-8e45-26c45c23a1b0 backed by image 3756ae98-5c12-48e7-920e-ef5d1dd5543c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129946) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} May 07 21:52:49.995881 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d7daa488-7416-41a6-946d-401f8ce259cd tempest-TaggedBootDevicesTest_v242-1845920429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0828dcb5-b55d-418d-accc-642705b6586e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7cbb2f4-5220-49cb-8e45-26c45c23a1b0', 'volume_size': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e2f828af0706465883131e16cb564d05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'created_at': datetime.datetime(2022, 5, 7, 21, 36, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:52:50.013168 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d7daa488-7416-41a6-946d-401f8ce259cd tempest-TaggedBootDevicesTest_v242-1845920429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (209a5ccd-e0ac-477f-b5c6-b6c7441a4a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:52:50.031788 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-d7daa488-7416-41a6-946d-401f8ce259cd tempest-TaggedBootDevicesTest_v242-1845920429 None] Volume volume-f7cbb2f4-5220-49cb-8e45-26c45c23a1b0 (f7cbb2f4-5220-49cb-8e45-26c45c23a1b0): created successfully May 07 21:52:50.042294 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d7daa488-7416-41a6-946d-401f8ce259cd tempest-TaggedBootDevicesTest_v242-1845920429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (209a5ccd-e0ac-477f-b5c6-b6c7441a4a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:52:50.048705 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d7daa488-7416-41a6-946d-401f8ce259cd tempest-TaggedBootDevicesTest_v242-1845920429 None] Flow 'volume_create_manager' (a512bc65-e6cd-466d-8a09-ffc50172eff8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 21:52:50.061066 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-d7daa488-7416-41a6-946d-401f8ce259cd tempest-TaggedBootDevicesTest_v242-1845920429 None] Created volume successfully. May 07 21:52:51.623378 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c7c7deb-3f16-48d9-9428-67f627b1c4b5 tempest-TaggedBootDevicesTest_v242-1845920429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 21:52:51.650122 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4c7c7deb-3f16-48d9-9428-67f627b1c4b5 tempest-TaggedBootDevicesTest_v242-1845920429 None] Flow 'volume_create_manager' (49d084b8-93f3-4e8e-a901-d39548e2a3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 21:52:51.669588 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4c7c7deb-3f16-48d9-9428-67f627b1c4b5 tempest-TaggedBootDevicesTest_v242-1845920429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1434f15d-ff4b-41e3-b4f0-8a1049af885f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:52:51.706299 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4c7c7deb-3f16-48d9-9428-67f627b1c4b5 tempest-TaggedBootDevicesTest_v242-1845920429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1434f15d-ff4b-41e3-b4f0-8a1049af885f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T21:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1343892882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1a25a58d-c451-4444-8959-9eaa3b7e6be1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f75cb675742543209bcbb75d99b60e97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T21:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T21:52:52Z,use_quota=True,user_id='60446154374c4fac9315543687cdc0b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:52:51.740524 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4c7c7deb-3f16-48d9-9428-67f627b1c4b5 tempest-TaggedBootDevicesTest_v242-1845920429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dcce85d-1cf7-45ea-9f7c-4c35a29c3d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:52:51.748030 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4c7c7deb-3f16-48d9-9428-67f627b1c4b5 tempest-TaggedBootDevicesTest_v242-1845920429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dcce85d-1cf7-45ea-9f7c-4c35a29c3d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:52:51.755726 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4c7c7deb-3f16-48d9-9428-67f627b1c4b5 tempest-TaggedBootDevicesTest_v242-1845920429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (050bd17b-695c-4fee-a669-27f2af4d312d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:52:51.760477 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4c7c7deb-3f16-48d9-9428-67f627b1c4b5 tempest-TaggedBootDevicesTest_v242-1845920429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (050bd17b-695c-4fee-a669-27f2af4d312d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a25a58d-c451-4444-8959-9eaa3b7e6be1', 'volume_name': 'volume-1a25a58d-c451-4444-8959-9eaa3b7e6be1', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:52:51.767377 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4c7c7deb-3f16-48d9-9428-67f627b1c4b5 tempest-TaggedBootDevicesTest_v242-1845920429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcfe1433-2bf4-4286-ad89-bfe6fee34fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:52:51.771839 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4c7c7deb-3f16-48d9-9428-67f627b1c4b5 tempest-TaggedBootDevicesTest_v242-1845920429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcfe1433-2bf4-4286-ad89-bfe6fee34fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:52:51.794834 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4c7c7deb-3f16-48d9-9428-67f627b1c4b5 tempest-TaggedBootDevicesTest_v242-1845920429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41aeb875-9c5e-4a07-b5a2-e010c8dde00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:52:51.797169 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-4c7c7deb-3f16-48d9-9428-67f627b1c4b5 tempest-TaggedBootDevicesTest_v242-1845920429 None] Volume 1a25a58d-c451-4444-8959-9eaa3b7e6be1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a25a58d-c451-4444-8959-9eaa3b7e6be1', 'volume_size': 1} May 07 21:52:51.797964 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-4c7c7deb-3f16-48d9-9428-67f627b1c4b5 tempest-TaggedBootDevicesTest_v242-1845920429 None] creating volume 'volume-1a25a58d-c451-4444-8959-9eaa3b7e6be1' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 21:52:51.799203 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-4c7c7deb-3f16-48d9-9428-67f627b1c4b5 tempest-TaggedBootDevicesTest_v242-1845920429 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:52:51.940371 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-4c7c7deb-3f16-48d9-9428-67f627b1c4b5 tempest-TaggedBootDevicesTest_v242-1845920429 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 21:52:51.940759 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-4c7c7deb-3f16-48d9-9428-67f627b1c4b5 tempest-TaggedBootDevicesTest_v242-1845920429 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 21:52:51.945707 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4c7c7deb-3f16-48d9-9428-67f627b1c4b5 tempest-TaggedBootDevicesTest_v242-1845920429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41aeb875-9c5e-4a07-b5a2-e010c8dde00c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a25a58d-c451-4444-8959-9eaa3b7e6be1', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:52:51.957356 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4c7c7deb-3f16-48d9-9428-67f627b1c4b5 tempest-TaggedBootDevicesTest_v242-1845920429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (606197fd-9fa4-4c60-8fb2-1830af2c2b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:52:51.978795 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-4c7c7deb-3f16-48d9-9428-67f627b1c4b5 tempest-TaggedBootDevicesTest_v242-1845920429 None] Volume volume-1a25a58d-c451-4444-8959-9eaa3b7e6be1 (1a25a58d-c451-4444-8959-9eaa3b7e6be1): created successfully May 07 21:52:51.982440 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4c7c7deb-3f16-48d9-9428-67f627b1c4b5 tempest-TaggedBootDevicesTest_v242-1845920429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (606197fd-9fa4-4c60-8fb2-1830af2c2b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:52:51.988586 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4c7c7deb-3f16-48d9-9428-67f627b1c4b5 tempest-TaggedBootDevicesTest_v242-1845920429 None] Flow 'volume_create_manager' (49d084b8-93f3-4e8e-a901-d39548e2a3c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 21:52:52.008851 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-4c7c7deb-3f16-48d9-9428-67f627b1c4b5 tempest-TaggedBootDevicesTest_v242-1845920429 None] Created volume successfully. May 07 21:52:53.600888 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-b78b0562-203d-4949-8598-a3e9cd7ae9f4 tempest-TaggedBootDevicesTest_v242-1845920429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 21:52:53.679196 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-b78b0562-203d-4949-8598-a3e9cd7ae9f4 tempest-TaggedBootDevicesTest_v242-1845920429 None] Flow 'volume_create_manager' (e3005162-c553-45f0-835d-f38b0fa5831f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 21:52:53.701009 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-b78b0562-203d-4949-8598-a3e9cd7ae9f4 tempest-TaggedBootDevicesTest_v242-1845920429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (019c706c-502f-422e-8c2e-7fa90aed98f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:52:53.760594 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-b78b0562-203d-4949-8598-a3e9cd7ae9f4 tempest-TaggedBootDevicesTest_v242-1845920429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (019c706c-502f-422e-8c2e-7fa90aed98f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T21:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1266267301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ce511f52-3a6f-4a80-8ff5-f2f4c9553392,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f75cb675742543209bcbb75d99b60e97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T21:52:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T21:52:54Z,use_quota=True,user_id='60446154374c4fac9315543687cdc0b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:52:53.777238 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-b78b0562-203d-4949-8598-a3e9cd7ae9f4 tempest-TaggedBootDevicesTest_v242-1845920429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40b11b65-3613-4ecc-ba5b-4c9302d4bba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:52:53.803294 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-b78b0562-203d-4949-8598-a3e9cd7ae9f4 tempest-TaggedBootDevicesTest_v242-1845920429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40b11b65-3613-4ecc-ba5b-4c9302d4bba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:52:53.820796 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-b78b0562-203d-4949-8598-a3e9cd7ae9f4 tempest-TaggedBootDevicesTest_v242-1845920429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc3707b0-9339-4a79-a307-88d5ece41169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:52:53.837026 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-b78b0562-203d-4949-8598-a3e9cd7ae9f4 tempest-TaggedBootDevicesTest_v242-1845920429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc3707b0-9339-4a79-a307-88d5ece41169) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce511f52-3a6f-4a80-8ff5-f2f4c9553392', 'volume_name': 'volume-ce511f52-3a6f-4a80-8ff5-f2f4c9553392', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:52:53.851959 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-b78b0562-203d-4949-8598-a3e9cd7ae9f4 tempest-TaggedBootDevicesTest_v242-1845920429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7261ea6-88e6-4d42-a26a-e3835230293e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:52:53.865163 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-b78b0562-203d-4949-8598-a3e9cd7ae9f4 tempest-TaggedBootDevicesTest_v242-1845920429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7261ea6-88e6-4d42-a26a-e3835230293e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:52:53.886677 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-b78b0562-203d-4949-8598-a3e9cd7ae9f4 tempest-TaggedBootDevicesTest_v242-1845920429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfac50c6-5388-4503-b5e4-93dbf6629ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:52:53.908220 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-b78b0562-203d-4949-8598-a3e9cd7ae9f4 tempest-TaggedBootDevicesTest_v242-1845920429 None] Volume ce511f52-3a6f-4a80-8ff5-f2f4c9553392: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce511f52-3a6f-4a80-8ff5-f2f4c9553392', 'volume_size': 1} May 07 21:52:53.909281 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b78b0562-203d-4949-8598-a3e9cd7ae9f4 tempest-TaggedBootDevicesTest_v242-1845920429 None] creating volume 'volume-ce511f52-3a6f-4a80-8ff5-f2f4c9553392' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 21:52:53.909991 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b78b0562-203d-4949-8598-a3e9cd7ae9f4 tempest-TaggedBootDevicesTest_v242-1845920429 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:52:54.068165 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b78b0562-203d-4949-8598-a3e9cd7ae9f4 tempest-TaggedBootDevicesTest_v242-1845920429 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 21:52:54.068675 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b78b0562-203d-4949-8598-a3e9cd7ae9f4 tempest-TaggedBootDevicesTest_v242-1845920429 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 21:52:54.073255 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-b78b0562-203d-4949-8598-a3e9cd7ae9f4 tempest-TaggedBootDevicesTest_v242-1845920429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfac50c6-5388-4503-b5e4-93dbf6629ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce511f52-3a6f-4a80-8ff5-f2f4c9553392', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:52:54.083131 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-b78b0562-203d-4949-8598-a3e9cd7ae9f4 tempest-TaggedBootDevicesTest_v242-1845920429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d19b337-b0c9-4aba-9816-014a4959ec64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:52:54.101140 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-b78b0562-203d-4949-8598-a3e9cd7ae9f4 tempest-TaggedBootDevicesTest_v242-1845920429 None] Volume volume-ce511f52-3a6f-4a80-8ff5-f2f4c9553392 (ce511f52-3a6f-4a80-8ff5-f2f4c9553392): created successfully May 07 21:52:54.104962 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-b78b0562-203d-4949-8598-a3e9cd7ae9f4 tempest-TaggedBootDevicesTest_v242-1845920429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d19b337-b0c9-4aba-9816-014a4959ec64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:52:54.110617 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-b78b0562-203d-4949-8598-a3e9cd7ae9f4 tempest-TaggedBootDevicesTest_v242-1845920429 None] Flow 'volume_create_manager' (e3005162-c553-45f0-835d-f38b0fa5831f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 21:52:54.134613 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-b78b0562-203d-4949-8598-a3e9cd7ae9f4 tempest-TaggedBootDevicesTest_v242-1845920429 None] Created volume successfully. May 07 21:53:18.906170 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-25f08409-8d64-4e44-b56c-79a1a809265c tempest-ServersTestBootFromVolume-513562440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 21:53:18.948124 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-25f08409-8d64-4e44-b56c-79a1a809265c tempest-ServersTestBootFromVolume-513562440 None] Flow 'volume_create_manager' (1bf22479-4c6a-45ba-bad0-48eb2959f52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 21:53:18.958049 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-25f08409-8d64-4e44-b56c-79a1a809265c tempest-ServersTestBootFromVolume-513562440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a8d139f-bd9d-4231-8f17-b514e549274c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:53:18.976042 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-25f08409-8d64-4e44-b56c-79a1a809265c tempest-ServersTestBootFromVolume-513562440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a8d139f-bd9d-4231-8f17-b514e549274c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T21:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2046225500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=03b8428c-d607-4323-a5b3-0814d754827a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b9502da27d64dffaf0859d1f6b5663f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T21:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T21:53:19Z,use_quota=True,user_id='63a6acdebf9648698ee5f3a5cac02675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:53:18.982675 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-25f08409-8d64-4e44-b56c-79a1a809265c tempest-ServersTestBootFromVolume-513562440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (412678c5-8158-456e-afda-44c664ae10b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:53:18.998178 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-25f08409-8d64-4e44-b56c-79a1a809265c tempest-ServersTestBootFromVolume-513562440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (412678c5-8158-456e-afda-44c664ae10b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:53:19.004569 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-25f08409-8d64-4e44-b56c-79a1a809265c tempest-ServersTestBootFromVolume-513562440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95c93cac-022e-48e9-b8a1-fbed9f88ce2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:53:19.101648 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-25f08409-8d64-4e44-b56c-79a1a809265c tempest-ServersTestBootFromVolume-513562440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95c93cac-022e-48e9-b8a1-fbed9f88ce2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '03b8428c-d607-4323-a5b3-0814d754827a', 'volume_name': 'volume-03b8428c-d607-4323-a5b3-0814d754827a', 'volume_size': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e2f828af0706465883131e16cb564d05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'created_at': datetime.datetime(2022, 5, 7, 21, 36, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:53:19.107572 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-25f08409-8d64-4e44-b56c-79a1a809265c tempest-ServersTestBootFromVolume-513562440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d269a744-f68a-4a41-9e34-33ee67ca1b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:53:19.116733 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-25f08409-8d64-4e44-b56c-79a1a809265c tempest-ServersTestBootFromVolume-513562440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d269a744-f68a-4a41-9e34-33ee67ca1b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:53:19.119533 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-25f08409-8d64-4e44-b56c-79a1a809265c tempest-ServersTestBootFromVolume-513562440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f7f2ee5-9888-432e-a73f-4911f45c0fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:53:19.122182 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-25f08409-8d64-4e44-b56c-79a1a809265c tempest-ServersTestBootFromVolume-513562440 None] Volume 03b8428c-d607-4323-a5b3-0814d754827a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-03b8428c-d607-4323-a5b3-0814d754827a', 'volume_size': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e2f828af0706465883131e16cb564d05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'created_at': datetime.datetime(2022, 5, 7, 21, 36, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } May 07 21:53:19.122764 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-25f08409-8d64-4e44-b56c-79a1a809265c tempest-ServersTestBootFromVolume-513562440 None] Cloning 03b8428c-d607-4323-a5b3-0814d754827a from image 3756ae98-5c12-48e7-920e-ef5d1dd5543c at location (None, None). {{(pid=129946) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} May 07 21:53:19.136703 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-25f08409-8d64-4e44-b56c-79a1a809265c tempest-ServersTestBootFromVolume-513562440 None] Lock "b'cinder-3756ae98-5c12-48e7-920e-ef5d1dd5543c'" acquired by "_prepare_image_cache_entry" :: waited 0.013s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 21:53:19.167250 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-25f08409-8d64-4e44-b56c-79a1a809265c tempest-ServersTestBootFromVolume-513562440 None] Found image-volume cache entry: {'id': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'volume_id': '82279f40-9683-441f-a541-0db8b9177f48', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9), 'last_used': datetime.datetime(2022, 5, 7, 21, 53, 19, 152574)}. {{(pid=129946) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 07 21:53:19.168814 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-25f08409-8d64-4e44-b56c-79a1a809265c tempest-ServersTestBootFromVolume-513562440 None] Image-volume cache entry image_update_at = 2022-05-07 21:37:09+00:00, requested image updated_at = 2022-05-07 21:37:09+00:00. {{(pid=129946) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 07 21:53:19.170059 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-25f08409-8d64-4e44-b56c-79a1a809265c tempest-ServersTestBootFromVolume-513562440 None] Found cache entry for image = 3756ae98-5c12-48e7-920e-ef5d1dd5543c on host ncdv-master-1@ceph#ceph. {{(pid=129946) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} May 07 21:53:19.177259 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-25f08409-8d64-4e44-b56c-79a1a809265c tempest-ServersTestBootFromVolume-513562440 None] Lock "b'cinder-3756ae98-5c12-48e7-920e-ef5d1dd5543c'" released by "_prepare_image_cache_entry" :: held 0.041s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 21:53:19.178989 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-25f08409-8d64-4e44-b56c-79a1a809265c tempest-ServersTestBootFromVolume-513562440 None] Attempting to retrieve cache entry for image = 3756ae98-5c12-48e7-920e-ef5d1dd5543c on host ncdv-master-1@ceph#ceph. {{(pid=129946) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} May 07 21:53:19.187613 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-25f08409-8d64-4e44-b56c-79a1a809265c tempest-ServersTestBootFromVolume-513562440 None] Found image-volume cache entry: {'id': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'volume_id': '82279f40-9683-441f-a541-0db8b9177f48', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9), 'last_used': datetime.datetime(2022, 5, 7, 21, 53, 19, 184661)}. {{(pid=129946) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 07 21:53:19.188169 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-25f08409-8d64-4e44-b56c-79a1a809265c tempest-ServersTestBootFromVolume-513562440 None] Image-volume cache entry image_update_at = 2022-05-07 21:37:09+00:00, requested image updated_at = 2022-05-07 21:37:09+00:00. {{(pid=129946) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 07 21:53:19.188627 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-25f08409-8d64-4e44-b56c-79a1a809265c tempest-ServersTestBootFromVolume-513562440 None] Creating from source image-volume 82279f40-9683-441f-a541-0db8b9177f48 {{(pid=129946) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} May 07 21:53:19.202811 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-25f08409-8d64-4e44-b56c-79a1a809265c tempest-ServersTestBootFromVolume-513562440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:53:19.280179 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-25f08409-8d64-4e44-b56c-79a1a809265c tempest-ServersTestBootFromVolume-513562440 None] creating snapshot='volume-03b8428c-d607-4323-a5b3-0814d754827a.clone_snap' {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} May 07 21:53:20.126889 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-25f08409-8d64-4e44-b56c-79a1a809265c tempest-ServersTestBootFromVolume-513562440 None] cloning 'volume-82279f40-9683-441f-a541-0db8b9177f48@volume-03b8428c-d607-4323-a5b3-0814d754827a.clone_snap' to 'volume-03b8428c-d607-4323-a5b3-0814d754827a' {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 07 21:53:20.418563 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-25f08409-8d64-4e44-b56c-79a1a809265c tempest-ServersTestBootFromVolume-513562440 None] Volume volume-3864f924-91b4-4015-ab37-8bdbf8ad652d.deleted is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 21:53:20.419913 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-25f08409-8d64-4e44-b56c-79a1a809265c tempest-ServersTestBootFromVolume-513562440 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 21:53:20.420486 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-25f08409-8d64-4e44-b56c-79a1a809265c tempest-ServersTestBootFromVolume-513562440 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 21:53:20.476165 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-25f08409-8d64-4e44-b56c-79a1a809265c tempest-ServersTestBootFromVolume-513562440 None] clone created successfully {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} May 07 21:53:20.477122 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.volume_utils [None req-25f08409-8d64-4e44-b56c-79a1a809265c tempest-ServersTestBootFromVolume-513562440 None] Marking volume 03b8428c-d607-4323-a5b3-0814d754827a as bootable. {{(pid=129946) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} May 07 21:53:20.489767 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-25f08409-8d64-4e44-b56c-79a1a809265c tempest-ServersTestBootFromVolume-513562440 None] Copying metadata from image 3756ae98-5c12-48e7-920e-ef5d1dd5543c to 03b8428c-d607-4323-a5b3-0814d754827a. {{(pid=129946) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} May 07 21:53:20.490567 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-25f08409-8d64-4e44-b56c-79a1a809265c tempest-ServersTestBootFromVolume-513562440 None] Creating volume glance metadata for volume 03b8428c-d607-4323-a5b3-0814d754827a backed by image 3756ae98-5c12-48e7-920e-ef5d1dd5543c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129946) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} May 07 21:53:20.635356 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-25f08409-8d64-4e44-b56c-79a1a809265c tempest-ServersTestBootFromVolume-513562440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f7f2ee5-9888-432e-a73f-4911f45c0fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03b8428c-d607-4323-a5b3-0814d754827a', 'volume_size': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e2f828af0706465883131e16cb564d05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'created_at': datetime.datetime(2022, 5, 7, 21, 36, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:53:20.646115 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-25f08409-8d64-4e44-b56c-79a1a809265c tempest-ServersTestBootFromVolume-513562440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a297a47-5456-4e74-9ff7-8412e4e45506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:53:20.665098 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-25f08409-8d64-4e44-b56c-79a1a809265c tempest-ServersTestBootFromVolume-513562440 None] Volume volume-03b8428c-d607-4323-a5b3-0814d754827a (03b8428c-d607-4323-a5b3-0814d754827a): created successfully May 07 21:53:20.677021 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-25f08409-8d64-4e44-b56c-79a1a809265c tempest-ServersTestBootFromVolume-513562440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a297a47-5456-4e74-9ff7-8412e4e45506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:53:20.686201 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-25f08409-8d64-4e44-b56c-79a1a809265c tempest-ServersTestBootFromVolume-513562440 None] Flow 'volume_create_manager' (1bf22479-4c6a-45ba-bad0-48eb2959f52e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 21:53:20.711799 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-25f08409-8d64-4e44-b56c-79a1a809265c tempest-ServersTestBootFromVolume-513562440 None] Created volume successfully. May 07 21:53:23.106441 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-1ebd58c0-efd0-4ca5-87d0-26045a6f7efc req-811184ad-b2be-4ecb-b2e6-503edae70f67 tempest-TaggedBootDevicesTest_v242-1845920429 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 21:53:23.806642 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-1ebd58c0-efd0-4ca5-87d0-26045a6f7efc req-811184ad-b2be-4ecb-b2e6-503edae70f67 tempest-TaggedBootDevicesTest_v242-1845920429 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.700s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 21:53:23.807914 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-1ebd58c0-efd0-4ca5-87d0-26045a6f7efc req-811184ad-b2be-4ecb-b2e6-503edae70f67 tempest-TaggedBootDevicesTest_v242-1845920429 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f7cbb2f4-5220-49cb-8e45-26c45c23a1b0', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3ca0b836-1cfe-436a-b0fa-deb74d3203d9', 'volume_id': 'f7cbb2f4-5220-49cb-8e45-26c45c23a1b0', 'discard': True}} {{(pid=129946) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 07 21:53:23.854518 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-1ebd58c0-efd0-4ca5-87d0-26045a6f7efc req-811184ad-b2be-4ecb-b2e6-503edae70f67 tempest-TaggedBootDevicesTest_v242-1845920429 None] Connection info returned from driver {'name': 'volumes/volume-f7cbb2f4-5220-49cb-8e45-26c45c23a1b0', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f7cbb2f4-5220-49cb-8e45-26c45c23a1b0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '9f960f2e-4834-4897-8458-28d92a1824f4'} {{(pid=129946) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 07 21:53:23.947591 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-1ebd58c0-efd0-4ca5-87d0-26045a6f7efc req-811184ad-b2be-4ecb-b2e6-503edae70f67 tempest-TaggedBootDevicesTest_v242-1845920429 None] attachment_update completed successfully. May 07 21:53:24.372120 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-1ebd58c0-efd0-4ca5-87d0-26045a6f7efc req-f6b03e77-2c98-4c1c-be91-502a2d86dcce tempest-TaggedBootDevicesTest_v242-1845920429 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 21:53:25.097797 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-1ebd58c0-efd0-4ca5-87d0-26045a6f7efc req-f6b03e77-2c98-4c1c-be91-502a2d86dcce tempest-TaggedBootDevicesTest_v242-1845920429 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.725s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 21:53:25.099081 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-1ebd58c0-efd0-4ca5-87d0-26045a6f7efc req-f6b03e77-2c98-4c1c-be91-502a2d86dcce tempest-TaggedBootDevicesTest_v242-1845920429 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1a25a58d-c451-4444-8959-9eaa3b7e6be1', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3ca0b836-1cfe-436a-b0fa-deb74d3203d9', 'volume_id': '1a25a58d-c451-4444-8959-9eaa3b7e6be1', 'discard': True}} {{(pid=129946) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 07 21:53:25.142936 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-1ebd58c0-efd0-4ca5-87d0-26045a6f7efc req-f6b03e77-2c98-4c1c-be91-502a2d86dcce tempest-TaggedBootDevicesTest_v242-1845920429 None] Connection info returned from driver {'name': 'volumes/volume-1a25a58d-c451-4444-8959-9eaa3b7e6be1', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1a25a58d-c451-4444-8959-9eaa3b7e6be1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '85b3cb71-6256-4e7a-bba0-a983216dc64b'} {{(pid=129946) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 07 21:53:25.208545 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-1ebd58c0-efd0-4ca5-87d0-26045a6f7efc req-f6b03e77-2c98-4c1c-be91-502a2d86dcce tempest-TaggedBootDevicesTest_v242-1845920429 None] attachment_update completed successfully. May 07 21:53:25.738056 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-a8424fda-dc0f-4969-b461-959e0cdbca70 req-53a8053f-fb5b-4f6c-8272-592601d73bc2 tempest-ServersTestBootFromVolume-513562440 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 21:53:26.181628 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-1ebd58c0-efd0-4ca5-87d0-26045a6f7efc req-ef71bc33-7c26-4385-80f1-5ee51ea92f99 tempest-TaggedBootDevicesTest_v242-1845920429 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 21:53:26.863511 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-a8424fda-dc0f-4969-b461-959e0cdbca70 req-53a8053f-fb5b-4f6c-8272-592601d73bc2 tempest-ServersTestBootFromVolume-513562440 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.126s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 21:53:26.865175 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-a8424fda-dc0f-4969-b461-959e0cdbca70 req-53a8053f-fb5b-4f6c-8272-592601d73bc2 tempest-ServersTestBootFromVolume-513562440 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-03b8428c-d607-4323-a5b3-0814d754827a', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3ca0b836-1cfe-436a-b0fa-deb74d3203d9', 'volume_id': '03b8428c-d607-4323-a5b3-0814d754827a', 'discard': True}} {{(pid=129946) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 07 21:53:26.948092 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-a8424fda-dc0f-4969-b461-959e0cdbca70 req-53a8053f-fb5b-4f6c-8272-592601d73bc2 tempest-ServersTestBootFromVolume-513562440 None] Connection info returned from driver {'name': 'volumes/volume-03b8428c-d607-4323-a5b3-0814d754827a', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '03b8428c-d607-4323-a5b3-0814d754827a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '4dffaa04-ad25-4a8a-835f-371734983470'} {{(pid=129946) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 07 21:53:27.043792 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-a8424fda-dc0f-4969-b461-959e0cdbca70 req-53a8053f-fb5b-4f6c-8272-592601d73bc2 tempest-ServersTestBootFromVolume-513562440 None] attachment_update completed successfully. May 07 21:53:27.193329 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-1ebd58c0-efd0-4ca5-87d0-26045a6f7efc req-ef71bc33-7c26-4385-80f1-5ee51ea92f99 tempest-TaggedBootDevicesTest_v242-1845920429 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.012s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 21:53:27.194888 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-1ebd58c0-efd0-4ca5-87d0-26045a6f7efc req-ef71bc33-7c26-4385-80f1-5ee51ea92f99 tempest-TaggedBootDevicesTest_v242-1845920429 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ce511f52-3a6f-4a80-8ff5-f2f4c9553392', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3ca0b836-1cfe-436a-b0fa-deb74d3203d9', 'volume_id': 'ce511f52-3a6f-4a80-8ff5-f2f4c9553392', 'discard': True}} {{(pid=129946) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 07 21:53:27.312937 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-1ebd58c0-efd0-4ca5-87d0-26045a6f7efc req-ef71bc33-7c26-4385-80f1-5ee51ea92f99 tempest-TaggedBootDevicesTest_v242-1845920429 None] Connection info returned from driver {'name': 'volumes/volume-ce511f52-3a6f-4a80-8ff5-f2f4c9553392', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ce511f52-3a6f-4a80-8ff5-f2f4c9553392', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '46f3dde9-9de5-4ab8-bc9e-e4d29bf8e8f0'} {{(pid=129946) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 07 21:53:27.427249 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-1ebd58c0-efd0-4ca5-87d0-26045a6f7efc req-ef71bc33-7c26-4385-80f1-5ee51ea92f99 tempest-TaggedBootDevicesTest_v242-1845920429 None] attachment_update completed successfully. May 07 21:53:30.742371 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 21:53:30.743484 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:53:30.798621 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:53:30.863763 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 21:53:32.975732 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9291ece-bfaa-4756-85ee-2c46898c83e0 tempest-AttachSCSIVolumeTestJSON-1730679280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 21:53:33.033855 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f9291ece-bfaa-4756-85ee-2c46898c83e0 tempest-AttachSCSIVolumeTestJSON-1730679280 None] Flow 'volume_create_manager' (1081168e-3ab1-456c-a416-70cdcf5ea14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 21:53:33.041376 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f9291ece-bfaa-4756-85ee-2c46898c83e0 tempest-AttachSCSIVolumeTestJSON-1730679280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8cf86a2-299b-440b-a218-0352ff88ce7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:53:33.068790 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f9291ece-bfaa-4756-85ee-2c46898c83e0 tempest-AttachSCSIVolumeTestJSON-1730679280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8cf86a2-299b-440b-a218-0352ff88ce7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T21:53:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1465075986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3ffd61d7-05ac-4061-ba7c-ad9ea39417e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b1d2f38652407eaa85fbb15aff6307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T21:53:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T21:53:33Z,use_quota=True,user_id='a2d5596fa4984ceab3525ffc0a14d48f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:53:33.075015 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f9291ece-bfaa-4756-85ee-2c46898c83e0 tempest-AttachSCSIVolumeTestJSON-1730679280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2851c438-39e7-47f9-9776-b5b4cf922888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:53:33.080506 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f9291ece-bfaa-4756-85ee-2c46898c83e0 tempest-AttachSCSIVolumeTestJSON-1730679280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2851c438-39e7-47f9-9776-b5b4cf922888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:53:33.086610 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f9291ece-bfaa-4756-85ee-2c46898c83e0 tempest-AttachSCSIVolumeTestJSON-1730679280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e560b0d-7308-4f14-8fbf-8d301992db6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:53:33.090758 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f9291ece-bfaa-4756-85ee-2c46898c83e0 tempest-AttachSCSIVolumeTestJSON-1730679280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e560b0d-7308-4f14-8fbf-8d301992db6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ffd61d7-05ac-4061-ba7c-ad9ea39417e6', 'volume_name': 'volume-3ffd61d7-05ac-4061-ba7c-ad9ea39417e6', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:53:33.095973 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f9291ece-bfaa-4756-85ee-2c46898c83e0 tempest-AttachSCSIVolumeTestJSON-1730679280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c29b090-fca8-46be-af00-a4ac8ce7bdf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:53:33.100736 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f9291ece-bfaa-4756-85ee-2c46898c83e0 tempest-AttachSCSIVolumeTestJSON-1730679280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c29b090-fca8-46be-af00-a4ac8ce7bdf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:53:33.107464 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f9291ece-bfaa-4756-85ee-2c46898c83e0 tempest-AttachSCSIVolumeTestJSON-1730679280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be969d1d-6a9d-47b7-92ea-cd008e29bd52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:53:33.109523 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-f9291ece-bfaa-4756-85ee-2c46898c83e0 tempest-AttachSCSIVolumeTestJSON-1730679280 None] Volume 3ffd61d7-05ac-4061-ba7c-ad9ea39417e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ffd61d7-05ac-4061-ba7c-ad9ea39417e6', 'volume_size': 1} May 07 21:53:33.110930 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-f9291ece-bfaa-4756-85ee-2c46898c83e0 tempest-AttachSCSIVolumeTestJSON-1730679280 None] creating volume 'volume-3ffd61d7-05ac-4061-ba7c-ad9ea39417e6' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 21:53:33.112091 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-f9291ece-bfaa-4756-85ee-2c46898c83e0 tempest-AttachSCSIVolumeTestJSON-1730679280 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:53:33.232573 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-f9291ece-bfaa-4756-85ee-2c46898c83e0 tempest-AttachSCSIVolumeTestJSON-1730679280 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 21:53:33.234003 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-f9291ece-bfaa-4756-85ee-2c46898c83e0 tempest-AttachSCSIVolumeTestJSON-1730679280 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 21:53:33.241140 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f9291ece-bfaa-4756-85ee-2c46898c83e0 tempest-AttachSCSIVolumeTestJSON-1730679280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be969d1d-6a9d-47b7-92ea-cd008e29bd52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ffd61d7-05ac-4061-ba7c-ad9ea39417e6', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:53:33.248099 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f9291ece-bfaa-4756-85ee-2c46898c83e0 tempest-AttachSCSIVolumeTestJSON-1730679280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b034b0e-d575-4570-a47d-e08636261b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:53:33.268658 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-f9291ece-bfaa-4756-85ee-2c46898c83e0 tempest-AttachSCSIVolumeTestJSON-1730679280 None] Volume volume-3ffd61d7-05ac-4061-ba7c-ad9ea39417e6 (3ffd61d7-05ac-4061-ba7c-ad9ea39417e6): created successfully May 07 21:53:33.282917 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f9291ece-bfaa-4756-85ee-2c46898c83e0 tempest-AttachSCSIVolumeTestJSON-1730679280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b034b0e-d575-4570-a47d-e08636261b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:53:33.300489 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f9291ece-bfaa-4756-85ee-2c46898c83e0 tempest-AttachSCSIVolumeTestJSON-1730679280 None] Flow 'volume_create_manager' (1081168e-3ab1-456c-a416-70cdcf5ea14d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 21:53:33.319907 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-f9291ece-bfaa-4756-85ee-2c46898c83e0 tempest-AttachSCSIVolumeTestJSON-1730679280 None] Created volume successfully. May 07 21:53:35.011690 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-4fe6c108-7adb-4151-bb8d-6fb2ae0517f5 req-25b30be7-4b1c-4695-b2c3-2685833c2ac5 tempest-AttachSCSIVolumeTestJSON-1730679280 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 21:53:36.045219 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-4fe6c108-7adb-4151-bb8d-6fb2ae0517f5 req-25b30be7-4b1c-4695-b2c3-2685833c2ac5 tempest-AttachSCSIVolumeTestJSON-1730679280 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.033s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 21:53:36.046871 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-4fe6c108-7adb-4151-bb8d-6fb2ae0517f5 req-25b30be7-4b1c-4695-b2c3-2685833c2ac5 tempest-AttachSCSIVolumeTestJSON-1730679280 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-3ffd61d7-05ac-4061-ba7c-ad9ea39417e6', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3ca0b836-1cfe-436a-b0fa-deb74d3203d9', 'volume_id': '3ffd61d7-05ac-4061-ba7c-ad9ea39417e6', 'discard': True}} {{(pid=129946) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 07 21:53:36.102394 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-4fe6c108-7adb-4151-bb8d-6fb2ae0517f5 req-25b30be7-4b1c-4695-b2c3-2685833c2ac5 tempest-AttachSCSIVolumeTestJSON-1730679280 None] Connection info returned from driver {'name': 'volumes/volume-3ffd61d7-05ac-4061-ba7c-ad9ea39417e6', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '3ffd61d7-05ac-4061-ba7c-ad9ea39417e6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '154b5c20-874b-420f-af8d-7cfc4cba4851'} {{(pid=129946) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 07 21:53:36.174045 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-4fe6c108-7adb-4151-bb8d-6fb2ae0517f5 req-25b30be7-4b1c-4695-b2c3-2685833c2ac5 tempest-AttachSCSIVolumeTestJSON-1730679280 None] attachment_update completed successfully. May 07 21:53:40.029855 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-cb68ec99-a3c7-41da-96b9-a4f8a3deae91 req-c808bd9c-ee96-4062-a89d-e07681300087 tempest-AttachSCSIVolumeTestJSON-1730679280 None] Terminate volume connection completed successfully. May 07 21:53:40.031020 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-cb68ec99-a3c7-41da-96b9-a4f8a3deae91 req-c808bd9c-ee96-4062-a89d-e07681300087 tempest-AttachSCSIVolumeTestJSON-1730679280 None] Deleting attachment 154b5c20-874b-420f-af8d-7cfc4cba4851. {{(pid=129946) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 07 21:53:55.456621 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-09f99545-2746-4d43-9d06-0af0ade04a2a tempest-AttachSCSIVolumeTestJSON-1730679280 None] Lock "b'cinder-3ffd61d7-05ac-4061-ba7c-ad9ea39417e6-delete_volume'" acquired by "delete_volume" :: waited 0.032s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 21:53:55.594294 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-09f99545-2746-4d43-9d06-0af0ade04a2a tempest-AttachSCSIVolumeTestJSON-1730679280 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:53:55.685187 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-09f99545-2746-4d43-9d06-0af0ade04a2a tempest-AttachSCSIVolumeTestJSON-1730679280 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 21:53:55.685735 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-09f99545-2746-4d43-9d06-0af0ade04a2a tempest-AttachSCSIVolumeTestJSON-1730679280 None] Volume volume-3ffd61d7-05ac-4061-ba7c-ad9ea39417e6 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 21:53:55.699126 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-09f99545-2746-4d43-9d06-0af0ade04a2a tempest-AttachSCSIVolumeTestJSON-1730679280 None] deleting rbd volume volume-3ffd61d7-05ac-4061-ba7c-ad9ea39417e6 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 21:53:56.355710 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-09f99545-2746-4d43-9d06-0af0ade04a2a tempest-AttachSCSIVolumeTestJSON-1730679280 None] Created reservations ['f2aae6fe-f587-4f7c-9cd9-3a8e7c23b3d7', '201331a2-1481-40c5-866d-d127186be732', '9783481e-4fe5-491d-b62a-aab8c9a36a5c', 'c40bd6cf-e4da-4500-9b01-0a47f0dabe3e'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 21:53:56.441448 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-09f99545-2746-4d43-9d06-0af0ade04a2a tempest-AttachSCSIVolumeTestJSON-1730679280 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:53:56.530276 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-09f99545-2746-4d43-9d06-0af0ade04a2a tempest-AttachSCSIVolumeTestJSON-1730679280 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:53:56.590161 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-09f99545-2746-4d43-9d06-0af0ade04a2a tempest-AttachSCSIVolumeTestJSON-1730679280 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 21:53:56.596006 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-09f99545-2746-4d43-9d06-0af0ade04a2a tempest-AttachSCSIVolumeTestJSON-1730679280 None] Deleted volume successfully. May 07 21:53:56.636962 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-09f99545-2746-4d43-9d06-0af0ade04a2a tempest-AttachSCSIVolumeTestJSON-1730679280 None] Lock "b'cinder-3ffd61d7-05ac-4061-ba7c-ad9ea39417e6-delete_volume'" released by "delete_volume" :: held 1.181s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 21:54:30.739351 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 21:54:30.741058 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:54:30.805270 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:54:30.839926 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 21:54:32.026791 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-71f1eb6a-bb3e-4e0e-8588-8f9f9057af20 tempest-TaggedBootDevicesTest-1550846050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 21:54:32.073113 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-71f1eb6a-bb3e-4e0e-8588-8f9f9057af20 tempest-TaggedBootDevicesTest-1550846050 None] Flow 'volume_create_manager' (7391881f-7e35-4191-a7db-d5a01d4ca805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 21:54:32.085077 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-71f1eb6a-bb3e-4e0e-8588-8f9f9057af20 tempest-TaggedBootDevicesTest-1550846050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e9938f9-fd01-475f-bad4-6393cef72adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:54:32.107039 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-71f1eb6a-bb3e-4e0e-8588-8f9f9057af20 tempest-TaggedBootDevicesTest-1550846050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e9938f9-fd01-475f-bad4-6393cef72adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T21:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1859407684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b5a9abca-fd78-4787-87fc-9e321869b37d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70a2fded25c74c839c01e55a91e7f7fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T21:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T21:54:32Z,use_quota=True,user_id='58c7ff193f244ddfa887908f05a920c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:54:32.114863 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-71f1eb6a-bb3e-4e0e-8588-8f9f9057af20 tempest-TaggedBootDevicesTest-1550846050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4c0bd5f-cf76-4dca-85b9-1ec814c507c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:54:32.123003 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-71f1eb6a-bb3e-4e0e-8588-8f9f9057af20 tempest-TaggedBootDevicesTest-1550846050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4c0bd5f-cf76-4dca-85b9-1ec814c507c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:54:32.129104 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-71f1eb6a-bb3e-4e0e-8588-8f9f9057af20 tempest-TaggedBootDevicesTest-1550846050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c604a67a-43c6-4521-ad73-f7fea8f65430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:54:32.283879 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-71f1eb6a-bb3e-4e0e-8588-8f9f9057af20 tempest-TaggedBootDevicesTest-1550846050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c604a67a-43c6-4521-ad73-f7fea8f65430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b5a9abca-fd78-4787-87fc-9e321869b37d', 'volume_name': 'volume-b5a9abca-fd78-4787-87fc-9e321869b37d', 'volume_size': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e2f828af0706465883131e16cb564d05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'created_at': datetime.datetime(2022, 5, 7, 21, 36, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:54:32.290500 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-71f1eb6a-bb3e-4e0e-8588-8f9f9057af20 tempest-TaggedBootDevicesTest-1550846050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c21ae60-8f48-486c-bcdc-b66e5864b46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:54:32.296418 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-71f1eb6a-bb3e-4e0e-8588-8f9f9057af20 tempest-TaggedBootDevicesTest-1550846050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c21ae60-8f48-486c-bcdc-b66e5864b46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:54:32.301255 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-71f1eb6a-bb3e-4e0e-8588-8f9f9057af20 tempest-TaggedBootDevicesTest-1550846050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09692ba1-00d4-4037-a9d8-e3b68343c716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:54:32.304474 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-71f1eb6a-bb3e-4e0e-8588-8f9f9057af20 tempest-TaggedBootDevicesTest-1550846050 None] Volume b5a9abca-fd78-4787-87fc-9e321869b37d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b5a9abca-fd78-4787-87fc-9e321869b37d', 'volume_size': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e2f828af0706465883131e16cb564d05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'created_at': datetime.datetime(2022, 5, 7, 21, 36, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } May 07 21:54:32.305316 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-71f1eb6a-bb3e-4e0e-8588-8f9f9057af20 tempest-TaggedBootDevicesTest-1550846050 None] Cloning b5a9abca-fd78-4787-87fc-9e321869b37d from image 3756ae98-5c12-48e7-920e-ef5d1dd5543c at location (None, None). {{(pid=129946) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} May 07 21:54:32.321304 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-71f1eb6a-bb3e-4e0e-8588-8f9f9057af20 tempest-TaggedBootDevicesTest-1550846050 None] Lock "b'cinder-3756ae98-5c12-48e7-920e-ef5d1dd5543c'" acquired by "_prepare_image_cache_entry" :: waited 0.014s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 21:54:32.336115 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-71f1eb6a-bb3e-4e0e-8588-8f9f9057af20 tempest-TaggedBootDevicesTest-1550846050 None] Found image-volume cache entry: {'id': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'volume_id': '82279f40-9683-441f-a541-0db8b9177f48', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9), 'last_used': datetime.datetime(2022, 5, 7, 21, 54, 32, 327678)}. {{(pid=129946) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 07 21:54:32.336876 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-71f1eb6a-bb3e-4e0e-8588-8f9f9057af20 tempest-TaggedBootDevicesTest-1550846050 None] Image-volume cache entry image_update_at = 2022-05-07 21:37:09+00:00, requested image updated_at = 2022-05-07 21:37:09+00:00. {{(pid=129946) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 07 21:54:32.337442 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-71f1eb6a-bb3e-4e0e-8588-8f9f9057af20 tempest-TaggedBootDevicesTest-1550846050 None] Found cache entry for image = 3756ae98-5c12-48e7-920e-ef5d1dd5543c on host ncdv-master-1@ceph#ceph. {{(pid=129946) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} May 07 21:54:32.343400 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-71f1eb6a-bb3e-4e0e-8588-8f9f9057af20 tempest-TaggedBootDevicesTest-1550846050 None] Lock "b'cinder-3756ae98-5c12-48e7-920e-ef5d1dd5543c'" released by "_prepare_image_cache_entry" :: held 0.023s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 21:54:32.344708 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-71f1eb6a-bb3e-4e0e-8588-8f9f9057af20 tempest-TaggedBootDevicesTest-1550846050 None] Attempting to retrieve cache entry for image = 3756ae98-5c12-48e7-920e-ef5d1dd5543c on host ncdv-master-1@ceph#ceph. {{(pid=129946) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} May 07 21:54:32.363467 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-71f1eb6a-bb3e-4e0e-8588-8f9f9057af20 tempest-TaggedBootDevicesTest-1550846050 None] Found image-volume cache entry: {'id': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'volume_id': '82279f40-9683-441f-a541-0db8b9177f48', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9), 'last_used': datetime.datetime(2022, 5, 7, 21, 54, 32, 358854)}. {{(pid=129946) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 07 21:54:32.363912 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-71f1eb6a-bb3e-4e0e-8588-8f9f9057af20 tempest-TaggedBootDevicesTest-1550846050 None] Image-volume cache entry image_update_at = 2022-05-07 21:37:09+00:00, requested image updated_at = 2022-05-07 21:37:09+00:00. {{(pid=129946) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 07 21:54:32.364542 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-71f1eb6a-bb3e-4e0e-8588-8f9f9057af20 tempest-TaggedBootDevicesTest-1550846050 None] Creating from source image-volume 82279f40-9683-441f-a541-0db8b9177f48 {{(pid=129946) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} May 07 21:54:32.379990 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-71f1eb6a-bb3e-4e0e-8588-8f9f9057af20 tempest-TaggedBootDevicesTest-1550846050 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:54:32.491487 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-71f1eb6a-bb3e-4e0e-8588-8f9f9057af20 tempest-TaggedBootDevicesTest-1550846050 None] creating snapshot='volume-b5a9abca-fd78-4787-87fc-9e321869b37d.clone_snap' {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} May 07 21:54:33.252565 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-71f1eb6a-bb3e-4e0e-8588-8f9f9057af20 tempest-TaggedBootDevicesTest-1550846050 None] cloning 'volume-82279f40-9683-441f-a541-0db8b9177f48@volume-b5a9abca-fd78-4787-87fc-9e321869b37d.clone_snap' to 'volume-b5a9abca-fd78-4787-87fc-9e321869b37d' {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 07 21:54:33.593001 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-71f1eb6a-bb3e-4e0e-8588-8f9f9057af20 tempest-TaggedBootDevicesTest-1550846050 None] Volume volume-3864f924-91b4-4015-ab37-8bdbf8ad652d.deleted is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 21:54:33.594224 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-71f1eb6a-bb3e-4e0e-8588-8f9f9057af20 tempest-TaggedBootDevicesTest-1550846050 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 21:54:33.594932 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-71f1eb6a-bb3e-4e0e-8588-8f9f9057af20 tempest-TaggedBootDevicesTest-1550846050 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 21:54:33.679611 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-71f1eb6a-bb3e-4e0e-8588-8f9f9057af20 tempest-TaggedBootDevicesTest-1550846050 None] clone created successfully {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} May 07 21:54:33.681189 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.volume_utils [None req-71f1eb6a-bb3e-4e0e-8588-8f9f9057af20 tempest-TaggedBootDevicesTest-1550846050 None] Marking volume b5a9abca-fd78-4787-87fc-9e321869b37d as bootable. {{(pid=129946) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} May 07 21:54:33.694692 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-71f1eb6a-bb3e-4e0e-8588-8f9f9057af20 tempest-TaggedBootDevicesTest-1550846050 None] Copying metadata from image 3756ae98-5c12-48e7-920e-ef5d1dd5543c to b5a9abca-fd78-4787-87fc-9e321869b37d. {{(pid=129946) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} May 07 21:54:33.695569 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-71f1eb6a-bb3e-4e0e-8588-8f9f9057af20 tempest-TaggedBootDevicesTest-1550846050 None] Creating volume glance metadata for volume b5a9abca-fd78-4787-87fc-9e321869b37d backed by image 3756ae98-5c12-48e7-920e-ef5d1dd5543c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129946) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} May 07 21:54:33.850209 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-71f1eb6a-bb3e-4e0e-8588-8f9f9057af20 tempest-TaggedBootDevicesTest-1550846050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09692ba1-00d4-4037-a9d8-e3b68343c716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5a9abca-fd78-4787-87fc-9e321869b37d', 'volume_size': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e2f828af0706465883131e16cb564d05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'created_at': datetime.datetime(2022, 5, 7, 21, 36, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:54:33.861180 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-71f1eb6a-bb3e-4e0e-8588-8f9f9057af20 tempest-TaggedBootDevicesTest-1550846050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ed51d8b-a54a-43d1-927b-3bb658e33b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:54:33.880207 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-71f1eb6a-bb3e-4e0e-8588-8f9f9057af20 tempest-TaggedBootDevicesTest-1550846050 None] Volume volume-b5a9abca-fd78-4787-87fc-9e321869b37d (b5a9abca-fd78-4787-87fc-9e321869b37d): created successfully May 07 21:54:33.884080 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-71f1eb6a-bb3e-4e0e-8588-8f9f9057af20 tempest-TaggedBootDevicesTest-1550846050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ed51d8b-a54a-43d1-927b-3bb658e33b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:54:33.900179 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-71f1eb6a-bb3e-4e0e-8588-8f9f9057af20 tempest-TaggedBootDevicesTest-1550846050 None] Flow 'volume_create_manager' (7391881f-7e35-4191-a7db-d5a01d4ca805) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 21:54:33.924187 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-71f1eb6a-bb3e-4e0e-8588-8f9f9057af20 tempest-TaggedBootDevicesTest-1550846050 None] Created volume successfully. May 07 21:54:34.943031 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-57623631-827c-4687-80b6-52a80502828c tempest-TaggedBootDevicesTest-1550846050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 21:54:34.970015 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-57623631-827c-4687-80b6-52a80502828c tempest-TaggedBootDevicesTest-1550846050 None] Flow 'volume_create_manager' (d8695195-4924-429a-ab74-c3777b1e0bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 21:54:34.987284 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-57623631-827c-4687-80b6-52a80502828c tempest-TaggedBootDevicesTest-1550846050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29301f40-d676-4078-9e9f-e5046f225264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:54:35.012648 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-57623631-827c-4687-80b6-52a80502828c tempest-TaggedBootDevicesTest-1550846050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29301f40-d676-4078-9e9f-e5046f225264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T21:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-982034443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=30fc7619-db02-4f4d-8966-a00216d45663,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70a2fded25c74c839c01e55a91e7f7fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T21:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T21:54:35Z,use_quota=True,user_id='58c7ff193f244ddfa887908f05a920c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:54:35.021383 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-57623631-827c-4687-80b6-52a80502828c tempest-TaggedBootDevicesTest-1550846050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3972b124-1e62-4359-ad20-43e28926ead8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:54:35.043558 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-57623631-827c-4687-80b6-52a80502828c tempest-TaggedBootDevicesTest-1550846050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3972b124-1e62-4359-ad20-43e28926ead8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:54:35.056602 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-57623631-827c-4687-80b6-52a80502828c tempest-TaggedBootDevicesTest-1550846050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a92fb996-bb39-4e54-8eaa-78b79b3dd7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:54:35.066631 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-57623631-827c-4687-80b6-52a80502828c tempest-TaggedBootDevicesTest-1550846050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a92fb996-bb39-4e54-8eaa-78b79b3dd7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30fc7619-db02-4f4d-8966-a00216d45663', 'volume_name': 'volume-30fc7619-db02-4f4d-8966-a00216d45663', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:54:35.081491 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-57623631-827c-4687-80b6-52a80502828c tempest-TaggedBootDevicesTest-1550846050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56812803-3ee7-47b5-a748-f76c0462c699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:54:35.091477 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-57623631-827c-4687-80b6-52a80502828c tempest-TaggedBootDevicesTest-1550846050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56812803-3ee7-47b5-a748-f76c0462c699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:54:35.115275 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-57623631-827c-4687-80b6-52a80502828c tempest-TaggedBootDevicesTest-1550846050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fb7925a-c190-4b4c-8c92-c2ba4317fc1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:54:35.122802 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-57623631-827c-4687-80b6-52a80502828c tempest-TaggedBootDevicesTest-1550846050 None] Volume 30fc7619-db02-4f4d-8966-a00216d45663: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30fc7619-db02-4f4d-8966-a00216d45663', 'volume_size': 1} May 07 21:54:35.123223 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-57623631-827c-4687-80b6-52a80502828c tempest-TaggedBootDevicesTest-1550846050 None] creating volume 'volume-30fc7619-db02-4f4d-8966-a00216d45663' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 21:54:35.124721 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-57623631-827c-4687-80b6-52a80502828c tempest-TaggedBootDevicesTest-1550846050 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:54:35.298905 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-57623631-827c-4687-80b6-52a80502828c tempest-TaggedBootDevicesTest-1550846050 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 21:54:35.300456 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-57623631-827c-4687-80b6-52a80502828c tempest-TaggedBootDevicesTest-1550846050 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 21:54:35.305870 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-57623631-827c-4687-80b6-52a80502828c tempest-TaggedBootDevicesTest-1550846050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fb7925a-c190-4b4c-8c92-c2ba4317fc1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30fc7619-db02-4f4d-8966-a00216d45663', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:54:35.314825 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-57623631-827c-4687-80b6-52a80502828c tempest-TaggedBootDevicesTest-1550846050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (185ccdde-3626-4774-a474-39f4d91025fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:54:35.327489 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-57623631-827c-4687-80b6-52a80502828c tempest-TaggedBootDevicesTest-1550846050 None] Volume volume-30fc7619-db02-4f4d-8966-a00216d45663 (30fc7619-db02-4f4d-8966-a00216d45663): created successfully May 07 21:54:35.334602 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-57623631-827c-4687-80b6-52a80502828c tempest-TaggedBootDevicesTest-1550846050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (185ccdde-3626-4774-a474-39f4d91025fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:54:35.342265 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-57623631-827c-4687-80b6-52a80502828c tempest-TaggedBootDevicesTest-1550846050 None] Flow 'volume_create_manager' (d8695195-4924-429a-ab74-c3777b1e0bd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 21:54:35.360586 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-57623631-827c-4687-80b6-52a80502828c tempest-TaggedBootDevicesTest-1550846050 None] Created volume successfully. May 07 21:54:37.031414 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9a666ed-c279-456e-ae41-7bf596bed3dc tempest-TaggedBootDevicesTest-1550846050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 21:54:37.077264 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f9a666ed-c279-456e-ae41-7bf596bed3dc tempest-TaggedBootDevicesTest-1550846050 None] Flow 'volume_create_manager' (f5d2c50c-8060-4d29-81e7-a8b5e87666f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 21:54:37.103287 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f9a666ed-c279-456e-ae41-7bf596bed3dc tempest-TaggedBootDevicesTest-1550846050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (356ceda8-b89f-4670-92c9-03344220c9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:54:37.178278 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f9a666ed-c279-456e-ae41-7bf596bed3dc tempest-TaggedBootDevicesTest-1550846050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (356ceda8-b89f-4670-92c9-03344220c9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T21:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1124403384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=edf0b8e8-8a9a-4d7b-95eb-46163eae5081,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70a2fded25c74c839c01e55a91e7f7fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T21:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T21:54:37Z,use_quota=True,user_id='58c7ff193f244ddfa887908f05a920c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:54:37.201573 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f9a666ed-c279-456e-ae41-7bf596bed3dc tempest-TaggedBootDevicesTest-1550846050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a159517d-49ee-44eb-a8ba-55538bd8745b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:54:37.214314 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f9a666ed-c279-456e-ae41-7bf596bed3dc tempest-TaggedBootDevicesTest-1550846050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a159517d-49ee-44eb-a8ba-55538bd8745b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:54:37.226800 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f9a666ed-c279-456e-ae41-7bf596bed3dc tempest-TaggedBootDevicesTest-1550846050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fafec49-d614-4eb8-bbb2-8aee63546ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:54:37.237473 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f9a666ed-c279-456e-ae41-7bf596bed3dc tempest-TaggedBootDevicesTest-1550846050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fafec49-d614-4eb8-bbb2-8aee63546ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edf0b8e8-8a9a-4d7b-95eb-46163eae5081', 'volume_name': 'volume-edf0b8e8-8a9a-4d7b-95eb-46163eae5081', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:54:37.252681 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f9a666ed-c279-456e-ae41-7bf596bed3dc tempest-TaggedBootDevicesTest-1550846050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fea6f07b-fb3e-4b6b-a217-38f9f91ffad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:54:37.262000 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f9a666ed-c279-456e-ae41-7bf596bed3dc tempest-TaggedBootDevicesTest-1550846050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fea6f07b-fb3e-4b6b-a217-38f9f91ffad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:54:37.277981 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f9a666ed-c279-456e-ae41-7bf596bed3dc tempest-TaggedBootDevicesTest-1550846050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c07d95a-620e-46f3-8de4-43a33eee16e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:54:37.279183 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-f9a666ed-c279-456e-ae41-7bf596bed3dc tempest-TaggedBootDevicesTest-1550846050 None] Volume edf0b8e8-8a9a-4d7b-95eb-46163eae5081: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edf0b8e8-8a9a-4d7b-95eb-46163eae5081', 'volume_size': 1} May 07 21:54:37.279513 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-f9a666ed-c279-456e-ae41-7bf596bed3dc tempest-TaggedBootDevicesTest-1550846050 None] creating volume 'volume-edf0b8e8-8a9a-4d7b-95eb-46163eae5081' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 21:54:37.280184 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-f9a666ed-c279-456e-ae41-7bf596bed3dc tempest-TaggedBootDevicesTest-1550846050 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:54:37.463571 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-f9a666ed-c279-456e-ae41-7bf596bed3dc tempest-TaggedBootDevicesTest-1550846050 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 21:54:37.463959 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-f9a666ed-c279-456e-ae41-7bf596bed3dc tempest-TaggedBootDevicesTest-1550846050 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 21:54:37.473243 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f9a666ed-c279-456e-ae41-7bf596bed3dc tempest-TaggedBootDevicesTest-1550846050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c07d95a-620e-46f3-8de4-43a33eee16e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edf0b8e8-8a9a-4d7b-95eb-46163eae5081', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:54:37.491387 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f9a666ed-c279-456e-ae41-7bf596bed3dc tempest-TaggedBootDevicesTest-1550846050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f0e1f8d-3f30-4fc5-b1cb-3455b62f85b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:54:37.519329 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-f9a666ed-c279-456e-ae41-7bf596bed3dc tempest-TaggedBootDevicesTest-1550846050 None] Volume volume-edf0b8e8-8a9a-4d7b-95eb-46163eae5081 (edf0b8e8-8a9a-4d7b-95eb-46163eae5081): created successfully May 07 21:54:37.523456 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f9a666ed-c279-456e-ae41-7bf596bed3dc tempest-TaggedBootDevicesTest-1550846050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f0e1f8d-3f30-4fc5-b1cb-3455b62f85b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:54:37.537785 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f9a666ed-c279-456e-ae41-7bf596bed3dc tempest-TaggedBootDevicesTest-1550846050 None] Flow 'volume_create_manager' (f5d2c50c-8060-4d29-81e7-a8b5e87666f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 21:54:37.572376 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-f9a666ed-c279-456e-ae41-7bf596bed3dc tempest-TaggedBootDevicesTest-1550846050 None] Created volume successfully. May 07 21:54:46.796116 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cec1c8a-1ddf-4787-8cc4-c1c55f02b974 tempest-AttachVolumeShelveTestJSON-2118378341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 21:54:46.839749 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-2cec1c8a-1ddf-4787-8cc4-c1c55f02b974 tempest-AttachVolumeShelveTestJSON-2118378341 None] Flow 'volume_create_manager' (332707ba-bafd-4d2f-be10-af1eb99796e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 21:54:46.857921 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-2cec1c8a-1ddf-4787-8cc4-c1c55f02b974 tempest-AttachVolumeShelveTestJSON-2118378341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44671a9f-7681-4a71-8076-f8ad100eeddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:54:46.901985 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-2cec1c8a-1ddf-4787-8cc4-c1c55f02b974 tempest-AttachVolumeShelveTestJSON-2118378341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44671a9f-7681-4a71-8076-f8ad100eeddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T21:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-127352127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8544d5aa-b3ac-47bc-9200-f41820a8209c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93c3c71171814bb7b1018904086ad506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T21:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T21:54:47Z,use_quota=True,user_id='bdc18dc6c5214fbb9c1fa61eeb514cc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:54:46.907584 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-2cec1c8a-1ddf-4787-8cc4-c1c55f02b974 tempest-AttachVolumeShelveTestJSON-2118378341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5dcf12e-978c-4983-a40e-f92d85572979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:54:46.923707 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-2cec1c8a-1ddf-4787-8cc4-c1c55f02b974 tempest-AttachVolumeShelveTestJSON-2118378341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5dcf12e-978c-4983-a40e-f92d85572979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:54:46.942194 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-2cec1c8a-1ddf-4787-8cc4-c1c55f02b974 tempest-AttachVolumeShelveTestJSON-2118378341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16b80ba6-6924-4b1e-b0e8-fdaafc177e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:54:46.948534 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-2cec1c8a-1ddf-4787-8cc4-c1c55f02b974 tempest-AttachVolumeShelveTestJSON-2118378341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16b80ba6-6924-4b1e-b0e8-fdaafc177e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8544d5aa-b3ac-47bc-9200-f41820a8209c', 'volume_name': 'volume-8544d5aa-b3ac-47bc-9200-f41820a8209c', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:54:46.969536 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-2cec1c8a-1ddf-4787-8cc4-c1c55f02b974 tempest-AttachVolumeShelveTestJSON-2118378341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (094c326e-c534-416a-8004-f4ef89825a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:54:46.974705 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-2cec1c8a-1ddf-4787-8cc4-c1c55f02b974 tempest-AttachVolumeShelveTestJSON-2118378341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (094c326e-c534-416a-8004-f4ef89825a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:54:46.981411 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-2cec1c8a-1ddf-4787-8cc4-c1c55f02b974 tempest-AttachVolumeShelveTestJSON-2118378341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd4b50f2-8cf5-4021-89eb-b1846bde33c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:54:46.983153 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-2cec1c8a-1ddf-4787-8cc4-c1c55f02b974 tempest-AttachVolumeShelveTestJSON-2118378341 None] Volume 8544d5aa-b3ac-47bc-9200-f41820a8209c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8544d5aa-b3ac-47bc-9200-f41820a8209c', 'volume_size': 1} May 07 21:54:46.983821 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-2cec1c8a-1ddf-4787-8cc4-c1c55f02b974 tempest-AttachVolumeShelveTestJSON-2118378341 None] creating volume 'volume-8544d5aa-b3ac-47bc-9200-f41820a8209c' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 21:54:46.984785 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-2cec1c8a-1ddf-4787-8cc4-c1c55f02b974 tempest-AttachVolumeShelveTestJSON-2118378341 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:54:47.125876 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-2cec1c8a-1ddf-4787-8cc4-c1c55f02b974 tempest-AttachVolumeShelveTestJSON-2118378341 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 21:54:47.126252 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-2cec1c8a-1ddf-4787-8cc4-c1c55f02b974 tempest-AttachVolumeShelveTestJSON-2118378341 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 21:54:47.133479 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-2cec1c8a-1ddf-4787-8cc4-c1c55f02b974 tempest-AttachVolumeShelveTestJSON-2118378341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd4b50f2-8cf5-4021-89eb-b1846bde33c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8544d5aa-b3ac-47bc-9200-f41820a8209c', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:54:47.138692 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-2cec1c8a-1ddf-4787-8cc4-c1c55f02b974 tempest-AttachVolumeShelveTestJSON-2118378341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (224e2ea1-d4a6-4dd6-902f-fdfb383f1573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:54:47.173004 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-2cec1c8a-1ddf-4787-8cc4-c1c55f02b974 tempest-AttachVolumeShelveTestJSON-2118378341 None] Volume volume-8544d5aa-b3ac-47bc-9200-f41820a8209c (8544d5aa-b3ac-47bc-9200-f41820a8209c): created successfully May 07 21:54:47.179823 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-2cec1c8a-1ddf-4787-8cc4-c1c55f02b974 tempest-AttachVolumeShelveTestJSON-2118378341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (224e2ea1-d4a6-4dd6-902f-fdfb383f1573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:54:47.189381 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-2cec1c8a-1ddf-4787-8cc4-c1c55f02b974 tempest-AttachVolumeShelveTestJSON-2118378341 None] Flow 'volume_create_manager' (332707ba-bafd-4d2f-be10-af1eb99796e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 21:54:47.207076 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-2cec1c8a-1ddf-4787-8cc4-c1c55f02b974 tempest-AttachVolumeShelveTestJSON-2118378341 None] Created volume successfully. May 07 21:54:57.194231 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-63e649c1-18e5-4674-9f58-d5b476f8737c req-9ddd6b70-61f3-4c75-9a5e-bdc6b3dfbfb4 tempest-TaggedBootDevicesTest-1550846050 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 21:54:57.874225 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-63e649c1-18e5-4674-9f58-d5b476f8737c req-9ddd6b70-61f3-4c75-9a5e-bdc6b3dfbfb4 tempest-TaggedBootDevicesTest-1550846050 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.680s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 21:54:57.874972 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-63e649c1-18e5-4674-9f58-d5b476f8737c req-9ddd6b70-61f3-4c75-9a5e-bdc6b3dfbfb4 tempest-TaggedBootDevicesTest-1550846050 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b5a9abca-fd78-4787-87fc-9e321869b37d', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3ca0b836-1cfe-436a-b0fa-deb74d3203d9', 'volume_id': 'b5a9abca-fd78-4787-87fc-9e321869b37d', 'discard': True}} {{(pid=129946) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 07 21:54:57.899508 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-63e649c1-18e5-4674-9f58-d5b476f8737c req-9ddd6b70-61f3-4c75-9a5e-bdc6b3dfbfb4 tempest-TaggedBootDevicesTest-1550846050 None] Connection info returned from driver {'name': 'volumes/volume-b5a9abca-fd78-4787-87fc-9e321869b37d', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'b5a9abca-fd78-4787-87fc-9e321869b37d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '87ddf862-2d54-47e3-9507-856a52795958'} {{(pid=129946) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 07 21:54:57.950580 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-63e649c1-18e5-4674-9f58-d5b476f8737c req-9ddd6b70-61f3-4c75-9a5e-bdc6b3dfbfb4 tempest-TaggedBootDevicesTest-1550846050 None] attachment_update completed successfully. May 07 21:54:58.321745 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-63e649c1-18e5-4674-9f58-d5b476f8737c req-3f0a802e-daba-423a-ab7f-17f1485b9178 tempest-TaggedBootDevicesTest-1550846050 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 21:54:59.120047 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-c23c49a8-da0c-48d3-bf31-1b10773d7698 req-90f524c5-8ca8-4d26-bca6-28470751348e tempest-ServersTestBootFromVolume-513562440 None] Terminate volume connection completed successfully. May 07 21:54:59.121106 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-c23c49a8-da0c-48d3-bf31-1b10773d7698 req-90f524c5-8ca8-4d26-bca6-28470751348e tempest-ServersTestBootFromVolume-513562440 None] Deleting attachment 4dffaa04-ad25-4a8a-835f-371734983470. {{(pid=129946) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 07 21:54:59.375076 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [req-c23c49a8-da0c-48d3-bf31-1b10773d7698 req-8f2e8206-1c36-46d3-8ad9-a754bb2c2aaf tempest-ServersTestBootFromVolume-513562440 None] Lock "b'cinder-03b8428c-d607-4323-a5b3-0814d754827a-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 21:54:59.444436 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-63e649c1-18e5-4674-9f58-d5b476f8737c req-3f0a802e-daba-423a-ab7f-17f1485b9178 tempest-TaggedBootDevicesTest-1550846050 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.123s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 21:54:59.458055 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-63e649c1-18e5-4674-9f58-d5b476f8737c req-3f0a802e-daba-423a-ab7f-17f1485b9178 tempest-TaggedBootDevicesTest-1550846050 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-30fc7619-db02-4f4d-8966-a00216d45663', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3ca0b836-1cfe-436a-b0fa-deb74d3203d9', 'volume_id': '30fc7619-db02-4f4d-8966-a00216d45663', 'discard': True}} {{(pid=129946) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 07 21:54:59.475945 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-c23c49a8-da0c-48d3-bf31-1b10773d7698 req-8f2e8206-1c36-46d3-8ad9-a754bb2c2aaf tempest-ServersTestBootFromVolume-513562440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:54:59.583603 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-c23c49a8-da0c-48d3-bf31-1b10773d7698 req-8f2e8206-1c36-46d3-8ad9-a754bb2c2aaf tempest-ServersTestBootFromVolume-513562440 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 21:54:59.606710 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-c23c49a8-da0c-48d3-bf31-1b10773d7698 req-8f2e8206-1c36-46d3-8ad9-a754bb2c2aaf tempest-ServersTestBootFromVolume-513562440 None] deleting rbd volume volume-03b8428c-d607-4323-a5b3-0814d754827a {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 21:54:59.657334 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-63e649c1-18e5-4674-9f58-d5b476f8737c req-3f0a802e-daba-423a-ab7f-17f1485b9178 tempest-TaggedBootDevicesTest-1550846050 None] Connection info returned from driver {'name': 'volumes/volume-30fc7619-db02-4f4d-8966-a00216d45663', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '30fc7619-db02-4f4d-8966-a00216d45663', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '5eb37c71-e3c0-4e9e-bbbe-bf3306cca096'} {{(pid=129946) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 07 21:54:59.757979 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-63e649c1-18e5-4674-9f58-d5b476f8737c req-3f0a802e-daba-423a-ab7f-17f1485b9178 tempest-TaggedBootDevicesTest-1550846050 None] attachment_update completed successfully. May 07 21:55:00.289743 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-c23c49a8-da0c-48d3-bf31-1b10773d7698 req-8f2e8206-1c36-46d3-8ad9-a754bb2c2aaf tempest-ServersTestBootFromVolume-513562440 None] volume is a clone so cleaning references {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} May 07 21:55:00.338930 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-c23c49a8-da0c-48d3-bf31-1b10773d7698 req-8f2e8206-1c36-46d3-8ad9-a754bb2c2aaf tempest-ServersTestBootFromVolume-513562440 None] deleting parent snapshot volume-03b8428c-d607-4323-a5b3-0814d754827a.clone_snap {{(pid=129946) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} May 07 21:55:01.202889 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-63e649c1-18e5-4674-9f58-d5b476f8737c req-8a89995a-33fe-4dd2-aa3b-0de63e2f5649 tempest-TaggedBootDevicesTest-1550846050 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 21:55:01.307593 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [req-c23c49a8-da0c-48d3-bf31-1b10773d7698 req-8f2e8206-1c36-46d3-8ad9-a754bb2c2aaf tempest-ServersTestBootFromVolume-513562440 None] Created reservations ['71a38ec9-f5e7-4dd7-b05b-e1988c8dc473', '440d5cb4-2652-4f3b-957c-33aa5c17aa72', 'e192e714-7df5-4ae7-9e07-94feee9fa44b', 'cf4be3a8-5dcf-4dfd-8fa1-86638e668323'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 21:55:01.423781 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-c23c49a8-da0c-48d3-bf31-1b10773d7698 req-8f2e8206-1c36-46d3-8ad9-a754bb2c2aaf tempest-ServersTestBootFromVolume-513562440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:55:01.493991 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-c23c49a8-da0c-48d3-bf31-1b10773d7698 req-8f2e8206-1c36-46d3-8ad9-a754bb2c2aaf tempest-ServersTestBootFromVolume-513562440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:55:01.558664 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [req-c23c49a8-da0c-48d3-bf31-1b10773d7698 req-8f2e8206-1c36-46d3-8ad9-a754bb2c2aaf tempest-ServersTestBootFromVolume-513562440 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 21:55:01.566340 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-c23c49a8-da0c-48d3-bf31-1b10773d7698 req-8f2e8206-1c36-46d3-8ad9-a754bb2c2aaf tempest-ServersTestBootFromVolume-513562440 None] Deleted volume successfully. May 07 21:55:01.589662 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [req-c23c49a8-da0c-48d3-bf31-1b10773d7698 req-8f2e8206-1c36-46d3-8ad9-a754bb2c2aaf tempest-ServersTestBootFromVolume-513562440 None] Lock "b'cinder-03b8428c-d607-4323-a5b3-0814d754827a-delete_volume'" released by "delete_volume" :: held 2.216s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 21:55:02.333081 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-63e649c1-18e5-4674-9f58-d5b476f8737c req-8a89995a-33fe-4dd2-aa3b-0de63e2f5649 tempest-TaggedBootDevicesTest-1550846050 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.130s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 21:55:02.333819 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-63e649c1-18e5-4674-9f58-d5b476f8737c req-8a89995a-33fe-4dd2-aa3b-0de63e2f5649 tempest-TaggedBootDevicesTest-1550846050 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-edf0b8e8-8a9a-4d7b-95eb-46163eae5081', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3ca0b836-1cfe-436a-b0fa-deb74d3203d9', 'volume_id': 'edf0b8e8-8a9a-4d7b-95eb-46163eae5081', 'discard': True}} {{(pid=129946) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 07 21:55:02.359734 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-63e649c1-18e5-4674-9f58-d5b476f8737c req-8a89995a-33fe-4dd2-aa3b-0de63e2f5649 tempest-TaggedBootDevicesTest-1550846050 None] Connection info returned from driver {'name': 'volumes/volume-edf0b8e8-8a9a-4d7b-95eb-46163eae5081', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'edf0b8e8-8a9a-4d7b-95eb-46163eae5081', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '3bd229b2-c3d3-4c7c-a644-104bb1379d65'} {{(pid=129946) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 07 21:55:02.435305 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-63e649c1-18e5-4674-9f58-d5b476f8737c req-8a89995a-33fe-4dd2-aa3b-0de63e2f5649 tempest-TaggedBootDevicesTest-1550846050 None] attachment_update completed successfully. May 07 21:55:30.736691 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 21:55:30.738177 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:55:30.805821 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:55:30.871602 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 21:55:38.158504 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-e3d94404-7540-43b9-b01a-37a5920d486e req-44fad4db-77ec-4b52-a498-ac24408cb0b4 tempest-AttachVolumeShelveTestJSON-2118378341 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 21:55:38.912475 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-e3d94404-7540-43b9-b01a-37a5920d486e req-44fad4db-77ec-4b52-a498-ac24408cb0b4 tempest-AttachVolumeShelveTestJSON-2118378341 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.751s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 21:55:38.914697 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-e3d94404-7540-43b9-b01a-37a5920d486e req-44fad4db-77ec-4b52-a498-ac24408cb0b4 tempest-AttachVolumeShelveTestJSON-2118378341 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-8544d5aa-b3ac-47bc-9200-f41820a8209c', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3ca0b836-1cfe-436a-b0fa-deb74d3203d9', 'volume_id': '8544d5aa-b3ac-47bc-9200-f41820a8209c', 'discard': True}} {{(pid=129946) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 07 21:55:38.944860 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-e3d94404-7540-43b9-b01a-37a5920d486e req-44fad4db-77ec-4b52-a498-ac24408cb0b4 tempest-AttachVolumeShelveTestJSON-2118378341 None] Connection info returned from driver {'name': 'volumes/volume-8544d5aa-b3ac-47bc-9200-f41820a8209c', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '8544d5aa-b3ac-47bc-9200-f41820a8209c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '043e8f93-1846-4013-90f7-6d72a3d79123'} {{(pid=129946) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 07 21:55:39.019875 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-e3d94404-7540-43b9-b01a-37a5920d486e req-44fad4db-77ec-4b52-a498-ac24408cb0b4 tempest-AttachVolumeShelveTestJSON-2118378341 None] attachment_update completed successfully. May 07 21:56:19.930376 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-9995ee03-65ef-4c80-a092-5e77c04e155a tempest-DeleteServersTestJSON-1693230253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 21:56:19.999681 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-9995ee03-65ef-4c80-a092-5e77c04e155a tempest-DeleteServersTestJSON-1693230253 None] Flow 'volume_create_manager' (5090b910-82c6-49d7-8658-fdb39e16a6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 21:56:20.009655 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-9995ee03-65ef-4c80-a092-5e77c04e155a tempest-DeleteServersTestJSON-1693230253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43740e7d-6caa-48ba-a876-4356923b3d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:56:20.061127 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-9995ee03-65ef-4c80-a092-5e77c04e155a tempest-DeleteServersTestJSON-1693230253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43740e7d-6caa-48ba-a876-4356923b3d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T21:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1813635220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a357f932-6e86-441e-992c-5e2d6589be9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85587313eff94af59406aca0c1a96a02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T21:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T21:56:20Z,use_quota=True,user_id='228761ebf4c0406ab0977cabe351ac76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:56:20.090901 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-9995ee03-65ef-4c80-a092-5e77c04e155a tempest-DeleteServersTestJSON-1693230253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (092cd206-8749-48f9-a7e3-585022649745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:56:20.096789 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-9995ee03-65ef-4c80-a092-5e77c04e155a tempest-DeleteServersTestJSON-1693230253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (092cd206-8749-48f9-a7e3-585022649745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:56:20.112614 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-9995ee03-65ef-4c80-a092-5e77c04e155a tempest-DeleteServersTestJSON-1693230253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95fda160-3cbb-4743-bd37-1a962f0cbfd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:56:20.122727 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-9995ee03-65ef-4c80-a092-5e77c04e155a tempest-DeleteServersTestJSON-1693230253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95fda160-3cbb-4743-bd37-1a962f0cbfd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a357f932-6e86-441e-992c-5e2d6589be9a', 'volume_name': 'volume-a357f932-6e86-441e-992c-5e2d6589be9a', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:56:20.144633 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-9995ee03-65ef-4c80-a092-5e77c04e155a tempest-DeleteServersTestJSON-1693230253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcbc5816-ab32-4b53-918d-8a3fae187f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:56:20.149110 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-9995ee03-65ef-4c80-a092-5e77c04e155a tempest-DeleteServersTestJSON-1693230253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcbc5816-ab32-4b53-918d-8a3fae187f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:56:20.162627 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-9995ee03-65ef-4c80-a092-5e77c04e155a tempest-DeleteServersTestJSON-1693230253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaffd46a-f582-46d1-969c-c27bcaa44c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:56:20.164037 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-9995ee03-65ef-4c80-a092-5e77c04e155a tempest-DeleteServersTestJSON-1693230253 None] Volume a357f932-6e86-441e-992c-5e2d6589be9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a357f932-6e86-441e-992c-5e2d6589be9a', 'volume_size': 1} May 07 21:56:20.164556 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-9995ee03-65ef-4c80-a092-5e77c04e155a tempest-DeleteServersTestJSON-1693230253 None] creating volume 'volume-a357f932-6e86-441e-992c-5e2d6589be9a' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 21:56:20.165779 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-9995ee03-65ef-4c80-a092-5e77c04e155a tempest-DeleteServersTestJSON-1693230253 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:56:20.350469 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-9995ee03-65ef-4c80-a092-5e77c04e155a tempest-DeleteServersTestJSON-1693230253 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 21:56:20.354124 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-9995ee03-65ef-4c80-a092-5e77c04e155a tempest-DeleteServersTestJSON-1693230253 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 21:56:20.364826 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-9995ee03-65ef-4c80-a092-5e77c04e155a tempest-DeleteServersTestJSON-1693230253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaffd46a-f582-46d1-969c-c27bcaa44c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a357f932-6e86-441e-992c-5e2d6589be9a', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:56:20.382001 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-9995ee03-65ef-4c80-a092-5e77c04e155a tempest-DeleteServersTestJSON-1693230253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ded0016f-0a29-475d-b1ab-96e95d6a2568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:56:20.425340 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-9995ee03-65ef-4c80-a092-5e77c04e155a tempest-DeleteServersTestJSON-1693230253 None] Volume volume-a357f932-6e86-441e-992c-5e2d6589be9a (a357f932-6e86-441e-992c-5e2d6589be9a): created successfully May 07 21:56:20.447936 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-9995ee03-65ef-4c80-a092-5e77c04e155a tempest-DeleteServersTestJSON-1693230253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ded0016f-0a29-475d-b1ab-96e95d6a2568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:56:20.471126 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-9995ee03-65ef-4c80-a092-5e77c04e155a tempest-DeleteServersTestJSON-1693230253 None] Flow 'volume_create_manager' (5090b910-82c6-49d7-8658-fdb39e16a6a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 21:56:20.497210 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-9995ee03-65ef-4c80-a092-5e77c04e155a tempest-DeleteServersTestJSON-1693230253 None] Created volume successfully. May 07 21:56:22.244703 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-ee1af3fd-6920-4836-a710-ee9cdf0f6098 req-1d8c7f73-6503-478a-a9f0-74331ec83da9 tempest-DeleteServersTestJSON-1693230253 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 21:56:23.571556 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-ee1af3fd-6920-4836-a710-ee9cdf0f6098 req-1d8c7f73-6503-478a-a9f0-74331ec83da9 tempest-DeleteServersTestJSON-1693230253 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.326s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 21:56:23.572691 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-ee1af3fd-6920-4836-a710-ee9cdf0f6098 req-1d8c7f73-6503-478a-a9f0-74331ec83da9 tempest-DeleteServersTestJSON-1693230253 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a357f932-6e86-441e-992c-5e2d6589be9a', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3ca0b836-1cfe-436a-b0fa-deb74d3203d9', 'volume_id': 'a357f932-6e86-441e-992c-5e2d6589be9a', 'discard': True}} {{(pid=129946) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 07 21:56:23.612905 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-ee1af3fd-6920-4836-a710-ee9cdf0f6098 req-1d8c7f73-6503-478a-a9f0-74331ec83da9 tempest-DeleteServersTestJSON-1693230253 None] Connection info returned from driver {'name': 'volumes/volume-a357f932-6e86-441e-992c-5e2d6589be9a', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a357f932-6e86-441e-992c-5e2d6589be9a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'cf666d18-f618-4790-a6bd-83c96ab124eb'} {{(pid=129946) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 07 21:56:23.678336 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-ee1af3fd-6920-4836-a710-ee9cdf0f6098 req-1d8c7f73-6503-478a-a9f0-74331ec83da9 tempest-DeleteServersTestJSON-1693230253 None] attachment_update completed successfully. May 07 21:56:30.323316 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-5eee3e2a-7248-4615-9f7f-0314f4f3baa5 req-3559e918-83a3-4be1-be0a-71142e725f3c tempest-DeleteServersTestJSON-1693230253 None] Terminate volume connection completed successfully. May 07 21:56:30.324459 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-5eee3e2a-7248-4615-9f7f-0314f4f3baa5 req-3559e918-83a3-4be1-be0a-71142e725f3c tempest-DeleteServersTestJSON-1693230253 None] Deleting attachment cf666d18-f618-4790-a6bd-83c96ab124eb. {{(pid=129946) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 07 21:56:30.741333 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 21:56:30.742268 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:56:30.794588 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:56:30.865547 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 21:56:50.036366 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-e00d1740-2d21-49de-8368-c625e85b89f0 req-0dc4cd04-7ace-4d1b-aa99-e8d05a25f304 tempest-AttachVolumeShelveTestJSON-2118378341 None] Terminate volume connection completed successfully. May 07 21:56:50.041679 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-e00d1740-2d21-49de-8368-c625e85b89f0 req-0dc4cd04-7ace-4d1b-aa99-e8d05a25f304 tempest-AttachVolumeShelveTestJSON-2118378341 None] Deleting attachment 043e8f93-1846-4013-90f7-6d72a3d79123. {{(pid=129946) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 07 21:57:30.741473 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 21:57:30.742307 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:57:30.783290 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:57:30.825948 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 21:57:52.279420 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-87c8b588-e404-406c-a398-a6571c2c1d31 tempest-AttachVolumeShelveTestJSON-2118378341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 21:57:52.355821 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-87c8b588-e404-406c-a398-a6571c2c1d31 tempest-AttachVolumeShelveTestJSON-2118378341 None] Flow 'volume_create_manager' (a42019c0-8aa8-4acb-80f2-5c9f2b10387f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 21:57:52.376841 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-87c8b588-e404-406c-a398-a6571c2c1d31 tempest-AttachVolumeShelveTestJSON-2118378341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1d98b81-1ae6-4782-a99b-1d14764519db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:57:52.431435 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-87c8b588-e404-406c-a398-a6571c2c1d31 tempest-AttachVolumeShelveTestJSON-2118378341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1d98b81-1ae6-4782-a99b-1d14764519db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T21:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-374469302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=10f3d102-b557-432f-b1e2-75334003ed87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93c3c71171814bb7b1018904086ad506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T21:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T21:57:52Z,use_quota=True,user_id='bdc18dc6c5214fbb9c1fa61eeb514cc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:57:52.449075 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-87c8b588-e404-406c-a398-a6571c2c1d31 tempest-AttachVolumeShelveTestJSON-2118378341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ba57fc5-f56c-4e7a-b876-df3545e53e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:57:52.458087 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-87c8b588-e404-406c-a398-a6571c2c1d31 tempest-AttachVolumeShelveTestJSON-2118378341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ba57fc5-f56c-4e7a-b876-df3545e53e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:57:52.464076 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-87c8b588-e404-406c-a398-a6571c2c1d31 tempest-AttachVolumeShelveTestJSON-2118378341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2621118-5fb4-4dd5-b476-ef7571d6dc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:57:52.469441 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-87c8b588-e404-406c-a398-a6571c2c1d31 tempest-AttachVolumeShelveTestJSON-2118378341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2621118-5fb4-4dd5-b476-ef7571d6dc24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10f3d102-b557-432f-b1e2-75334003ed87', 'volume_name': 'volume-10f3d102-b557-432f-b1e2-75334003ed87', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:57:52.483223 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-87c8b588-e404-406c-a398-a6571c2c1d31 tempest-AttachVolumeShelveTestJSON-2118378341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54484f9f-f7e8-4ce8-a658-c3ae8105f77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:57:52.490881 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-87c8b588-e404-406c-a398-a6571c2c1d31 tempest-AttachVolumeShelveTestJSON-2118378341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54484f9f-f7e8-4ce8-a658-c3ae8105f77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:57:52.499151 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-87c8b588-e404-406c-a398-a6571c2c1d31 tempest-AttachVolumeShelveTestJSON-2118378341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e142810-858d-4916-8449-5ea40add2b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:57:52.501769 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-87c8b588-e404-406c-a398-a6571c2c1d31 tempest-AttachVolumeShelveTestJSON-2118378341 None] Volume 10f3d102-b557-432f-b1e2-75334003ed87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10f3d102-b557-432f-b1e2-75334003ed87', 'volume_size': 1} May 07 21:57:52.502510 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-87c8b588-e404-406c-a398-a6571c2c1d31 tempest-AttachVolumeShelveTestJSON-2118378341 None] creating volume 'volume-10f3d102-b557-432f-b1e2-75334003ed87' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 21:57:52.503592 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-87c8b588-e404-406c-a398-a6571c2c1d31 tempest-AttachVolumeShelveTestJSON-2118378341 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:57:52.652150 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-87c8b588-e404-406c-a398-a6571c2c1d31 tempest-AttachVolumeShelveTestJSON-2118378341 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 21:57:52.652640 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-87c8b588-e404-406c-a398-a6571c2c1d31 tempest-AttachVolumeShelveTestJSON-2118378341 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 21:57:52.657315 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-87c8b588-e404-406c-a398-a6571c2c1d31 tempest-AttachVolumeShelveTestJSON-2118378341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e142810-858d-4916-8449-5ea40add2b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10f3d102-b557-432f-b1e2-75334003ed87', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:57:52.667180 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-87c8b588-e404-406c-a398-a6571c2c1d31 tempest-AttachVolumeShelveTestJSON-2118378341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afdfacce-f6d8-4e73-8ab5-3cefaf1f3617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 21:57:52.694323 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-87c8b588-e404-406c-a398-a6571c2c1d31 tempest-AttachVolumeShelveTestJSON-2118378341 None] Volume volume-10f3d102-b557-432f-b1e2-75334003ed87 (10f3d102-b557-432f-b1e2-75334003ed87): created successfully May 07 21:57:52.701499 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-87c8b588-e404-406c-a398-a6571c2c1d31 tempest-AttachVolumeShelveTestJSON-2118378341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afdfacce-f6d8-4e73-8ab5-3cefaf1f3617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 21:57:52.729184 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-87c8b588-e404-406c-a398-a6571c2c1d31 tempest-AttachVolumeShelveTestJSON-2118378341 None] Flow 'volume_create_manager' (a42019c0-8aa8-4acb-80f2-5c9f2b10387f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 21:57:52.742321 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-87c8b588-e404-406c-a398-a6571c2c1d31 tempest-AttachVolumeShelveTestJSON-2118378341 None] Created volume successfully. May 07 21:58:30.743248 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 21:58:30.745436 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:58:30.863269 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:58:30.990987 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 21:58:36.476209 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-c6171366-343a-4bf2-8e6c-d87963c9b631 req-4420fcf3-f1ab-4b45-90d6-d62920c03890 tempest-AttachVolumeShelveTestJSON-2118378341 None] No connector for attachment 07d20bd5-a218-4b32-b6ef-c6ae1721c0c7; skipping storage backend terminate_connection call. {{(pid=129946) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4910}} May 07 21:58:36.477034 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-c6171366-343a-4bf2-8e6c-d87963c9b631 req-4420fcf3-f1ab-4b45-90d6-d62920c03890 tempest-AttachVolumeShelveTestJSON-2118378341 None] Deleting attachment 07d20bd5-a218-4b32-b6ef-c6ae1721c0c7. {{(pid=129946) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 07 21:58:46.270667 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-e0f27af7-aacc-4c0b-9316-edbc12c1109b req-fc627e51-1f66-4b95-a72b-4ce356328d5a tempest-TaggedBootDevicesTest_v242-1845920429 None] Terminate volume connection completed successfully. May 07 21:58:46.273605 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-e0f27af7-aacc-4c0b-9316-edbc12c1109b req-fc627e51-1f66-4b95-a72b-4ce356328d5a tempest-TaggedBootDevicesTest_v242-1845920429 None] Deleting attachment 85b3cb71-6256-4e7a-bba0-a983216dc64b. {{(pid=129946) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 07 21:58:46.609471 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-e0f27af7-aacc-4c0b-9316-edbc12c1109b req-f648ded6-b56d-48fc-9bb9-6fa8c0589ef4 tempest-TaggedBootDevicesTest_v242-1845920429 None] Terminate volume connection completed successfully. May 07 21:58:46.611391 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-e0f27af7-aacc-4c0b-9316-edbc12c1109b req-f648ded6-b56d-48fc-9bb9-6fa8c0589ef4 tempest-TaggedBootDevicesTest_v242-1845920429 None] Deleting attachment 46f3dde9-9de5-4ab8-bc9e-e4d29bf8e8f0. {{(pid=129946) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 07 21:58:46.817490 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-e0f27af7-aacc-4c0b-9316-edbc12c1109b req-17fd725e-c83a-4b3d-a6a1-2e1f6ccc80a5 tempest-TaggedBootDevicesTest_v242-1845920429 None] Terminate volume connection completed successfully. May 07 21:58:46.822752 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-e0f27af7-aacc-4c0b-9316-edbc12c1109b req-17fd725e-c83a-4b3d-a6a1-2e1f6ccc80a5 tempest-TaggedBootDevicesTest_v242-1845920429 None] Deleting attachment 9f960f2e-4834-4897-8458-28d92a1824f4. {{(pid=129946) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 07 21:59:03.146520 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-d9853903-cc2b-4242-b1c0-4495ec35edc6 tempest-TaggedBootDevicesTest_v242-1845920429 None] Lock "b'cinder-ce511f52-3a6f-4a80-8ff5-f2f4c9553392-delete_volume'" acquired by "delete_volume" :: waited 0.029s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 21:59:03.249099 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d9853903-cc2b-4242-b1c0-4495ec35edc6 tempest-TaggedBootDevicesTest_v242-1845920429 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:59:03.328367 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d9853903-cc2b-4242-b1c0-4495ec35edc6 tempest-TaggedBootDevicesTest_v242-1845920429 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 21:59:03.330008 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d9853903-cc2b-4242-b1c0-4495ec35edc6 tempest-TaggedBootDevicesTest_v242-1845920429 None] Volume volume-ce511f52-3a6f-4a80-8ff5-f2f4c9553392 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 21:59:03.342748 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d9853903-cc2b-4242-b1c0-4495ec35edc6 tempest-TaggedBootDevicesTest_v242-1845920429 None] deleting rbd volume volume-ce511f52-3a6f-4a80-8ff5-f2f4c9553392 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 21:59:03.785373 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-d9853903-cc2b-4242-b1c0-4495ec35edc6 tempest-TaggedBootDevicesTest_v242-1845920429 None] Created reservations ['162bdf03-8783-440e-a8ff-971de60b7541', '4f7e9050-1905-4a34-ae86-d81fb61ac3c2', 'e496e409-39f5-49db-bb52-9ba4a88c3c0c', '58ff630e-2934-4a08-a380-2c882fc58d1a'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 21:59:03.877208 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d9853903-cc2b-4242-b1c0-4495ec35edc6 tempest-TaggedBootDevicesTest_v242-1845920429 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:59:03.995309 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d9853903-cc2b-4242-b1c0-4495ec35edc6 tempest-TaggedBootDevicesTest_v242-1845920429 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:59:04.082321 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-d9853903-cc2b-4242-b1c0-4495ec35edc6 tempest-TaggedBootDevicesTest_v242-1845920429 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 21:59:04.088224 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-d9853903-cc2b-4242-b1c0-4495ec35edc6 tempest-TaggedBootDevicesTest_v242-1845920429 None] Deleted volume successfully. May 07 21:59:04.108842 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-d9853903-cc2b-4242-b1c0-4495ec35edc6 tempest-TaggedBootDevicesTest_v242-1845920429 None] Lock "b'cinder-ce511f52-3a6f-4a80-8ff5-f2f4c9553392-delete_volume'" released by "delete_volume" :: held 0.963s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 21:59:04.411995 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-42957eab-0aaf-4cdd-85d2-ceade562b487 tempest-TaggedBootDevicesTest_v242-1845920429 None] Lock "b'cinder-1a25a58d-c451-4444-8959-9eaa3b7e6be1-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 21:59:04.498575 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-42957eab-0aaf-4cdd-85d2-ceade562b487 tempest-TaggedBootDevicesTest_v242-1845920429 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:59:04.590429 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-42957eab-0aaf-4cdd-85d2-ceade562b487 tempest-TaggedBootDevicesTest_v242-1845920429 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 21:59:04.590900 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-42957eab-0aaf-4cdd-85d2-ceade562b487 tempest-TaggedBootDevicesTest_v242-1845920429 None] Volume volume-1a25a58d-c451-4444-8959-9eaa3b7e6be1 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 21:59:04.602477 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-42957eab-0aaf-4cdd-85d2-ceade562b487 tempest-TaggedBootDevicesTest_v242-1845920429 None] deleting rbd volume volume-1a25a58d-c451-4444-8959-9eaa3b7e6be1 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 21:59:05.052159 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-42957eab-0aaf-4cdd-85d2-ceade562b487 tempest-TaggedBootDevicesTest_v242-1845920429 None] Created reservations ['0237bd78-0d20-4079-a64e-3a4cf890439c', '717eb0e1-31ba-44b5-bc88-cd3f7868ae86', '39b323c0-124c-4bf4-9b50-95b37b199a8c', 'e2a41218-abab-4969-9a96-60297164caba'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 21:59:05.141523 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-42957eab-0aaf-4cdd-85d2-ceade562b487 tempest-TaggedBootDevicesTest_v242-1845920429 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:59:05.213563 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-42957eab-0aaf-4cdd-85d2-ceade562b487 tempest-TaggedBootDevicesTest_v242-1845920429 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:59:05.309614 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-42957eab-0aaf-4cdd-85d2-ceade562b487 tempest-TaggedBootDevicesTest_v242-1845920429 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 21:59:05.317531 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-42957eab-0aaf-4cdd-85d2-ceade562b487 tempest-TaggedBootDevicesTest_v242-1845920429 None] Deleted volume successfully. May 07 21:59:05.337668 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-42957eab-0aaf-4cdd-85d2-ceade562b487 tempest-TaggedBootDevicesTest_v242-1845920429 None] Lock "b'cinder-1a25a58d-c451-4444-8959-9eaa3b7e6be1-delete_volume'" released by "delete_volume" :: held 0.926s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 21:59:05.677979 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-ebcfbd15-bd7c-440d-89f3-63663626b760 tempest-TaggedBootDevicesTest_v242-1845920429 None] Lock "b'cinder-f7cbb2f4-5220-49cb-8e45-26c45c23a1b0-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 21:59:05.739182 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-ebcfbd15-bd7c-440d-89f3-63663626b760 tempest-TaggedBootDevicesTest_v242-1845920429 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:59:05.871053 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-ebcfbd15-bd7c-440d-89f3-63663626b760 tempest-TaggedBootDevicesTest_v242-1845920429 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 21:59:05.881254 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-ebcfbd15-bd7c-440d-89f3-63663626b760 tempest-TaggedBootDevicesTest_v242-1845920429 None] deleting rbd volume volume-f7cbb2f4-5220-49cb-8e45-26c45c23a1b0 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 21:59:06.398546 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-ebcfbd15-bd7c-440d-89f3-63663626b760 tempest-TaggedBootDevicesTest_v242-1845920429 None] volume is a clone so cleaning references {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} May 07 21:59:06.452730 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-ebcfbd15-bd7c-440d-89f3-63663626b760 tempest-TaggedBootDevicesTest_v242-1845920429 None] deleting parent snapshot volume-f7cbb2f4-5220-49cb-8e45-26c45c23a1b0.clone_snap {{(pid=129946) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} May 07 21:59:07.692802 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-ebcfbd15-bd7c-440d-89f3-63663626b760 tempest-TaggedBootDevicesTest_v242-1845920429 None] Created reservations ['5dcc7a9e-1c84-4b90-988a-d66d148f5663', '107fe8bd-2d75-461e-8417-6617aa98b3e5', 'a6e84960-ca57-46ea-87e8-208b675fb2b0', 'd9125609-1bb4-4328-b7cf-6b78e11755d6'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 21:59:07.822806 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-ebcfbd15-bd7c-440d-89f3-63663626b760 tempest-TaggedBootDevicesTest_v242-1845920429 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:59:07.928421 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-ebcfbd15-bd7c-440d-89f3-63663626b760 tempest-TaggedBootDevicesTest_v242-1845920429 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:59:08.043247 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-ebcfbd15-bd7c-440d-89f3-63663626b760 tempest-TaggedBootDevicesTest_v242-1845920429 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 21:59:08.050011 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-ebcfbd15-bd7c-440d-89f3-63663626b760 tempest-TaggedBootDevicesTest_v242-1845920429 None] Deleted volume successfully. May 07 21:59:08.070114 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-ebcfbd15-bd7c-440d-89f3-63663626b760 tempest-TaggedBootDevicesTest_v242-1845920429 None] Lock "b'cinder-f7cbb2f4-5220-49cb-8e45-26c45c23a1b0-delete_volume'" released by "delete_volume" :: held 2.392s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 21:59:30.743857 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 21:59:30.744567 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:59:30.839783 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:59:30.900297 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 21:59:32.209983 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-297f5c8f-60f5-4bbb-a4fa-be1090b9a165 tempest-DeleteServersTestJSON-1693230253 None] Lock "b'cinder-a357f932-6e86-441e-992c-5e2d6589be9a-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 21:59:32.321675 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-297f5c8f-60f5-4bbb-a4fa-be1090b9a165 tempest-DeleteServersTestJSON-1693230253 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:59:32.422246 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-297f5c8f-60f5-4bbb-a4fa-be1090b9a165 tempest-DeleteServersTestJSON-1693230253 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 21:59:32.423207 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-297f5c8f-60f5-4bbb-a4fa-be1090b9a165 tempest-DeleteServersTestJSON-1693230253 None] Volume volume-a357f932-6e86-441e-992c-5e2d6589be9a is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 21:59:32.437224 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-297f5c8f-60f5-4bbb-a4fa-be1090b9a165 tempest-DeleteServersTestJSON-1693230253 None] deleting rbd volume volume-a357f932-6e86-441e-992c-5e2d6589be9a {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 21:59:32.949260 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-297f5c8f-60f5-4bbb-a4fa-be1090b9a165 tempest-DeleteServersTestJSON-1693230253 None] Created reservations ['f12305fc-1134-4ab2-9d7a-5b7697dcb02b', 'd5b184c0-4142-437b-89ac-8f61f7740a9c', 'ee14f8a3-99e8-496d-bde2-76ba9f36744b', '79f8159e-b54d-461c-81d7-25a1ae46b2b7'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 21:59:33.067273 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-297f5c8f-60f5-4bbb-a4fa-be1090b9a165 tempest-DeleteServersTestJSON-1693230253 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:59:33.127544 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-297f5c8f-60f5-4bbb-a4fa-be1090b9a165 tempest-DeleteServersTestJSON-1693230253 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 21:59:33.223215 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-297f5c8f-60f5-4bbb-a4fa-be1090b9a165 tempest-DeleteServersTestJSON-1693230253 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 21:59:33.230643 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-297f5c8f-60f5-4bbb-a4fa-be1090b9a165 tempest-DeleteServersTestJSON-1693230253 None] Deleted volume successfully. May 07 21:59:33.248621 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-297f5c8f-60f5-4bbb-a4fa-be1090b9a165 tempest-DeleteServersTestJSON-1693230253 None] Lock "b'cinder-a357f932-6e86-441e-992c-5e2d6589be9a-delete_volume'" released by "delete_volume" :: held 1.040s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 21:59:59.860804 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-2b25430d-4f32-42ff-a166-b3b13933479f tempest-AttachVolumeShelveTestJSON-2118378341 None] Lock "b'cinder-10f3d102-b557-432f-b1e2-75334003ed87-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 21:59:59.959283 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-2b25430d-4f32-42ff-a166-b3b13933479f tempest-AttachVolumeShelveTestJSON-2118378341 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:00:00.056553 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-2b25430d-4f32-42ff-a166-b3b13933479f tempest-AttachVolumeShelveTestJSON-2118378341 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:00:00.057508 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-2b25430d-4f32-42ff-a166-b3b13933479f tempest-AttachVolumeShelveTestJSON-2118378341 None] Volume volume-10f3d102-b557-432f-b1e2-75334003ed87 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:00:00.076145 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-2b25430d-4f32-42ff-a166-b3b13933479f tempest-AttachVolumeShelveTestJSON-2118378341 None] deleting rbd volume volume-10f3d102-b557-432f-b1e2-75334003ed87 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:00:00.763219 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-2b25430d-4f32-42ff-a166-b3b13933479f tempest-AttachVolumeShelveTestJSON-2118378341 None] Created reservations ['ff3ca061-4ad3-4f82-8c97-5f12fadcb2e9', '4b97b26a-c2b3-4d18-8285-9e6ee851599c', '6c1bff20-54d8-4480-8f4e-be28ee7b683e', '4a317511-f7dd-491d-b168-3d54ccbb941f'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:00:00.899312 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-2b25430d-4f32-42ff-a166-b3b13933479f tempest-AttachVolumeShelveTestJSON-2118378341 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:00:01.010843 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-2b25430d-4f32-42ff-a166-b3b13933479f tempest-AttachVolumeShelveTestJSON-2118378341 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:00:01.112216 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-2b25430d-4f32-42ff-a166-b3b13933479f tempest-AttachVolumeShelveTestJSON-2118378341 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:00:01.118046 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-2b25430d-4f32-42ff-a166-b3b13933479f tempest-AttachVolumeShelveTestJSON-2118378341 None] Deleted volume successfully. May 07 22:00:01.141534 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-2b25430d-4f32-42ff-a166-b3b13933479f tempest-AttachVolumeShelveTestJSON-2118378341 None] Lock "b'cinder-10f3d102-b557-432f-b1e2-75334003ed87-delete_volume'" released by "delete_volume" :: held 1.281s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:00:02.005941 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-916ff751-0130-4f59-80db-73197121bd3c tempest-AttachVolumeShelveTestJSON-2118378341 None] Lock "b'cinder-8544d5aa-b3ac-47bc-9200-f41820a8209c-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:00:02.080997 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-916ff751-0130-4f59-80db-73197121bd3c tempest-AttachVolumeShelveTestJSON-2118378341 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:00:02.236223 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-916ff751-0130-4f59-80db-73197121bd3c tempest-AttachVolumeShelveTestJSON-2118378341 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:00:02.236665 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-916ff751-0130-4f59-80db-73197121bd3c tempest-AttachVolumeShelveTestJSON-2118378341 None] Volume volume-8544d5aa-b3ac-47bc-9200-f41820a8209c is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:00:02.260577 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-916ff751-0130-4f59-80db-73197121bd3c tempest-AttachVolumeShelveTestJSON-2118378341 None] deleting rbd volume volume-8544d5aa-b3ac-47bc-9200-f41820a8209c {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:00:02.999562 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-916ff751-0130-4f59-80db-73197121bd3c tempest-AttachVolumeShelveTestJSON-2118378341 None] Created reservations ['d8bb8516-bc9b-4193-9666-a96d1beafbeb', 'b1a98ab5-0258-4f87-98a1-6431704af20e', '93de405e-1aa7-4191-839f-21b9bbcd20f6', '8dffcdb1-194e-4ae9-8faa-5c2e489390ed'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:00:03.093569 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-916ff751-0130-4f59-80db-73197121bd3c tempest-AttachVolumeShelveTestJSON-2118378341 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:00:03.189695 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-916ff751-0130-4f59-80db-73197121bd3c tempest-AttachVolumeShelveTestJSON-2118378341 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:00:03.282533 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-916ff751-0130-4f59-80db-73197121bd3c tempest-AttachVolumeShelveTestJSON-2118378341 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:00:03.296158 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-916ff751-0130-4f59-80db-73197121bd3c tempest-AttachVolumeShelveTestJSON-2118378341 None] Deleted volume successfully. May 07 22:00:03.328121 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-916ff751-0130-4f59-80db-73197121bd3c tempest-AttachVolumeShelveTestJSON-2118378341 None] Lock "b'cinder-8544d5aa-b3ac-47bc-9200-f41820a8209c-delete_volume'" released by "delete_volume" :: held 1.326s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:00:19.399124 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-9ee4e500-0219-413b-a3cc-90d2f5d4e581 req-52ddcdd7-3fca-4f2b-a37b-6f6a838ba551 tempest-TaggedBootDevicesTest-1550846050 None] Terminate volume connection completed successfully. May 07 22:00:19.399760 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-9ee4e500-0219-413b-a3cc-90d2f5d4e581 req-52ddcdd7-3fca-4f2b-a37b-6f6a838ba551 tempest-TaggedBootDevicesTest-1550846050 None] Deleting attachment 5eb37c71-e3c0-4e9e-bbbe-bf3306cca096. {{(pid=129946) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 07 22:00:19.574332 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-9ee4e500-0219-413b-a3cc-90d2f5d4e581 req-b7264e8e-f213-4618-b3f6-5166b45b2333 tempest-TaggedBootDevicesTest-1550846050 None] Terminate volume connection completed successfully. May 07 22:00:19.575539 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-9ee4e500-0219-413b-a3cc-90d2f5d4e581 req-b7264e8e-f213-4618-b3f6-5166b45b2333 tempest-TaggedBootDevicesTest-1550846050 None] Deleting attachment 87ddf862-2d54-47e3-9507-856a52795958. {{(pid=129946) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 07 22:00:19.743122 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-9ee4e500-0219-413b-a3cc-90d2f5d4e581 req-853e1f9d-1204-41f9-a04f-8227ca1d0ce6 tempest-TaggedBootDevicesTest-1550846050 None] Terminate volume connection completed successfully. May 07 22:00:19.744018 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-9ee4e500-0219-413b-a3cc-90d2f5d4e581 req-853e1f9d-1204-41f9-a04f-8227ca1d0ce6 tempest-TaggedBootDevicesTest-1550846050 None] Deleting attachment 3bd229b2-c3d3-4c7c-a644-104bb1379d65. {{(pid=129946) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 07 22:00:30.745718 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:00:30.746487 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:00:30.820511 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:00:30.925599 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:00:38.171138 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-9e5d618e-c91d-440c-b71c-62d38665d292 tempest-TaggedBootDevicesTest-1550846050 None] Lock "b'cinder-edf0b8e8-8a9a-4d7b-95eb-46163eae5081-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:00:38.236290 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-9e5d618e-c91d-440c-b71c-62d38665d292 tempest-TaggedBootDevicesTest-1550846050 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:00:38.324365 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-9e5d618e-c91d-440c-b71c-62d38665d292 tempest-TaggedBootDevicesTest-1550846050 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:00:38.325132 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-9e5d618e-c91d-440c-b71c-62d38665d292 tempest-TaggedBootDevicesTest-1550846050 None] Volume volume-edf0b8e8-8a9a-4d7b-95eb-46163eae5081 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:00:38.340103 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-9e5d618e-c91d-440c-b71c-62d38665d292 tempest-TaggedBootDevicesTest-1550846050 None] deleting rbd volume volume-edf0b8e8-8a9a-4d7b-95eb-46163eae5081 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:00:38.861152 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-9e5d618e-c91d-440c-b71c-62d38665d292 tempest-TaggedBootDevicesTest-1550846050 None] Created reservations ['80016295-7fe1-4d70-9009-1e3e1b335625', 'd9836dea-c8a4-43f8-be99-41c78edca637', '49dca001-dd9b-4a4d-98d2-85fa350331dc', '48222bdc-76bc-4605-81c9-26bf3660f576'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:00:38.953021 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-9e5d618e-c91d-440c-b71c-62d38665d292 tempest-TaggedBootDevicesTest-1550846050 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:00:39.026377 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-9e5d618e-c91d-440c-b71c-62d38665d292 tempest-TaggedBootDevicesTest-1550846050 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:00:39.099542 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-9e5d618e-c91d-440c-b71c-62d38665d292 tempest-TaggedBootDevicesTest-1550846050 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:00:39.105177 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-9e5d618e-c91d-440c-b71c-62d38665d292 tempest-TaggedBootDevicesTest-1550846050 None] Deleted volume successfully. May 07 22:00:39.132987 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-9e5d618e-c91d-440c-b71c-62d38665d292 tempest-TaggedBootDevicesTest-1550846050 None] Lock "b'cinder-edf0b8e8-8a9a-4d7b-95eb-46163eae5081-delete_volume'" released by "delete_volume" :: held 0.963s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:00:39.487140 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-58ee03a1-1dc7-4a3a-85a4-ee71fd782c27 tempest-TaggedBootDevicesTest-1550846050 None] Lock "b'cinder-30fc7619-db02-4f4d-8966-a00216d45663-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:00:39.595895 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-58ee03a1-1dc7-4a3a-85a4-ee71fd782c27 tempest-TaggedBootDevicesTest-1550846050 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:00:39.725450 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-58ee03a1-1dc7-4a3a-85a4-ee71fd782c27 tempest-TaggedBootDevicesTest-1550846050 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:00:39.725940 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-58ee03a1-1dc7-4a3a-85a4-ee71fd782c27 tempest-TaggedBootDevicesTest-1550846050 None] Volume volume-30fc7619-db02-4f4d-8966-a00216d45663 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:00:39.746052 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-58ee03a1-1dc7-4a3a-85a4-ee71fd782c27 tempest-TaggedBootDevicesTest-1550846050 None] deleting rbd volume volume-30fc7619-db02-4f4d-8966-a00216d45663 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:00:40.497038 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-58ee03a1-1dc7-4a3a-85a4-ee71fd782c27 tempest-TaggedBootDevicesTest-1550846050 None] Created reservations ['5adce44c-ae19-4469-8e40-8c08806e4e2c', 'ab359792-4341-4e06-9bc2-9f23a3d86b5e', 'f5a03dcc-b74d-49e0-9256-1648ec0e6b75', 'a54e69e9-f785-48e0-a3e4-87beeca0d097'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:00:40.652964 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-58ee03a1-1dc7-4a3a-85a4-ee71fd782c27 tempest-TaggedBootDevicesTest-1550846050 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:00:40.780275 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-58ee03a1-1dc7-4a3a-85a4-ee71fd782c27 tempest-TaggedBootDevicesTest-1550846050 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:00:40.888305 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-58ee03a1-1dc7-4a3a-85a4-ee71fd782c27 tempest-TaggedBootDevicesTest-1550846050 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:00:40.904147 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-58ee03a1-1dc7-4a3a-85a4-ee71fd782c27 tempest-TaggedBootDevicesTest-1550846050 None] Deleted volume successfully. May 07 22:00:40.989841 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-a3b84e28-b3e0-4776-bffd-d460832ad078 tempest-TaggedBootDevicesTest-1550846050 None] Lock "b'cinder-b5a9abca-fd78-4787-87fc-9e321869b37d-delete_volume'" acquired by "delete_volume" :: waited 0.048s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:00:41.039832 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-58ee03a1-1dc7-4a3a-85a4-ee71fd782c27 tempest-TaggedBootDevicesTest-1550846050 None] Lock "b'cinder-30fc7619-db02-4f4d-8966-a00216d45663-delete_volume'" released by "delete_volume" :: held 1.553s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:00:41.117187 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-a3b84e28-b3e0-4776-bffd-d460832ad078 tempest-TaggedBootDevicesTest-1550846050 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:00:41.267053 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-a3b84e28-b3e0-4776-bffd-d460832ad078 tempest-TaggedBootDevicesTest-1550846050 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:00:41.295295 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-a3b84e28-b3e0-4776-bffd-d460832ad078 tempest-TaggedBootDevicesTest-1550846050 None] deleting rbd volume volume-b5a9abca-fd78-4787-87fc-9e321869b37d {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:00:42.096855 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-a3b84e28-b3e0-4776-bffd-d460832ad078 tempest-TaggedBootDevicesTest-1550846050 None] volume is a clone so cleaning references {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} May 07 22:00:42.151881 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-a3b84e28-b3e0-4776-bffd-d460832ad078 tempest-TaggedBootDevicesTest-1550846050 None] deleting parent snapshot volume-b5a9abca-fd78-4787-87fc-9e321869b37d.clone_snap {{(pid=129946) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} May 07 22:00:42.918144 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-a3b84e28-b3e0-4776-bffd-d460832ad078 tempest-TaggedBootDevicesTest-1550846050 None] Created reservations ['216fe954-9ff0-4ddf-a8f3-23e8c79b4c45', '967fbc44-f537-4735-aae5-5b65b79f1fc0', 'd7512e1e-7cf5-4dea-8260-7e72fe1dd791', 'ec54d79e-0780-4133-925d-85b995933ff9'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:00:43.081096 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-a3b84e28-b3e0-4776-bffd-d460832ad078 tempest-TaggedBootDevicesTest-1550846050 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:00:43.237101 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-a3b84e28-b3e0-4776-bffd-d460832ad078 tempest-TaggedBootDevicesTest-1550846050 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:00:43.342090 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-a3b84e28-b3e0-4776-bffd-d460832ad078 tempest-TaggedBootDevicesTest-1550846050 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:00:43.350415 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-a3b84e28-b3e0-4776-bffd-d460832ad078 tempest-TaggedBootDevicesTest-1550846050 None] Deleted volume successfully. May 07 22:00:43.380529 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-a3b84e28-b3e0-4776-bffd-d460832ad078 tempest-TaggedBootDevicesTest-1550846050 None] Lock "b'cinder-b5a9abca-fd78-4787-87fc-9e321869b37d-delete_volume'" released by "delete_volume" :: held 2.391s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:01:29.326229 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0745aa9-1baa-4099-93c0-21803ae28aaf tempest-AttachVolumeTestJSON-808075378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:01:29.377265 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a0745aa9-1baa-4099-93c0-21803ae28aaf tempest-AttachVolumeTestJSON-808075378 None] Flow 'volume_create_manager' (21603f5f-36fa-45ee-ae0c-e10e8d0c9e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:01:29.392276 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a0745aa9-1baa-4099-93c0-21803ae28aaf tempest-AttachVolumeTestJSON-808075378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (769bf5e8-7d5d-42a5-8307-f04705bfe662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:01:29.430178 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a0745aa9-1baa-4099-93c0-21803ae28aaf tempest-AttachVolumeTestJSON-808075378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (769bf5e8-7d5d-42a5-8307-f04705bfe662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2009828580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=563e3251-764b-419d-8f65-8e94c270df50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81e5c5d849ea4fc59d5c4fc58b31530f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:01:29Z,use_quota=True,user_id='5ea5d144165a4e129de242905439e951',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:01:29.443498 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a0745aa9-1baa-4099-93c0-21803ae28aaf tempest-AttachVolumeTestJSON-808075378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (760e3572-7c14-4ed8-80e4-691e8cc940cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:01:29.465153 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a0745aa9-1baa-4099-93c0-21803ae28aaf tempest-AttachVolumeTestJSON-808075378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (760e3572-7c14-4ed8-80e4-691e8cc940cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:01:29.478723 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a0745aa9-1baa-4099-93c0-21803ae28aaf tempest-AttachVolumeTestJSON-808075378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ceb8cb2-89a0-49ba-9b9d-036f17197f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:01:29.486868 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a0745aa9-1baa-4099-93c0-21803ae28aaf tempest-AttachVolumeTestJSON-808075378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ceb8cb2-89a0-49ba-9b9d-036f17197f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '563e3251-764b-419d-8f65-8e94c270df50', 'volume_name': 'volume-563e3251-764b-419d-8f65-8e94c270df50', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:01:29.508389 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a0745aa9-1baa-4099-93c0-21803ae28aaf tempest-AttachVolumeTestJSON-808075378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cebeaf2f-35d4-4338-82cf-098446979ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:01:29.526098 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a0745aa9-1baa-4099-93c0-21803ae28aaf tempest-AttachVolumeTestJSON-808075378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cebeaf2f-35d4-4338-82cf-098446979ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:01:29.549614 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a0745aa9-1baa-4099-93c0-21803ae28aaf tempest-AttachVolumeTestJSON-808075378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef0b6bf8-6990-4577-bdc0-67eb3a802bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:01:29.552195 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-a0745aa9-1baa-4099-93c0-21803ae28aaf tempest-AttachVolumeTestJSON-808075378 None] Volume 563e3251-764b-419d-8f65-8e94c270df50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-563e3251-764b-419d-8f65-8e94c270df50', 'volume_size': 1} May 07 22:01:29.552606 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-a0745aa9-1baa-4099-93c0-21803ae28aaf tempest-AttachVolumeTestJSON-808075378 None] creating volume 'volume-563e3251-764b-419d-8f65-8e94c270df50' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:01:29.558310 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-a0745aa9-1baa-4099-93c0-21803ae28aaf tempest-AttachVolumeTestJSON-808075378 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:01:29.726172 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-a0745aa9-1baa-4099-93c0-21803ae28aaf tempest-AttachVolumeTestJSON-808075378 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:01:29.726971 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-a0745aa9-1baa-4099-93c0-21803ae28aaf tempest-AttachVolumeTestJSON-808075378 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:01:29.731754 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a0745aa9-1baa-4099-93c0-21803ae28aaf tempest-AttachVolumeTestJSON-808075378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef0b6bf8-6990-4577-bdc0-67eb3a802bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-563e3251-764b-419d-8f65-8e94c270df50', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:01:29.741293 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a0745aa9-1baa-4099-93c0-21803ae28aaf tempest-AttachVolumeTestJSON-808075378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b138a68a-eccd-4730-9292-d8337d734920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:01:29.782289 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-a0745aa9-1baa-4099-93c0-21803ae28aaf tempest-AttachVolumeTestJSON-808075378 None] Volume volume-563e3251-764b-419d-8f65-8e94c270df50 (563e3251-764b-419d-8f65-8e94c270df50): created successfully May 07 22:01:29.799748 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a0745aa9-1baa-4099-93c0-21803ae28aaf tempest-AttachVolumeTestJSON-808075378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b138a68a-eccd-4730-9292-d8337d734920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:01:29.827963 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a0745aa9-1baa-4099-93c0-21803ae28aaf tempest-AttachVolumeTestJSON-808075378 None] Flow 'volume_create_manager' (21603f5f-36fa-45ee-ae0c-e10e8d0c9e0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:01:29.854755 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-a0745aa9-1baa-4099-93c0-21803ae28aaf tempest-AttachVolumeTestJSON-808075378 None] Created volume successfully. May 07 22:01:30.752171 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:01:30.752762 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:01:30.814400 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:01:30.967505 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:01:31.192519 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-de06d29e-8e19-4902-9b8e-7a2a27729dcc req-6d32c2ac-4609-4b6d-b7af-6ba947ee597b tempest-AttachVolumeTestJSON-808075378 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 22:01:32.837519 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-de06d29e-8e19-4902-9b8e-7a2a27729dcc req-6d32c2ac-4609-4b6d-b7af-6ba947ee597b tempest-AttachVolumeTestJSON-808075378 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.649s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 22:01:32.838332 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-de06d29e-8e19-4902-9b8e-7a2a27729dcc req-6d32c2ac-4609-4b6d-b7af-6ba947ee597b tempest-AttachVolumeTestJSON-808075378 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-563e3251-764b-419d-8f65-8e94c270df50', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3ca0b836-1cfe-436a-b0fa-deb74d3203d9', 'volume_id': '563e3251-764b-419d-8f65-8e94c270df50', 'discard': True}} {{(pid=129946) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 07 22:01:32.906872 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-de06d29e-8e19-4902-9b8e-7a2a27729dcc req-6d32c2ac-4609-4b6d-b7af-6ba947ee597b tempest-AttachVolumeTestJSON-808075378 None] Connection info returned from driver {'name': 'volumes/volume-563e3251-764b-419d-8f65-8e94c270df50', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '563e3251-764b-419d-8f65-8e94c270df50', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '8d8cd546-ecc9-43c4-9633-37769701eeb9'} {{(pid=129946) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 07 22:01:33.008400 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-de06d29e-8e19-4902-9b8e-7a2a27729dcc req-6d32c2ac-4609-4b6d-b7af-6ba947ee597b tempest-AttachVolumeTestJSON-808075378 None] attachment_update completed successfully. May 07 22:02:10.544701 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-0191df56-a926-456b-9f3b-cf66d89182a7 tempest-GroupSnapshotsTest-781055013 None] Group tempest-GroupSnapshotsTest-Group-979069738: creating May 07 22:02:10.580227 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-0191df56-a926-456b-9f3b-cf66d89182a7 tempest-GroupSnapshotsTest-781055013 None] Group tempest-GroupSnapshotsTest-Group-979069738: created successfully May 07 22:02:10.592721 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-0191df56-a926-456b-9f3b-cf66d89182a7 tempest-GroupSnapshotsTest-781055013 None] Create group completed successfully. May 07 22:02:12.076084 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-778efec1-d6ff-4705-8e40-70b1c2d150b1 tempest-GroupSnapshotsTest-781055013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:02:12.103278 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-778efec1-d6ff-4705-8e40-70b1c2d150b1 tempest-GroupSnapshotsTest-781055013 None] Flow 'volume_create_manager' (4997c6e3-3f60-4e2e-a4ed-025016d15a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:02:12.111323 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-778efec1-d6ff-4705-8e40-70b1c2d150b1 tempest-GroupSnapshotsTest-781055013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee637b08-9afb-4edc-b056-a91c5be908cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:02:12.132523 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-778efec1-d6ff-4705-8e40-70b1c2d150b1 tempest-GroupSnapshotsTest-781055013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee637b08-9afb-4edc-b056-a91c5be908cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:02:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1124294958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b137c810-7cc1-4ea1-b3d0-a5c4dde2f117,host='ncdv-master-1@ceph#ceph',id=8ec0562e-1929-4bfb-b6ea-405ba3dc67de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ea307efc44a4c648173ea614ab793a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:02:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:02:12Z,use_quota=True,user_id='a251148af7f940b596a159886a883bb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4bd623b-808a-4330-ae92-97c961bb01a3),volume_type_id=a4bd623b-808a-4330-ae92-97c961bb01a3)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:02:12.141047 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-778efec1-d6ff-4705-8e40-70b1c2d150b1 tempest-GroupSnapshotsTest-781055013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0891606f-160a-4718-8678-5a12f867d222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:02:12.146481 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-778efec1-d6ff-4705-8e40-70b1c2d150b1 tempest-GroupSnapshotsTest-781055013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0891606f-160a-4718-8678-5a12f867d222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:02:12.151989 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-778efec1-d6ff-4705-8e40-70b1c2d150b1 tempest-GroupSnapshotsTest-781055013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff5503f1-38f9-4a00-bf50-fb3f34d3e6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:02:12.156339 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-778efec1-d6ff-4705-8e40-70b1c2d150b1 tempest-GroupSnapshotsTest-781055013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff5503f1-38f9-4a00-bf50-fb3f34d3e6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ec0562e-1929-4bfb-b6ea-405ba3dc67de', 'volume_name': 'volume-8ec0562e-1929-4bfb-b6ea-405ba3dc67de', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:02:12.161621 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-778efec1-d6ff-4705-8e40-70b1c2d150b1 tempest-GroupSnapshotsTest-781055013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (141b315c-80e0-47c0-bc01-232bfbdf5ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:02:12.166216 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-778efec1-d6ff-4705-8e40-70b1c2d150b1 tempest-GroupSnapshotsTest-781055013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (141b315c-80e0-47c0-bc01-232bfbdf5ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:02:12.171252 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-778efec1-d6ff-4705-8e40-70b1c2d150b1 tempest-GroupSnapshotsTest-781055013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94d704cc-568f-440a-8a99-8171e44ac09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:02:12.172477 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-778efec1-d6ff-4705-8e40-70b1c2d150b1 tempest-GroupSnapshotsTest-781055013 None] Volume 8ec0562e-1929-4bfb-b6ea-405ba3dc67de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ec0562e-1929-4bfb-b6ea-405ba3dc67de', 'volume_size': 1} May 07 22:02:12.172873 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-778efec1-d6ff-4705-8e40-70b1c2d150b1 tempest-GroupSnapshotsTest-781055013 None] creating volume 'volume-8ec0562e-1929-4bfb-b6ea-405ba3dc67de' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:02:12.173900 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-778efec1-d6ff-4705-8e40-70b1c2d150b1 tempest-GroupSnapshotsTest-781055013 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:02:12.260922 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-778efec1-d6ff-4705-8e40-70b1c2d150b1 tempest-GroupSnapshotsTest-781055013 None] extra_specs: {} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:02:12.261540 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-778efec1-d6ff-4705-8e40-70b1c2d150b1 tempest-GroupSnapshotsTest-781055013 None] extra_specs: {} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:02:12.265818 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-778efec1-d6ff-4705-8e40-70b1c2d150b1 tempest-GroupSnapshotsTest-781055013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94d704cc-568f-440a-8a99-8171e44ac09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ec0562e-1929-4bfb-b6ea-405ba3dc67de', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:02:12.272659 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-778efec1-d6ff-4705-8e40-70b1c2d150b1 tempest-GroupSnapshotsTest-781055013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (772c3294-26d2-411b-acb6-ff2dbbe7064d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:02:12.286405 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-778efec1-d6ff-4705-8e40-70b1c2d150b1 tempest-GroupSnapshotsTest-781055013 None] Volume volume-8ec0562e-1929-4bfb-b6ea-405ba3dc67de (8ec0562e-1929-4bfb-b6ea-405ba3dc67de): created successfully May 07 22:02:12.293025 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-778efec1-d6ff-4705-8e40-70b1c2d150b1 tempest-GroupSnapshotsTest-781055013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (772c3294-26d2-411b-acb6-ff2dbbe7064d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:02:12.300201 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-778efec1-d6ff-4705-8e40-70b1c2d150b1 tempest-GroupSnapshotsTest-781055013 None] Flow 'volume_create_manager' (4997c6e3-3f60-4e2e-a4ed-025016d15a99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:02:12.334432 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-778efec1-d6ff-4705-8e40-70b1c2d150b1 tempest-GroupSnapshotsTest-781055013 None] Created volume successfully. May 07 22:02:13.722343 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-014ad504-3fb2-4e9a-b9c9-0f15a801248d tempest-GroupSnapshotsTest-781055013 None] GroupSnapshot a4e238df-c4c4-499b-ac13-e330814c515f: creating. May 07 22:02:13.818877 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-014ad504-3fb2-4e9a-b9c9-0f15a801248d tempest-GroupSnapshotsTest-781055013 None] Group snapshot a4e238df-c4c4-499b-ac13-e330814c515f: creating. {{(pid=129946) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4078}} May 07 22:02:13.862543 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-014ad504-3fb2-4e9a-b9c9-0f15a801248d tempest-GroupSnapshotsTest-781055013 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:02:14.411527 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-014ad504-3fb2-4e9a-b9c9-0f15a801248d tempest-GroupSnapshotsTest-781055013 None] group_snapshot a4e238df-c4c4-499b-ac13-e330814c515f: created successfully May 07 22:02:16.167014 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-e94ebf4d-ecd3-46a5-9ac6-50ac3cfe6e5e tempest-GroupSnapshotsTest-781055013 None] cloning volumes/volume-8ec0562e-1929-4bfb-b6ea-405ba3dc67de@snapshot-1c63b5de-ec71-452c-b9c2-c103ca08ae40 to volume-006986d0-f02f-49a6-9700-e7d091057e50 {{(pid=129946) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1091}} May 07 22:02:16.167731 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-e94ebf4d-ecd3-46a5-9ac6-50ac3cfe6e5e tempest-GroupSnapshotsTest-781055013 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:02:16.303421 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-e94ebf4d-ecd3-46a5-9ac6-50ac3cfe6e5e tempest-GroupSnapshotsTest-781055013 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:02:16.404758 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dd29342-4488-4153-ab50-39f393cf0933 tempest-AttachVolumeNegativeTest-835916675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:02:16.434888 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5dd29342-4488-4153-ab50-39f393cf0933 tempest-AttachVolumeNegativeTest-835916675 None] Flow 'volume_create_manager' (6d47c7ec-de21-46bb-9b6e-b24ac7e0b4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:02:16.447268 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5dd29342-4488-4153-ab50-39f393cf0933 tempest-AttachVolumeNegativeTest-835916675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0159b40-1534-42be-899a-2b9882cb08f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:02:16.501705 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5dd29342-4488-4153-ab50-39f393cf0933 tempest-AttachVolumeNegativeTest-835916675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0159b40-1534-42be-899a-2b9882cb08f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:02:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1069375375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5df3e22c-323c-404a-a8e6-d7e28dc9b693,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57990769f50b412194a108cdd627a767',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:02:16Z,use_quota=True,user_id='887054d178de43b18a472fed2297659d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:02:16.519117 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5dd29342-4488-4153-ab50-39f393cf0933 tempest-AttachVolumeNegativeTest-835916675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c28e1939-c99b-4bd6-8860-708ad4930a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:02:16.529742 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5dd29342-4488-4153-ab50-39f393cf0933 tempest-AttachVolumeNegativeTest-835916675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c28e1939-c99b-4bd6-8860-708ad4930a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:02:16.536830 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5dd29342-4488-4153-ab50-39f393cf0933 tempest-AttachVolumeNegativeTest-835916675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0fc3f66-356b-4e17-91b9-1b1937963641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:02:16.549871 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5dd29342-4488-4153-ab50-39f393cf0933 tempest-AttachVolumeNegativeTest-835916675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0fc3f66-356b-4e17-91b9-1b1937963641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5df3e22c-323c-404a-a8e6-d7e28dc9b693', 'volume_name': 'volume-5df3e22c-323c-404a-a8e6-d7e28dc9b693', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:02:16.568629 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5dd29342-4488-4153-ab50-39f393cf0933 tempest-AttachVolumeNegativeTest-835916675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5718c402-7c86-4f99-9981-3049c0b82f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:02:16.582422 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5dd29342-4488-4153-ab50-39f393cf0933 tempest-AttachVolumeNegativeTest-835916675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5718c402-7c86-4f99-9981-3049c0b82f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:02:16.604492 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5dd29342-4488-4153-ab50-39f393cf0933 tempest-AttachVolumeNegativeTest-835916675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0afe8d43-4346-4206-a571-c449b0ebdead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:02:16.607185 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-5dd29342-4488-4153-ab50-39f393cf0933 tempest-AttachVolumeNegativeTest-835916675 None] Volume 5df3e22c-323c-404a-a8e6-d7e28dc9b693: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5df3e22c-323c-404a-a8e6-d7e28dc9b693', 'volume_size': 1} May 07 22:02:16.609277 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-5dd29342-4488-4153-ab50-39f393cf0933 tempest-AttachVolumeNegativeTest-835916675 None] creating volume 'volume-5df3e22c-323c-404a-a8e6-d7e28dc9b693' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:02:16.610388 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-5dd29342-4488-4153-ab50-39f393cf0933 tempest-AttachVolumeNegativeTest-835916675 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:02:16.760568 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-e94ebf4d-ecd3-46a5-9ac6-50ac3cfe6e5e tempest-GroupSnapshotsTest-781055013 None] extra_specs: {} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:02:16.760943 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-e94ebf4d-ecd3-46a5-9ac6-50ac3cfe6e5e tempest-GroupSnapshotsTest-781055013 None] extra_specs: {} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:02:16.773713 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-e94ebf4d-ecd3-46a5-9ac6-50ac3cfe6e5e tempest-GroupSnapshotsTest-781055013 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:02:16.864432 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-5dd29342-4488-4153-ab50-39f393cf0933 tempest-AttachVolumeNegativeTest-835916675 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:02:16.865103 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-5dd29342-4488-4153-ab50-39f393cf0933 tempest-AttachVolumeNegativeTest-835916675 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:02:16.869992 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5dd29342-4488-4153-ab50-39f393cf0933 tempest-AttachVolumeNegativeTest-835916675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0afe8d43-4346-4206-a571-c449b0ebdead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5df3e22c-323c-404a-a8e6-d7e28dc9b693', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:02:16.875402 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5dd29342-4488-4153-ab50-39f393cf0933 tempest-AttachVolumeNegativeTest-835916675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (908d679d-5ffe-48d8-8ae7-b6c39e470577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:02:16.888375 ncdv-master-1 cinder-volume[129946]: WARNING cinder.volume.drivers.rbd [None req-e94ebf4d-ecd3-46a5-9ac6-50ac3cfe6e5e tempest-GroupSnapshotsTest-781055013 None] Not using v2 clone API, please upgrade to mimic+ and set the OSD minimum client compat version to mimic for better performance, fewer deletion issues: NotImplementedError May 07 22:02:16.913888 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-5dd29342-4488-4153-ab50-39f393cf0933 tempest-AttachVolumeNegativeTest-835916675 None] Volume volume-5df3e22c-323c-404a-a8e6-d7e28dc9b693 (5df3e22c-323c-404a-a8e6-d7e28dc9b693): created successfully May 07 22:02:16.923915 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5dd29342-4488-4153-ab50-39f393cf0933 tempest-AttachVolumeNegativeTest-835916675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (908d679d-5ffe-48d8-8ae7-b6c39e470577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:02:16.930246 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5dd29342-4488-4153-ab50-39f393cf0933 tempest-AttachVolumeNegativeTest-835916675 None] Flow 'volume_create_manager' (6d47c7ec-de21-46bb-9b6e-b24ac7e0b4e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:02:16.945745 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-5dd29342-4488-4153-ab50-39f393cf0933 tempest-AttachVolumeNegativeTest-835916675 None] Created volume successfully. May 07 22:02:17.027416 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-e94ebf4d-ecd3-46a5-9ac6-50ac3cfe6e5e tempest-GroupSnapshotsTest-781055013 None] Create group from source-snapshot-a4e238df-c4c4-499b-ac13-e330814c515f completed successfully. May 07 22:02:17.961280 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-2519fd56-71e6-4b73-8643-579f42de8839 tempest-GroupSnapshotsTest-781055013 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:02:18.103919 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-2519fd56-71e6-4b73-8643-579f42de8839 tempest-GroupSnapshotsTest-781055013 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:02:18.122449 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-2519fd56-71e6-4b73-8643-579f42de8839 tempest-GroupSnapshotsTest-781055013 None] deleting rbd volume volume-006986d0-f02f-49a6-9700-e7d091057e50 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:02:18.682261 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-2519fd56-71e6-4b73-8643-579f42de8839 tempest-GroupSnapshotsTest-781055013 None] Created reservations ['fccff19b-8464-44b7-b663-d45bfa654684'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:02:18.787237 ncdv-master-1 cinder-volume[129946]: WARNING cinder.quota [None req-2519fd56-71e6-4b73-8643-579f42de8839 tempest-GroupSnapshotsTest-781055013 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1709348627 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1709348627, it is now deprecated. Please use the default quota class for default quota. May 07 22:02:18.788081 ncdv-master-1 cinder-volume[129946]: WARNING cinder.quota [None req-2519fd56-71e6-4b73-8643-579f42de8839 tempest-GroupSnapshotsTest-781055013 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1709348627 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1709348627, it is now deprecated. Please use the default quota class for default quota. May 07 22:02:18.822473 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-2519fd56-71e6-4b73-8643-579f42de8839 tempest-GroupSnapshotsTest-781055013 None] Created reservations ['283f24e3-a325-4247-b7f9-e051b0efb697', '2bd73399-ec71-43d4-b583-c1f4f4700b49', '94e99c64-1eb2-4357-85de-6e9c7dc2a4a2', '6e303599-f8c0-44a2-a0a8-8f481379bef7'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:02:19.090659 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-2519fd56-71e6-4b73-8643-579f42de8839 tempest-GroupSnapshotsTest-781055013 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:02:19.194175 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-2519fd56-71e6-4b73-8643-579f42de8839 tempest-GroupSnapshotsTest-781055013 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:02:19.289753 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-2519fd56-71e6-4b73-8643-579f42de8839 tempest-GroupSnapshotsTest-781055013 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:02:19.305288 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-2519fd56-71e6-4b73-8643-579f42de8839 tempest-GroupSnapshotsTest-781055013 None] Delete group completed successfully. May 07 22:02:19.386609 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-afaea28e-a66f-4744-abe0-e7ebb963e2cd req-74aade53-4590-4b2d-a4a7-e47290aa9277 tempest-AttachVolumeNegativeTest-835916675 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 22:02:19.443274 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-8e2d1f67-67ea-4d81-83de-18e26d620fc4 tempest-GroupSnapshotsTest-781055013 None] group_snapshot a4e238df-c4c4-499b-ac13-e330814c515f: deleting May 07 22:02:19.472343 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-8e2d1f67-67ea-4d81-83de-18e26d620fc4 tempest-GroupSnapshotsTest-781055013 None] group_snapshot a4e238df-c4c4-499b-ac13-e330814c515f: deleting {{(pid=129946) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4253}} May 07 22:02:19.497285 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-8e2d1f67-67ea-4d81-83de-18e26d620fc4 tempest-GroupSnapshotsTest-781055013 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:02:20.873777 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-afaea28e-a66f-4744-abe0-e7ebb963e2cd req-74aade53-4590-4b2d-a4a7-e47290aa9277 tempest-AttachVolumeNegativeTest-835916675 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.487s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 22:02:20.874468 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-afaea28e-a66f-4744-abe0-e7ebb963e2cd req-74aade53-4590-4b2d-a4a7-e47290aa9277 tempest-AttachVolumeNegativeTest-835916675 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-5df3e22c-323c-404a-a8e6-d7e28dc9b693', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3ca0b836-1cfe-436a-b0fa-deb74d3203d9', 'volume_id': '5df3e22c-323c-404a-a8e6-d7e28dc9b693', 'discard': True}} {{(pid=129946) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 07 22:02:20.925821 ncdv-master-1 cinder-volume[129946]: WARNING cinder.quota [None req-8e2d1f67-67ea-4d81-83de-18e26d620fc4 tempest-GroupSnapshotsTest-781055013 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1709348627 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1709348627, it is now deprecated. Please use the default quota class for default quota. May 07 22:02:20.968444 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-afaea28e-a66f-4744-abe0-e7ebb963e2cd req-74aade53-4590-4b2d-a4a7-e47290aa9277 tempest-AttachVolumeNegativeTest-835916675 None] Connection info returned from driver {'name': 'volumes/volume-5df3e22c-323c-404a-a8e6-d7e28dc9b693', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '5df3e22c-323c-404a-a8e6-d7e28dc9b693', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '2f6a31ad-2800-4677-aed5-6a32e31f3d23'} {{(pid=129946) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 07 22:02:21.045096 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-8e2d1f67-67ea-4d81-83de-18e26d620fc4 tempest-GroupSnapshotsTest-781055013 None] Created reservations ['7e2f9311-bef8-431f-91d3-8263431497d4', '9b36ca26-fbe7-4ce4-a1c1-baa5646690cc', 'd4f4c823-bedc-473b-bdb8-def192d3b17e', '7a385a97-f22b-458e-9307-a14cffd4f6da'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:02:21.079086 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-afaea28e-a66f-4744-abe0-e7ebb963e2cd req-74aade53-4590-4b2d-a4a7-e47290aa9277 tempest-AttachVolumeNegativeTest-835916675 None] attachment_update completed successfully. May 07 22:02:21.155512 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-8e2d1f67-67ea-4d81-83de-18e26d620fc4 tempest-GroupSnapshotsTest-781055013 None] group_snapshot a4e238df-c4c4-499b-ac13-e330814c515f: deleted successfully May 07 22:02:22.595920 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-ba2147df-0fc1-49e9-acde-a778ce0cde73 tempest-GroupSnapshotsTest-781055013 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:02:22.772029 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-ba2147df-0fc1-49e9-acde-a778ce0cde73 tempest-GroupSnapshotsTest-781055013 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:02:22.776184 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-ba2147df-0fc1-49e9-acde-a778ce0cde73 tempest-GroupSnapshotsTest-781055013 None] Volume volume-8ec0562e-1929-4bfb-b6ea-405ba3dc67de is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:02:22.788266 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-ba2147df-0fc1-49e9-acde-a778ce0cde73 tempest-GroupSnapshotsTest-781055013 None] deleting rbd volume volume-8ec0562e-1929-4bfb-b6ea-405ba3dc67de {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:02:23.399838 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-ba2147df-0fc1-49e9-acde-a778ce0cde73 tempest-GroupSnapshotsTest-781055013 None] Created reservations ['e29e9a89-03dd-4049-9a99-e23514131eec'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:02:23.441641 ncdv-master-1 cinder-volume[129946]: WARNING cinder.db.sqlalchemy.api [None req-ba2147df-0fc1-49e9-acde-a778ce0cde73 tempest-GroupSnapshotsTest-781055013 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1709348627'] May 07 22:02:23.445654 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-ba2147df-0fc1-49e9-acde-a778ce0cde73 tempest-GroupSnapshotsTest-781055013 None] Created reservations ['e26e7206-ec03-45ca-9716-101d52d5c86d', '10d465e4-1e68-4ff8-90fa-3a90a505ea79', 'ed638b3e-584b-4b60-9a40-e0424ffcebc7', '3eed67b6-cbad-41bd-aa56-9c47a509c338'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:02:23.611932 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-ba2147df-0fc1-49e9-acde-a778ce0cde73 tempest-GroupSnapshotsTest-781055013 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:02:23.696879 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-ba2147df-0fc1-49e9-acde-a778ce0cde73 tempest-GroupSnapshotsTest-781055013 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:02:23.779969 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-ba2147df-0fc1-49e9-acde-a778ce0cde73 tempest-GroupSnapshotsTest-781055013 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:02:23.792610 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-ba2147df-0fc1-49e9-acde-a778ce0cde73 tempest-GroupSnapshotsTest-781055013 None] Delete group completed successfully. May 07 22:02:24.119624 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-51dcb0da-c39a-4158-830b-702f7e81a024 tempest-GroupSnapshotsTest-781055013 None] Group tempest-GroupSnapshotsTest-Group-1395023558: creating May 07 22:02:24.171208 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-51dcb0da-c39a-4158-830b-702f7e81a024 tempest-GroupSnapshotsTest-781055013 None] Group tempest-GroupSnapshotsTest-Group-1395023558: created successfully May 07 22:02:24.184039 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-51dcb0da-c39a-4158-830b-702f7e81a024 tempest-GroupSnapshotsTest-781055013 None] Create group completed successfully. May 07 22:02:25.930122 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-edc389d3-3fc7-4c55-af8a-6a85c67128f7 tempest-GroupSnapshotsTest-781055013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:02:25.954905 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-edc389d3-3fc7-4c55-af8a-6a85c67128f7 tempest-GroupSnapshotsTest-781055013 None] Flow 'volume_create_manager' (1ed9a130-6707-4e21-96bd-20c8e8c46149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:02:25.963047 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-edc389d3-3fc7-4c55-af8a-6a85c67128f7 tempest-GroupSnapshotsTest-781055013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cd9b493-0a8a-4041-bfc6-7866065ca029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:02:25.982263 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-edc389d3-3fc7-4c55-af8a-6a85c67128f7 tempest-GroupSnapshotsTest-781055013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cd9b493-0a8a-4041-bfc6-7866065ca029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1316819900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c0c0ace5-1e70-46a9-ae31-5748745eb7b9,host='ncdv-master-1@ceph#ceph',id=0bac74d5-2221-44ee-81cb-a57b64dd73a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ea307efc44a4c648173ea614ab793a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:02:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:02:26Z,use_quota=True,user_id='a251148af7f940b596a159886a883bb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e35bf88-4bbf-4324-b845-5cb8c5fce87f),volume_type_id=5e35bf88-4bbf-4324-b845-5cb8c5fce87f)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:02:25.993229 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-edc389d3-3fc7-4c55-af8a-6a85c67128f7 tempest-GroupSnapshotsTest-781055013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0b1985d-150a-4c05-a60a-48623ecd93d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:02:25.999393 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-edc389d3-3fc7-4c55-af8a-6a85c67128f7 tempest-GroupSnapshotsTest-781055013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0b1985d-150a-4c05-a60a-48623ecd93d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:02:26.009528 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-edc389d3-3fc7-4c55-af8a-6a85c67128f7 tempest-GroupSnapshotsTest-781055013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06074099-95d3-4b96-8122-e0d52394470b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:02:26.014840 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-edc389d3-3fc7-4c55-af8a-6a85c67128f7 tempest-GroupSnapshotsTest-781055013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06074099-95d3-4b96-8122-e0d52394470b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bac74d5-2221-44ee-81cb-a57b64dd73a5', 'volume_name': 'volume-0bac74d5-2221-44ee-81cb-a57b64dd73a5', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:02:26.021927 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-edc389d3-3fc7-4c55-af8a-6a85c67128f7 tempest-GroupSnapshotsTest-781055013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (922ce37d-de06-46e3-b0d3-6aca6cf10f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:02:26.033340 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-edc389d3-3fc7-4c55-af8a-6a85c67128f7 tempest-GroupSnapshotsTest-781055013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (922ce37d-de06-46e3-b0d3-6aca6cf10f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:02:26.048995 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-edc389d3-3fc7-4c55-af8a-6a85c67128f7 tempest-GroupSnapshotsTest-781055013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bda6229c-8e66-4837-b199-c6872d73f7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:02:26.050973 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-edc389d3-3fc7-4c55-af8a-6a85c67128f7 tempest-GroupSnapshotsTest-781055013 None] Volume 0bac74d5-2221-44ee-81cb-a57b64dd73a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bac74d5-2221-44ee-81cb-a57b64dd73a5', 'volume_size': 1} May 07 22:02:26.051531 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-edc389d3-3fc7-4c55-af8a-6a85c67128f7 tempest-GroupSnapshotsTest-781055013 None] creating volume 'volume-0bac74d5-2221-44ee-81cb-a57b64dd73a5' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:02:26.052509 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-edc389d3-3fc7-4c55-af8a-6a85c67128f7 tempest-GroupSnapshotsTest-781055013 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:02:26.190734 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-edc389d3-3fc7-4c55-af8a-6a85c67128f7 tempest-GroupSnapshotsTest-781055013 None] extra_specs: {} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:02:26.191641 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-edc389d3-3fc7-4c55-af8a-6a85c67128f7 tempest-GroupSnapshotsTest-781055013 None] extra_specs: {} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:02:26.198299 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-edc389d3-3fc7-4c55-af8a-6a85c67128f7 tempest-GroupSnapshotsTest-781055013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bda6229c-8e66-4837-b199-c6872d73f7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bac74d5-2221-44ee-81cb-a57b64dd73a5', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:02:26.207953 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-edc389d3-3fc7-4c55-af8a-6a85c67128f7 tempest-GroupSnapshotsTest-781055013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00499892-fff8-4382-be42-9f792caeb521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:02:26.229375 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-edc389d3-3fc7-4c55-af8a-6a85c67128f7 tempest-GroupSnapshotsTest-781055013 None] Volume volume-0bac74d5-2221-44ee-81cb-a57b64dd73a5 (0bac74d5-2221-44ee-81cb-a57b64dd73a5): created successfully May 07 22:02:26.241111 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-edc389d3-3fc7-4c55-af8a-6a85c67128f7 tempest-GroupSnapshotsTest-781055013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00499892-fff8-4382-be42-9f792caeb521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:02:26.272098 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-edc389d3-3fc7-4c55-af8a-6a85c67128f7 tempest-GroupSnapshotsTest-781055013 None] Flow 'volume_create_manager' (1ed9a130-6707-4e21-96bd-20c8e8c46149) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:02:26.295506 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-edc389d3-3fc7-4c55-af8a-6a85c67128f7 tempest-GroupSnapshotsTest-781055013 None] Created volume successfully. May 07 22:02:27.854972 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b96735c-02f8-4695-a4fb-fda18d30870e tempest-GroupSnapshotsTest-781055013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:02:27.901612 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-3b96735c-02f8-4695-a4fb-fda18d30870e tempest-GroupSnapshotsTest-781055013 None] Flow 'volume_create_manager' (f3a2525d-ce0a-46c6-a065-42ddf7bd8d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:02:27.922053 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-3b96735c-02f8-4695-a4fb-fda18d30870e tempest-GroupSnapshotsTest-781055013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad3562c1-e801-421f-8c56-6c0b11e599be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:02:27.967258 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-3b96735c-02f8-4695-a4fb-fda18d30870e tempest-GroupSnapshotsTest-781055013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad3562c1-e801-421f-8c56-6c0b11e599be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:02:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1407958917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c0c0ace5-1e70-46a9-ae31-5748745eb7b9,host='ncdv-master-1@ceph#ceph',id=80540ba9-6c3b-4257-bced-679718b16aab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ea307efc44a4c648173ea614ab793a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:02:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:02:28Z,use_quota=True,user_id='a251148af7f940b596a159886a883bb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e35bf88-4bbf-4324-b845-5cb8c5fce87f),volume_type_id=5e35bf88-4bbf-4324-b845-5cb8c5fce87f)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:02:27.980694 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-3b96735c-02f8-4695-a4fb-fda18d30870e tempest-GroupSnapshotsTest-781055013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12be5707-3b89-47a2-bfb7-100ca444c347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:02:27.998670 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-3b96735c-02f8-4695-a4fb-fda18d30870e tempest-GroupSnapshotsTest-781055013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12be5707-3b89-47a2-bfb7-100ca444c347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:02:28.040467 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-3b96735c-02f8-4695-a4fb-fda18d30870e tempest-GroupSnapshotsTest-781055013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86157bc1-c66c-4ef6-80bd-14fb7c46bb7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:02:28.053426 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-3b96735c-02f8-4695-a4fb-fda18d30870e tempest-GroupSnapshotsTest-781055013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86157bc1-c66c-4ef6-80bd-14fb7c46bb7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80540ba9-6c3b-4257-bced-679718b16aab', 'volume_name': 'volume-80540ba9-6c3b-4257-bced-679718b16aab', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:02:28.072226 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-3b96735c-02f8-4695-a4fb-fda18d30870e tempest-GroupSnapshotsTest-781055013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c50bad0-aa46-4c73-aa7f-3061b6d89d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:02:28.107108 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-3b96735c-02f8-4695-a4fb-fda18d30870e tempest-GroupSnapshotsTest-781055013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c50bad0-aa46-4c73-aa7f-3061b6d89d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:02:28.126500 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-3b96735c-02f8-4695-a4fb-fda18d30870e tempest-GroupSnapshotsTest-781055013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c058d4e-3c1b-4f6a-a0ed-b0347a470a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:02:28.127583 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-3b96735c-02f8-4695-a4fb-fda18d30870e tempest-GroupSnapshotsTest-781055013 None] Volume 80540ba9-6c3b-4257-bced-679718b16aab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80540ba9-6c3b-4257-bced-679718b16aab', 'volume_size': 1} May 07 22:02:28.127974 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-3b96735c-02f8-4695-a4fb-fda18d30870e tempest-GroupSnapshotsTest-781055013 None] creating volume 'volume-80540ba9-6c3b-4257-bced-679718b16aab' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:02:28.128659 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-3b96735c-02f8-4695-a4fb-fda18d30870e tempest-GroupSnapshotsTest-781055013 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:02:28.300091 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-3b96735c-02f8-4695-a4fb-fda18d30870e tempest-GroupSnapshotsTest-781055013 None] extra_specs: {} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:02:28.301160 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-3b96735c-02f8-4695-a4fb-fda18d30870e tempest-GroupSnapshotsTest-781055013 None] extra_specs: {} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:02:28.306426 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-3b96735c-02f8-4695-a4fb-fda18d30870e tempest-GroupSnapshotsTest-781055013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c058d4e-3c1b-4f6a-a0ed-b0347a470a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80540ba9-6c3b-4257-bced-679718b16aab', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:02:28.325454 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-3b96735c-02f8-4695-a4fb-fda18d30870e tempest-GroupSnapshotsTest-781055013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (235dd67b-f91c-4d7e-8912-2c4d9e6c11b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:02:28.368706 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-3b96735c-02f8-4695-a4fb-fda18d30870e tempest-GroupSnapshotsTest-781055013 None] Volume volume-80540ba9-6c3b-4257-bced-679718b16aab (80540ba9-6c3b-4257-bced-679718b16aab): created successfully May 07 22:02:28.375732 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-3b96735c-02f8-4695-a4fb-fda18d30870e tempest-GroupSnapshotsTest-781055013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (235dd67b-f91c-4d7e-8912-2c4d9e6c11b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:02:28.399302 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-3b96735c-02f8-4695-a4fb-fda18d30870e tempest-GroupSnapshotsTest-781055013 None] Flow 'volume_create_manager' (f3a2525d-ce0a-46c6-a065-42ddf7bd8d2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:02:28.422519 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-3b96735c-02f8-4695-a4fb-fda18d30870e tempest-GroupSnapshotsTest-781055013 None] Created volume successfully. May 07 22:02:29.454039 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-79cb69a9-ec2c-405f-b9e0-b3735ee746c6 tempest-GroupSnapshotsTest-781055013 None] Update group completed successfully. May 07 22:02:30.608016 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-964f8561-0255-4788-8faf-0340402a969f req-4b2a8c94-077a-4388-8370-e3fae107b5cf tempest-AttachVolumeTestJSON-808075378 None] Terminate volume connection completed successfully. May 07 22:02:30.609988 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-964f8561-0255-4788-8faf-0340402a969f req-4b2a8c94-077a-4388-8370-e3fae107b5cf tempest-AttachVolumeTestJSON-808075378 None] Deleting attachment 8d8cd546-ecc9-43c4-9633-37769701eeb9. {{(pid=129946) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 07 22:02:30.752731 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:02:30.754403 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:02:30.865799 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:02:30.935769 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:02:31.104580 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-fa3313ff-262c-48bd-ba4b-269dc22d5dd7 tempest-GroupSnapshotsTest-781055013 None] Update group completed successfully. May 07 22:02:32.341999 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-7f1db627-bf6a-4a7d-96ad-1ccc0d95e992 tempest-GroupSnapshotsTest-781055013 None] Update group completed successfully. May 07 22:02:33.912409 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-0062c4c3-6e59-44d5-837b-05778ca044c4 tempest-GroupSnapshotsTest-781055013 None] Update group completed successfully. May 07 22:02:35.781011 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-7d22f127-0b1c-4c0e-a1e3-e17c8365bcb2 tempest-GroupSnapshotsTest-781055013 None] GroupSnapshot 9f9b9185-cc0a-48b3-8157-78bd71db09a2: creating. May 07 22:02:35.864825 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7d22f127-0b1c-4c0e-a1e3-e17c8365bcb2 tempest-GroupSnapshotsTest-781055013 None] Group snapshot 9f9b9185-cc0a-48b3-8157-78bd71db09a2: creating. {{(pid=129946) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4078}} May 07 22:02:35.954191 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-7d22f127-0b1c-4c0e-a1e3-e17c8365bcb2 tempest-GroupSnapshotsTest-781055013 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:02:36.446705 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-7d22f127-0b1c-4c0e-a1e3-e17c8365bcb2 tempest-GroupSnapshotsTest-781055013 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:02:37.614187 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-7d22f127-0b1c-4c0e-a1e3-e17c8365bcb2 tempest-GroupSnapshotsTest-781055013 None] group_snapshot 9f9b9185-cc0a-48b3-8157-78bd71db09a2: created successfully May 07 22:02:38.232076 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-fa194279-42a1-4b42-9943-04d735b10142 tempest-GroupSnapshotsTest-781055013 None] group_snapshot 9f9b9185-cc0a-48b3-8157-78bd71db09a2: deleting May 07 22:02:38.294712 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-fa194279-42a1-4b42-9943-04d735b10142 tempest-GroupSnapshotsTest-781055013 None] group_snapshot 9f9b9185-cc0a-48b3-8157-78bd71db09a2: deleting {{(pid=129946) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4253}} May 07 22:02:38.360334 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-fa194279-42a1-4b42-9943-04d735b10142 tempest-GroupSnapshotsTest-781055013 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:02:39.425123 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-fa194279-42a1-4b42-9943-04d735b10142 tempest-GroupSnapshotsTest-781055013 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:02:40.810283 ncdv-master-1 cinder-volume[129946]: WARNING cinder.quota [None req-fa194279-42a1-4b42-9943-04d735b10142 tempest-GroupSnapshotsTest-781055013 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-835793514 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-835793514, it is now deprecated. Please use the default quota class for default quota. May 07 22:02:40.811720 ncdv-master-1 cinder-volume[129946]: WARNING cinder.quota [None req-fa194279-42a1-4b42-9943-04d735b10142 tempest-GroupSnapshotsTest-781055013 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-835793514 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-835793514, it is now deprecated. Please use the default quota class for default quota. May 07 22:02:40.829933 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-fa194279-42a1-4b42-9943-04d735b10142 tempest-GroupSnapshotsTest-781055013 None] Created reservations ['cc224154-8dff-4e3e-96ca-ca9b22f77ad7', '3af954ce-65e6-4e8c-be6c-fde9d7bd500d', 'aafb6284-bd41-4df7-bfa5-5ef30b7a4a72', 'af3a66cb-6050-44c1-a3a8-47a1ff17956f'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:02:41.062263 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-fa194279-42a1-4b42-9943-04d735b10142 tempest-GroupSnapshotsTest-781055013 None] Created reservations ['f8b80fa6-eddc-473d-a263-9a55dc57b943', '4b8dcdab-d424-4c71-80b9-5f0e15b6cfb4', '707d667a-e5a8-459c-b8c6-d1c82066d07e', '5f1d539b-303b-4464-9004-42686ae385c1'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:02:41.137239 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-fa194279-42a1-4b42-9943-04d735b10142 tempest-GroupSnapshotsTest-781055013 None] group_snapshot 9f9b9185-cc0a-48b3-8157-78bd71db09a2: deleted successfully May 07 22:02:42.747154 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-c44712f9-b19d-4798-9dd4-b0fa0f980bb0 tempest-GroupSnapshotsTest-781055013 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:02:42.842147 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-c44712f9-b19d-4798-9dd4-b0fa0f980bb0 tempest-GroupSnapshotsTest-781055013 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:02:42.842578 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-c44712f9-b19d-4798-9dd4-b0fa0f980bb0 tempest-GroupSnapshotsTest-781055013 None] Volume volume-0bac74d5-2221-44ee-81cb-a57b64dd73a5 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:02:42.857817 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-c44712f9-b19d-4798-9dd4-b0fa0f980bb0 tempest-GroupSnapshotsTest-781055013 None] deleting rbd volume volume-0bac74d5-2221-44ee-81cb-a57b64dd73a5 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:02:43.404017 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-c44712f9-b19d-4798-9dd4-b0fa0f980bb0 tempest-GroupSnapshotsTest-781055013 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:02:43.507957 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-c44712f9-b19d-4798-9dd4-b0fa0f980bb0 tempest-GroupSnapshotsTest-781055013 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:02:43.509609 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-c44712f9-b19d-4798-9dd4-b0fa0f980bb0 tempest-GroupSnapshotsTest-781055013 None] Volume volume-80540ba9-6c3b-4257-bced-679718b16aab is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:02:43.537225 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-c44712f9-b19d-4798-9dd4-b0fa0f980bb0 tempest-GroupSnapshotsTest-781055013 None] deleting rbd volume volume-80540ba9-6c3b-4257-bced-679718b16aab {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:02:44.243349 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-c44712f9-b19d-4798-9dd4-b0fa0f980bb0 tempest-GroupSnapshotsTest-781055013 None] Created reservations ['81ecb44f-9594-4442-9444-2138c0dd5f03'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:02:44.307816 ncdv-master-1 cinder-volume[129946]: WARNING cinder.quota [None req-c44712f9-b19d-4798-9dd4-b0fa0f980bb0 tempest-GroupSnapshotsTest-781055013 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-835793514 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-835793514, it is now deprecated. Please use the default quota class for default quota. May 07 22:02:44.333622 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-c44712f9-b19d-4798-9dd4-b0fa0f980bb0 tempest-GroupSnapshotsTest-781055013 None] Created reservations ['d0b8cd3c-f846-4e76-ad21-f303da8798d5', '74919288-c821-477e-a471-07ec32a38f16', '7e63f809-8dfd-4310-95ab-8a845e8cb69a', 'd84fa012-4fd6-4add-9c46-7dc7ba4c20d3'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:02:44.526957 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-c44712f9-b19d-4798-9dd4-b0fa0f980bb0 tempest-GroupSnapshotsTest-781055013 None] Created reservations ['0e21885b-74ab-4a11-9a84-c97514f47561', 'cfdd7460-39d2-41e2-9b30-06cf38d2c269', 'e1a380bc-840b-4c20-bd6c-5feed86d7416', '05096d48-c1c9-4e76-8411-f647cf3184b3'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:02:44.824922 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-c44712f9-b19d-4798-9dd4-b0fa0f980bb0 tempest-GroupSnapshotsTest-781055013 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:02:44.929681 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-c44712f9-b19d-4798-9dd4-b0fa0f980bb0 tempest-GroupSnapshotsTest-781055013 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:02:45.016026 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-c44712f9-b19d-4798-9dd4-b0fa0f980bb0 tempest-GroupSnapshotsTest-781055013 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:02:45.020186 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-c44712f9-b19d-4798-9dd4-b0fa0f980bb0 tempest-GroupSnapshotsTest-781055013 None] Delete group completed successfully. May 07 22:02:45.604353 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-62996594-362d-4b1f-8b36-dd7d3fbbb175 tempest-GroupSnapshotsTest-781055013 None] Group tempest-GroupSnapshotsTest-Group-23223957: creating May 07 22:02:45.689146 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-62996594-362d-4b1f-8b36-dd7d3fbbb175 tempest-GroupSnapshotsTest-781055013 None] Group tempest-GroupSnapshotsTest-Group-23223957: created successfully May 07 22:02:45.732504 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-62996594-362d-4b1f-8b36-dd7d3fbbb175 tempest-GroupSnapshotsTest-781055013 None] Create group completed successfully. May 07 22:02:47.491004 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-02706421-da1f-40be-b0f8-60564c1d6634 tempest-GroupSnapshotsTest-781055013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:02:47.570903 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-02706421-da1f-40be-b0f8-60564c1d6634 tempest-GroupSnapshotsTest-781055013 None] Flow 'volume_create_manager' (e45098b1-b574-434d-9915-5e9512f96f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:02:47.593087 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-02706421-da1f-40be-b0f8-60564c1d6634 tempest-GroupSnapshotsTest-781055013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1974e1fb-d8ff-479e-bbb7-4c7043e27c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:02:47.635785 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-02706421-da1f-40be-b0f8-60564c1d6634 tempest-GroupSnapshotsTest-781055013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1974e1fb-d8ff-479e-bbb7-4c7043e27c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:02:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1652411548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c7680092-f59c-4d5a-b8a0-0987139e0dc6,host='ncdv-master-1@ceph#ceph',id=76ffbd58-0385-4a57-a70c-498fa5e176a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ea307efc44a4c648173ea614ab793a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:02:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:02:47Z,use_quota=True,user_id='a251148af7f940b596a159886a883bb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e7502659-13e4-4f5a-99d2-6ccb27443bc4),volume_type_id=e7502659-13e4-4f5a-99d2-6ccb27443bc4)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:02:47.654249 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-02706421-da1f-40be-b0f8-60564c1d6634 tempest-GroupSnapshotsTest-781055013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0b53759-4ea6-4330-8f7c-8fa2ba2f12fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:02:47.664896 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-02706421-da1f-40be-b0f8-60564c1d6634 tempest-GroupSnapshotsTest-781055013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0b53759-4ea6-4330-8f7c-8fa2ba2f12fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:02:47.682241 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-02706421-da1f-40be-b0f8-60564c1d6634 tempest-GroupSnapshotsTest-781055013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7473158a-bbbb-4414-97d4-c840abf3f1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:02:47.688844 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-02706421-da1f-40be-b0f8-60564c1d6634 tempest-GroupSnapshotsTest-781055013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7473158a-bbbb-4414-97d4-c840abf3f1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76ffbd58-0385-4a57-a70c-498fa5e176a0', 'volume_name': 'volume-76ffbd58-0385-4a57-a70c-498fa5e176a0', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:02:47.705872 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-02706421-da1f-40be-b0f8-60564c1d6634 tempest-GroupSnapshotsTest-781055013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c77b04b4-bbf0-4d40-833e-59a52dcf50e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:02:47.719120 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-02706421-da1f-40be-b0f8-60564c1d6634 tempest-GroupSnapshotsTest-781055013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c77b04b4-bbf0-4d40-833e-59a52dcf50e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:02:47.734003 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-02706421-da1f-40be-b0f8-60564c1d6634 tempest-GroupSnapshotsTest-781055013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61162650-aeb2-441a-ad35-b49cb74605fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:02:47.738418 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-02706421-da1f-40be-b0f8-60564c1d6634 tempest-GroupSnapshotsTest-781055013 None] Volume 76ffbd58-0385-4a57-a70c-498fa5e176a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76ffbd58-0385-4a57-a70c-498fa5e176a0', 'volume_size': 1} May 07 22:02:47.740677 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-02706421-da1f-40be-b0f8-60564c1d6634 tempest-GroupSnapshotsTest-781055013 None] creating volume 'volume-76ffbd58-0385-4a57-a70c-498fa5e176a0' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:02:47.743002 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-02706421-da1f-40be-b0f8-60564c1d6634 tempest-GroupSnapshotsTest-781055013 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:02:47.909480 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-02706421-da1f-40be-b0f8-60564c1d6634 tempest-GroupSnapshotsTest-781055013 None] extra_specs: {} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:02:47.909867 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-02706421-da1f-40be-b0f8-60564c1d6634 tempest-GroupSnapshotsTest-781055013 None] extra_specs: {} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:02:47.914298 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-02706421-da1f-40be-b0f8-60564c1d6634 tempest-GroupSnapshotsTest-781055013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61162650-aeb2-441a-ad35-b49cb74605fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76ffbd58-0385-4a57-a70c-498fa5e176a0', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:02:47.928858 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-02706421-da1f-40be-b0f8-60564c1d6634 tempest-GroupSnapshotsTest-781055013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6431f6e-63e7-4cd6-a460-009ea0cafce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:02:47.962550 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-02706421-da1f-40be-b0f8-60564c1d6634 tempest-GroupSnapshotsTest-781055013 None] Volume volume-76ffbd58-0385-4a57-a70c-498fa5e176a0 (76ffbd58-0385-4a57-a70c-498fa5e176a0): created successfully May 07 22:02:47.967041 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-02706421-da1f-40be-b0f8-60564c1d6634 tempest-GroupSnapshotsTest-781055013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6431f6e-63e7-4cd6-a460-009ea0cafce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:02:47.984425 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-02706421-da1f-40be-b0f8-60564c1d6634 tempest-GroupSnapshotsTest-781055013 None] Flow 'volume_create_manager' (e45098b1-b574-434d-9915-5e9512f96f01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:02:48.012369 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-02706421-da1f-40be-b0f8-60564c1d6634 tempest-GroupSnapshotsTest-781055013 None] Created volume successfully. May 07 22:02:48.860252 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-951bb09b-7559-44b2-8317-e9618c918d33 tempest-GroupSnapshotsTest-781055013 None] GroupSnapshot e616da4b-f5a2-421a-b085-56a3488471ae: creating. May 07 22:02:48.900798 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-951bb09b-7559-44b2-8317-e9618c918d33 tempest-GroupSnapshotsTest-781055013 None] Group snapshot e616da4b-f5a2-421a-b085-56a3488471ae: creating. {{(pid=129946) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4078}} May 07 22:02:48.936969 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-951bb09b-7559-44b2-8317-e9618c918d33 tempest-GroupSnapshotsTest-781055013 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:02:49.789380 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-951bb09b-7559-44b2-8317-e9618c918d33 tempest-GroupSnapshotsTest-781055013 None] group_snapshot e616da4b-f5a2-421a-b085-56a3488471ae: created successfully May 07 22:02:50.270061 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-bc7b6d6c-7257-4701-bbf2-f4e6939759dd tempest-GroupSnapshotsTest-781055013 None] group_snapshot e616da4b-f5a2-421a-b085-56a3488471ae: deleting May 07 22:02:50.405324 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-bc7b6d6c-7257-4701-bbf2-f4e6939759dd tempest-GroupSnapshotsTest-781055013 None] group_snapshot e616da4b-f5a2-421a-b085-56a3488471ae: deleting {{(pid=129946) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4253}} May 07 22:02:50.443095 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-bc7b6d6c-7257-4701-bbf2-f4e6939759dd tempest-GroupSnapshotsTest-781055013 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:02:51.843973 ncdv-master-1 cinder-volume[129946]: WARNING cinder.quota [None req-bc7b6d6c-7257-4701-bbf2-f4e6939759dd tempest-GroupSnapshotsTest-781055013 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-65000172 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-65000172, it is now deprecated. Please use the default quota class for default quota. May 07 22:02:51.853741 ncdv-master-1 cinder-volume[129946]: WARNING cinder.quota [None req-bc7b6d6c-7257-4701-bbf2-f4e6939759dd tempest-GroupSnapshotsTest-781055013 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-65000172 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-65000172, it is now deprecated. Please use the default quota class for default quota. May 07 22:02:51.919465 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-bc7b6d6c-7257-4701-bbf2-f4e6939759dd tempest-GroupSnapshotsTest-781055013 None] Created reservations ['6604dd40-6a46-40e8-bc5c-9f8960af355f', 'c395c7d5-c702-45b2-a948-a154b68ff3b2', 'a6337258-30e0-4c63-a549-b9c51e127163', '7cca3f5f-287c-4187-8d26-be9059af74a8'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:02:52.044500 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-bc7b6d6c-7257-4701-bbf2-f4e6939759dd tempest-GroupSnapshotsTest-781055013 None] group_snapshot e616da4b-f5a2-421a-b085-56a3488471ae: deleted successfully May 07 22:02:53.255026 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d885783a-c278-4584-b8f5-8cc351b5b004 tempest-GroupSnapshotsTest-781055013 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:02:53.387946 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d885783a-c278-4584-b8f5-8cc351b5b004 tempest-GroupSnapshotsTest-781055013 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:02:53.388375 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d885783a-c278-4584-b8f5-8cc351b5b004 tempest-GroupSnapshotsTest-781055013 None] Volume volume-76ffbd58-0385-4a57-a70c-498fa5e176a0 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:02:53.400747 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d885783a-c278-4584-b8f5-8cc351b5b004 tempest-GroupSnapshotsTest-781055013 None] deleting rbd volume volume-76ffbd58-0385-4a57-a70c-498fa5e176a0 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:02:54.006697 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-d885783a-c278-4584-b8f5-8cc351b5b004 tempest-GroupSnapshotsTest-781055013 None] Created reservations ['8277a9c7-17e1-420d-9ed4-d7279147892a'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:02:54.066596 ncdv-master-1 cinder-volume[129946]: WARNING cinder.quota [None req-d885783a-c278-4584-b8f5-8cc351b5b004 tempest-GroupSnapshotsTest-781055013 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-65000172 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-65000172, it is now deprecated. Please use the default quota class for default quota. May 07 22:02:54.118440 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-d885783a-c278-4584-b8f5-8cc351b5b004 tempest-GroupSnapshotsTest-781055013 None] Created reservations ['58e3c951-04e9-4c1b-bb84-aa6166858be4', 'bbeacb1e-411c-4c64-995b-f7883c927f5b', '1ea0921c-5f39-4310-a10e-7a411a55dd13', 'bf2f2c51-a4d3-43c3-941d-9dfafe25b593'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:02:54.281445 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d885783a-c278-4584-b8f5-8cc351b5b004 tempest-GroupSnapshotsTest-781055013 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:02:54.388670 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d885783a-c278-4584-b8f5-8cc351b5b004 tempest-GroupSnapshotsTest-781055013 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:02:54.484018 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-d885783a-c278-4584-b8f5-8cc351b5b004 tempest-GroupSnapshotsTest-781055013 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:02:54.488975 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-d885783a-c278-4584-b8f5-8cc351b5b004 tempest-GroupSnapshotsTest-781055013 None] Delete group completed successfully. May 07 22:03:01.705293 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eb18772-9c8d-4cb4-8f58-23d91532ef8d tempest-VolumesBackupsAdminTest-1667063411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:03:01.737616 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-0eb18772-9c8d-4cb4-8f58-23d91532ef8d tempest-VolumesBackupsAdminTest-1667063411 None] Flow 'volume_create_manager' (f55c8970-1236-4cec-a9f1-803fa972a7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:03:01.746698 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-0eb18772-9c8d-4cb4-8f58-23d91532ef8d tempest-VolumesBackupsAdminTest-1667063411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da8ddef1-7510-45d6-8700-d990a2015511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:01.773842 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-0eb18772-9c8d-4cb4-8f58-23d91532ef8d tempest-VolumesBackupsAdminTest-1667063411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da8ddef1-7510-45d6-8700-d990a2015511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-314040788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4c2b93f0-2cae-4c4a-8f15-32043b50e7d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9efc1fbca3ab413fabfc108b752dd251',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:03:02Z,use_quota=True,user_id='e1d72e319762436a9a2f8a69e5402bf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:01.781071 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-0eb18772-9c8d-4cb4-8f58-23d91532ef8d tempest-VolumesBackupsAdminTest-1667063411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a61cce6b-5548-4094-8fd6-7f1cf6358ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:01.786388 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-0eb18772-9c8d-4cb4-8f58-23d91532ef8d tempest-VolumesBackupsAdminTest-1667063411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a61cce6b-5548-4094-8fd6-7f1cf6358ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:01.793334 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-0eb18772-9c8d-4cb4-8f58-23d91532ef8d tempest-VolumesBackupsAdminTest-1667063411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c201e057-6a66-46e4-8bbe-92fc43313b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:01.798862 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-0eb18772-9c8d-4cb4-8f58-23d91532ef8d tempest-VolumesBackupsAdminTest-1667063411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c201e057-6a66-46e4-8bbe-92fc43313b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c2b93f0-2cae-4c4a-8f15-32043b50e7d8', 'volume_name': 'volume-4c2b93f0-2cae-4c4a-8f15-32043b50e7d8', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:01.804826 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-0eb18772-9c8d-4cb4-8f58-23d91532ef8d tempest-VolumesBackupsAdminTest-1667063411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64cf77b2-994b-4461-98ae-66fbd36484ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:01.809207 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-0eb18772-9c8d-4cb4-8f58-23d91532ef8d tempest-VolumesBackupsAdminTest-1667063411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64cf77b2-994b-4461-98ae-66fbd36484ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:01.814909 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-0eb18772-9c8d-4cb4-8f58-23d91532ef8d tempest-VolumesBackupsAdminTest-1667063411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8dfd4f2-3ff0-430d-854b-5143532dfb76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:01.816041 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-0eb18772-9c8d-4cb4-8f58-23d91532ef8d tempest-VolumesBackupsAdminTest-1667063411 None] Volume 4c2b93f0-2cae-4c4a-8f15-32043b50e7d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c2b93f0-2cae-4c4a-8f15-32043b50e7d8', 'volume_size': 1} May 07 22:03:01.816432 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0eb18772-9c8d-4cb4-8f58-23d91532ef8d tempest-VolumesBackupsAdminTest-1667063411 None] creating volume 'volume-4c2b93f0-2cae-4c4a-8f15-32043b50e7d8' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:03:01.817371 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0eb18772-9c8d-4cb4-8f58-23d91532ef8d tempest-VolumesBackupsAdminTest-1667063411 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:03:01.903542 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0eb18772-9c8d-4cb4-8f58-23d91532ef8d tempest-VolumesBackupsAdminTest-1667063411 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:03:01.904205 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0eb18772-9c8d-4cb4-8f58-23d91532ef8d tempest-VolumesBackupsAdminTest-1667063411 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:03:01.908936 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-0eb18772-9c8d-4cb4-8f58-23d91532ef8d tempest-VolumesBackupsAdminTest-1667063411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8dfd4f2-3ff0-430d-854b-5143532dfb76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c2b93f0-2cae-4c4a-8f15-32043b50e7d8', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:01.915357 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-0eb18772-9c8d-4cb4-8f58-23d91532ef8d tempest-VolumesBackupsAdminTest-1667063411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b81aa09d-801f-4e02-a601-a24ac33fd844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:01.939818 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-0eb18772-9c8d-4cb4-8f58-23d91532ef8d tempest-VolumesBackupsAdminTest-1667063411 None] Volume volume-4c2b93f0-2cae-4c4a-8f15-32043b50e7d8 (4c2b93f0-2cae-4c4a-8f15-32043b50e7d8): created successfully May 07 22:03:01.945777 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-0eb18772-9c8d-4cb4-8f58-23d91532ef8d tempest-VolumesBackupsAdminTest-1667063411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b81aa09d-801f-4e02-a601-a24ac33fd844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:01.955101 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-0eb18772-9c8d-4cb4-8f58-23d91532ef8d tempest-VolumesBackupsAdminTest-1667063411 None] Flow 'volume_create_manager' (f55c8970-1236-4cec-a9f1-803fa972a7ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:03:01.965413 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-0eb18772-9c8d-4cb4-8f58-23d91532ef8d tempest-VolumesBackupsAdminTest-1667063411 None] Created volume successfully. May 07 22:03:02.951884 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-631c89ce-2253-4b93-8186-b2ca7786b1d7 tempest-VolumesListTestJSON-425580272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:03:02.973890 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-631c89ce-2253-4b93-8186-b2ca7786b1d7 tempest-VolumesListTestJSON-425580272 None] Flow 'volume_create_manager' (32515ff3-1809-40a3-9284-445cc53a2702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:03:02.981159 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-631c89ce-2253-4b93-8186-b2ca7786b1d7 tempest-VolumesListTestJSON-425580272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06161bd2-a95b-4a4a-a363-85665d1dd0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:03.002340 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-631c89ce-2253-4b93-8186-b2ca7786b1d7 tempest-VolumesListTestJSON-425580272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06161bd2-a95b-4a4a-a363-85665d1dd0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-408353769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6686d121-fe66-4a90-8f93-5ca4fad2163d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='496d6c4436364effa7fa3e8577d05729',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:03:03Z,use_quota=True,user_id='792c2071a6254c73920ca02fdfa4494b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:03.009218 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-631c89ce-2253-4b93-8186-b2ca7786b1d7 tempest-VolumesListTestJSON-425580272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecaab870-be1b-4b41-b8b3-2cd847fd44b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:03.015995 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-631c89ce-2253-4b93-8186-b2ca7786b1d7 tempest-VolumesListTestJSON-425580272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecaab870-be1b-4b41-b8b3-2cd847fd44b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:03.018966 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-631c89ce-2253-4b93-8186-b2ca7786b1d7 tempest-VolumesListTestJSON-425580272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ccd152b-0ae3-4a15-bfda-8fe90efda092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:03.023150 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-631c89ce-2253-4b93-8186-b2ca7786b1d7 tempest-VolumesListTestJSON-425580272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ccd152b-0ae3-4a15-bfda-8fe90efda092) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6686d121-fe66-4a90-8f93-5ca4fad2163d', 'volume_name': 'volume-6686d121-fe66-4a90-8f93-5ca4fad2163d', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:03.029054 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-631c89ce-2253-4b93-8186-b2ca7786b1d7 tempest-VolumesListTestJSON-425580272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dda2e70-a83b-4c53-b3ae-45ff6084c1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:03.033995 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-631c89ce-2253-4b93-8186-b2ca7786b1d7 tempest-VolumesListTestJSON-425580272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dda2e70-a83b-4c53-b3ae-45ff6084c1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:03.039397 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-631c89ce-2253-4b93-8186-b2ca7786b1d7 tempest-VolumesListTestJSON-425580272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fa5269a-26ec-4f7a-9a05-a548dbcef906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:03.040506 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-631c89ce-2253-4b93-8186-b2ca7786b1d7 tempest-VolumesListTestJSON-425580272 None] Volume 6686d121-fe66-4a90-8f93-5ca4fad2163d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6686d121-fe66-4a90-8f93-5ca4fad2163d', 'volume_size': 1} May 07 22:03:03.040896 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-631c89ce-2253-4b93-8186-b2ca7786b1d7 tempest-VolumesListTestJSON-425580272 None] creating volume 'volume-6686d121-fe66-4a90-8f93-5ca4fad2163d' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:03:03.041655 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-631c89ce-2253-4b93-8186-b2ca7786b1d7 tempest-VolumesListTestJSON-425580272 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:03:03.080622 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-b081dca8-a479-4d1e-b998-17265761e68a tempest-VolumesBackupsAdminTest-1667063411 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-05-07T22:03:02Z,data_timestamp=2022-05-07T22:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-1434947356',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=44335655-37f1-4718-9305-8b11c79b2434,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='9efc1fbca3ab413fabfc108b752dd251',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='e1d72e319762436a9a2f8a69e5402bf6',volume_id=4c2b93f0-2cae-4c4a-8f15-32043b50e7d8) May 07 22:03:03.087008 ncdv-master-1 cinder-volume[129946]: INFO cinder.rpc [None req-b081dca8-a479-4d1e-b998-17265761e68a tempest-VolumesBackupsAdminTest-1667063411 None] Automatically selected cinder-backup objects version 1.39 as minimum service version. May 07 22:03:03.092217 ncdv-master-1 cinder-volume[129946]: INFO cinder.rpc [None req-b081dca8-a479-4d1e-b998-17265761e68a tempest-VolumesBackupsAdminTest-1667063411 None] Automatically selected cinder-backup RPC version 2.3 as minimum service version. May 07 22:03:03.092980 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.backup.rpcapi [None req-b081dca8-a479-4d1e-b998-17265761e68a tempest-VolumesBackupsAdminTest-1667063411 None] continue_backup in rpcapi backup_id 44335655-37f1-4718-9305-8b11c79b2434 {{(pid=129946) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} May 07 22:03:03.104992 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-631c89ce-2253-4b93-8186-b2ca7786b1d7 tempest-VolumesListTestJSON-425580272 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:03:03.105662 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-631c89ce-2253-4b93-8186-b2ca7786b1d7 tempest-VolumesListTestJSON-425580272 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:03:03.109949 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-631c89ce-2253-4b93-8186-b2ca7786b1d7 tempest-VolumesListTestJSON-425580272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fa5269a-26ec-4f7a-9a05-a548dbcef906) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6686d121-fe66-4a90-8f93-5ca4fad2163d', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:03.114998 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-631c89ce-2253-4b93-8186-b2ca7786b1d7 tempest-VolumesListTestJSON-425580272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (191211fb-cd17-468f-81e0-d283e901cca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:03.131704 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-631c89ce-2253-4b93-8186-b2ca7786b1d7 tempest-VolumesListTestJSON-425580272 None] Volume volume-6686d121-fe66-4a90-8f93-5ca4fad2163d (6686d121-fe66-4a90-8f93-5ca4fad2163d): created successfully May 07 22:03:03.136122 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-631c89ce-2253-4b93-8186-b2ca7786b1d7 tempest-VolumesListTestJSON-425580272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (191211fb-cd17-468f-81e0-d283e901cca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:03.142019 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-631c89ce-2253-4b93-8186-b2ca7786b1d7 tempest-VolumesListTestJSON-425580272 None] Flow 'volume_create_manager' (32515ff3-1809-40a3-9284-445cc53a2702) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:03:03.169696 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-631c89ce-2253-4b93-8186-b2ca7786b1d7 tempest-VolumesListTestJSON-425580272 None] Created volume successfully. May 07 22:03:04.419185 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-225ffb73-03be-4505-b7b0-39ace3f9e944 tempest-VolumesListTestJSON-425580272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:03:04.434283 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-225ffb73-03be-4505-b7b0-39ace3f9e944 tempest-VolumesListTestJSON-425580272 None] Flow 'volume_create_manager' (2bab0c88-6aa0-4d1b-9d4f-f028109bebbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:03:04.443072 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-225ffb73-03be-4505-b7b0-39ace3f9e944 tempest-VolumesListTestJSON-425580272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32a57a03-4daa-4798-b800-3dea358d4290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:04.464811 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-225ffb73-03be-4505-b7b0-39ace3f9e944 tempest-VolumesListTestJSON-425580272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32a57a03-4daa-4798-b800-3dea358d4290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:03:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1236106093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=09f39758-c253-4fe2-96b8-a1474e563701,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='496d6c4436364effa7fa3e8577d05729',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:03:04Z,use_quota=True,user_id='792c2071a6254c73920ca02fdfa4494b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:04.470593 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-225ffb73-03be-4505-b7b0-39ace3f9e944 tempest-VolumesListTestJSON-425580272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f231c9f-475e-4644-a450-a1f4a8acb2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:04.475365 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-225ffb73-03be-4505-b7b0-39ace3f9e944 tempest-VolumesListTestJSON-425580272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f231c9f-475e-4644-a450-a1f4a8acb2a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:04.480743 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-225ffb73-03be-4505-b7b0-39ace3f9e944 tempest-VolumesListTestJSON-425580272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30fae861-31fc-4a0d-8fc8-72469517e7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:04.484921 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-225ffb73-03be-4505-b7b0-39ace3f9e944 tempest-VolumesListTestJSON-425580272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30fae861-31fc-4a0d-8fc8-72469517e7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09f39758-c253-4fe2-96b8-a1474e563701', 'volume_name': 'volume-09f39758-c253-4fe2-96b8-a1474e563701', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:04.490372 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-225ffb73-03be-4505-b7b0-39ace3f9e944 tempest-VolumesListTestJSON-425580272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83e958bd-5a7e-4214-9670-021b5d215f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:04.494437 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-225ffb73-03be-4505-b7b0-39ace3f9e944 tempest-VolumesListTestJSON-425580272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83e958bd-5a7e-4214-9670-021b5d215f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:04.499453 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-225ffb73-03be-4505-b7b0-39ace3f9e944 tempest-VolumesListTestJSON-425580272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55ee3ac1-9195-4deb-9370-8ca624038dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:04.500340 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-225ffb73-03be-4505-b7b0-39ace3f9e944 tempest-VolumesListTestJSON-425580272 None] Volume 09f39758-c253-4fe2-96b8-a1474e563701: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09f39758-c253-4fe2-96b8-a1474e563701', 'volume_size': 1} May 07 22:03:04.500795 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-225ffb73-03be-4505-b7b0-39ace3f9e944 tempest-VolumesListTestJSON-425580272 None] creating volume 'volume-09f39758-c253-4fe2-96b8-a1474e563701' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:03:04.501764 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-225ffb73-03be-4505-b7b0-39ace3f9e944 tempest-VolumesListTestJSON-425580272 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:03:04.563457 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-225ffb73-03be-4505-b7b0-39ace3f9e944 tempest-VolumesListTestJSON-425580272 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:03:04.563963 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-225ffb73-03be-4505-b7b0-39ace3f9e944 tempest-VolumesListTestJSON-425580272 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:03:04.567942 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-225ffb73-03be-4505-b7b0-39ace3f9e944 tempest-VolumesListTestJSON-425580272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55ee3ac1-9195-4deb-9370-8ca624038dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09f39758-c253-4fe2-96b8-a1474e563701', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:04.574230 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-225ffb73-03be-4505-b7b0-39ace3f9e944 tempest-VolumesListTestJSON-425580272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aff7237e-360d-4af0-82be-6ba63f2e27df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:04.583502 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-225ffb73-03be-4505-b7b0-39ace3f9e944 tempest-VolumesListTestJSON-425580272 None] Volume volume-09f39758-c253-4fe2-96b8-a1474e563701 (09f39758-c253-4fe2-96b8-a1474e563701): created successfully May 07 22:03:04.587927 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-225ffb73-03be-4505-b7b0-39ace3f9e944 tempest-VolumesListTestJSON-425580272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aff7237e-360d-4af0-82be-6ba63f2e27df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:04.593782 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-225ffb73-03be-4505-b7b0-39ace3f9e944 tempest-VolumesListTestJSON-425580272 None] Flow 'volume_create_manager' (2bab0c88-6aa0-4d1b-9d4f-f028109bebbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:03:04.602492 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-225ffb73-03be-4505-b7b0-39ace3f9e944 tempest-VolumesListTestJSON-425580272 None] Created volume successfully. May 07 22:03:05.913344 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1cd69ca-80ba-4a09-9364-200ed861c52d tempest-VolumesListTestJSON-425580272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:03:05.941490 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a1cd69ca-80ba-4a09-9364-200ed861c52d tempest-VolumesListTestJSON-425580272 None] Flow 'volume_create_manager' (8a454d4d-8925-451c-b2a3-86790dbaf830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:03:05.949736 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a1cd69ca-80ba-4a09-9364-200ed861c52d tempest-VolumesListTestJSON-425580272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a084445-8f16-49a1-9b42-47f3ee82f99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:05.972465 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a1cd69ca-80ba-4a09-9364-200ed861c52d tempest-VolumesListTestJSON-425580272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a084445-8f16-49a1-9b42-47f3ee82f99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-659757341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b2c567fa-1b21-4b4f-9b64-541d089f7a9b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='496d6c4436364effa7fa3e8577d05729',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:03:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:03:06Z,use_quota=True,user_id='792c2071a6254c73920ca02fdfa4494b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:05.979783 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a1cd69ca-80ba-4a09-9364-200ed861c52d tempest-VolumesListTestJSON-425580272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b040a6e-2d08-4f1e-85ef-f11c4aad6225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:05.986764 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a1cd69ca-80ba-4a09-9364-200ed861c52d tempest-VolumesListTestJSON-425580272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b040a6e-2d08-4f1e-85ef-f11c4aad6225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:05.995479 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a1cd69ca-80ba-4a09-9364-200ed861c52d tempest-VolumesListTestJSON-425580272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1354875f-1779-48db-bc43-b3b2f320faf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:06.002995 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a1cd69ca-80ba-4a09-9364-200ed861c52d tempest-VolumesListTestJSON-425580272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1354875f-1779-48db-bc43-b3b2f320faf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2c567fa-1b21-4b4f-9b64-541d089f7a9b', 'volume_name': 'volume-b2c567fa-1b21-4b4f-9b64-541d089f7a9b', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:06.010879 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a1cd69ca-80ba-4a09-9364-200ed861c52d tempest-VolumesListTestJSON-425580272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d9de048-9ab7-43e9-8b29-abda3f5ea44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:06.017996 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a1cd69ca-80ba-4a09-9364-200ed861c52d tempest-VolumesListTestJSON-425580272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d9de048-9ab7-43e9-8b29-abda3f5ea44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:06.029004 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a1cd69ca-80ba-4a09-9364-200ed861c52d tempest-VolumesListTestJSON-425580272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4f7de28-c444-45b8-af21-93c03b6ad2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:06.030648 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-a1cd69ca-80ba-4a09-9364-200ed861c52d tempest-VolumesListTestJSON-425580272 None] Volume b2c567fa-1b21-4b4f-9b64-541d089f7a9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2c567fa-1b21-4b4f-9b64-541d089f7a9b', 'volume_size': 1} May 07 22:03:06.031286 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-a1cd69ca-80ba-4a09-9364-200ed861c52d tempest-VolumesListTestJSON-425580272 None] creating volume 'volume-b2c567fa-1b21-4b4f-9b64-541d089f7a9b' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:03:06.032145 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-a1cd69ca-80ba-4a09-9364-200ed861c52d tempest-VolumesListTestJSON-425580272 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:03:06.132577 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-a1cd69ca-80ba-4a09-9364-200ed861c52d tempest-VolumesListTestJSON-425580272 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:03:06.132947 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-a1cd69ca-80ba-4a09-9364-200ed861c52d tempest-VolumesListTestJSON-425580272 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:03:06.138214 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a1cd69ca-80ba-4a09-9364-200ed861c52d tempest-VolumesListTestJSON-425580272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4f7de28-c444-45b8-af21-93c03b6ad2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2c567fa-1b21-4b4f-9b64-541d089f7a9b', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:06.148652 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a1cd69ca-80ba-4a09-9364-200ed861c52d tempest-VolumesListTestJSON-425580272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c2beee3-683c-4aeb-a0eb-b99252ed4bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:06.173791 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-a1cd69ca-80ba-4a09-9364-200ed861c52d tempest-VolumesListTestJSON-425580272 None] Volume volume-b2c567fa-1b21-4b4f-9b64-541d089f7a9b (b2c567fa-1b21-4b4f-9b64-541d089f7a9b): created successfully May 07 22:03:06.192470 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a1cd69ca-80ba-4a09-9364-200ed861c52d tempest-VolumesListTestJSON-425580272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c2beee3-683c-4aeb-a0eb-b99252ed4bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:06.212939 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a1cd69ca-80ba-4a09-9364-200ed861c52d tempest-VolumesListTestJSON-425580272 None] Flow 'volume_create_manager' (8a454d4d-8925-451c-b2a3-86790dbaf830) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:03:06.225997 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-a1cd69ca-80ba-4a09-9364-200ed861c52d tempest-VolumesListTestJSON-425580272 None] Created volume successfully. May 07 22:03:09.551069 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [None req-b081dca8-a479-4d1e-b998-17265761e68a tempest-VolumesBackupsAdminTest-1667063411 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 22:03:10.920382 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [None req-b081dca8-a479-4d1e-b998-17265761e68a tempest-VolumesBackupsAdminTest-1667063411 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.369s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 22:03:10.921854 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b081dca8-a479-4d1e-b998-17265761e68a tempest-VolumesBackupsAdminTest-1667063411 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-4c2b93f0-2cae-4c4a-8f15-32043b50e7d8', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3ca0b836-1cfe-436a-b0fa-deb74d3203d9', 'volume_id': '4c2b93f0-2cae-4c4a-8f15-32043b50e7d8', 'discard': True}} {{(pid=129946) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 07 22:03:10.957288 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-b1196274-d103-4d61-9238-a5bd9e263ec2 tempest-VolumesListTestJSON-425580272 None] Lock "b'cinder-b2c567fa-1b21-4b4f-9b64-541d089f7a9b-delete_volume'" acquired by "delete_volume" :: waited 0.027s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:03:10.961438 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-b081dca8-a479-4d1e-b998-17265761e68a tempest-VolumesBackupsAdminTest-1667063411 None] Initialize volume connection completed successfully. May 07 22:03:11.024118 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b1196274-d103-4d61-9238-a5bd9e263ec2 tempest-VolumesListTestJSON-425580272 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:03:11.109322 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b1196274-d103-4d61-9238-a5bd9e263ec2 tempest-VolumesListTestJSON-425580272 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:03:11.111837 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b1196274-d103-4d61-9238-a5bd9e263ec2 tempest-VolumesListTestJSON-425580272 None] Volume volume-b2c567fa-1b21-4b4f-9b64-541d089f7a9b is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:03:11.128135 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b1196274-d103-4d61-9238-a5bd9e263ec2 tempest-VolumesListTestJSON-425580272 None] deleting rbd volume volume-b2c567fa-1b21-4b4f-9b64-541d089f7a9b {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:03:11.599926 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-b1196274-d103-4d61-9238-a5bd9e263ec2 tempest-VolumesListTestJSON-425580272 None] Created reservations ['16c325c9-2a3a-47c8-bb1c-eba219003870', 'c9c37d49-2921-4e28-bfee-aec9d1bdc71d', '2a9c0cab-f1f8-42a9-8d5f-abc41947e2d0', '2f4c07fc-c85b-4fbc-b917-b3885507450e'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:03:11.727297 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b1196274-d103-4d61-9238-a5bd9e263ec2 tempest-VolumesListTestJSON-425580272 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:03:11.798997 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b1196274-d103-4d61-9238-a5bd9e263ec2 tempest-VolumesListTestJSON-425580272 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:03:11.881257 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-b1196274-d103-4d61-9238-a5bd9e263ec2 tempest-VolumesListTestJSON-425580272 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:03:11.886071 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-b1196274-d103-4d61-9238-a5bd9e263ec2 tempest-VolumesListTestJSON-425580272 None] Deleted volume successfully. May 07 22:03:11.912472 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-b1196274-d103-4d61-9238-a5bd9e263ec2 tempest-VolumesListTestJSON-425580272 None] Lock "b'cinder-b2c567fa-1b21-4b4f-9b64-541d089f7a9b-delete_volume'" released by "delete_volume" :: held 0.954s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:03:12.172855 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-eae2e56a-7aa4-4470-92c7-fb9ec2803602 tempest-VolumesListTestJSON-425580272 None] Lock "b'cinder-09f39758-c253-4fe2-96b8-a1474e563701-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:03:12.221515 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-eae2e56a-7aa4-4470-92c7-fb9ec2803602 tempest-VolumesListTestJSON-425580272 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:03:12.314955 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-eae2e56a-7aa4-4470-92c7-fb9ec2803602 tempest-VolumesListTestJSON-425580272 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:03:12.315377 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-eae2e56a-7aa4-4470-92c7-fb9ec2803602 tempest-VolumesListTestJSON-425580272 None] Volume volume-09f39758-c253-4fe2-96b8-a1474e563701 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:03:12.334855 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-eae2e56a-7aa4-4470-92c7-fb9ec2803602 tempest-VolumesListTestJSON-425580272 None] deleting rbd volume volume-09f39758-c253-4fe2-96b8-a1474e563701 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:03:12.819079 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-eae2e56a-7aa4-4470-92c7-fb9ec2803602 tempest-VolumesListTestJSON-425580272 None] Created reservations ['37bffaa0-2d73-4c60-998e-f6c3bfebd07c', '9e688168-2ce9-4511-8109-e501a9169a5a', '2ec0af55-90ab-42c3-997a-d9d89375a489', '2d96ac90-19a6-4284-ad75-b831651f3fac'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:03:12.937111 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-eae2e56a-7aa4-4470-92c7-fb9ec2803602 tempest-VolumesListTestJSON-425580272 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:03:13.022596 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-eae2e56a-7aa4-4470-92c7-fb9ec2803602 tempest-VolumesListTestJSON-425580272 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:03:13.106847 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-eae2e56a-7aa4-4470-92c7-fb9ec2803602 tempest-VolumesListTestJSON-425580272 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:03:13.112169 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-eae2e56a-7aa4-4470-92c7-fb9ec2803602 tempest-VolumesListTestJSON-425580272 None] Deleted volume successfully. May 07 22:03:13.133748 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-eae2e56a-7aa4-4470-92c7-fb9ec2803602 tempest-VolumesListTestJSON-425580272 None] Lock "b'cinder-09f39758-c253-4fe2-96b8-a1474e563701-delete_volume'" released by "delete_volume" :: held 0.958s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:03:13.469885 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-440ec91f-1f9b-41a1-8420-ae467346f675 tempest-VolumesListTestJSON-425580272 None] Lock "b'cinder-6686d121-fe66-4a90-8f93-5ca4fad2163d-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:03:13.549606 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-440ec91f-1f9b-41a1-8420-ae467346f675 tempest-VolumesListTestJSON-425580272 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:03:13.617783 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-440ec91f-1f9b-41a1-8420-ae467346f675 tempest-VolumesListTestJSON-425580272 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:03:13.618400 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-440ec91f-1f9b-41a1-8420-ae467346f675 tempest-VolumesListTestJSON-425580272 None] Volume volume-6686d121-fe66-4a90-8f93-5ca4fad2163d is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:03:13.641322 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-440ec91f-1f9b-41a1-8420-ae467346f675 tempest-VolumesListTestJSON-425580272 None] deleting rbd volume volume-6686d121-fe66-4a90-8f93-5ca4fad2163d {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:03:14.252625 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-440ec91f-1f9b-41a1-8420-ae467346f675 tempest-VolumesListTestJSON-425580272 None] Created reservations ['31212303-0698-4d92-87c7-e1f8366a7fd6', 'ef4f8a61-c0f9-446b-a839-45072a0a2611', '3719bd87-eb8d-4e50-9f1b-86b401acecaa', '9f44f2a6-b316-4d1e-974b-adfc5fcb5ffa'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:03:14.370239 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-440ec91f-1f9b-41a1-8420-ae467346f675 tempest-VolumesListTestJSON-425580272 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:03:14.447948 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-440ec91f-1f9b-41a1-8420-ae467346f675 tempest-VolumesListTestJSON-425580272 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:03:14.538321 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-440ec91f-1f9b-41a1-8420-ae467346f675 tempest-VolumesListTestJSON-425580272 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:03:14.548801 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-440ec91f-1f9b-41a1-8420-ae467346f675 tempest-VolumesListTestJSON-425580272 None] Deleted volume successfully. May 07 22:03:14.588199 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-440ec91f-1f9b-41a1-8420-ae467346f675 tempest-VolumesListTestJSON-425580272 None] Lock "b'cinder-6686d121-fe66-4a90-8f93-5ca4fad2163d-delete_volume'" released by "delete_volume" :: held 1.118s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:03:15.340733 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-b081dca8-a479-4d1e-b998-17265761e68a tempest-VolumesBackupsAdminTest-1667063411 None] Terminate volume connection completed successfully. May 07 22:03:15.406098 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-b081dca8-a479-4d1e-b998-17265761e68a tempest-VolumesBackupsAdminTest-1667063411 None] Remove volume export completed successfully. May 07 22:03:18.912828 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-98f01482-5dd0-47cd-b4f0-e21097a158d4 tempest-VolumesBackupsAdminTest-1667063411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:03:18.942803 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-98f01482-5dd0-47cd-b4f0-e21097a158d4 tempest-VolumesBackupsAdminTest-1667063411 None] Flow 'volume_create_manager' (854b37f6-a299-4107-a2e0-04025a7df2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:03:18.950061 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-98f01482-5dd0-47cd-b4f0-e21097a158d4 tempest-VolumesBackupsAdminTest-1667063411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d7e4a54-f0ff-4110-a317-709581495cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:18.971048 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-98f01482-5dd0-47cd-b4f0-e21097a158d4 tempest-VolumesBackupsAdminTest-1667063411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d7e4a54-f0ff-4110-a317-709581495cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:03:19Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_44335655-37f1-4718-9305-8b11c79b2434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=80906e2f-de30-4b36-a909-d686d31082b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9efc1fbca3ab413fabfc108b752dd251',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:03:19Z,use_quota=True,user_id='e1d72e319762436a9a2f8a69e5402bf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:18.977320 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-98f01482-5dd0-47cd-b4f0-e21097a158d4 tempest-VolumesBackupsAdminTest-1667063411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f8c3484-7b71-453b-8a4c-b955b8b1450c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:18.982377 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-98f01482-5dd0-47cd-b4f0-e21097a158d4 tempest-VolumesBackupsAdminTest-1667063411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f8c3484-7b71-453b-8a4c-b955b8b1450c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:18.989059 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-98f01482-5dd0-47cd-b4f0-e21097a158d4 tempest-VolumesBackupsAdminTest-1667063411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd0c3b1b-e1a8-4d85-ac2e-16d795cfb0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:18.994624 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-98f01482-5dd0-47cd-b4f0-e21097a158d4 tempest-VolumesBackupsAdminTest-1667063411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd0c3b1b-e1a8-4d85-ac2e-16d795cfb0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80906e2f-de30-4b36-a909-d686d31082b3', 'volume_name': 'volume-80906e2f-de30-4b36-a909-d686d31082b3', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:19.000192 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-98f01482-5dd0-47cd-b4f0-e21097a158d4 tempest-VolumesBackupsAdminTest-1667063411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62806599-2cd9-4ab4-895f-28c003248ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:19.005661 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-98f01482-5dd0-47cd-b4f0-e21097a158d4 tempest-VolumesBackupsAdminTest-1667063411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62806599-2cd9-4ab4-895f-28c003248ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:19.013282 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-98f01482-5dd0-47cd-b4f0-e21097a158d4 tempest-VolumesBackupsAdminTest-1667063411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (357dde43-687d-45d2-9c1a-3cbdd57deafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:19.016364 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-98f01482-5dd0-47cd-b4f0-e21097a158d4 tempest-VolumesBackupsAdminTest-1667063411 None] Volume 80906e2f-de30-4b36-a909-d686d31082b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80906e2f-de30-4b36-a909-d686d31082b3', 'volume_size': 1} May 07 22:03:19.017958 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-98f01482-5dd0-47cd-b4f0-e21097a158d4 tempest-VolumesBackupsAdminTest-1667063411 None] creating volume 'volume-80906e2f-de30-4b36-a909-d686d31082b3' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:03:19.019960 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-98f01482-5dd0-47cd-b4f0-e21097a158d4 tempest-VolumesBackupsAdminTest-1667063411 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:03:19.199258 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-98f01482-5dd0-47cd-b4f0-e21097a158d4 tempest-VolumesBackupsAdminTest-1667063411 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:03:19.199258 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-98f01482-5dd0-47cd-b4f0-e21097a158d4 tempest-VolumesBackupsAdminTest-1667063411 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:03:19.206294 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-98f01482-5dd0-47cd-b4f0-e21097a158d4 tempest-VolumesBackupsAdminTest-1667063411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (357dde43-687d-45d2-9c1a-3cbdd57deafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80906e2f-de30-4b36-a909-d686d31082b3', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:19.211660 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-98f01482-5dd0-47cd-b4f0-e21097a158d4 tempest-VolumesBackupsAdminTest-1667063411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01692cec-0f84-4a1d-a5a2-1ed1dc278a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:19.241778 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-98f01482-5dd0-47cd-b4f0-e21097a158d4 tempest-VolumesBackupsAdminTest-1667063411 None] Volume volume-80906e2f-de30-4b36-a909-d686d31082b3 (80906e2f-de30-4b36-a909-d686d31082b3): created successfully May 07 22:03:19.245649 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-98f01482-5dd0-47cd-b4f0-e21097a158d4 tempest-VolumesBackupsAdminTest-1667063411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01692cec-0f84-4a1d-a5a2-1ed1dc278a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:19.257393 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-98f01482-5dd0-47cd-b4f0-e21097a158d4 tempest-VolumesBackupsAdminTest-1667063411 None] Flow 'volume_create_manager' (854b37f6-a299-4107-a2e0-04025a7df2af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:03:19.272176 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-98f01482-5dd0-47cd-b4f0-e21097a158d4 tempest-VolumesBackupsAdminTest-1667063411 None] Created volume successfully. May 07 22:03:20.169038 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [None req-98f01482-5dd0-47cd-b4f0-e21097a158d4 tempest-VolumesBackupsAdminTest-1667063411 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 22:03:21.179630 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [None req-98f01482-5dd0-47cd-b4f0-e21097a158d4 tempest-VolumesBackupsAdminTest-1667063411 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.010s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 22:03:21.180659 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-98f01482-5dd0-47cd-b4f0-e21097a158d4 tempest-VolumesBackupsAdminTest-1667063411 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-80906e2f-de30-4b36-a909-d686d31082b3', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3ca0b836-1cfe-436a-b0fa-deb74d3203d9', 'volume_id': '80906e2f-de30-4b36-a909-d686d31082b3', 'discard': True}} {{(pid=129946) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 07 22:03:21.210250 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-98f01482-5dd0-47cd-b4f0-e21097a158d4 tempest-VolumesBackupsAdminTest-1667063411 None] Initialize volume connection completed successfully. May 07 22:03:23.469138 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-98f01482-5dd0-47cd-b4f0-e21097a158d4 tempest-VolumesBackupsAdminTest-1667063411 None] Terminate volume connection completed successfully. May 07 22:03:23.489259 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-98f01482-5dd0-47cd-b4f0-e21097a158d4 tempest-VolumesBackupsAdminTest-1667063411 None] Remove volume export completed successfully. May 07 22:03:24.432217 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-32c22c6a-9d93-4cb6-8ec5-689d631f6be7 tempest-VolumesBackupsAdminTest-1667063411 None] Lock "b'cinder-80906e2f-de30-4b36-a909-d686d31082b3-delete_volume'" acquired by "delete_volume" :: waited 0.026s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:03:24.536252 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-32c22c6a-9d93-4cb6-8ec5-689d631f6be7 tempest-VolumesBackupsAdminTest-1667063411 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:03:25.060128 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-32c22c6a-9d93-4cb6-8ec5-689d631f6be7 tempest-VolumesBackupsAdminTest-1667063411 None] Volume volume-80906e2f-de30-4b36-a909-d686d31082b3 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:03:25.108777 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-32c22c6a-9d93-4cb6-8ec5-689d631f6be7 tempest-VolumesBackupsAdminTest-1667063411 None] deleting rbd volume volume-80906e2f-de30-4b36-a909-d686d31082b3 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:03:25.788328 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-32c22c6a-9d93-4cb6-8ec5-689d631f6be7 tempest-VolumesBackupsAdminTest-1667063411 None] Created reservations ['19392cfb-7090-46b5-b402-9de67de858fe', 'ca4cf5d6-d7e3-42df-a719-ed912856c83f', 'ac3fd514-e760-4328-a7e9-ff7d229977cf', '12a3bdb4-6d7a-4851-b522-d324b2ec7f1a'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:03:25.904756 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-32c22c6a-9d93-4cb6-8ec5-689d631f6be7 tempest-VolumesBackupsAdminTest-1667063411 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:03:25.999088 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-32c22c6a-9d93-4cb6-8ec5-689d631f6be7 tempest-VolumesBackupsAdminTest-1667063411 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:03:26.134228 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-32c22c6a-9d93-4cb6-8ec5-689d631f6be7 tempest-VolumesBackupsAdminTest-1667063411 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:03:26.211820 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-32c22c6a-9d93-4cb6-8ec5-689d631f6be7 tempest-VolumesBackupsAdminTest-1667063411 None] Deleted volume successfully. May 07 22:03:26.249611 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-32c22c6a-9d93-4cb6-8ec5-689d631f6be7 tempest-VolumesBackupsAdminTest-1667063411 None] Lock "b'cinder-80906e2f-de30-4b36-a909-d686d31082b3-delete_volume'" released by "delete_volume" :: held 1.821s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:03:28.473571 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-231e43bd-13fa-4432-9e0c-0a98733bc2ba tempest-VolumesBackupsAdminTest-1667063411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:03:28.497110 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-231e43bd-13fa-4432-9e0c-0a98733bc2ba tempest-VolumesBackupsAdminTest-1667063411 None] Flow 'volume_create_manager' (cbfe8375-291f-46f4-804e-981cecefd698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:03:28.509243 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-231e43bd-13fa-4432-9e0c-0a98733bc2ba tempest-VolumesBackupsAdminTest-1667063411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b99f36ed-ad3c-4337-8cd5-0ee9f02a75e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:28.531790 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-231e43bd-13fa-4432-9e0c-0a98733bc2ba tempest-VolumesBackupsAdminTest-1667063411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b99f36ed-ad3c-4337-8cd5-0ee9f02a75e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-70167903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7fd9a46a-c86c-4195-9beb-9b650657275c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9efc1fbca3ab413fabfc108b752dd251',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:03:28Z,use_quota=True,user_id='e1d72e319762436a9a2f8a69e5402bf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:28.550870 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-231e43bd-13fa-4432-9e0c-0a98733bc2ba tempest-VolumesBackupsAdminTest-1667063411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2defb7c-adc9-4cca-aad6-da111620c287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:28.561279 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-231e43bd-13fa-4432-9e0c-0a98733bc2ba tempest-VolumesBackupsAdminTest-1667063411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2defb7c-adc9-4cca-aad6-da111620c287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:28.569541 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-231e43bd-13fa-4432-9e0c-0a98733bc2ba tempest-VolumesBackupsAdminTest-1667063411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e607cad-8198-4200-b2f3-106bb25cecb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:28.585810 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-231e43bd-13fa-4432-9e0c-0a98733bc2ba tempest-VolumesBackupsAdminTest-1667063411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e607cad-8198-4200-b2f3-106bb25cecb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fd9a46a-c86c-4195-9beb-9b650657275c', 'volume_name': 'volume-7fd9a46a-c86c-4195-9beb-9b650657275c', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:28.596813 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-231e43bd-13fa-4432-9e0c-0a98733bc2ba tempest-VolumesBackupsAdminTest-1667063411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aa047d4-e9d8-4c9c-9838-ec6e0745100c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:28.605974 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-231e43bd-13fa-4432-9e0c-0a98733bc2ba tempest-VolumesBackupsAdminTest-1667063411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aa047d4-e9d8-4c9c-9838-ec6e0745100c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:28.614485 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-231e43bd-13fa-4432-9e0c-0a98733bc2ba tempest-VolumesBackupsAdminTest-1667063411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dff222f-9257-4584-90fe-64adac9ba744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:28.619173 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-231e43bd-13fa-4432-9e0c-0a98733bc2ba tempest-VolumesBackupsAdminTest-1667063411 None] Volume 7fd9a46a-c86c-4195-9beb-9b650657275c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fd9a46a-c86c-4195-9beb-9b650657275c', 'volume_size': 1} May 07 22:03:28.620553 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-231e43bd-13fa-4432-9e0c-0a98733bc2ba tempest-VolumesBackupsAdminTest-1667063411 None] creating volume 'volume-7fd9a46a-c86c-4195-9beb-9b650657275c' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:03:28.621644 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-231e43bd-13fa-4432-9e0c-0a98733bc2ba tempest-VolumesBackupsAdminTest-1667063411 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:03:28.774914 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-231e43bd-13fa-4432-9e0c-0a98733bc2ba tempest-VolumesBackupsAdminTest-1667063411 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:03:28.775237 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-231e43bd-13fa-4432-9e0c-0a98733bc2ba tempest-VolumesBackupsAdminTest-1667063411 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:03:28.804727 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-231e43bd-13fa-4432-9e0c-0a98733bc2ba tempest-VolumesBackupsAdminTest-1667063411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dff222f-9257-4584-90fe-64adac9ba744) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fd9a46a-c86c-4195-9beb-9b650657275c', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:28.820497 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-231e43bd-13fa-4432-9e0c-0a98733bc2ba tempest-VolumesBackupsAdminTest-1667063411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b561ddfc-460b-4607-a1d8-395a481b4c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:28.833763 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-231e43bd-13fa-4432-9e0c-0a98733bc2ba tempest-VolumesBackupsAdminTest-1667063411 None] Volume volume-7fd9a46a-c86c-4195-9beb-9b650657275c (7fd9a46a-c86c-4195-9beb-9b650657275c): created successfully May 07 22:03:28.838303 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-231e43bd-13fa-4432-9e0c-0a98733bc2ba tempest-VolumesBackupsAdminTest-1667063411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b561ddfc-460b-4607-a1d8-395a481b4c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:28.845146 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-231e43bd-13fa-4432-9e0c-0a98733bc2ba tempest-VolumesBackupsAdminTest-1667063411 None] Flow 'volume_create_manager' (cbfe8375-291f-46f4-804e-981cecefd698) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:03:28.863383 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-231e43bd-13fa-4432-9e0c-0a98733bc2ba tempest-VolumesBackupsAdminTest-1667063411 None] Created volume successfully. May 07 22:03:29.883767 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-7ceb5d1f-1508-4f6e-85ce-61f2c3c7d358 tempest-VolumesBackupsAdminTest-1667063411 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-05-07T22:03:29Z,data_timestamp=2022-05-07T22:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-2091994386',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=24077eb6-07be-49ca-9664-9b299764221a,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='9efc1fbca3ab413fabfc108b752dd251',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='e1d72e319762436a9a2f8a69e5402bf6',volume_id=7fd9a46a-c86c-4195-9beb-9b650657275c) May 07 22:03:29.885180 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.backup.rpcapi [None req-7ceb5d1f-1508-4f6e-85ce-61f2c3c7d358 tempest-VolumesBackupsAdminTest-1667063411 None] continue_backup in rpcapi backup_id 24077eb6-07be-49ca-9664-9b299764221a {{(pid=129946) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} May 07 22:03:30.173534 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [None req-7ceb5d1f-1508-4f6e-85ce-61f2c3c7d358 tempest-VolumesBackupsAdminTest-1667063411 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 22:03:30.750448 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:03:30.757282 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:03:30.860158 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:03:30.922921 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:03:31.328160 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [None req-7ceb5d1f-1508-4f6e-85ce-61f2c3c7d358 tempest-VolumesBackupsAdminTest-1667063411 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.155s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 22:03:31.328921 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-7ceb5d1f-1508-4f6e-85ce-61f2c3c7d358 tempest-VolumesBackupsAdminTest-1667063411 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7fd9a46a-c86c-4195-9beb-9b650657275c', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3ca0b836-1cfe-436a-b0fa-deb74d3203d9', 'volume_id': '7fd9a46a-c86c-4195-9beb-9b650657275c', 'discard': True}} {{(pid=129946) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 07 22:03:31.357820 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-7ceb5d1f-1508-4f6e-85ce-61f2c3c7d358 tempest-VolumesBackupsAdminTest-1667063411 None] Initialize volume connection completed successfully. May 07 22:03:33.413118 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-7ceb5d1f-1508-4f6e-85ce-61f2c3c7d358 tempest-VolumesBackupsAdminTest-1667063411 None] Terminate volume connection completed successfully. May 07 22:03:33.449568 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-7ceb5d1f-1508-4f6e-85ce-61f2c3c7d358 tempest-VolumesBackupsAdminTest-1667063411 None] Remove volume export completed successfully. May 07 22:03:37.790636 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-d7841e84-efd7-4010-a934-bec37f684ad6 tempest-VolumesBackupsAdminTest-1667063411 None] Lock "b'cinder-7fd9a46a-c86c-4195-9beb-9b650657275c-delete_volume'" acquired by "delete_volume" :: waited 0.030s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:03:37.906993 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d7841e84-efd7-4010-a934-bec37f684ad6 tempest-VolumesBackupsAdminTest-1667063411 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:03:38.147462 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d7841e84-efd7-4010-a934-bec37f684ad6 tempest-VolumesBackupsAdminTest-1667063411 None] Volume volume-7fd9a46a-c86c-4195-9beb-9b650657275c is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:03:38.177518 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d7841e84-efd7-4010-a934-bec37f684ad6 tempest-VolumesBackupsAdminTest-1667063411 None] deleting rbd volume volume-7fd9a46a-c86c-4195-9beb-9b650657275c {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:03:38.606388 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-d7841e84-efd7-4010-a934-bec37f684ad6 tempest-VolumesBackupsAdminTest-1667063411 None] Created reservations ['8f34e5bc-3c30-4e34-98ba-05361f7c7050', '5665ff06-fa1b-4e94-9266-15b32af921db', 'c64cf46c-1176-4c12-81c5-820eb36a2752', 'a7e79f50-a96c-4f82-b5cb-43bc9751142e'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:03:38.688318 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d7841e84-efd7-4010-a934-bec37f684ad6 tempest-VolumesBackupsAdminTest-1667063411 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:03:38.751851 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d7841e84-efd7-4010-a934-bec37f684ad6 tempest-VolumesBackupsAdminTest-1667063411 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:03:38.816524 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-d7841e84-efd7-4010-a934-bec37f684ad6 tempest-VolumesBackupsAdminTest-1667063411 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:03:38.827668 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-d7841e84-efd7-4010-a934-bec37f684ad6 tempest-VolumesBackupsAdminTest-1667063411 None] Deleted volume successfully. May 07 22:03:38.869507 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-d7841e84-efd7-4010-a934-bec37f684ad6 tempest-VolumesBackupsAdminTest-1667063411 None] Lock "b'cinder-7fd9a46a-c86c-4195-9beb-9b650657275c-delete_volume'" released by "delete_volume" :: held 1.078s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:03:39.037807 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-b3ea8b9e-b924-4ac6-b4c1-dffbfeecc93e tempest-VolumesBackupsAdminTest-1667063411 None] Lock "b'cinder-4c2b93f0-2cae-4c4a-8f15-32043b50e7d8-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:03:39.153950 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b3ea8b9e-b924-4ac6-b4c1-dffbfeecc93e tempest-VolumesBackupsAdminTest-1667063411 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:03:39.979790 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b3ea8b9e-b924-4ac6-b4c1-dffbfeecc93e tempest-VolumesBackupsAdminTest-1667063411 None] Volume volume-4c2b93f0-2cae-4c4a-8f15-32043b50e7d8 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:03:40.054053 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b3ea8b9e-b924-4ac6-b4c1-dffbfeecc93e tempest-VolumesBackupsAdminTest-1667063411 None] deleting rbd volume volume-4c2b93f0-2cae-4c4a-8f15-32043b50e7d8 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:03:40.680077 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-b3ea8b9e-b924-4ac6-b4c1-dffbfeecc93e tempest-VolumesBackupsAdminTest-1667063411 None] Created reservations ['5ab6e456-551f-46bc-ad8e-cfc9175cdd2b', '9b684cb6-c4fd-491b-a335-88e1ac8abb84', '2222b906-0582-4b56-80d5-7b4cd097db80', 'df95d27f-7f9d-4f95-abb2-4e499c336b7e'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:03:40.777895 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b3ea8b9e-b924-4ac6-b4c1-dffbfeecc93e tempest-VolumesBackupsAdminTest-1667063411 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:03:40.870161 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b3ea8b9e-b924-4ac6-b4c1-dffbfeecc93e tempest-VolumesBackupsAdminTest-1667063411 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:03:40.939604 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-b3ea8b9e-b924-4ac6-b4c1-dffbfeecc93e tempest-VolumesBackupsAdminTest-1667063411 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:03:40.948093 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-b3ea8b9e-b924-4ac6-b4c1-dffbfeecc93e tempest-VolumesBackupsAdminTest-1667063411 None] Deleted volume successfully. May 07 22:03:40.974660 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-b3ea8b9e-b924-4ac6-b4c1-dffbfeecc93e tempest-VolumesBackupsAdminTest-1667063411 None] Lock "b'cinder-4c2b93f0-2cae-4c4a-8f15-32043b50e7d8-delete_volume'" released by "delete_volume" :: held 1.937s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:03:43.005866 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f82f357-3477-4c7e-8e6c-79cdf570659f tempest-ServerRescueNegativeTestJSON-1146234554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:03:43.034341 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-2f82f357-3477-4c7e-8e6c-79cdf570659f tempest-ServerRescueNegativeTestJSON-1146234554 None] Flow 'volume_create_manager' (20dedbfe-fa99-4bc1-ac5f-e089c0da6d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:03:43.041824 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-2f82f357-3477-4c7e-8e6c-79cdf570659f tempest-ServerRescueNegativeTestJSON-1146234554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24ded95d-2a75-4e72-8998-13c033018c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:43.059609 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-2f82f357-3477-4c7e-8e6c-79cdf570659f tempest-ServerRescueNegativeTestJSON-1146234554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24ded95d-2a75-4e72-8998-13c033018c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:03:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1945697100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4f8e363d-4b8a-48db-874a-26551079d6b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8130c27f2b84434a8d6fa5032b67aa1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:03:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:03:43Z,use_quota=True,user_id='4fb48e4d50184d2e97674324027d9ec0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:43.069046 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-2f82f357-3477-4c7e-8e6c-79cdf570659f tempest-ServerRescueNegativeTestJSON-1146234554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c4a3220-63c6-4987-b0ba-2fdad6dd5893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:43.076127 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-2f82f357-3477-4c7e-8e6c-79cdf570659f tempest-ServerRescueNegativeTestJSON-1146234554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c4a3220-63c6-4987-b0ba-2fdad6dd5893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:43.081661 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-2f82f357-3477-4c7e-8e6c-79cdf570659f tempest-ServerRescueNegativeTestJSON-1146234554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb78db58-71d9-4faf-b09b-835413e49acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:43.086566 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-2f82f357-3477-4c7e-8e6c-79cdf570659f tempest-ServerRescueNegativeTestJSON-1146234554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb78db58-71d9-4faf-b09b-835413e49acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f8e363d-4b8a-48db-874a-26551079d6b0', 'volume_name': 'volume-4f8e363d-4b8a-48db-874a-26551079d6b0', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:43.091841 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-2f82f357-3477-4c7e-8e6c-79cdf570659f tempest-ServerRescueNegativeTestJSON-1146234554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5942cfb2-1a82-4db4-b648-a2fd56e0dc9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:43.096110 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-2f82f357-3477-4c7e-8e6c-79cdf570659f tempest-ServerRescueNegativeTestJSON-1146234554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5942cfb2-1a82-4db4-b648-a2fd56e0dc9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:43.101585 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-2f82f357-3477-4c7e-8e6c-79cdf570659f tempest-ServerRescueNegativeTestJSON-1146234554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2ac4cf0-3fae-407f-ade2-67ce16f09f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:43.106591 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-2f82f357-3477-4c7e-8e6c-79cdf570659f tempest-ServerRescueNegativeTestJSON-1146234554 None] Volume 4f8e363d-4b8a-48db-874a-26551079d6b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f8e363d-4b8a-48db-874a-26551079d6b0', 'volume_size': 1} May 07 22:03:43.107220 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-2f82f357-3477-4c7e-8e6c-79cdf570659f tempest-ServerRescueNegativeTestJSON-1146234554 None] creating volume 'volume-4f8e363d-4b8a-48db-874a-26551079d6b0' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:03:43.108402 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-2f82f357-3477-4c7e-8e6c-79cdf570659f tempest-ServerRescueNegativeTestJSON-1146234554 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:03:43.253334 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-2f82f357-3477-4c7e-8e6c-79cdf570659f tempest-ServerRescueNegativeTestJSON-1146234554 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:03:43.254037 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-2f82f357-3477-4c7e-8e6c-79cdf570659f tempest-ServerRescueNegativeTestJSON-1146234554 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:03:43.259673 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-2f82f357-3477-4c7e-8e6c-79cdf570659f tempest-ServerRescueNegativeTestJSON-1146234554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2ac4cf0-3fae-407f-ade2-67ce16f09f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f8e363d-4b8a-48db-874a-26551079d6b0', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:43.267267 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-2f82f357-3477-4c7e-8e6c-79cdf570659f tempest-ServerRescueNegativeTestJSON-1146234554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecbe939d-f596-4bc7-95c4-7613ed269d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:43.290118 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-2f82f357-3477-4c7e-8e6c-79cdf570659f tempest-ServerRescueNegativeTestJSON-1146234554 None] Volume volume-4f8e363d-4b8a-48db-874a-26551079d6b0 (4f8e363d-4b8a-48db-874a-26551079d6b0): created successfully May 07 22:03:43.327971 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-2f82f357-3477-4c7e-8e6c-79cdf570659f tempest-ServerRescueNegativeTestJSON-1146234554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecbe939d-f596-4bc7-95c4-7613ed269d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:43.345794 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-2f82f357-3477-4c7e-8e6c-79cdf570659f tempest-ServerRescueNegativeTestJSON-1146234554 None] Flow 'volume_create_manager' (20dedbfe-fa99-4bc1-ac5f-e089c0da6d1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:03:43.369468 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-2f82f357-3477-4c7e-8e6c-79cdf570659f tempest-ServerRescueNegativeTestJSON-1146234554 None] Created volume successfully. May 07 22:03:46.049945 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-e2b1b6f3-e5ff-4437-81ed-ee46bbb197ef req-df7be16f-62d4-49ed-97d4-ece0a407642b tempest-AttachVolumeNegativeTest-835916675 None] Terminate volume connection completed successfully. May 07 22:03:46.050662 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-e2b1b6f3-e5ff-4437-81ed-ee46bbb197ef req-df7be16f-62d4-49ed-97d4-ece0a407642b tempest-AttachVolumeNegativeTest-835916675 None] Deleting attachment 2f6a31ad-2800-4677-aed5-6a32e31f3d23. {{(pid=129946) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 07 22:03:52.682949 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc8fb4c0-883f-4e7b-bb21-ac2c7af257ff tempest-AbsoluteLimitsTests-1905355698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:03:52.733276 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-bc8fb4c0-883f-4e7b-bb21-ac2c7af257ff tempest-AbsoluteLimitsTests-1905355698 None] Flow 'volume_create_manager' (a963fbd4-4727-4c8d-aaef-9efa897c014f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:03:52.740909 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-bc8fb4c0-883f-4e7b-bb21-ac2c7af257ff tempest-AbsoluteLimitsTests-1905355698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3903c71-cf14-4819-a924-5e33bc637a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:52.761810 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-bc8fb4c0-883f-4e7b-bb21-ac2c7af257ff tempest-AbsoluteLimitsTests-1905355698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3903c71-cf14-4819-a924-5e33bc637a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:03:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-345636983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=bd0404d0-040e-4441-8dfd-e4dec0921b84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f158d8420cb42c38e5f216bc8c59b0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:03:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:03:53Z,use_quota=True,user_id='d1178d0a050245f9b14de19acf9f10eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:52.767763 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-bc8fb4c0-883f-4e7b-bb21-ac2c7af257ff tempest-AbsoluteLimitsTests-1905355698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26626e39-f3ee-44f6-a5f6-6cdc350dff0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:52.773837 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-bc8fb4c0-883f-4e7b-bb21-ac2c7af257ff tempest-AbsoluteLimitsTests-1905355698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26626e39-f3ee-44f6-a5f6-6cdc350dff0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:52.782061 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-bc8fb4c0-883f-4e7b-bb21-ac2c7af257ff tempest-AbsoluteLimitsTests-1905355698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1eb461c-1231-4f26-8fda-666639a7d956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:52.789115 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-bc8fb4c0-883f-4e7b-bb21-ac2c7af257ff tempest-AbsoluteLimitsTests-1905355698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1eb461c-1231-4f26-8fda-666639a7d956) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd0404d0-040e-4441-8dfd-e4dec0921b84', 'volume_name': 'volume-bd0404d0-040e-4441-8dfd-e4dec0921b84', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:52.795967 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-bc8fb4c0-883f-4e7b-bb21-ac2c7af257ff tempest-AbsoluteLimitsTests-1905355698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0790bc3e-3da2-49ed-aa09-1e1cdf171877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:52.800847 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-bc8fb4c0-883f-4e7b-bb21-ac2c7af257ff tempest-AbsoluteLimitsTests-1905355698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0790bc3e-3da2-49ed-aa09-1e1cdf171877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:52.806090 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-bc8fb4c0-883f-4e7b-bb21-ac2c7af257ff tempest-AbsoluteLimitsTests-1905355698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (842cdc03-3aa2-427a-9870-5acbc74843c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:52.807266 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-bc8fb4c0-883f-4e7b-bb21-ac2c7af257ff tempest-AbsoluteLimitsTests-1905355698 None] Volume bd0404d0-040e-4441-8dfd-e4dec0921b84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd0404d0-040e-4441-8dfd-e4dec0921b84', 'volume_size': 1} May 07 22:03:52.807698 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-bc8fb4c0-883f-4e7b-bb21-ac2c7af257ff tempest-AbsoluteLimitsTests-1905355698 None] creating volume 'volume-bd0404d0-040e-4441-8dfd-e4dec0921b84' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:03:52.808395 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-bc8fb4c0-883f-4e7b-bb21-ac2c7af257ff tempest-AbsoluteLimitsTests-1905355698 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:03:52.905039 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-bc8fb4c0-883f-4e7b-bb21-ac2c7af257ff tempest-AbsoluteLimitsTests-1905355698 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:03:52.905986 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-bc8fb4c0-883f-4e7b-bb21-ac2c7af257ff tempest-AbsoluteLimitsTests-1905355698 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:03:52.910328 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-bc8fb4c0-883f-4e7b-bb21-ac2c7af257ff tempest-AbsoluteLimitsTests-1905355698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (842cdc03-3aa2-427a-9870-5acbc74843c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd0404d0-040e-4441-8dfd-e4dec0921b84', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:52.921864 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-bc8fb4c0-883f-4e7b-bb21-ac2c7af257ff tempest-AbsoluteLimitsTests-1905355698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a194d68e-dbcb-44c1-8817-d070cbc53ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:52.943219 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-bc8fb4c0-883f-4e7b-bb21-ac2c7af257ff tempest-AbsoluteLimitsTests-1905355698 None] Volume volume-bd0404d0-040e-4441-8dfd-e4dec0921b84 (bd0404d0-040e-4441-8dfd-e4dec0921b84): created successfully May 07 22:03:52.947644 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-bc8fb4c0-883f-4e7b-bb21-ac2c7af257ff tempest-AbsoluteLimitsTests-1905355698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a194d68e-dbcb-44c1-8817-d070cbc53ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:52.956356 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-bc8fb4c0-883f-4e7b-bb21-ac2c7af257ff tempest-AbsoluteLimitsTests-1905355698 None] Flow 'volume_create_manager' (a963fbd4-4727-4c8d-aaef-9efa897c014f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:03:52.978066 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-bc8fb4c0-883f-4e7b-bb21-ac2c7af257ff tempest-AbsoluteLimitsTests-1905355698 None] Created volume successfully. May 07 22:03:53.759581 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-4b3b67a2-bfdf-4230-9fda-941d7aa161d9 tempest-AbsoluteLimitsTests-1905355698 None] Lock "b'cinder-bd0404d0-040e-4441-8dfd-e4dec0921b84-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:03:53.891227 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-4b3b67a2-bfdf-4230-9fda-941d7aa161d9 tempest-AbsoluteLimitsTests-1905355698 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:03:54.054001 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-4b3b67a2-bfdf-4230-9fda-941d7aa161d9 tempest-AbsoluteLimitsTests-1905355698 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:03:54.054178 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-4b3b67a2-bfdf-4230-9fda-941d7aa161d9 tempest-AbsoluteLimitsTests-1905355698 None] Volume volume-bd0404d0-040e-4441-8dfd-e4dec0921b84 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:03:54.070394 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-4b3b67a2-bfdf-4230-9fda-941d7aa161d9 tempest-AbsoluteLimitsTests-1905355698 None] deleting rbd volume volume-bd0404d0-040e-4441-8dfd-e4dec0921b84 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:03:54.581629 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-4b3b67a2-bfdf-4230-9fda-941d7aa161d9 tempest-AbsoluteLimitsTests-1905355698 None] Created reservations ['8863c350-8afc-4892-8a05-d2679b3af0d8', '113e1654-3f71-4ee3-b0e8-3bd6a32be62e', '835974da-e832-4423-a92f-d831c43e4887', 'ffad8bff-23c7-40f7-a986-b1ec63a68d3a'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:03:54.648067 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-4b3b67a2-bfdf-4230-9fda-941d7aa161d9 tempest-AbsoluteLimitsTests-1905355698 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:03:54.742316 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-4b3b67a2-bfdf-4230-9fda-941d7aa161d9 tempest-AbsoluteLimitsTests-1905355698 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:03:54.828564 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-4b3b67a2-bfdf-4230-9fda-941d7aa161d9 tempest-AbsoluteLimitsTests-1905355698 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:03:54.846251 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-4b3b67a2-bfdf-4230-9fda-941d7aa161d9 tempest-AbsoluteLimitsTests-1905355698 None] Deleted volume successfully. May 07 22:03:54.873254 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-4b3b67a2-bfdf-4230-9fda-941d7aa161d9 tempest-AbsoluteLimitsTests-1905355698 None] Lock "b'cinder-bd0404d0-040e-4441-8dfd-e4dec0921b84-delete_volume'" released by "delete_volume" :: held 1.114s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:03:59.323612 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c24dfbd-4ca5-4fc1-9d92-af24f426e3b3 tempest-ServersNegativeTestJSON-282814339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:03:59.405851 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5c24dfbd-4ca5-4fc1-9d92-af24f426e3b3 tempest-ServersNegativeTestJSON-282814339 None] Flow 'volume_create_manager' (4fbb4878-8cbd-425d-abe8-13c71db4ef35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:03:59.416100 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5c24dfbd-4ca5-4fc1-9d92-af24f426e3b3 tempest-ServersNegativeTestJSON-282814339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4778f42-5b7e-4fa8-9baf-fe04aaa86b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:59.453446 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5c24dfbd-4ca5-4fc1-9d92-af24f426e3b3 tempest-ServersNegativeTestJSON-282814339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4778f42-5b7e-4fa8-9baf-fe04aaa86b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-839365902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ca043d28-1974-421c-89fa-77065888ac9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cdcd8ea83db42c996b9c0cb8bac89aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:03:59Z,use_quota=True,user_id='e6abaee58e2540e090b6f53b6f6ef587',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:59.466503 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5c24dfbd-4ca5-4fc1-9d92-af24f426e3b3 tempest-ServersNegativeTestJSON-282814339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6451a718-bc71-45e6-ae38-d8c6fdf33e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:59.471667 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5c24dfbd-4ca5-4fc1-9d92-af24f426e3b3 tempest-ServersNegativeTestJSON-282814339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6451a718-bc71-45e6-ae38-d8c6fdf33e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:59.477796 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5c24dfbd-4ca5-4fc1-9d92-af24f426e3b3 tempest-ServersNegativeTestJSON-282814339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0a56e83-aafe-44f2-ab6c-d0a27dc98bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:59.500167 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5c24dfbd-4ca5-4fc1-9d92-af24f426e3b3 tempest-ServersNegativeTestJSON-282814339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0a56e83-aafe-44f2-ab6c-d0a27dc98bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca043d28-1974-421c-89fa-77065888ac9d', 'volume_name': 'volume-ca043d28-1974-421c-89fa-77065888ac9d', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:59.507128 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5c24dfbd-4ca5-4fc1-9d92-af24f426e3b3 tempest-ServersNegativeTestJSON-282814339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9289b72-b982-4944-9ee4-fa18f75e8001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:59.511475 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5c24dfbd-4ca5-4fc1-9d92-af24f426e3b3 tempest-ServersNegativeTestJSON-282814339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9289b72-b982-4944-9ee4-fa18f75e8001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:59.518001 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5c24dfbd-4ca5-4fc1-9d92-af24f426e3b3 tempest-ServersNegativeTestJSON-282814339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82c7167b-dc05-4619-a7b6-1cba43642c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:59.519418 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-5c24dfbd-4ca5-4fc1-9d92-af24f426e3b3 tempest-ServersNegativeTestJSON-282814339 None] Volume ca043d28-1974-421c-89fa-77065888ac9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca043d28-1974-421c-89fa-77065888ac9d', 'volume_size': 1} May 07 22:03:59.520578 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-5c24dfbd-4ca5-4fc1-9d92-af24f426e3b3 tempest-ServersNegativeTestJSON-282814339 None] creating volume 'volume-ca043d28-1974-421c-89fa-77065888ac9d' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:03:59.521620 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-5c24dfbd-4ca5-4fc1-9d92-af24f426e3b3 tempest-ServersNegativeTestJSON-282814339 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:03:59.645318 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-5c24dfbd-4ca5-4fc1-9d92-af24f426e3b3 tempest-ServersNegativeTestJSON-282814339 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:03:59.646196 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-5c24dfbd-4ca5-4fc1-9d92-af24f426e3b3 tempest-ServersNegativeTestJSON-282814339 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:03:59.651428 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5c24dfbd-4ca5-4fc1-9d92-af24f426e3b3 tempest-ServersNegativeTestJSON-282814339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82c7167b-dc05-4619-a7b6-1cba43642c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca043d28-1974-421c-89fa-77065888ac9d', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:59.657648 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5c24dfbd-4ca5-4fc1-9d92-af24f426e3b3 tempest-ServersNegativeTestJSON-282814339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aa4f40b-5dde-4eed-8681-5ac91cf9a82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:03:59.674603 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-5c24dfbd-4ca5-4fc1-9d92-af24f426e3b3 tempest-ServersNegativeTestJSON-282814339 None] Volume volume-ca043d28-1974-421c-89fa-77065888ac9d (ca043d28-1974-421c-89fa-77065888ac9d): created successfully May 07 22:03:59.679809 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5c24dfbd-4ca5-4fc1-9d92-af24f426e3b3 tempest-ServersNegativeTestJSON-282814339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aa4f40b-5dde-4eed-8681-5ac91cf9a82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:03:59.700362 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5c24dfbd-4ca5-4fc1-9d92-af24f426e3b3 tempest-ServersNegativeTestJSON-282814339 None] Flow 'volume_create_manager' (4fbb4878-8cbd-425d-abe8-13c71db4ef35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:03:59.723432 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-5c24dfbd-4ca5-4fc1-9d92-af24f426e3b3 tempest-ServersNegativeTestJSON-282814339 None] Created volume successfully. May 07 22:04:00.658861 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffdc064e-1ad2-458b-981d-e10c71f48286 tempest-VolumesCloneNegativeTest-218611381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:04:00.689042 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-ffdc064e-1ad2-458b-981d-e10c71f48286 tempest-VolumesCloneNegativeTest-218611381 None] Flow 'volume_create_manager' (ff9ed536-0c47-4ab9-8587-b02db90497f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:04:00.697789 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-ffdc064e-1ad2-458b-981d-e10c71f48286 tempest-VolumesCloneNegativeTest-218611381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7744bb4-b427-4534-84eb-649768c054a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:04:00.750198 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-ffdc064e-1ad2-458b-981d-e10c71f48286 tempest-VolumesCloneNegativeTest-218611381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7744bb4-b427-4534-84eb-649768c054a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:04:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-431308919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=25fff359-467a-48f6-86c5-455a9acf1f99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eb6f72ad6d74a07a2dfe86fad801ec7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:04:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:04:01Z,use_quota=True,user_id='47d6db69f9fc429fb995db3b839d1cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:04:00.758765 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-ffdc064e-1ad2-458b-981d-e10c71f48286 tempest-VolumesCloneNegativeTest-218611381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d75abae5-edbd-42a6-b276-b10090df3c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:04:00.765497 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-ffdc064e-1ad2-458b-981d-e10c71f48286 tempest-VolumesCloneNegativeTest-218611381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d75abae5-edbd-42a6-b276-b10090df3c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:04:00.773296 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-ffdc064e-1ad2-458b-981d-e10c71f48286 tempest-VolumesCloneNegativeTest-218611381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bc6d88e-48b5-4d48-9822-5d1e1b3ceab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:04:00.778373 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-ffdc064e-1ad2-458b-981d-e10c71f48286 tempest-VolumesCloneNegativeTest-218611381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bc6d88e-48b5-4d48-9822-5d1e1b3ceab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25fff359-467a-48f6-86c5-455a9acf1f99', 'volume_name': 'volume-25fff359-467a-48f6-86c5-455a9acf1f99', 'volume_size': 2}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:04:00.786399 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-ffdc064e-1ad2-458b-981d-e10c71f48286 tempest-VolumesCloneNegativeTest-218611381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4d239b6-22e7-4aa5-b64e-edb6833063a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:04:00.791228 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-ffdc064e-1ad2-458b-981d-e10c71f48286 tempest-VolumesCloneNegativeTest-218611381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4d239b6-22e7-4aa5-b64e-edb6833063a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:04:00.796734 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-ffdc064e-1ad2-458b-981d-e10c71f48286 tempest-VolumesCloneNegativeTest-218611381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14cf7d88-43cc-4b89-8afa-2752187692c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:04:00.798414 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-ffdc064e-1ad2-458b-981d-e10c71f48286 tempest-VolumesCloneNegativeTest-218611381 None] Volume 25fff359-467a-48f6-86c5-455a9acf1f99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25fff359-467a-48f6-86c5-455a9acf1f99', 'volume_size': 2} May 07 22:04:00.799145 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-ffdc064e-1ad2-458b-981d-e10c71f48286 tempest-VolumesCloneNegativeTest-218611381 None] creating volume 'volume-25fff359-467a-48f6-86c5-455a9acf1f99' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:04:00.800117 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-ffdc064e-1ad2-458b-981d-e10c71f48286 tempest-VolumesCloneNegativeTest-218611381 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:04:00.965029 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-ffdc064e-1ad2-458b-981d-e10c71f48286 tempest-VolumesCloneNegativeTest-218611381 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:04:00.965752 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-ffdc064e-1ad2-458b-981d-e10c71f48286 tempest-VolumesCloneNegativeTest-218611381 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:04:00.970174 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-ffdc064e-1ad2-458b-981d-e10c71f48286 tempest-VolumesCloneNegativeTest-218611381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14cf7d88-43cc-4b89-8afa-2752187692c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25fff359-467a-48f6-86c5-455a9acf1f99', 'volume_size': 2}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:04:00.976241 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-ffdc064e-1ad2-458b-981d-e10c71f48286 tempest-VolumesCloneNegativeTest-218611381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b89e945e-13ab-41a0-9369-660b58b034ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:04:00.990357 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-ffdc064e-1ad2-458b-981d-e10c71f48286 tempest-VolumesCloneNegativeTest-218611381 None] Volume volume-25fff359-467a-48f6-86c5-455a9acf1f99 (25fff359-467a-48f6-86c5-455a9acf1f99): created successfully May 07 22:04:01.017121 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-ffdc064e-1ad2-458b-981d-e10c71f48286 tempest-VolumesCloneNegativeTest-218611381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b89e945e-13ab-41a0-9369-660b58b034ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:04:01.025679 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-ffdc064e-1ad2-458b-981d-e10c71f48286 tempest-VolumesCloneNegativeTest-218611381 None] Flow 'volume_create_manager' (ff9ed536-0c47-4ab9-8587-b02db90497f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:04:01.037770 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-ffdc064e-1ad2-458b-981d-e10c71f48286 tempest-VolumesCloneNegativeTest-218611381 None] Created volume successfully. May 07 22:04:01.788434 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-565c496a-cf23-4b49-9d68-bfa13235f47d tempest-VolumesCloneNegativeTest-218611381 None] Lock "b'cinder-25fff359-467a-48f6-86c5-455a9acf1f99-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:04:01.841436 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-565c496a-cf23-4b49-9d68-bfa13235f47d tempest-VolumesCloneNegativeTest-218611381 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:04:01.943288 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-565c496a-cf23-4b49-9d68-bfa13235f47d tempest-VolumesCloneNegativeTest-218611381 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:04:01.943710 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-565c496a-cf23-4b49-9d68-bfa13235f47d tempest-VolumesCloneNegativeTest-218611381 None] Volume volume-25fff359-467a-48f6-86c5-455a9acf1f99 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:04:01.958359 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-565c496a-cf23-4b49-9d68-bfa13235f47d tempest-VolumesCloneNegativeTest-218611381 None] deleting rbd volume volume-25fff359-467a-48f6-86c5-455a9acf1f99 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:04:02.387966 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-565c496a-cf23-4b49-9d68-bfa13235f47d tempest-VolumesCloneNegativeTest-218611381 None] Created reservations ['7841a54a-406e-4b71-bdec-1330dd49aac1', '5f4a0238-f4ba-428f-a86a-e4fe5a7a5420', '20ec8eec-0b19-42c3-9329-8bcca856adbc', '67e04134-7713-45fd-b545-d3c0b0e3330d'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:04:02.439156 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-565c496a-cf23-4b49-9d68-bfa13235f47d tempest-VolumesCloneNegativeTest-218611381 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:04:02.501429 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-565c496a-cf23-4b49-9d68-bfa13235f47d tempest-VolumesCloneNegativeTest-218611381 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:04:02.554634 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-565c496a-cf23-4b49-9d68-bfa13235f47d tempest-VolumesCloneNegativeTest-218611381 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:04:02.560645 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-565c496a-cf23-4b49-9d68-bfa13235f47d tempest-VolumesCloneNegativeTest-218611381 None] Deleted volume successfully. May 07 22:04:02.574605 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-565c496a-cf23-4b49-9d68-bfa13235f47d tempest-VolumesCloneNegativeTest-218611381 None] Lock "b'cinder-25fff359-467a-48f6-86c5-455a9acf1f99-delete_volume'" released by "delete_volume" :: held 0.786s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:04:03.062064 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f9fea4a-01e5-43d5-b69d-8c1a1f501f0e tempest-ServersNegativeTestJSON-282814339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:04:03.084437 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4f9fea4a-01e5-43d5-b69d-8c1a1f501f0e tempest-ServersNegativeTestJSON-282814339 None] Flow 'volume_create_manager' (dae6121f-8d0c-4062-8334-21fd4d3e9348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:04:03.091789 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4f9fea4a-01e5-43d5-b69d-8c1a1f501f0e tempest-ServersNegativeTestJSON-282814339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40963282-5e3a-474e-89ba-9f3e5b606030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:04:03.133623 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4f9fea4a-01e5-43d5-b69d-8c1a1f501f0e tempest-ServersNegativeTestJSON-282814339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40963282-5e3a-474e-89ba-9f3e5b606030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1518127592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d3df800a-fdaa-4085-8fb9-311c1af45f76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cdcd8ea83db42c996b9c0cb8bac89aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:04:03Z,use_quota=True,user_id='e6abaee58e2540e090b6f53b6f6ef587',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:04:03.139636 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4f9fea4a-01e5-43d5-b69d-8c1a1f501f0e tempest-ServersNegativeTestJSON-282814339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3243dd3a-c4c6-4d71-84ce-1f75acc503c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:04:03.143900 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4f9fea4a-01e5-43d5-b69d-8c1a1f501f0e tempest-ServersNegativeTestJSON-282814339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3243dd3a-c4c6-4d71-84ce-1f75acc503c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:04:03.149707 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4f9fea4a-01e5-43d5-b69d-8c1a1f501f0e tempest-ServersNegativeTestJSON-282814339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a925ae10-7568-4a91-bb9b-c7299784981c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:04:03.155176 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4f9fea4a-01e5-43d5-b69d-8c1a1f501f0e tempest-ServersNegativeTestJSON-282814339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a925ae10-7568-4a91-bb9b-c7299784981c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3df800a-fdaa-4085-8fb9-311c1af45f76', 'volume_name': 'volume-d3df800a-fdaa-4085-8fb9-311c1af45f76', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:04:03.161405 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4f9fea4a-01e5-43d5-b69d-8c1a1f501f0e tempest-ServersNegativeTestJSON-282814339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df15e20d-f741-42dc-953d-14814451ffa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:04:03.166260 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4f9fea4a-01e5-43d5-b69d-8c1a1f501f0e tempest-ServersNegativeTestJSON-282814339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df15e20d-f741-42dc-953d-14814451ffa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:04:03.171380 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4f9fea4a-01e5-43d5-b69d-8c1a1f501f0e tempest-ServersNegativeTestJSON-282814339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c57682e-718d-41f7-9d4a-0fd1a39282af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:04:03.172484 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-4f9fea4a-01e5-43d5-b69d-8c1a1f501f0e tempest-ServersNegativeTestJSON-282814339 None] Volume d3df800a-fdaa-4085-8fb9-311c1af45f76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3df800a-fdaa-4085-8fb9-311c1af45f76', 'volume_size': 1} May 07 22:04:03.173060 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-4f9fea4a-01e5-43d5-b69d-8c1a1f501f0e tempest-ServersNegativeTestJSON-282814339 None] creating volume 'volume-d3df800a-fdaa-4085-8fb9-311c1af45f76' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:04:03.173869 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-4f9fea4a-01e5-43d5-b69d-8c1a1f501f0e tempest-ServersNegativeTestJSON-282814339 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:04:03.259393 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-4f9fea4a-01e5-43d5-b69d-8c1a1f501f0e tempest-ServersNegativeTestJSON-282814339 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:04:03.260121 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-4f9fea4a-01e5-43d5-b69d-8c1a1f501f0e tempest-ServersNegativeTestJSON-282814339 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:04:03.264618 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4f9fea4a-01e5-43d5-b69d-8c1a1f501f0e tempest-ServersNegativeTestJSON-282814339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c57682e-718d-41f7-9d4a-0fd1a39282af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3df800a-fdaa-4085-8fb9-311c1af45f76', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:04:03.270261 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4f9fea4a-01e5-43d5-b69d-8c1a1f501f0e tempest-ServersNegativeTestJSON-282814339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (141c2e28-2b0a-4bb6-a825-a1ec1a1dc919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:04:03.294563 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-4f9fea4a-01e5-43d5-b69d-8c1a1f501f0e tempest-ServersNegativeTestJSON-282814339 None] Volume volume-d3df800a-fdaa-4085-8fb9-311c1af45f76 (d3df800a-fdaa-4085-8fb9-311c1af45f76): created successfully May 07 22:04:03.303677 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4f9fea4a-01e5-43d5-b69d-8c1a1f501f0e tempest-ServersNegativeTestJSON-282814339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (141c2e28-2b0a-4bb6-a825-a1ec1a1dc919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:04:03.310446 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4f9fea4a-01e5-43d5-b69d-8c1a1f501f0e tempest-ServersNegativeTestJSON-282814339 None] Flow 'volume_create_manager' (dae6121f-8d0c-4062-8334-21fd4d3e9348) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:04:03.320882 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-4f9fea4a-01e5-43d5-b69d-8c1a1f501f0e tempest-ServersNegativeTestJSON-282814339 None] Created volume successfully. May 07 22:04:05.930982 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eb645cb-334e-4ce5-a9e5-05b9b6d79a71 tempest-VolumesNegativeTest-1084226632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:04:05.958491 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-0eb645cb-334e-4ce5-a9e5-05b9b6d79a71 tempest-VolumesNegativeTest-1084226632 None] Flow 'volume_create_manager' (81ee1774-785f-4060-b571-58260749bab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:04:05.963833 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-0eb645cb-334e-4ce5-a9e5-05b9b6d79a71 tempest-VolumesNegativeTest-1084226632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2212445a-5a41-468e-999b-26dd16ee1eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:04:05.981913 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-0eb645cb-334e-4ce5-a9e5-05b9b6d79a71 tempest-VolumesNegativeTest-1084226632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2212445a-5a41-468e-999b-26dd16ee1eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-905828420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=31cd6b8e-4326-473d-a8bb-327abde79cff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17f1e26eb0cc42eea75d5194838b50f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:04:06Z,use_quota=True,user_id='b18ec20bcd654015b37eb90758427e1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:04:05.988038 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-0eb645cb-334e-4ce5-a9e5-05b9b6d79a71 tempest-VolumesNegativeTest-1084226632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f047fc9-13dd-4144-940c-fe2a688180fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:04:05.992981 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-0eb645cb-334e-4ce5-a9e5-05b9b6d79a71 tempest-VolumesNegativeTest-1084226632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f047fc9-13dd-4144-940c-fe2a688180fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:04:05.998884 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-0eb645cb-334e-4ce5-a9e5-05b9b6d79a71 tempest-VolumesNegativeTest-1084226632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (086b5ba6-58ad-4661-bfbc-dc4f688260c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:04:06.003602 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-0eb645cb-334e-4ce5-a9e5-05b9b6d79a71 tempest-VolumesNegativeTest-1084226632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (086b5ba6-58ad-4661-bfbc-dc4f688260c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31cd6b8e-4326-473d-a8bb-327abde79cff', 'volume_name': 'volume-31cd6b8e-4326-473d-a8bb-327abde79cff', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:04:06.011303 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-0eb645cb-334e-4ce5-a9e5-05b9b6d79a71 tempest-VolumesNegativeTest-1084226632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03c865bc-c397-4c58-80d6-0c1f5489fb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:04:06.020170 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-0eb645cb-334e-4ce5-a9e5-05b9b6d79a71 tempest-VolumesNegativeTest-1084226632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03c865bc-c397-4c58-80d6-0c1f5489fb45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:04:06.026740 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-0eb645cb-334e-4ce5-a9e5-05b9b6d79a71 tempest-VolumesNegativeTest-1084226632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee4d1510-3a82-4475-9622-b1c7c7bd36ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:04:06.028509 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-0eb645cb-334e-4ce5-a9e5-05b9b6d79a71 tempest-VolumesNegativeTest-1084226632 None] Volume 31cd6b8e-4326-473d-a8bb-327abde79cff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31cd6b8e-4326-473d-a8bb-327abde79cff', 'volume_size': 1} May 07 22:04:06.029073 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0eb645cb-334e-4ce5-a9e5-05b9b6d79a71 tempest-VolumesNegativeTest-1084226632 None] creating volume 'volume-31cd6b8e-4326-473d-a8bb-327abde79cff' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:04:06.030503 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0eb645cb-334e-4ce5-a9e5-05b9b6d79a71 tempest-VolumesNegativeTest-1084226632 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:04:06.153410 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0eb645cb-334e-4ce5-a9e5-05b9b6d79a71 tempest-VolumesNegativeTest-1084226632 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:04:06.154455 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0eb645cb-334e-4ce5-a9e5-05b9b6d79a71 tempest-VolumesNegativeTest-1084226632 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:04:06.159310 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-0eb645cb-334e-4ce5-a9e5-05b9b6d79a71 tempest-VolumesNegativeTest-1084226632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee4d1510-3a82-4475-9622-b1c7c7bd36ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31cd6b8e-4326-473d-a8bb-327abde79cff', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:04:06.169206 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-0eb645cb-334e-4ce5-a9e5-05b9b6d79a71 tempest-VolumesNegativeTest-1084226632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76400958-49ef-4d4b-beaf-d3f3299510b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:04:06.205992 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-0eb645cb-334e-4ce5-a9e5-05b9b6d79a71 tempest-VolumesNegativeTest-1084226632 None] Volume volume-31cd6b8e-4326-473d-a8bb-327abde79cff (31cd6b8e-4326-473d-a8bb-327abde79cff): created successfully May 07 22:04:06.227692 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-0eb645cb-334e-4ce5-a9e5-05b9b6d79a71 tempest-VolumesNegativeTest-1084226632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76400958-49ef-4d4b-beaf-d3f3299510b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:04:06.236079 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-0eb645cb-334e-4ce5-a9e5-05b9b6d79a71 tempest-VolumesNegativeTest-1084226632 None] Flow 'volume_create_manager' (81ee1774-785f-4060-b571-58260749bab4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:04:06.249381 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-0eb645cb-334e-4ce5-a9e5-05b9b6d79a71 tempest-VolumesNegativeTest-1084226632 None] Created volume successfully. May 07 22:04:19.749444 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-8692a7ac-9a44-4f65-bace-9a1f8502907a tempest-ServerRescueNegativeTestJSON-1146234554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:04:19.770628 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-8692a7ac-9a44-4f65-bace-9a1f8502907a tempest-ServerRescueNegativeTestJSON-1146234554 None] Flow 'volume_create_manager' (992149a0-aee8-40bd-887e-08eb3df73ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:04:19.777887 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-8692a7ac-9a44-4f65-bace-9a1f8502907a tempest-ServerRescueNegativeTestJSON-1146234554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cbe4faa-0c0e-42d7-864e-a157453966b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:04:19.793581 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-8692a7ac-9a44-4f65-bace-9a1f8502907a tempest-ServerRescueNegativeTestJSON-1146234554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cbe4faa-0c0e-42d7-864e-a157453966b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-283594128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c1f1602a-c13f-4f22-870b-54705d29081f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8130c27f2b84434a8d6fa5032b67aa1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:04:20Z,use_quota=True,user_id='4fb48e4d50184d2e97674324027d9ec0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:04:19.799374 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-8692a7ac-9a44-4f65-bace-9a1f8502907a tempest-ServerRescueNegativeTestJSON-1146234554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f480376-3919-4ca3-b902-9f23c8007ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:04:19.804193 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-8692a7ac-9a44-4f65-bace-9a1f8502907a tempest-ServerRescueNegativeTestJSON-1146234554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f480376-3919-4ca3-b902-9f23c8007ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:04:19.809398 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-8692a7ac-9a44-4f65-bace-9a1f8502907a tempest-ServerRescueNegativeTestJSON-1146234554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3028345c-3f5d-45cb-bf77-59dea1d423f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:04:19.813789 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-8692a7ac-9a44-4f65-bace-9a1f8502907a tempest-ServerRescueNegativeTestJSON-1146234554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3028345c-3f5d-45cb-bf77-59dea1d423f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1f1602a-c13f-4f22-870b-54705d29081f', 'volume_name': 'volume-c1f1602a-c13f-4f22-870b-54705d29081f', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:04:19.819431 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-8692a7ac-9a44-4f65-bace-9a1f8502907a tempest-ServerRescueNegativeTestJSON-1146234554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96862eff-6ea9-4ba3-aa7e-d61fa5f4c3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:04:19.823470 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-8692a7ac-9a44-4f65-bace-9a1f8502907a tempest-ServerRescueNegativeTestJSON-1146234554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96862eff-6ea9-4ba3-aa7e-d61fa5f4c3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:04:19.828256 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-8692a7ac-9a44-4f65-bace-9a1f8502907a tempest-ServerRescueNegativeTestJSON-1146234554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca4fb34d-dcc9-4de3-bdf2-7b00ac80e780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:04:19.829530 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-8692a7ac-9a44-4f65-bace-9a1f8502907a tempest-ServerRescueNegativeTestJSON-1146234554 None] Volume c1f1602a-c13f-4f22-870b-54705d29081f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1f1602a-c13f-4f22-870b-54705d29081f', 'volume_size': 1} May 07 22:04:19.830088 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-8692a7ac-9a44-4f65-bace-9a1f8502907a tempest-ServerRescueNegativeTestJSON-1146234554 None] creating volume 'volume-c1f1602a-c13f-4f22-870b-54705d29081f' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:04:19.830941 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-8692a7ac-9a44-4f65-bace-9a1f8502907a tempest-ServerRescueNegativeTestJSON-1146234554 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:04:19.930966 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-8692a7ac-9a44-4f65-bace-9a1f8502907a tempest-ServerRescueNegativeTestJSON-1146234554 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:04:19.931350 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-8692a7ac-9a44-4f65-bace-9a1f8502907a tempest-ServerRescueNegativeTestJSON-1146234554 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:04:19.936247 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-8692a7ac-9a44-4f65-bace-9a1f8502907a tempest-ServerRescueNegativeTestJSON-1146234554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca4fb34d-dcc9-4de3-bdf2-7b00ac80e780) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1f1602a-c13f-4f22-870b-54705d29081f', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:04:19.941910 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-8692a7ac-9a44-4f65-bace-9a1f8502907a tempest-ServerRescueNegativeTestJSON-1146234554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01efff6a-bfcb-4a48-aebb-cf4566b75d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:04:19.951993 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-8692a7ac-9a44-4f65-bace-9a1f8502907a tempest-ServerRescueNegativeTestJSON-1146234554 None] Volume volume-c1f1602a-c13f-4f22-870b-54705d29081f (c1f1602a-c13f-4f22-870b-54705d29081f): created successfully May 07 22:04:19.955850 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-8692a7ac-9a44-4f65-bace-9a1f8502907a tempest-ServerRescueNegativeTestJSON-1146234554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01efff6a-bfcb-4a48-aebb-cf4566b75d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:04:19.961613 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-8692a7ac-9a44-4f65-bace-9a1f8502907a tempest-ServerRescueNegativeTestJSON-1146234554 None] Flow 'volume_create_manager' (992149a0-aee8-40bd-887e-08eb3df73ff6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:04:19.979181 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-8692a7ac-9a44-4f65-bace-9a1f8502907a tempest-ServerRescueNegativeTestJSON-1146234554 None] Created volume successfully. May 07 22:04:30.750387 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:04:30.751110 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:04:30.788687 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:04:30.842207 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:04:31.189091 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-48c1a6d3-01bc-4ec8-9a2e-678e22451935 tempest-VolumesNegativeTest-1084226632 None] Lock "b'cinder-31cd6b8e-4326-473d-a8bb-327abde79cff-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:04:31.260507 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-48c1a6d3-01bc-4ec8-9a2e-678e22451935 tempest-VolumesNegativeTest-1084226632 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:04:31.334193 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-48c1a6d3-01bc-4ec8-9a2e-678e22451935 tempest-VolumesNegativeTest-1084226632 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:04:31.334626 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-48c1a6d3-01bc-4ec8-9a2e-678e22451935 tempest-VolumesNegativeTest-1084226632 None] Volume volume-31cd6b8e-4326-473d-a8bb-327abde79cff is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:04:31.340686 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-48c1a6d3-01bc-4ec8-9a2e-678e22451935 tempest-VolumesNegativeTest-1084226632 None] deleting rbd volume volume-31cd6b8e-4326-473d-a8bb-327abde79cff {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:04:31.609408 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-48c1a6d3-01bc-4ec8-9a2e-678e22451935 tempest-VolumesNegativeTest-1084226632 None] Created reservations ['f183d904-3293-4293-b255-5ad5efe5d042', '10a03dce-6bef-449d-a957-8ef5744a6369', '4b57798b-0a67-42ca-9a29-8f2664ee42db', '5537e1cd-637e-448d-9dd3-52223466a837'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:04:31.656287 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-48c1a6d3-01bc-4ec8-9a2e-678e22451935 tempest-VolumesNegativeTest-1084226632 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:04:31.687912 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-48c1a6d3-01bc-4ec8-9a2e-678e22451935 tempest-VolumesNegativeTest-1084226632 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:04:31.718289 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-48c1a6d3-01bc-4ec8-9a2e-678e22451935 tempest-VolumesNegativeTest-1084226632 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:04:31.722503 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-48c1a6d3-01bc-4ec8-9a2e-678e22451935 tempest-VolumesNegativeTest-1084226632 None] Deleted volume successfully. May 07 22:04:31.733876 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-48c1a6d3-01bc-4ec8-9a2e-678e22451935 tempest-VolumesNegativeTest-1084226632 None] Lock "b'cinder-31cd6b8e-4326-473d-a8bb-327abde79cff-delete_volume'" released by "delete_volume" :: held 0.545s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:04:49.480923 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fc67fe3-574f-447f-9ee8-76e06dfbadd6 tempest-AttachVolumeTestJSON-808075378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:04:49.528221 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-1fc67fe3-574f-447f-9ee8-76e06dfbadd6 tempest-AttachVolumeTestJSON-808075378 None] Flow 'volume_create_manager' (98e463ea-edde-4d3f-8646-0d35182404ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:04:49.539159 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-1fc67fe3-574f-447f-9ee8-76e06dfbadd6 tempest-AttachVolumeTestJSON-808075378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ad8bf2b-6820-4729-81b4-c452122ee299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:04:49.584549 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-1fc67fe3-574f-447f-9ee8-76e06dfbadd6 tempest-AttachVolumeTestJSON-808075378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ad8bf2b-6820-4729-81b4-c452122ee299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1185367851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2f2e1d36-a982-48b0-8bfb-72803eff465b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81e5c5d849ea4fc59d5c4fc58b31530f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:04:49Z,use_quota=True,user_id='5ea5d144165a4e129de242905439e951',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:04:49.594908 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-1fc67fe3-574f-447f-9ee8-76e06dfbadd6 tempest-AttachVolumeTestJSON-808075378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (275f3666-78f5-4025-8a0e-feae8681d0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:04:49.609634 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-1fc67fe3-574f-447f-9ee8-76e06dfbadd6 tempest-AttachVolumeTestJSON-808075378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (275f3666-78f5-4025-8a0e-feae8681d0d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:04:49.616417 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-1fc67fe3-574f-447f-9ee8-76e06dfbadd6 tempest-AttachVolumeTestJSON-808075378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7af896fe-2b16-46b4-adb1-9f1ea26e33cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:04:49.622148 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-1fc67fe3-574f-447f-9ee8-76e06dfbadd6 tempest-AttachVolumeTestJSON-808075378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7af896fe-2b16-46b4-adb1-9f1ea26e33cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f2e1d36-a982-48b0-8bfb-72803eff465b', 'volume_name': 'volume-2f2e1d36-a982-48b0-8bfb-72803eff465b', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:04:49.634023 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-1fc67fe3-574f-447f-9ee8-76e06dfbadd6 tempest-AttachVolumeTestJSON-808075378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9295747e-0c2f-43f0-96a8-690a5798d489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:04:49.638129 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-1fc67fe3-574f-447f-9ee8-76e06dfbadd6 tempest-AttachVolumeTestJSON-808075378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9295747e-0c2f-43f0-96a8-690a5798d489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:04:49.647763 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-1fc67fe3-574f-447f-9ee8-76e06dfbadd6 tempest-AttachVolumeTestJSON-808075378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a55ff6a0-4cc3-4b35-b620-c4e9ee2fca5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:04:49.649060 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-1fc67fe3-574f-447f-9ee8-76e06dfbadd6 tempest-AttachVolumeTestJSON-808075378 None] Volume 2f2e1d36-a982-48b0-8bfb-72803eff465b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f2e1d36-a982-48b0-8bfb-72803eff465b', 'volume_size': 1} May 07 22:04:49.649624 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-1fc67fe3-574f-447f-9ee8-76e06dfbadd6 tempest-AttachVolumeTestJSON-808075378 None] creating volume 'volume-2f2e1d36-a982-48b0-8bfb-72803eff465b' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:04:49.650829 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-1fc67fe3-574f-447f-9ee8-76e06dfbadd6 tempest-AttachVolumeTestJSON-808075378 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:04:49.716798 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-1fc67fe3-574f-447f-9ee8-76e06dfbadd6 tempest-AttachVolumeTestJSON-808075378 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:04:49.717301 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-1fc67fe3-574f-447f-9ee8-76e06dfbadd6 tempest-AttachVolumeTestJSON-808075378 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:04:49.721495 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-1fc67fe3-574f-447f-9ee8-76e06dfbadd6 tempest-AttachVolumeTestJSON-808075378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a55ff6a0-4cc3-4b35-b620-c4e9ee2fca5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f2e1d36-a982-48b0-8bfb-72803eff465b', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:04:49.727210 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-1fc67fe3-574f-447f-9ee8-76e06dfbadd6 tempest-AttachVolumeTestJSON-808075378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55de9d3c-aed6-4bcb-8b3b-ea5c793fcb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:04:49.737838 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-1fc67fe3-574f-447f-9ee8-76e06dfbadd6 tempest-AttachVolumeTestJSON-808075378 None] Volume volume-2f2e1d36-a982-48b0-8bfb-72803eff465b (2f2e1d36-a982-48b0-8bfb-72803eff465b): created successfully May 07 22:04:49.743507 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-1fc67fe3-574f-447f-9ee8-76e06dfbadd6 tempest-AttachVolumeTestJSON-808075378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55de9d3c-aed6-4bcb-8b3b-ea5c793fcb00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:04:49.750516 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-1fc67fe3-574f-447f-9ee8-76e06dfbadd6 tempest-AttachVolumeTestJSON-808075378 None] Flow 'volume_create_manager' (98e463ea-edde-4d3f-8646-0d35182404ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:04:49.761144 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-1fc67fe3-574f-447f-9ee8-76e06dfbadd6 tempest-AttachVolumeTestJSON-808075378 None] Created volume successfully. May 07 22:04:50.973721 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-4ef49c34-f888-43cb-a15e-57eecf8f227c req-6e965139-0354-42ab-9054-6df8e48bd9f3 tempest-AttachVolumeTestJSON-808075378 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 22:04:51.688231 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-4ef49c34-f888-43cb-a15e-57eecf8f227c req-6e965139-0354-42ab-9054-6df8e48bd9f3 tempest-AttachVolumeTestJSON-808075378 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.714s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 22:04:51.689095 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-4ef49c34-f888-43cb-a15e-57eecf8f227c req-6e965139-0354-42ab-9054-6df8e48bd9f3 tempest-AttachVolumeTestJSON-808075378 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2f2e1d36-a982-48b0-8bfb-72803eff465b', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3ca0b836-1cfe-436a-b0fa-deb74d3203d9', 'volume_id': '2f2e1d36-a982-48b0-8bfb-72803eff465b', 'discard': True}} {{(pid=129946) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 07 22:04:51.715584 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-4ef49c34-f888-43cb-a15e-57eecf8f227c req-6e965139-0354-42ab-9054-6df8e48bd9f3 tempest-AttachVolumeTestJSON-808075378 None] Connection info returned from driver {'name': 'volumes/volume-2f2e1d36-a982-48b0-8bfb-72803eff465b', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '2f2e1d36-a982-48b0-8bfb-72803eff465b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '82f645c3-146d-4868-8c70-8bbfda14e71d'} {{(pid=129946) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 07 22:04:51.772246 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-4ef49c34-f888-43cb-a15e-57eecf8f227c req-6e965139-0354-42ab-9054-6df8e48bd9f3 tempest-AttachVolumeTestJSON-808075378 None] attachment_update completed successfully. May 07 22:04:54.943172 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-079f8d4b-920a-4065-a5ac-8f81028efce2 tempest-AttachVolumeTestJSON-808075378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:04:54.967614 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-079f8d4b-920a-4065-a5ac-8f81028efce2 tempest-AttachVolumeTestJSON-808075378 None] Flow 'volume_create_manager' (caf4892e-6e73-41c7-86fb-c5e3dfb12876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:04:54.976317 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-079f8d4b-920a-4065-a5ac-8f81028efce2 tempest-AttachVolumeTestJSON-808075378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bec7584-0d27-4e95-873f-8b9124e98b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:04:55.008627 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-079f8d4b-920a-4065-a5ac-8f81028efce2 tempest-AttachVolumeTestJSON-808075378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bec7584-0d27-4e95-873f-8b9124e98b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1314049710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8ca6cc52-9abb-42c9-b4b5-c2025d24f7f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81e5c5d849ea4fc59d5c4fc58b31530f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:04:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:04:55Z,use_quota=True,user_id='5ea5d144165a4e129de242905439e951',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:04:55.016049 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-079f8d4b-920a-4065-a5ac-8f81028efce2 tempest-AttachVolumeTestJSON-808075378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aebe8ef-b74f-48bb-ae71-10ff11765f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:04:55.024636 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-079f8d4b-920a-4065-a5ac-8f81028efce2 tempest-AttachVolumeTestJSON-808075378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aebe8ef-b74f-48bb-ae71-10ff11765f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:04:55.033458 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-079f8d4b-920a-4065-a5ac-8f81028efce2 tempest-AttachVolumeTestJSON-808075378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d102db54-f872-4963-a907-75616cfadbf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:04:55.045922 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-079f8d4b-920a-4065-a5ac-8f81028efce2 tempest-AttachVolumeTestJSON-808075378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d102db54-f872-4963-a907-75616cfadbf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ca6cc52-9abb-42c9-b4b5-c2025d24f7f8', 'volume_name': 'volume-8ca6cc52-9abb-42c9-b4b5-c2025d24f7f8', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:04:55.055263 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-079f8d4b-920a-4065-a5ac-8f81028efce2 tempest-AttachVolumeTestJSON-808075378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5f2d140-b139-41f3-8630-34e340e444fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:04:55.062436 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-079f8d4b-920a-4065-a5ac-8f81028efce2 tempest-AttachVolumeTestJSON-808075378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5f2d140-b139-41f3-8630-34e340e444fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:04:55.072441 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-079f8d4b-920a-4065-a5ac-8f81028efce2 tempest-AttachVolumeTestJSON-808075378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5193f95d-1ebd-49de-9df9-cbadb272d97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:04:55.073856 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-079f8d4b-920a-4065-a5ac-8f81028efce2 tempest-AttachVolumeTestJSON-808075378 None] Volume 8ca6cc52-9abb-42c9-b4b5-c2025d24f7f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ca6cc52-9abb-42c9-b4b5-c2025d24f7f8', 'volume_size': 1} May 07 22:04:55.074425 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-079f8d4b-920a-4065-a5ac-8f81028efce2 tempest-AttachVolumeTestJSON-808075378 None] creating volume 'volume-8ca6cc52-9abb-42c9-b4b5-c2025d24f7f8' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:04:55.075547 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-079f8d4b-920a-4065-a5ac-8f81028efce2 tempest-AttachVolumeTestJSON-808075378 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:04:55.203724 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-079f8d4b-920a-4065-a5ac-8f81028efce2 tempest-AttachVolumeTestJSON-808075378 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:04:55.204112 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-079f8d4b-920a-4065-a5ac-8f81028efce2 tempest-AttachVolumeTestJSON-808075378 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:04:55.208213 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-079f8d4b-920a-4065-a5ac-8f81028efce2 tempest-AttachVolumeTestJSON-808075378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5193f95d-1ebd-49de-9df9-cbadb272d97c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ca6cc52-9abb-42c9-b4b5-c2025d24f7f8', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:04:55.223816 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-079f8d4b-920a-4065-a5ac-8f81028efce2 tempest-AttachVolumeTestJSON-808075378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0790a69-0bbc-495c-84c7-85cca8097521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:04:55.261535 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-079f8d4b-920a-4065-a5ac-8f81028efce2 tempest-AttachVolumeTestJSON-808075378 None] Volume volume-8ca6cc52-9abb-42c9-b4b5-c2025d24f7f8 (8ca6cc52-9abb-42c9-b4b5-c2025d24f7f8): created successfully May 07 22:04:55.285152 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-079f8d4b-920a-4065-a5ac-8f81028efce2 tempest-AttachVolumeTestJSON-808075378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0790a69-0bbc-495c-84c7-85cca8097521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:04:55.304317 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-079f8d4b-920a-4065-a5ac-8f81028efce2 tempest-AttachVolumeTestJSON-808075378 None] Flow 'volume_create_manager' (caf4892e-6e73-41c7-86fb-c5e3dfb12876) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:04:55.326690 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-079f8d4b-920a-4065-a5ac-8f81028efce2 tempest-AttachVolumeTestJSON-808075378 None] Created volume successfully. May 07 22:04:56.553468 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-82be985e-52f4-41c0-92fe-6c9d0364921e req-9de77070-56c3-48d0-909b-ab446568cd25 tempest-AttachVolumeTestJSON-808075378 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 22:04:57.550500 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-82be985e-52f4-41c0-92fe-6c9d0364921e req-9de77070-56c3-48d0-909b-ab446568cd25 tempest-AttachVolumeTestJSON-808075378 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.996s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 22:04:57.552200 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-82be985e-52f4-41c0-92fe-6c9d0364921e req-9de77070-56c3-48d0-909b-ab446568cd25 tempest-AttachVolumeTestJSON-808075378 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-8ca6cc52-9abb-42c9-b4b5-c2025d24f7f8', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3ca0b836-1cfe-436a-b0fa-deb74d3203d9', 'volume_id': '8ca6cc52-9abb-42c9-b4b5-c2025d24f7f8', 'discard': True}} {{(pid=129946) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 07 22:04:57.659385 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-82be985e-52f4-41c0-92fe-6c9d0364921e req-9de77070-56c3-48d0-909b-ab446568cd25 tempest-AttachVolumeTestJSON-808075378 None] Connection info returned from driver {'name': 'volumes/volume-8ca6cc52-9abb-42c9-b4b5-c2025d24f7f8', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '8ca6cc52-9abb-42c9-b4b5-c2025d24f7f8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'edbb49b3-17cb-413f-a292-c1aba75f9036'} {{(pid=129946) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 07 22:04:57.759315 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-82be985e-52f4-41c0-92fe-6c9d0364921e req-9de77070-56c3-48d0-909b-ab446568cd25 tempest-AttachVolumeTestJSON-808075378 None] attachment_update completed successfully. May 07 22:05:01.362148 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-37a8dc72-1198-414d-80b6-32a8c6e301ec req-7bc6cd03-2801-4330-9cb5-05282bfe638a tempest-AttachVolumeTestJSON-808075378 None] Terminate volume connection completed successfully. May 07 22:05:01.363444 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-37a8dc72-1198-414d-80b6-32a8c6e301ec req-7bc6cd03-2801-4330-9cb5-05282bfe638a tempest-AttachVolumeTestJSON-808075378 None] Deleting attachment 82f645c3-146d-4868-8c70-8bbfda14e71d. {{(pid=129946) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 07 22:05:02.901030 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-c8833029-d2b2-4fe0-b043-da37b895081a req-c46af12c-6075-452b-bd4c-f73a6056a027 tempest-AttachVolumeTestJSON-808075378 None] Terminate volume connection completed successfully. May 07 22:05:02.902881 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-c8833029-d2b2-4fe0-b043-da37b895081a req-c46af12c-6075-452b-bd4c-f73a6056a027 tempest-AttachVolumeTestJSON-808075378 None] Deleting attachment edbb49b3-17cb-413f-a292-c1aba75f9036. {{(pid=129946) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 07 22:05:08.404604 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0e9dbf0-5051-4fce-a109-a3de3265e7c6 tempest-AttachVolumeNegativeTest-835916675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:05:08.434344 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d0e9dbf0-5051-4fce-a109-a3de3265e7c6 tempest-AttachVolumeNegativeTest-835916675 None] Flow 'volume_create_manager' (3649fe0f-fa9a-474f-a73b-4cd61e469e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:05:08.441733 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d0e9dbf0-5051-4fce-a109-a3de3265e7c6 tempest-AttachVolumeNegativeTest-835916675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32df2652-7ac7-493e-83c8-7170e691063c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:05:08.459397 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d0e9dbf0-5051-4fce-a109-a3de3265e7c6 tempest-AttachVolumeNegativeTest-835916675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32df2652-7ac7-493e-83c8-7170e691063c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:05:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1420177848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6bcc482f-be0e-4aa0-8871-ca6d63dad8d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57990769f50b412194a108cdd627a767',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:05:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:05:08Z,use_quota=True,user_id='887054d178de43b18a472fed2297659d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:05:08.465737 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d0e9dbf0-5051-4fce-a109-a3de3265e7c6 tempest-AttachVolumeNegativeTest-835916675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4b6c3bd-4160-4694-85f4-59ab53a978ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:05:08.470180 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d0e9dbf0-5051-4fce-a109-a3de3265e7c6 tempest-AttachVolumeNegativeTest-835916675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4b6c3bd-4160-4694-85f4-59ab53a978ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:05:08.475899 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d0e9dbf0-5051-4fce-a109-a3de3265e7c6 tempest-AttachVolumeNegativeTest-835916675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dd3df32-0497-46fe-8263-bb201dfb3648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:05:08.480450 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d0e9dbf0-5051-4fce-a109-a3de3265e7c6 tempest-AttachVolumeNegativeTest-835916675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dd3df32-0497-46fe-8263-bb201dfb3648) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bcc482f-be0e-4aa0-8871-ca6d63dad8d7', 'volume_name': 'volume-6bcc482f-be0e-4aa0-8871-ca6d63dad8d7', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:05:08.485725 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d0e9dbf0-5051-4fce-a109-a3de3265e7c6 tempest-AttachVolumeNegativeTest-835916675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e5a2c19-25ef-49be-b7c5-a59e1fc58759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:05:08.490533 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d0e9dbf0-5051-4fce-a109-a3de3265e7c6 tempest-AttachVolumeNegativeTest-835916675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e5a2c19-25ef-49be-b7c5-a59e1fc58759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:05:08.496392 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d0e9dbf0-5051-4fce-a109-a3de3265e7c6 tempest-AttachVolumeNegativeTest-835916675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c42044ad-b48a-4511-bea1-0f7aa737ca50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:05:08.498562 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-d0e9dbf0-5051-4fce-a109-a3de3265e7c6 tempest-AttachVolumeNegativeTest-835916675 None] Volume 6bcc482f-be0e-4aa0-8871-ca6d63dad8d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bcc482f-be0e-4aa0-8871-ca6d63dad8d7', 'volume_size': 1} May 07 22:05:08.498562 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d0e9dbf0-5051-4fce-a109-a3de3265e7c6 tempest-AttachVolumeNegativeTest-835916675 None] creating volume 'volume-6bcc482f-be0e-4aa0-8871-ca6d63dad8d7' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:05:08.499065 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d0e9dbf0-5051-4fce-a109-a3de3265e7c6 tempest-AttachVolumeNegativeTest-835916675 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:05:08.638943 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d0e9dbf0-5051-4fce-a109-a3de3265e7c6 tempest-AttachVolumeNegativeTest-835916675 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:05:08.639571 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d0e9dbf0-5051-4fce-a109-a3de3265e7c6 tempest-AttachVolumeNegativeTest-835916675 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:05:08.644024 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d0e9dbf0-5051-4fce-a109-a3de3265e7c6 tempest-AttachVolumeNegativeTest-835916675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c42044ad-b48a-4511-bea1-0f7aa737ca50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bcc482f-be0e-4aa0-8871-ca6d63dad8d7', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:05:08.649384 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d0e9dbf0-5051-4fce-a109-a3de3265e7c6 tempest-AttachVolumeNegativeTest-835916675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37754b27-38fc-4191-8c9f-2e008f20b368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:05:08.677382 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-d0e9dbf0-5051-4fce-a109-a3de3265e7c6 tempest-AttachVolumeNegativeTest-835916675 None] Volume volume-6bcc482f-be0e-4aa0-8871-ca6d63dad8d7 (6bcc482f-be0e-4aa0-8871-ca6d63dad8d7): created successfully May 07 22:05:08.686748 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d0e9dbf0-5051-4fce-a109-a3de3265e7c6 tempest-AttachVolumeNegativeTest-835916675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37754b27-38fc-4191-8c9f-2e008f20b368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:05:08.699307 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d0e9dbf0-5051-4fce-a109-a3de3265e7c6 tempest-AttachVolumeNegativeTest-835916675 None] Flow 'volume_create_manager' (3649fe0f-fa9a-474f-a73b-4cd61e469e79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:05:08.716745 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-d0e9dbf0-5051-4fce-a109-a3de3265e7c6 tempest-AttachVolumeNegativeTest-835916675 None] Created volume successfully. May 07 22:05:09.889548 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-449fb9fb-5c84-43ab-8cfd-ec54be7b646e tempest-AttachVolumeTestJSON-808075378 None] Lock "b'cinder-8ca6cc52-9abb-42c9-b4b5-c2025d24f7f8-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:05:09.923289 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-449fb9fb-5c84-43ab-8cfd-ec54be7b646e tempest-AttachVolumeTestJSON-808075378 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:05:09.962832 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-449fb9fb-5c84-43ab-8cfd-ec54be7b646e tempest-AttachVolumeTestJSON-808075378 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:05:09.963349 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-449fb9fb-5c84-43ab-8cfd-ec54be7b646e tempest-AttachVolumeTestJSON-808075378 None] Volume volume-8ca6cc52-9abb-42c9-b4b5-c2025d24f7f8 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:05:09.969734 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-449fb9fb-5c84-43ab-8cfd-ec54be7b646e tempest-AttachVolumeTestJSON-808075378 None] deleting rbd volume volume-8ca6cc52-9abb-42c9-b4b5-c2025d24f7f8 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:05:10.246512 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-449fb9fb-5c84-43ab-8cfd-ec54be7b646e tempest-AttachVolumeTestJSON-808075378 None] Created reservations ['77aab960-d266-4812-8087-24670a8ba2a1', '01066cef-774b-4d35-a3d6-fc39c8f066a9', 'cf13a426-4450-4e3c-968b-7aecc387c939', 'dc7433f9-f37d-4a13-9d0b-8e19f52fe25a'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:05:10.301882 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-449fb9fb-5c84-43ab-8cfd-ec54be7b646e tempest-AttachVolumeTestJSON-808075378 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:05:10.327033 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-449fb9fb-5c84-43ab-8cfd-ec54be7b646e tempest-AttachVolumeTestJSON-808075378 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:05:10.354666 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-449fb9fb-5c84-43ab-8cfd-ec54be7b646e tempest-AttachVolumeTestJSON-808075378 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:05:10.360723 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-449fb9fb-5c84-43ab-8cfd-ec54be7b646e tempest-AttachVolumeTestJSON-808075378 None] Deleted volume successfully. May 07 22:05:10.377155 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-449fb9fb-5c84-43ab-8cfd-ec54be7b646e tempest-AttachVolumeTestJSON-808075378 None] Lock "b'cinder-8ca6cc52-9abb-42c9-b4b5-c2025d24f7f8-delete_volume'" released by "delete_volume" :: held 0.488s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:05:11.084024 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-662663a1-c307-444a-a5e7-3ec468495da0 req-0c819044-99e6-48cd-99c4-b47167c69d13 tempest-AttachVolumeNegativeTest-835916675 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 22:05:11.136721 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-99793dc1-eb73-4231-8047-f01bc9d33865 tempest-AttachVolumeTestJSON-808075378 None] Lock "b'cinder-2f2e1d36-a982-48b0-8bfb-72803eff465b-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:05:11.201148 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-99793dc1-eb73-4231-8047-f01bc9d33865 tempest-AttachVolumeTestJSON-808075378 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:05:11.302978 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-99793dc1-eb73-4231-8047-f01bc9d33865 tempest-AttachVolumeTestJSON-808075378 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:05:11.303438 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-99793dc1-eb73-4231-8047-f01bc9d33865 tempest-AttachVolumeTestJSON-808075378 None] Volume volume-2f2e1d36-a982-48b0-8bfb-72803eff465b is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:05:11.311866 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-99793dc1-eb73-4231-8047-f01bc9d33865 tempest-AttachVolumeTestJSON-808075378 None] deleting rbd volume volume-2f2e1d36-a982-48b0-8bfb-72803eff465b {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:05:11.606979 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-99793dc1-eb73-4231-8047-f01bc9d33865 tempest-AttachVolumeTestJSON-808075378 None] Created reservations ['01e74771-ddf6-4694-9bff-b4e63fd816f0', '1586f2a3-6272-4398-b89a-36c9645c5024', '4da4b461-dddc-4ae5-b0af-56c6151a5551', '2303d1f6-bc6b-46c1-aa87-95dfb1f68911'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:05:11.661508 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-99793dc1-eb73-4231-8047-f01bc9d33865 tempest-AttachVolumeTestJSON-808075378 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:05:11.714788 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-99793dc1-eb73-4231-8047-f01bc9d33865 tempest-AttachVolumeTestJSON-808075378 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:05:11.756984 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-99793dc1-eb73-4231-8047-f01bc9d33865 tempest-AttachVolumeTestJSON-808075378 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:05:11.761947 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-99793dc1-eb73-4231-8047-f01bc9d33865 tempest-AttachVolumeTestJSON-808075378 None] Deleted volume successfully. May 07 22:05:11.779395 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-99793dc1-eb73-4231-8047-f01bc9d33865 tempest-AttachVolumeTestJSON-808075378 None] Lock "b'cinder-2f2e1d36-a982-48b0-8bfb-72803eff465b-delete_volume'" released by "delete_volume" :: held 0.642s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:05:11.972439 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-662663a1-c307-444a-a5e7-3ec468495da0 req-0c819044-99e6-48cd-99c4-b47167c69d13 tempest-AttachVolumeNegativeTest-835916675 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.889s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 22:05:11.973519 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-662663a1-c307-444a-a5e7-3ec468495da0 req-0c819044-99e6-48cd-99c4-b47167c69d13 tempest-AttachVolumeNegativeTest-835916675 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-6bcc482f-be0e-4aa0-8871-ca6d63dad8d7', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3ca0b836-1cfe-436a-b0fa-deb74d3203d9', 'volume_id': '6bcc482f-be0e-4aa0-8871-ca6d63dad8d7', 'discard': True}} {{(pid=129946) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 07 22:05:11.999851 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-662663a1-c307-444a-a5e7-3ec468495da0 req-0c819044-99e6-48cd-99c4-b47167c69d13 tempest-AttachVolumeNegativeTest-835916675 None] Connection info returned from driver {'name': 'volumes/volume-6bcc482f-be0e-4aa0-8871-ca6d63dad8d7', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '6bcc482f-be0e-4aa0-8871-ca6d63dad8d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '743a919a-41c9-4c38-9fa5-5d62615d64f2'} {{(pid=129946) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 07 22:05:12.067417 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-662663a1-c307-444a-a5e7-3ec468495da0 req-0c819044-99e6-48cd-99c4-b47167c69d13 tempest-AttachVolumeNegativeTest-835916675 None] attachment_update completed successfully. May 07 22:05:12.339329 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-64fea017-724c-4dd3-9ec2-4f02ed627307 tempest-AttachVolumeTestJSON-808075378 None] Lock "b'cinder-563e3251-764b-419d-8f65-8e94c270df50-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:05:12.392359 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-64fea017-724c-4dd3-9ec2-4f02ed627307 tempest-AttachVolumeTestJSON-808075378 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:05:12.442659 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-64fea017-724c-4dd3-9ec2-4f02ed627307 tempest-AttachVolumeTestJSON-808075378 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:05:12.443174 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-64fea017-724c-4dd3-9ec2-4f02ed627307 tempest-AttachVolumeTestJSON-808075378 None] Volume volume-563e3251-764b-419d-8f65-8e94c270df50 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:05:12.451883 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-64fea017-724c-4dd3-9ec2-4f02ed627307 tempest-AttachVolumeTestJSON-808075378 None] deleting rbd volume volume-563e3251-764b-419d-8f65-8e94c270df50 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:05:12.826020 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-64fea017-724c-4dd3-9ec2-4f02ed627307 tempest-AttachVolumeTestJSON-808075378 None] Created reservations ['d44a54e9-7dc4-4a77-9d44-3468a228b1b9', '148171d9-f39a-48b7-a3ff-2662f5456c18', '1d08fa7f-a145-4d50-a62d-29dfb4cd6f25', '1232571a-f297-4aff-a45f-ad3bc49e2f22'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:05:12.901020 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-64fea017-724c-4dd3-9ec2-4f02ed627307 tempest-AttachVolumeTestJSON-808075378 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:05:12.932521 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-64fea017-724c-4dd3-9ec2-4f02ed627307 tempest-AttachVolumeTestJSON-808075378 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:05:12.981620 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-64fea017-724c-4dd3-9ec2-4f02ed627307 tempest-AttachVolumeTestJSON-808075378 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:05:12.988019 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-64fea017-724c-4dd3-9ec2-4f02ed627307 tempest-AttachVolumeTestJSON-808075378 None] Deleted volume successfully. May 07 22:05:13.004921 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-64fea017-724c-4dd3-9ec2-4f02ed627307 tempest-AttachVolumeTestJSON-808075378 None] Lock "b'cinder-563e3251-764b-419d-8f65-8e94c270df50-delete_volume'" released by "delete_volume" :: held 0.666s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:05:15.256510 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-dc311666-4d84-4519-8d52-a8ef396f82b1 req-d440dfb5-44b7-430f-be0f-7682c4617519 tempest-AttachVolumeNegativeTest-835916675 None] Terminate volume connection completed successfully. May 07 22:05:15.257194 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-dc311666-4d84-4519-8d52-a8ef396f82b1 req-d440dfb5-44b7-430f-be0f-7682c4617519 tempest-AttachVolumeNegativeTest-835916675 None] Deleting attachment 743a919a-41c9-4c38-9fa5-5d62615d64f2. {{(pid=129946) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 07 22:05:25.192076 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-4e9d1081-b754-4242-b922-45b2e326d390 req-6ccb11ec-236c-4d9e-a3d4-9ce2484dc71b tempest-ServerRescueNegativeTestJSON-1146234554 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 22:05:26.429443 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-4e9d1081-b754-4242-b922-45b2e326d390 req-6ccb11ec-236c-4d9e-a3d4-9ce2484dc71b tempest-ServerRescueNegativeTestJSON-1146234554 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.237s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 22:05:26.431156 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-4e9d1081-b754-4242-b922-45b2e326d390 req-6ccb11ec-236c-4d9e-a3d4-9ce2484dc71b tempest-ServerRescueNegativeTestJSON-1146234554 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c1f1602a-c13f-4f22-870b-54705d29081f', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3ca0b836-1cfe-436a-b0fa-deb74d3203d9', 'volume_id': 'c1f1602a-c13f-4f22-870b-54705d29081f', 'discard': True}} {{(pid=129946) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 07 22:05:26.503655 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-4e9d1081-b754-4242-b922-45b2e326d390 req-6ccb11ec-236c-4d9e-a3d4-9ce2484dc71b tempest-ServerRescueNegativeTestJSON-1146234554 None] Connection info returned from driver {'name': 'volumes/volume-c1f1602a-c13f-4f22-870b-54705d29081f', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'c1f1602a-c13f-4f22-870b-54705d29081f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'd5442a6c-0d4a-4da1-a357-f572b5ec9934'} {{(pid=129946) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 07 22:05:26.609454 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-4e9d1081-b754-4242-b922-45b2e326d390 req-6ccb11ec-236c-4d9e-a3d4-9ce2484dc71b tempest-ServerRescueNegativeTestJSON-1146234554 None] attachment_update completed successfully. May 07 22:05:30.750545 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:05:30.752119 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:05:30.805762 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:05:30.854128 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:05:48.859274 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-5c407249-e5ff-410e-8e28-f331427d5eb3 tempest-ServersNegativeTestJSON-282814339 None] Lock "b'cinder-d3df800a-fdaa-4085-8fb9-311c1af45f76-delete_volume'" acquired by "delete_volume" :: waited 0.027s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:05:48.915029 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-5c407249-e5ff-410e-8e28-f331427d5eb3 tempest-ServersNegativeTestJSON-282814339 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:05:48.979389 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-5c407249-e5ff-410e-8e28-f331427d5eb3 tempest-ServersNegativeTestJSON-282814339 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:05:48.979965 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-5c407249-e5ff-410e-8e28-f331427d5eb3 tempest-ServersNegativeTestJSON-282814339 None] Volume volume-d3df800a-fdaa-4085-8fb9-311c1af45f76 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:05:48.986369 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-5c407249-e5ff-410e-8e28-f331427d5eb3 tempest-ServersNegativeTestJSON-282814339 None] deleting rbd volume volume-d3df800a-fdaa-4085-8fb9-311c1af45f76 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:05:49.368595 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-5c407249-e5ff-410e-8e28-f331427d5eb3 tempest-ServersNegativeTestJSON-282814339 None] Created reservations ['0932b1c7-097d-4bfd-a240-044d286aff9d', 'e6e9ebd4-2519-4960-9e87-da44106a09a1', 'ed5539b5-3915-42b0-8cde-c640e5a06b27', '30f883cf-0e4b-42e7-88df-0f8fa424de5b'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:05:49.488402 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-5c407249-e5ff-410e-8e28-f331427d5eb3 tempest-ServersNegativeTestJSON-282814339 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:05:49.556615 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-5c407249-e5ff-410e-8e28-f331427d5eb3 tempest-ServersNegativeTestJSON-282814339 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:05:49.616381 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-5c407249-e5ff-410e-8e28-f331427d5eb3 tempest-ServersNegativeTestJSON-282814339 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:05:49.627069 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-5c407249-e5ff-410e-8e28-f331427d5eb3 tempest-ServersNegativeTestJSON-282814339 None] Deleted volume successfully. May 07 22:05:49.663106 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-5c407249-e5ff-410e-8e28-f331427d5eb3 tempest-ServersNegativeTestJSON-282814339 None] Lock "b'cinder-d3df800a-fdaa-4085-8fb9-311c1af45f76-delete_volume'" released by "delete_volume" :: held 0.804s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:05:50.029840 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-0c728318-9778-4f38-8f45-1a6340e3f3de tempest-ServersNegativeTestJSON-282814339 None] Lock "b'cinder-ca043d28-1974-421c-89fa-77065888ac9d-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:05:50.119865 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0c728318-9778-4f38-8f45-1a6340e3f3de tempest-ServersNegativeTestJSON-282814339 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:05:50.225199 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0c728318-9778-4f38-8f45-1a6340e3f3de tempest-ServersNegativeTestJSON-282814339 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:05:50.225621 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0c728318-9778-4f38-8f45-1a6340e3f3de tempest-ServersNegativeTestJSON-282814339 None] Volume volume-ca043d28-1974-421c-89fa-77065888ac9d is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:05:50.237345 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0c728318-9778-4f38-8f45-1a6340e3f3de tempest-ServersNegativeTestJSON-282814339 None] deleting rbd volume volume-ca043d28-1974-421c-89fa-77065888ac9d {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:05:50.778945 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-0c728318-9778-4f38-8f45-1a6340e3f3de tempest-ServersNegativeTestJSON-282814339 None] Created reservations ['19c84cc5-4b19-4d1e-8d27-d4966926b1f5', '9ba74979-2735-49b3-9b8d-35a768fa20d7', 'd59661e7-b281-4cf6-81f7-3a02d5725e51', 'c494aa35-e216-40c5-8c91-a444162f0550'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:05:50.862580 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0c728318-9778-4f38-8f45-1a6340e3f3de tempest-ServersNegativeTestJSON-282814339 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:05:50.924074 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0c728318-9778-4f38-8f45-1a6340e3f3de tempest-ServersNegativeTestJSON-282814339 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:05:51.002153 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-0c728318-9778-4f38-8f45-1a6340e3f3de tempest-ServersNegativeTestJSON-282814339 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:05:51.010498 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-0c728318-9778-4f38-8f45-1a6340e3f3de tempest-ServersNegativeTestJSON-282814339 None] Deleted volume successfully. May 07 22:05:51.033892 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-0c728318-9778-4f38-8f45-1a6340e3f3de tempest-ServersNegativeTestJSON-282814339 None] Lock "b'cinder-ca043d28-1974-421c-89fa-77065888ac9d-delete_volume'" released by "delete_volume" :: held 1.006s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:06:19.854813 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-82c866a2-5c1f-4b85-8004-828d3e2516d3 tempest-AttachVolumeNegativeTest-835916675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:06:19.879842 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-82c866a2-5c1f-4b85-8004-828d3e2516d3 tempest-AttachVolumeNegativeTest-835916675 None] Flow 'volume_create_manager' (4e53a174-33e9-4976-9351-a9bce62367b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:06:19.887640 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-82c866a2-5c1f-4b85-8004-828d3e2516d3 tempest-AttachVolumeNegativeTest-835916675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (128afb44-d647-4ed0-b552-07779e24aee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:06:19.905416 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-82c866a2-5c1f-4b85-8004-828d3e2516d3 tempest-AttachVolumeNegativeTest-835916675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (128afb44-d647-4ed0-b552-07779e24aee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-496424360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5918e1f8-56b4-47a0-9fdb-561562c08263,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57990769f50b412194a108cdd627a767',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:06:20Z,use_quota=True,user_id='887054d178de43b18a472fed2297659d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:06:19.911133 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-82c866a2-5c1f-4b85-8004-828d3e2516d3 tempest-AttachVolumeNegativeTest-835916675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5642ec5-276e-486b-9e4e-9c4d5340f6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:06:19.915525 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-82c866a2-5c1f-4b85-8004-828d3e2516d3 tempest-AttachVolumeNegativeTest-835916675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5642ec5-276e-486b-9e4e-9c4d5340f6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:06:19.922168 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-82c866a2-5c1f-4b85-8004-828d3e2516d3 tempest-AttachVolumeNegativeTest-835916675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9562522a-9d6e-4520-8450-f14e7cb3352b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:06:19.926464 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-82c866a2-5c1f-4b85-8004-828d3e2516d3 tempest-AttachVolumeNegativeTest-835916675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9562522a-9d6e-4520-8450-f14e7cb3352b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5918e1f8-56b4-47a0-9fdb-561562c08263', 'volume_name': 'volume-5918e1f8-56b4-47a0-9fdb-561562c08263', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:06:19.931832 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-82c866a2-5c1f-4b85-8004-828d3e2516d3 tempest-AttachVolumeNegativeTest-835916675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b202a8fa-e87c-482d-b5d8-1d7616063f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:06:19.936265 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-82c866a2-5c1f-4b85-8004-828d3e2516d3 tempest-AttachVolumeNegativeTest-835916675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b202a8fa-e87c-482d-b5d8-1d7616063f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:06:19.941821 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-82c866a2-5c1f-4b85-8004-828d3e2516d3 tempest-AttachVolumeNegativeTest-835916675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9df464a-524d-4a8a-b1f0-ed19639aefd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:06:19.942981 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-82c866a2-5c1f-4b85-8004-828d3e2516d3 tempest-AttachVolumeNegativeTest-835916675 None] Volume 5918e1f8-56b4-47a0-9fdb-561562c08263: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5918e1f8-56b4-47a0-9fdb-561562c08263', 'volume_size': 1} May 07 22:06:19.943374 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-82c866a2-5c1f-4b85-8004-828d3e2516d3 tempest-AttachVolumeNegativeTest-835916675 None] creating volume 'volume-5918e1f8-56b4-47a0-9fdb-561562c08263' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:06:19.944177 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-82c866a2-5c1f-4b85-8004-828d3e2516d3 tempest-AttachVolumeNegativeTest-835916675 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:06:20.040043 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-82c866a2-5c1f-4b85-8004-828d3e2516d3 tempest-AttachVolumeNegativeTest-835916675 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:06:20.040420 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-82c866a2-5c1f-4b85-8004-828d3e2516d3 tempest-AttachVolumeNegativeTest-835916675 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:06:20.044169 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-82c866a2-5c1f-4b85-8004-828d3e2516d3 tempest-AttachVolumeNegativeTest-835916675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9df464a-524d-4a8a-b1f0-ed19639aefd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5918e1f8-56b4-47a0-9fdb-561562c08263', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:06:20.050052 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-82c866a2-5c1f-4b85-8004-828d3e2516d3 tempest-AttachVolumeNegativeTest-835916675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1fd687e-7b22-4c34-9c3a-03e9af9f7e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:06:20.061847 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-82c866a2-5c1f-4b85-8004-828d3e2516d3 tempest-AttachVolumeNegativeTest-835916675 None] Volume volume-5918e1f8-56b4-47a0-9fdb-561562c08263 (5918e1f8-56b4-47a0-9fdb-561562c08263): created successfully May 07 22:06:20.068040 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-82c866a2-5c1f-4b85-8004-828d3e2516d3 tempest-AttachVolumeNegativeTest-835916675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1fd687e-7b22-4c34-9c3a-03e9af9f7e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:06:20.075251 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-82c866a2-5c1f-4b85-8004-828d3e2516d3 tempest-AttachVolumeNegativeTest-835916675 None] Flow 'volume_create_manager' (4e53a174-33e9-4976-9351-a9bce62367b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:06:20.088481 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-82c866a2-5c1f-4b85-8004-828d3e2516d3 tempest-AttachVolumeNegativeTest-835916675 None] Created volume successfully. May 07 22:06:21.282997 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-25b0c769-5bf3-4cb0-8a6c-f65de33d7638 req-e7cdd6a4-e651-4d60-b009-5c9132cf128f tempest-AttachVolumeNegativeTest-835916675 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 22:06:22.034963 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-25b0c769-5bf3-4cb0-8a6c-f65de33d7638 req-e7cdd6a4-e651-4d60-b009-5c9132cf128f tempest-AttachVolumeNegativeTest-835916675 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.752s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 22:06:22.035811 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-25b0c769-5bf3-4cb0-8a6c-f65de33d7638 req-e7cdd6a4-e651-4d60-b009-5c9132cf128f tempest-AttachVolumeNegativeTest-835916675 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-5918e1f8-56b4-47a0-9fdb-561562c08263', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3ca0b836-1cfe-436a-b0fa-deb74d3203d9', 'volume_id': '5918e1f8-56b4-47a0-9fdb-561562c08263', 'discard': True}} {{(pid=129946) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 07 22:06:22.067332 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-25b0c769-5bf3-4cb0-8a6c-f65de33d7638 req-e7cdd6a4-e651-4d60-b009-5c9132cf128f tempest-AttachVolumeNegativeTest-835916675 None] Connection info returned from driver {'name': 'volumes/volume-5918e1f8-56b4-47a0-9fdb-561562c08263', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '5918e1f8-56b4-47a0-9fdb-561562c08263', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '694c0ecd-0d83-4044-ad30-901445ab2c0f'} {{(pid=129946) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 07 22:06:22.136977 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-25b0c769-5bf3-4cb0-8a6c-f65de33d7638 req-e7cdd6a4-e651-4d60-b009-5c9132cf128f tempest-AttachVolumeNegativeTest-835916675 None] attachment_update completed successfully. May 07 22:06:23.890931 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-1c1fd8e3-7462-4b2e-ba74-080312c7aa39 req-cbe4d018-9e67-4f3a-a3b2-00958ebc4475 tempest-ServerRescueNegativeTestJSON-1146234554 None] Terminate volume connection completed successfully. May 07 22:06:23.891568 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-1c1fd8e3-7462-4b2e-ba74-080312c7aa39 req-cbe4d018-9e67-4f3a-a3b2-00958ebc4475 tempest-ServerRescueNegativeTestJSON-1146234554 None] Deleting attachment d5442a6c-0d4a-4da1-a357-f572b5ec9934. {{(pid=129946) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 07 22:06:28.152086 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-2d459c60-38bf-4b34-beca-c81b98658fb5 req-334c48cf-8131-4545-b3fe-ca4ce4bcb171 tempest-AttachVolumeNegativeTest-835916675 None] Terminate volume connection completed successfully. May 07 22:06:28.153431 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-2d459c60-38bf-4b34-beca-c81b98658fb5 req-334c48cf-8131-4545-b3fe-ca4ce4bcb171 tempest-AttachVolumeNegativeTest-835916675 None] Deleting attachment 694c0ecd-0d83-4044-ad30-901445ab2c0f. {{(pid=129946) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 07 22:06:29.442526 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-2c376f29-61a2-4fe8-9845-baf827c88745 tempest-GroupsV320Test-802220807 None] Group tempest-GroupsV320Test-Group-1921203136: creating May 07 22:06:29.473455 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-2c376f29-61a2-4fe8-9845-baf827c88745 tempest-GroupsV320Test-802220807 None] Group tempest-GroupsV320Test-Group-1921203136: created successfully May 07 22:06:29.483098 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-2c376f29-61a2-4fe8-9845-baf827c88745 tempest-GroupsV320Test-802220807 None] Create group completed successfully. May 07 22:06:30.753509 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:06:30.754640 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:06:30.858295 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:06:30.919369 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:06:31.454665 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-15a6f17a-5c2e-4bd5-a1aa-61c1e668cadf tempest-GroupsV320Test-802220807 None] Created reservations ['f0e0d1c4-4394-4536-85d8-5c4024401241'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:06:31.518866 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-15a6f17a-5c2e-4bd5-a1aa-61c1e668cadf tempest-GroupsV320Test-802220807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:06:31.600600 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-15a6f17a-5c2e-4bd5-a1aa-61c1e668cadf tempest-GroupsV320Test-802220807 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:06:31.660778 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-15a6f17a-5c2e-4bd5-a1aa-61c1e668cadf tempest-GroupsV320Test-802220807 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:06:31.674087 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-15a6f17a-5c2e-4bd5-a1aa-61c1e668cadf tempest-GroupsV320Test-802220807 None] Delete group completed successfully. May 07 22:06:33.878305 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-418eb6a3-bbf0-4de4-bd00-d4c0cf7a4475 tempest-ServerRescueNegativeTestJSON-1146234554 None] Lock "b'cinder-c1f1602a-c13f-4f22-870b-54705d29081f-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:06:33.940942 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-418eb6a3-bbf0-4de4-bd00-d4c0cf7a4475 tempest-ServerRescueNegativeTestJSON-1146234554 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:06:34.026923 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-418eb6a3-bbf0-4de4-bd00-d4c0cf7a4475 tempest-ServerRescueNegativeTestJSON-1146234554 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:06:34.027428 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-418eb6a3-bbf0-4de4-bd00-d4c0cf7a4475 tempest-ServerRescueNegativeTestJSON-1146234554 None] Volume volume-c1f1602a-c13f-4f22-870b-54705d29081f is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:06:34.048016 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-418eb6a3-bbf0-4de4-bd00-d4c0cf7a4475 tempest-ServerRescueNegativeTestJSON-1146234554 None] deleting rbd volume volume-c1f1602a-c13f-4f22-870b-54705d29081f {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:06:34.503836 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-418eb6a3-bbf0-4de4-bd00-d4c0cf7a4475 tempest-ServerRescueNegativeTestJSON-1146234554 None] Created reservations ['cd47edba-b861-447c-a16f-002a373365af', '51abdfd1-6b6e-4a0c-b893-f6a2a72e534f', '407eb034-0ddc-4009-b421-6e53f598e915', '78ff7cd7-f6b3-4110-aa65-01d6d8655b07'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:06:34.588250 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-418eb6a3-bbf0-4de4-bd00-d4c0cf7a4475 tempest-ServerRescueNegativeTestJSON-1146234554 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:06:34.645047 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-418eb6a3-bbf0-4de4-bd00-d4c0cf7a4475 tempest-ServerRescueNegativeTestJSON-1146234554 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:06:34.713743 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-418eb6a3-bbf0-4de4-bd00-d4c0cf7a4475 tempest-ServerRescueNegativeTestJSON-1146234554 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:06:34.718269 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-418eb6a3-bbf0-4de4-bd00-d4c0cf7a4475 tempest-ServerRescueNegativeTestJSON-1146234554 None] Deleted volume successfully. May 07 22:06:34.737613 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-418eb6a3-bbf0-4de4-bd00-d4c0cf7a4475 tempest-ServerRescueNegativeTestJSON-1146234554 None] Lock "b'cinder-c1f1602a-c13f-4f22-870b-54705d29081f-delete_volume'" released by "delete_volume" :: held 0.859s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:06:35.137481 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-64491f0b-51c5-4208-9168-93da618dcb95 tempest-ServerRescueNegativeTestJSON-1146234554 None] Lock "b'cinder-4f8e363d-4b8a-48db-874a-26551079d6b0-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:06:35.196385 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-64491f0b-51c5-4208-9168-93da618dcb95 tempest-ServerRescueNegativeTestJSON-1146234554 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:06:35.302639 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-64491f0b-51c5-4208-9168-93da618dcb95 tempest-ServerRescueNegativeTestJSON-1146234554 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:06:35.303220 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-64491f0b-51c5-4208-9168-93da618dcb95 tempest-ServerRescueNegativeTestJSON-1146234554 None] Volume volume-4f8e363d-4b8a-48db-874a-26551079d6b0 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:06:35.325802 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-64491f0b-51c5-4208-9168-93da618dcb95 tempest-ServerRescueNegativeTestJSON-1146234554 None] deleting rbd volume volume-4f8e363d-4b8a-48db-874a-26551079d6b0 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:06:35.844684 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-64491f0b-51c5-4208-9168-93da618dcb95 tempest-ServerRescueNegativeTestJSON-1146234554 None] Created reservations ['00eeb3da-3d02-4a3b-be84-6cb0b3048e08', 'eec57d9b-ad1f-46ba-8e7c-84639a25ac7e', '9af9b047-9eb5-4eb4-b8ec-3ede58f81981', '50f9519f-c278-48d5-b4ae-ac0db968dcb0'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:06:35.940013 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-64491f0b-51c5-4208-9168-93da618dcb95 tempest-ServerRescueNegativeTestJSON-1146234554 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:06:36.003594 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-64491f0b-51c5-4208-9168-93da618dcb95 tempest-ServerRescueNegativeTestJSON-1146234554 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:06:36.064997 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-64491f0b-51c5-4208-9168-93da618dcb95 tempest-ServerRescueNegativeTestJSON-1146234554 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:06:36.069527 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-64491f0b-51c5-4208-9168-93da618dcb95 tempest-ServerRescueNegativeTestJSON-1146234554 None] Deleted volume successfully. May 07 22:06:36.085413 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-64491f0b-51c5-4208-9168-93da618dcb95 tempest-ServerRescueNegativeTestJSON-1146234554 None] Lock "b'cinder-4f8e363d-4b8a-48db-874a-26551079d6b0-delete_volume'" released by "delete_volume" :: held 0.948s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:06:37.945891 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-642d047c-6c99-4ca3-a14c-8d1081031401 tempest-AttachVolumeNegativeTest-835916675 None] Lock "b'cinder-5918e1f8-56b4-47a0-9fdb-561562c08263-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:06:38.018639 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-642d047c-6c99-4ca3-a14c-8d1081031401 tempest-AttachVolumeNegativeTest-835916675 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:06:38.110939 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-642d047c-6c99-4ca3-a14c-8d1081031401 tempest-AttachVolumeNegativeTest-835916675 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:06:38.111902 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-642d047c-6c99-4ca3-a14c-8d1081031401 tempest-AttachVolumeNegativeTest-835916675 None] Volume volume-5918e1f8-56b4-47a0-9fdb-561562c08263 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:06:38.121714 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-642d047c-6c99-4ca3-a14c-8d1081031401 tempest-AttachVolumeNegativeTest-835916675 None] deleting rbd volume volume-5918e1f8-56b4-47a0-9fdb-561562c08263 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:06:38.694632 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-642d047c-6c99-4ca3-a14c-8d1081031401 tempest-AttachVolumeNegativeTest-835916675 None] Created reservations ['d74040c9-0446-42dd-ba9e-8673fe1699c2', '3de3171c-e71f-4b56-9ac2-eff83b0d4b4e', 'a40a86c1-78c9-49aa-a6d6-b8ac54795382', '16d38aa6-8d86-4a8d-a328-e99caa3d7c51'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:06:38.779460 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-642d047c-6c99-4ca3-a14c-8d1081031401 tempest-AttachVolumeNegativeTest-835916675 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:06:38.862338 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-642d047c-6c99-4ca3-a14c-8d1081031401 tempest-AttachVolumeNegativeTest-835916675 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:06:38.923251 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-642d047c-6c99-4ca3-a14c-8d1081031401 tempest-AttachVolumeNegativeTest-835916675 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:06:38.943500 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-642d047c-6c99-4ca3-a14c-8d1081031401 tempest-AttachVolumeNegativeTest-835916675 None] Deleted volume successfully. May 07 22:06:38.966716 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-642d047c-6c99-4ca3-a14c-8d1081031401 tempest-AttachVolumeNegativeTest-835916675 None] Lock "b'cinder-5918e1f8-56b4-47a0-9fdb-561562c08263-delete_volume'" released by "delete_volume" :: held 1.021s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:06:39.508144 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-adc752c5-5e0e-478e-a947-f6dc6ae196eb tempest-AttachVolumeNegativeTest-835916675 None] Lock "b'cinder-6bcc482f-be0e-4aa0-8871-ca6d63dad8d7-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:06:39.556217 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-adc752c5-5e0e-478e-a947-f6dc6ae196eb tempest-AttachVolumeNegativeTest-835916675 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:06:39.608215 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-adc752c5-5e0e-478e-a947-f6dc6ae196eb tempest-AttachVolumeNegativeTest-835916675 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:06:39.608675 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-adc752c5-5e0e-478e-a947-f6dc6ae196eb tempest-AttachVolumeNegativeTest-835916675 None] Volume volume-6bcc482f-be0e-4aa0-8871-ca6d63dad8d7 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:06:39.625054 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-adc752c5-5e0e-478e-a947-f6dc6ae196eb tempest-AttachVolumeNegativeTest-835916675 None] deleting rbd volume volume-6bcc482f-be0e-4aa0-8871-ca6d63dad8d7 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:06:39.948654 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-adc752c5-5e0e-478e-a947-f6dc6ae196eb tempest-AttachVolumeNegativeTest-835916675 None] Created reservations ['bb0362dd-ebc5-48e6-b111-51573a4cd443', '1055a6cb-e615-4770-a647-f565dddf7890', '84a66775-5683-4462-9213-5caef931ff0d', 'c43e83eb-2fae-4043-b021-e7f0154f8cd1'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:06:40.031403 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-adc752c5-5e0e-478e-a947-f6dc6ae196eb tempest-AttachVolumeNegativeTest-835916675 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:06:40.077752 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-adc752c5-5e0e-478e-a947-f6dc6ae196eb tempest-AttachVolumeNegativeTest-835916675 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:06:40.110386 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-adc752c5-5e0e-478e-a947-f6dc6ae196eb tempest-AttachVolumeNegativeTest-835916675 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:06:40.114671 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-adc752c5-5e0e-478e-a947-f6dc6ae196eb tempest-AttachVolumeNegativeTest-835916675 None] Deleted volume successfully. May 07 22:06:40.133529 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-adc752c5-5e0e-478e-a947-f6dc6ae196eb tempest-AttachVolumeNegativeTest-835916675 None] Lock "b'cinder-6bcc482f-be0e-4aa0-8871-ca6d63dad8d7-delete_volume'" released by "delete_volume" :: held 0.625s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:06:40.921382 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-177fa0f7-e9f2-41fa-bca8-a02406b933a1 tempest-AttachVolumeNegativeTest-835916675 None] Lock "b'cinder-5df3e22c-323c-404a-a8e6-d7e28dc9b693-delete_volume'" acquired by "delete_volume" :: waited 0.033s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:06:41.001375 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-177fa0f7-e9f2-41fa-bca8-a02406b933a1 tempest-AttachVolumeNegativeTest-835916675 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:06:41.104051 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-177fa0f7-e9f2-41fa-bca8-a02406b933a1 tempest-AttachVolumeNegativeTest-835916675 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:06:41.104727 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-177fa0f7-e9f2-41fa-bca8-a02406b933a1 tempest-AttachVolumeNegativeTest-835916675 None] Volume volume-5df3e22c-323c-404a-a8e6-d7e28dc9b693 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:06:41.124860 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-177fa0f7-e9f2-41fa-bca8-a02406b933a1 tempest-AttachVolumeNegativeTest-835916675 None] deleting rbd volume volume-5df3e22c-323c-404a-a8e6-d7e28dc9b693 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:06:41.573448 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-177fa0f7-e9f2-41fa-bca8-a02406b933a1 tempest-AttachVolumeNegativeTest-835916675 None] Created reservations ['3f84e4cf-000f-4f25-9966-79c4a5ecf84c', '15f4a7bb-2de6-47a7-9ee4-05f26e76c4ff', '9dc3a1cb-cd06-441c-9c31-2a38ac0e27d4', 'c535f479-819c-43a6-8758-70030010b4e3'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:06:41.646874 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-177fa0f7-e9f2-41fa-bca8-a02406b933a1 tempest-AttachVolumeNegativeTest-835916675 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:06:41.696463 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-177fa0f7-e9f2-41fa-bca8-a02406b933a1 tempest-AttachVolumeNegativeTest-835916675 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:06:41.758221 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-177fa0f7-e9f2-41fa-bca8-a02406b933a1 tempest-AttachVolumeNegativeTest-835916675 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:06:41.764434 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-177fa0f7-e9f2-41fa-bca8-a02406b933a1 tempest-AttachVolumeNegativeTest-835916675 None] Deleted volume successfully. May 07 22:06:41.783525 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-177fa0f7-e9f2-41fa-bca8-a02406b933a1 tempest-AttachVolumeNegativeTest-835916675 None] Lock "b'cinder-5df3e22c-323c-404a-a8e6-d7e28dc9b693-delete_volume'" released by "delete_volume" :: held 0.863s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:06:50.190300 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-38628b3d-55ee-40e0-a5a7-08568c25b31c tempest-VolumesServicesTestJSON-417278855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:06:50.271432 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-38628b3d-55ee-40e0-a5a7-08568c25b31c tempest-VolumesServicesTestJSON-417278855 None] Flow 'volume_create_manager' (a2d01c1c-9066-44a2-bd7f-6352d73fd710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:06:50.281500 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-38628b3d-55ee-40e0-a5a7-08568c25b31c tempest-VolumesServicesTestJSON-417278855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cab5abf5-3c24-410c-bdde-5e9dd2002e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:06:50.305240 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-38628b3d-55ee-40e0-a5a7-08568c25b31c tempest-VolumesServicesTestJSON-417278855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cab5abf5-3c24-410c-bdde-5e9dd2002e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:06:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1750916000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f8466ec0-7eff-4f82-a09c-66f2380ff591,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a878ef559ce5410fbd0d1636507258fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:06:50Z,use_quota=True,user_id='4e03c01990d947a286dda65768487e00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:06:50.314106 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-38628b3d-55ee-40e0-a5a7-08568c25b31c tempest-VolumesServicesTestJSON-417278855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9df9d78-73ba-4609-9fec-1bd21cd3e0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:06:50.320047 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-38628b3d-55ee-40e0-a5a7-08568c25b31c tempest-VolumesServicesTestJSON-417278855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9df9d78-73ba-4609-9fec-1bd21cd3e0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:06:50.328281 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-38628b3d-55ee-40e0-a5a7-08568c25b31c tempest-VolumesServicesTestJSON-417278855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6ba4601-3cb6-4349-98d8-e87818ff9126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:06:50.342210 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-38628b3d-55ee-40e0-a5a7-08568c25b31c tempest-VolumesServicesTestJSON-417278855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6ba4601-3cb6-4349-98d8-e87818ff9126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8466ec0-7eff-4f82-a09c-66f2380ff591', 'volume_name': 'volume-f8466ec0-7eff-4f82-a09c-66f2380ff591', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:06:50.349441 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-38628b3d-55ee-40e0-a5a7-08568c25b31c tempest-VolumesServicesTestJSON-417278855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c68172f3-8593-448a-986f-d71cffbdb166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:06:50.354174 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-38628b3d-55ee-40e0-a5a7-08568c25b31c tempest-VolumesServicesTestJSON-417278855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c68172f3-8593-448a-986f-d71cffbdb166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:06:50.360671 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-38628b3d-55ee-40e0-a5a7-08568c25b31c tempest-VolumesServicesTestJSON-417278855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48add487-e85c-4fd2-b521-d3d1070090bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:06:50.362436 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-38628b3d-55ee-40e0-a5a7-08568c25b31c tempest-VolumesServicesTestJSON-417278855 None] Volume f8466ec0-7eff-4f82-a09c-66f2380ff591: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8466ec0-7eff-4f82-a09c-66f2380ff591', 'volume_size': 1} May 07 22:06:50.363667 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-38628b3d-55ee-40e0-a5a7-08568c25b31c tempest-VolumesServicesTestJSON-417278855 None] creating volume 'volume-f8466ec0-7eff-4f82-a09c-66f2380ff591' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:06:50.364788 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-38628b3d-55ee-40e0-a5a7-08568c25b31c tempest-VolumesServicesTestJSON-417278855 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:06:50.519300 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-38628b3d-55ee-40e0-a5a7-08568c25b31c tempest-VolumesServicesTestJSON-417278855 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:06:50.519678 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-38628b3d-55ee-40e0-a5a7-08568c25b31c tempest-VolumesServicesTestJSON-417278855 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:06:50.523474 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-38628b3d-55ee-40e0-a5a7-08568c25b31c tempest-VolumesServicesTestJSON-417278855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48add487-e85c-4fd2-b521-d3d1070090bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8466ec0-7eff-4f82-a09c-66f2380ff591', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:06:50.528125 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-38628b3d-55ee-40e0-a5a7-08568c25b31c tempest-VolumesServicesTestJSON-417278855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46f852ae-28f5-4777-a3cf-90eeb2b2a151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:06:50.557736 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-38628b3d-55ee-40e0-a5a7-08568c25b31c tempest-VolumesServicesTestJSON-417278855 None] Volume volume-f8466ec0-7eff-4f82-a09c-66f2380ff591 (f8466ec0-7eff-4f82-a09c-66f2380ff591): created successfully May 07 22:06:50.562693 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-38628b3d-55ee-40e0-a5a7-08568c25b31c tempest-VolumesServicesTestJSON-417278855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46f852ae-28f5-4777-a3cf-90eeb2b2a151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:06:50.573782 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-38628b3d-55ee-40e0-a5a7-08568c25b31c tempest-VolumesServicesTestJSON-417278855 None] Flow 'volume_create_manager' (a2d01c1c-9066-44a2-bd7f-6352d73fd710) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:06:50.597733 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-38628b3d-55ee-40e0-a5a7-08568c25b31c tempest-VolumesServicesTestJSON-417278855 None] Created volume successfully. May 07 22:06:51.394328 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-5caf1bc2-d43d-4a33-b5e1-3a8d667bcdfd tempest-VolumesServicesTestJSON-417278855 None] Lock "b'cinder-f8466ec0-7eff-4f82-a09c-66f2380ff591-delete_volume'" acquired by "delete_volume" :: waited 0.026s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:06:51.448020 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-5caf1bc2-d43d-4a33-b5e1-3a8d667bcdfd tempest-VolumesServicesTestJSON-417278855 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:06:51.532235 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-5caf1bc2-d43d-4a33-b5e1-3a8d667bcdfd tempest-VolumesServicesTestJSON-417278855 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:06:51.532997 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-5caf1bc2-d43d-4a33-b5e1-3a8d667bcdfd tempest-VolumesServicesTestJSON-417278855 None] Volume volume-f8466ec0-7eff-4f82-a09c-66f2380ff591 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:06:51.549941 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-5caf1bc2-d43d-4a33-b5e1-3a8d667bcdfd tempest-VolumesServicesTestJSON-417278855 None] deleting rbd volume volume-f8466ec0-7eff-4f82-a09c-66f2380ff591 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:06:51.898236 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-5caf1bc2-d43d-4a33-b5e1-3a8d667bcdfd tempest-VolumesServicesTestJSON-417278855 None] Created reservations ['b171ed4e-a48b-4b47-900d-d541114eedd5', 'e977f729-44e2-4986-a232-8a43180dcb2e', 'b337fb11-b96c-46fa-ab55-9c8a4b629517', '23480483-92e9-49a0-91ca-bda3309640e8'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:06:51.956476 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-5caf1bc2-d43d-4a33-b5e1-3a8d667bcdfd tempest-VolumesServicesTestJSON-417278855 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:06:52.005025 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-5caf1bc2-d43d-4a33-b5e1-3a8d667bcdfd tempest-VolumesServicesTestJSON-417278855 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:06:52.068556 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-5caf1bc2-d43d-4a33-b5e1-3a8d667bcdfd tempest-VolumesServicesTestJSON-417278855 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:06:52.073865 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-5caf1bc2-d43d-4a33-b5e1-3a8d667bcdfd tempest-VolumesServicesTestJSON-417278855 None] Deleted volume successfully. May 07 22:06:52.095916 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-5caf1bc2-d43d-4a33-b5e1-3a8d667bcdfd tempest-VolumesServicesTestJSON-417278855 None] Lock "b'cinder-f8466ec0-7eff-4f82-a09c-66f2380ff591-delete_volume'" released by "delete_volume" :: held 0.702s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:07:07.585251 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-36916f31-5238-4206-b526-fcb393d1ab01 tempest-VolumeSnapshotQuotasNegativeTestJSON-1376046281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:07:07.617902 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-36916f31-5238-4206-b526-fcb393d1ab01 tempest-VolumeSnapshotQuotasNegativeTestJSON-1376046281 None] Flow 'volume_create_manager' (4ed729be-c6a8-4ebb-83b7-49a26ceb9b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:07:07.625592 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-36916f31-5238-4206-b526-fcb393d1ab01 tempest-VolumeSnapshotQuotasNegativeTestJSON-1376046281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea34495c-dee2-4999-a400-35e0f18ef53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:07.646886 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-36916f31-5238-4206-b526-fcb393d1ab01 tempest-VolumeSnapshotQuotasNegativeTestJSON-1376046281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea34495c-dee2-4999-a400-35e0f18ef53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1185710608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=595a757a-efc0-41c4-bf88-adf07e00c453,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4584d3cb399e419e80cdbb072ba0c5d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:07:08Z,use_quota=True,user_id='e1e1460ae4d742e1ac943fa98e74d9ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:07.655701 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-36916f31-5238-4206-b526-fcb393d1ab01 tempest-VolumeSnapshotQuotasNegativeTestJSON-1376046281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f465af20-e89f-4613-8f00-47f7fa463e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:07.660704 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-36916f31-5238-4206-b526-fcb393d1ab01 tempest-VolumeSnapshotQuotasNegativeTestJSON-1376046281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f465af20-e89f-4613-8f00-47f7fa463e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:07.667717 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-36916f31-5238-4206-b526-fcb393d1ab01 tempest-VolumeSnapshotQuotasNegativeTestJSON-1376046281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42e08daf-760c-4965-bd10-ee8744fb49f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:07.673533 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-36916f31-5238-4206-b526-fcb393d1ab01 tempest-VolumeSnapshotQuotasNegativeTestJSON-1376046281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42e08daf-760c-4965-bd10-ee8744fb49f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '595a757a-efc0-41c4-bf88-adf07e00c453', 'volume_name': 'volume-595a757a-efc0-41c4-bf88-adf07e00c453', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:07.679143 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-36916f31-5238-4206-b526-fcb393d1ab01 tempest-VolumeSnapshotQuotasNegativeTestJSON-1376046281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54d100a1-b3df-4e38-a92c-be6a0ab53883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:07.683784 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-36916f31-5238-4206-b526-fcb393d1ab01 tempest-VolumeSnapshotQuotasNegativeTestJSON-1376046281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54d100a1-b3df-4e38-a92c-be6a0ab53883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:07.689715 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-36916f31-5238-4206-b526-fcb393d1ab01 tempest-VolumeSnapshotQuotasNegativeTestJSON-1376046281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c14a17a-2b02-469d-898a-8a7458b6cd1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:07.692281 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-36916f31-5238-4206-b526-fcb393d1ab01 tempest-VolumeSnapshotQuotasNegativeTestJSON-1376046281 None] Volume 595a757a-efc0-41c4-bf88-adf07e00c453: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-595a757a-efc0-41c4-bf88-adf07e00c453', 'volume_size': 1} May 07 22:07:07.692281 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-36916f31-5238-4206-b526-fcb393d1ab01 tempest-VolumeSnapshotQuotasNegativeTestJSON-1376046281 None] creating volume 'volume-595a757a-efc0-41c4-bf88-adf07e00c453' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:07:07.692531 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-36916f31-5238-4206-b526-fcb393d1ab01 tempest-VolumeSnapshotQuotasNegativeTestJSON-1376046281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:07:07.811919 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-36916f31-5238-4206-b526-fcb393d1ab01 tempest-VolumeSnapshotQuotasNegativeTestJSON-1376046281 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:07:07.812346 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-36916f31-5238-4206-b526-fcb393d1ab01 tempest-VolumeSnapshotQuotasNegativeTestJSON-1376046281 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:07:07.820583 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-36916f31-5238-4206-b526-fcb393d1ab01 tempest-VolumeSnapshotQuotasNegativeTestJSON-1376046281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c14a17a-2b02-469d-898a-8a7458b6cd1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-595a757a-efc0-41c4-bf88-adf07e00c453', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:07.836592 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-36916f31-5238-4206-b526-fcb393d1ab01 tempest-VolumeSnapshotQuotasNegativeTestJSON-1376046281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cdb7581-8175-417a-ba37-f73f08b2efb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:07.850677 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-36916f31-5238-4206-b526-fcb393d1ab01 tempest-VolumeSnapshotQuotasNegativeTestJSON-1376046281 None] Volume volume-595a757a-efc0-41c4-bf88-adf07e00c453 (595a757a-efc0-41c4-bf88-adf07e00c453): created successfully May 07 22:07:07.855334 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-36916f31-5238-4206-b526-fcb393d1ab01 tempest-VolumeSnapshotQuotasNegativeTestJSON-1376046281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cdb7581-8175-417a-ba37-f73f08b2efb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:07.862269 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-36916f31-5238-4206-b526-fcb393d1ab01 tempest-VolumeSnapshotQuotasNegativeTestJSON-1376046281 None] Flow 'volume_create_manager' (4ed729be-c6a8-4ebb-83b7-49a26ceb9b4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:07:07.877228 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-36916f31-5238-4206-b526-fcb393d1ab01 tempest-VolumeSnapshotQuotasNegativeTestJSON-1376046281 None] Created volume successfully. May 07 22:07:08.971639 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0e1e7e7e-aef5-4cd4-80ec-9e8f41817d71 tempest-VolumeSnapshotQuotasNegativeTestJSON-1376046281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:07:09.526606 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-0e1e7e7e-aef5-4cd4-80ec-9e8f41817d71 tempest-VolumeSnapshotQuotasNegativeTestJSON-1376046281 None] Create snapshot completed successfully May 07 22:07:10.715940 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [req-2d35e4f4-79d1-4f52-9f48-b95d015f6497 req-f6a61c8c-8a5c-41c4-b19e-d9c02e94e2e1 tempest-VolumesGetTestJSON-1264326149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:07:10.767316 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-2d35e4f4-79d1-4f52-9f48-b95d015f6497 req-f6a61c8c-8a5c-41c4-b19e-d9c02e94e2e1 tempest-VolumesGetTestJSON-1264326149 None] Flow 'volume_create_manager' (23c0daea-7588-4832-9521-c86bb3a0b2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:07:10.776109 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-2d35e4f4-79d1-4f52-9f48-b95d015f6497 req-f6a61c8c-8a5c-41c4-b19e-d9c02e94e2e1 tempest-VolumesGetTestJSON-1264326149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6be710c2-a021-449c-b78f-6b099e509bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:10.805155 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-2d35e4f4-79d1-4f52-9f48-b95d015f6497 req-f6a61c8c-8a5c-41c4-b19e-d9c02e94e2e1 tempest-VolumesGetTestJSON-1264326149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6be710c2-a021-449c-b78f-6b099e509bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1396280169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5dfedd9d-bf6d-4f5a-85e3-88d4f4089740,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7c27245ca1bd4d64bc65b0cadd17a6d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:07:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:07:11Z,use_quota=True,user_id='a972cb56ffab489ba2455fafd073023a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:10.834130 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-2d35e4f4-79d1-4f52-9f48-b95d015f6497 req-f6a61c8c-8a5c-41c4-b19e-d9c02e94e2e1 tempest-VolumesGetTestJSON-1264326149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d78328cc-8bcf-443c-82a5-fe5119b8ed37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:10.841632 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-2d35e4f4-79d1-4f52-9f48-b95d015f6497 req-f6a61c8c-8a5c-41c4-b19e-d9c02e94e2e1 tempest-VolumesGetTestJSON-1264326149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d78328cc-8bcf-443c-82a5-fe5119b8ed37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:10.853455 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-2d35e4f4-79d1-4f52-9f48-b95d015f6497 req-f6a61c8c-8a5c-41c4-b19e-d9c02e94e2e1 tempest-VolumesGetTestJSON-1264326149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6ea7637-7bae-4c65-9e61-ebe43a3ce61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:10.860571 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-2d35e4f4-79d1-4f52-9f48-b95d015f6497 req-f6a61c8c-8a5c-41c4-b19e-d9c02e94e2e1 tempest-VolumesGetTestJSON-1264326149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6ea7637-7bae-4c65-9e61-ebe43a3ce61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dfedd9d-bf6d-4f5a-85e3-88d4f4089740', 'volume_name': 'volume-5dfedd9d-bf6d-4f5a-85e3-88d4f4089740', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:10.866357 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-2d35e4f4-79d1-4f52-9f48-b95d015f6497 req-f6a61c8c-8a5c-41c4-b19e-d9c02e94e2e1 tempest-VolumesGetTestJSON-1264326149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c836158-17ca-4d86-97df-d27707bc4a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:10.872368 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-2d35e4f4-79d1-4f52-9f48-b95d015f6497 req-f6a61c8c-8a5c-41c4-b19e-d9c02e94e2e1 tempest-VolumesGetTestJSON-1264326149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c836158-17ca-4d86-97df-d27707bc4a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:10.879256 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-2d35e4f4-79d1-4f52-9f48-b95d015f6497 req-f6a61c8c-8a5c-41c4-b19e-d9c02e94e2e1 tempest-VolumesGetTestJSON-1264326149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (855d4cf6-7453-458c-ac19-627ea7088c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:10.880729 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [req-2d35e4f4-79d1-4f52-9f48-b95d015f6497 req-f6a61c8c-8a5c-41c4-b19e-d9c02e94e2e1 tempest-VolumesGetTestJSON-1264326149 None] Volume 5dfedd9d-bf6d-4f5a-85e3-88d4f4089740: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dfedd9d-bf6d-4f5a-85e3-88d4f4089740', 'volume_size': 1} May 07 22:07:10.881325 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-2d35e4f4-79d1-4f52-9f48-b95d015f6497 req-f6a61c8c-8a5c-41c4-b19e-d9c02e94e2e1 tempest-VolumesGetTestJSON-1264326149 None] creating volume 'volume-5dfedd9d-bf6d-4f5a-85e3-88d4f4089740' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:07:10.882206 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-2d35e4f4-79d1-4f52-9f48-b95d015f6497 req-f6a61c8c-8a5c-41c4-b19e-d9c02e94e2e1 tempest-VolumesGetTestJSON-1264326149 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:07:10.954081 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-a7ad771a-d359-4e08-a2e2-ebc78926b7cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1376046281 None] Lock "b'cinder-5806455d-e8be-44a3-8c8b-fcd7b76cf3c5-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:07:10.956051 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-a7ad771a-d359-4e08-a2e2-ebc78926b7cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1376046281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:07:11.049195 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-2d35e4f4-79d1-4f52-9f48-b95d015f6497 req-f6a61c8c-8a5c-41c4-b19e-d9c02e94e2e1 tempest-VolumesGetTestJSON-1264326149 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:07:11.050815 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-2d35e4f4-79d1-4f52-9f48-b95d015f6497 req-f6a61c8c-8a5c-41c4-b19e-d9c02e94e2e1 tempest-VolumesGetTestJSON-1264326149 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:07:11.055998 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-2d35e4f4-79d1-4f52-9f48-b95d015f6497 req-f6a61c8c-8a5c-41c4-b19e-d9c02e94e2e1 tempest-VolumesGetTestJSON-1264326149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (855d4cf6-7453-458c-ac19-627ea7088c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dfedd9d-bf6d-4f5a-85e3-88d4f4089740', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:11.064713 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-2d35e4f4-79d1-4f52-9f48-b95d015f6497 req-f6a61c8c-8a5c-41c4-b19e-d9c02e94e2e1 tempest-VolumesGetTestJSON-1264326149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4419c523-f39b-4895-aa78-0d37e3e47031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:11.082569 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [req-2d35e4f4-79d1-4f52-9f48-b95d015f6497 req-f6a61c8c-8a5c-41c4-b19e-d9c02e94e2e1 tempest-VolumesGetTestJSON-1264326149 None] Volume volume-5dfedd9d-bf6d-4f5a-85e3-88d4f4089740 (5dfedd9d-bf6d-4f5a-85e3-88d4f4089740): created successfully May 07 22:07:11.094321 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-2d35e4f4-79d1-4f52-9f48-b95d015f6497 req-f6a61c8c-8a5c-41c4-b19e-d9c02e94e2e1 tempest-VolumesGetTestJSON-1264326149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4419c523-f39b-4895-aa78-0d37e3e47031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:11.103563 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-2d35e4f4-79d1-4f52-9f48-b95d015f6497 req-f6a61c8c-8a5c-41c4-b19e-d9c02e94e2e1 tempest-VolumesGetTestJSON-1264326149 None] Flow 'volume_create_manager' (23c0daea-7588-4832-9521-c86bb3a0b2e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:07:11.118297 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-2d35e4f4-79d1-4f52-9f48-b95d015f6497 req-f6a61c8c-8a5c-41c4-b19e-d9c02e94e2e1 tempest-VolumesGetTestJSON-1264326149 None] Created volume successfully. May 07 22:07:11.507866 ncdv-master-1 cinder-volume[129946]: WARNING cinder.quota [None req-a7ad771a-d359-4e08-a2e2-ebc78926b7cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1376046281 None] Deprecated: Default quota for resource: snapshots_ceph is set by the default quota flag: quota_snapshots_ceph, it is now deprecated. Please use the default quota class for default quota. May 07 22:07:11.525045 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-a7ad771a-d359-4e08-a2e2-ebc78926b7cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1376046281 None] Created reservations ['d5856ec4-3794-4368-82ec-8515dbeb7e3d', '8b23b5ea-8c31-4880-958d-272569284f72', '2efc37eb-b03b-48c9-8b39-956e22658152', '865eaec8-0326-49f0-8561-fb91d0d82651'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:07:11.569973 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-a7ad771a-d359-4e08-a2e2-ebc78926b7cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1376046281 None] Delete snapshot completed successfully. May 07 22:07:11.579532 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-a7ad771a-d359-4e08-a2e2-ebc78926b7cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1376046281 None] Lock "b'cinder-5806455d-e8be-44a3-8c8b-fcd7b76cf3c5-delete_snapshot'" released by "delete_snapshot" :: held 0.626s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:07:11.957069 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [req-88e44926-ca88-4966-bc5c-54dc47049b8d req-95ea62e9-8d2b-44cd-b207-01798eea1de9 tempest-VolumesGetTestJSON-1264326149 None] Lock "b'cinder-5dfedd9d-bf6d-4f5a-85e3-88d4f4089740-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:07:12.040380 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-85f3dc61-a48a-4666-b6da-3d451ac4e536 tempest-VolumeSnapshotQuotasNegativeTestJSON-1376046281 None] Lock "b'cinder-595a757a-efc0-41c4-bf88-adf07e00c453-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:07:12.044831 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-88e44926-ca88-4966-bc5c-54dc47049b8d req-95ea62e9-8d2b-44cd-b207-01798eea1de9 tempest-VolumesGetTestJSON-1264326149 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:07:12.136753 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-88e44926-ca88-4966-bc5c-54dc47049b8d req-95ea62e9-8d2b-44cd-b207-01798eea1de9 tempest-VolumesGetTestJSON-1264326149 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:07:12.137260 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-88e44926-ca88-4966-bc5c-54dc47049b8d req-95ea62e9-8d2b-44cd-b207-01798eea1de9 tempest-VolumesGetTestJSON-1264326149 None] Volume volume-5dfedd9d-bf6d-4f5a-85e3-88d4f4089740 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:07:12.145305 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-88e44926-ca88-4966-bc5c-54dc47049b8d req-95ea62e9-8d2b-44cd-b207-01798eea1de9 tempest-VolumesGetTestJSON-1264326149 None] deleting rbd volume volume-5dfedd9d-bf6d-4f5a-85e3-88d4f4089740 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:07:12.228765 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-85f3dc61-a48a-4666-b6da-3d451ac4e536 tempest-VolumeSnapshotQuotasNegativeTestJSON-1376046281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:07:12.301381 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-85f3dc61-a48a-4666-b6da-3d451ac4e536 tempest-VolumeSnapshotQuotasNegativeTestJSON-1376046281 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:07:12.302007 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-85f3dc61-a48a-4666-b6da-3d451ac4e536 tempest-VolumeSnapshotQuotasNegativeTestJSON-1376046281 None] Volume volume-595a757a-efc0-41c4-bf88-adf07e00c453 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:07:12.313411 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-85f3dc61-a48a-4666-b6da-3d451ac4e536 tempest-VolumeSnapshotQuotasNegativeTestJSON-1376046281 None] deleting rbd volume volume-595a757a-efc0-41c4-bf88-adf07e00c453 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:07:12.539276 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [req-88e44926-ca88-4966-bc5c-54dc47049b8d req-95ea62e9-8d2b-44cd-b207-01798eea1de9 tempest-VolumesGetTestJSON-1264326149 None] Created reservations ['55aba66c-6d9d-4a1e-85d3-e1acb4b9e2ab', '3317bedd-d856-4463-ab8d-02719e5bee9d', '0a2c0942-d9db-4b9c-ac6e-ed9ddb362ba4', 'cd996f3c-32bc-4b99-9e32-29c2d26ac80f'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:07:12.613020 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-88e44926-ca88-4966-bc5c-54dc47049b8d req-95ea62e9-8d2b-44cd-b207-01798eea1de9 tempest-VolumesGetTestJSON-1264326149 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:07:12.686972 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-88e44926-ca88-4966-bc5c-54dc47049b8d req-95ea62e9-8d2b-44cd-b207-01798eea1de9 tempest-VolumesGetTestJSON-1264326149 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:07:12.735378 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [req-88e44926-ca88-4966-bc5c-54dc47049b8d req-95ea62e9-8d2b-44cd-b207-01798eea1de9 tempest-VolumesGetTestJSON-1264326149 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:07:12.760070 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-88e44926-ca88-4966-bc5c-54dc47049b8d req-95ea62e9-8d2b-44cd-b207-01798eea1de9 tempest-VolumesGetTestJSON-1264326149 None] Deleted volume successfully. May 07 22:07:12.795754 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [req-88e44926-ca88-4966-bc5c-54dc47049b8d req-95ea62e9-8d2b-44cd-b207-01798eea1de9 tempest-VolumesGetTestJSON-1264326149 None] Lock "b'cinder-5dfedd9d-bf6d-4f5a-85e3-88d4f4089740-delete_volume'" released by "delete_volume" :: held 0.841s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:07:12.810200 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-85f3dc61-a48a-4666-b6da-3d451ac4e536 tempest-VolumeSnapshotQuotasNegativeTestJSON-1376046281 None] Created reservations ['a7189ac2-563b-4a2f-9bad-dbd88c09549f', '979c8ef0-8100-4ed8-a479-38b8e3074794', 'ff95b3a3-eb85-403b-8e8d-b9af0d3e68db', 'e06c87c7-1b26-40eb-9b70-908438e6583b'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:07:12.867591 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-85f3dc61-a48a-4666-b6da-3d451ac4e536 tempest-VolumeSnapshotQuotasNegativeTestJSON-1376046281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:07:12.894105 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-85f3dc61-a48a-4666-b6da-3d451ac4e536 tempest-VolumeSnapshotQuotasNegativeTestJSON-1376046281 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:07:12.922512 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-85f3dc61-a48a-4666-b6da-3d451ac4e536 tempest-VolumeSnapshotQuotasNegativeTestJSON-1376046281 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:07:12.927131 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-85f3dc61-a48a-4666-b6da-3d451ac4e536 tempest-VolumeSnapshotQuotasNegativeTestJSON-1376046281 None] Deleted volume successfully. May 07 22:07:12.941096 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-85f3dc61-a48a-4666-b6da-3d451ac4e536 tempest-VolumeSnapshotQuotasNegativeTestJSON-1376046281 None] Lock "b'cinder-595a757a-efc0-41c4-bf88-adf07e00c453-delete_volume'" released by "delete_volume" :: held 0.901s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:07:16.620052 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-91cb401b-8af2-4901-8467-9ec22643a274 tempest-VolumesTestJSON-1716948367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:07:16.648888 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-91cb401b-8af2-4901-8467-9ec22643a274 tempest-VolumesTestJSON-1716948367 None] Flow 'volume_create_manager' (13bced1f-e9a9-458e-b5bc-7bde4c3f0106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:07:16.657000 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-91cb401b-8af2-4901-8467-9ec22643a274 tempest-VolumesTestJSON-1716948367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09f0eeb1-bba9-43a0-afa2-72480fc891ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:16.674066 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-91cb401b-8af2-4901-8467-9ec22643a274 tempest-VolumesTestJSON-1716948367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09f0eeb1-bba9-43a0-afa2-72480fc891ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-412656657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=afe5cc01-8331-432e-bba2-58a01d7c8178,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e26f8701226f4b8cbedae536d77c9c61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:07:17Z,use_quota=True,user_id='9c29470ef66e4f3fb42580aadd704908',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:16.680110 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-91cb401b-8af2-4901-8467-9ec22643a274 tempest-VolumesTestJSON-1716948367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dea89d2f-c291-44d5-856f-8cd48424b945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:16.687685 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-91cb401b-8af2-4901-8467-9ec22643a274 tempest-VolumesTestJSON-1716948367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dea89d2f-c291-44d5-856f-8cd48424b945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:16.693634 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-91cb401b-8af2-4901-8467-9ec22643a274 tempest-VolumesTestJSON-1716948367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c088545-4e1d-453c-b747-2fe008ee94f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:16.698228 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-91cb401b-8af2-4901-8467-9ec22643a274 tempest-VolumesTestJSON-1716948367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c088545-4e1d-453c-b747-2fe008ee94f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afe5cc01-8331-432e-bba2-58a01d7c8178', 'volume_name': 'volume-afe5cc01-8331-432e-bba2-58a01d7c8178', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:16.704008 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-91cb401b-8af2-4901-8467-9ec22643a274 tempest-VolumesTestJSON-1716948367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21acd9b3-d1c0-44f5-aa98-b4c13e2db66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:16.708384 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-91cb401b-8af2-4901-8467-9ec22643a274 tempest-VolumesTestJSON-1716948367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21acd9b3-d1c0-44f5-aa98-b4c13e2db66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:16.713759 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-91cb401b-8af2-4901-8467-9ec22643a274 tempest-VolumesTestJSON-1716948367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a23263c-0ca6-4574-ad0b-31cf84ecbfbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:16.715131 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-91cb401b-8af2-4901-8467-9ec22643a274 tempest-VolumesTestJSON-1716948367 None] Volume afe5cc01-8331-432e-bba2-58a01d7c8178: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afe5cc01-8331-432e-bba2-58a01d7c8178', 'volume_size': 1} May 07 22:07:16.715669 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-91cb401b-8af2-4901-8467-9ec22643a274 tempest-VolumesTestJSON-1716948367 None] creating volume 'volume-afe5cc01-8331-432e-bba2-58a01d7c8178' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:07:16.716660 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-91cb401b-8af2-4901-8467-9ec22643a274 tempest-VolumesTestJSON-1716948367 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:07:16.831047 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-91cb401b-8af2-4901-8467-9ec22643a274 tempest-VolumesTestJSON-1716948367 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:07:16.831389 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-91cb401b-8af2-4901-8467-9ec22643a274 tempest-VolumesTestJSON-1716948367 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:07:16.835724 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-91cb401b-8af2-4901-8467-9ec22643a274 tempest-VolumesTestJSON-1716948367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a23263c-0ca6-4574-ad0b-31cf84ecbfbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afe5cc01-8331-432e-bba2-58a01d7c8178', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:16.845484 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-91cb401b-8af2-4901-8467-9ec22643a274 tempest-VolumesTestJSON-1716948367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c804eb61-b480-4a6f-b503-dd0aa6ef7ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:16.873832 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-91cb401b-8af2-4901-8467-9ec22643a274 tempest-VolumesTestJSON-1716948367 None] Volume volume-afe5cc01-8331-432e-bba2-58a01d7c8178 (afe5cc01-8331-432e-bba2-58a01d7c8178): created successfully May 07 22:07:16.877858 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-91cb401b-8af2-4901-8467-9ec22643a274 tempest-VolumesTestJSON-1716948367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c804eb61-b480-4a6f-b503-dd0aa6ef7ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:16.883876 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-91cb401b-8af2-4901-8467-9ec22643a274 tempest-VolumesTestJSON-1716948367 None] Flow 'volume_create_manager' (13bced1f-e9a9-458e-b5bc-7bde4c3f0106) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:07:16.922288 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-91cb401b-8af2-4901-8467-9ec22643a274 tempest-VolumesTestJSON-1716948367 None] Created volume successfully. May 07 22:07:18.539834 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b4b9da3-5abd-4e22-aa22-74612fb33de6 tempest-VolumesTestJSON-1716948367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:07:18.590240 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-6b4b9da3-5abd-4e22-aa22-74612fb33de6 tempest-VolumesTestJSON-1716948367 None] Flow 'volume_create_manager' (81f51e65-dd0c-4233-b729-83291c568027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:07:18.618107 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-6b4b9da3-5abd-4e22-aa22-74612fb33de6 tempest-VolumesTestJSON-1716948367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f73e242-7ac6-41d6-8c3d-f6c398a0fc01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:18.664856 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-6b4b9da3-5abd-4e22-aa22-74612fb33de6 tempest-VolumesTestJSON-1716948367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f73e242-7ac6-41d6-8c3d-f6c398a0fc01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:07:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1174357201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=994abfac-15ec-409e-816d-ca7441f8f8d8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e26f8701226f4b8cbedae536d77c9c61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:07:18Z,use_quota=True,user_id='9c29470ef66e4f3fb42580aadd704908',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:18.672422 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-6b4b9da3-5abd-4e22-aa22-74612fb33de6 tempest-VolumesTestJSON-1716948367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd1a1f85-6cf1-4363-9e96-7d4e96291a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:18.695413 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-6b4b9da3-5abd-4e22-aa22-74612fb33de6 tempest-VolumesTestJSON-1716948367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd1a1f85-6cf1-4363-9e96-7d4e96291a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:18.707292 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-6b4b9da3-5abd-4e22-aa22-74612fb33de6 tempest-VolumesTestJSON-1716948367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1307c64a-a5b4-4e83-a1c8-9ea23a441225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:18.723630 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-6b4b9da3-5abd-4e22-aa22-74612fb33de6 tempest-VolumesTestJSON-1716948367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1307c64a-a5b4-4e83-a1c8-9ea23a441225) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '994abfac-15ec-409e-816d-ca7441f8f8d8', 'volume_name': 'volume-994abfac-15ec-409e-816d-ca7441f8f8d8', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:18.728992 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-6b4b9da3-5abd-4e22-aa22-74612fb33de6 tempest-VolumesTestJSON-1716948367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (614f6fcb-b259-48ca-9800-a7f14fa9f8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:18.741830 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-6b4b9da3-5abd-4e22-aa22-74612fb33de6 tempest-VolumesTestJSON-1716948367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (614f6fcb-b259-48ca-9800-a7f14fa9f8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:18.754365 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-6b4b9da3-5abd-4e22-aa22-74612fb33de6 tempest-VolumesTestJSON-1716948367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (059f7264-0506-412b-ab8d-927f334ab4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:18.755758 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-6b4b9da3-5abd-4e22-aa22-74612fb33de6 tempest-VolumesTestJSON-1716948367 None] Volume 994abfac-15ec-409e-816d-ca7441f8f8d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-994abfac-15ec-409e-816d-ca7441f8f8d8', 'volume_size': 1} May 07 22:07:18.757796 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-6b4b9da3-5abd-4e22-aa22-74612fb33de6 tempest-VolumesTestJSON-1716948367 None] creating volume 'volume-994abfac-15ec-409e-816d-ca7441f8f8d8' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:07:18.759096 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-6b4b9da3-5abd-4e22-aa22-74612fb33de6 tempest-VolumesTestJSON-1716948367 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:07:18.955071 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-6b4b9da3-5abd-4e22-aa22-74612fb33de6 tempest-VolumesTestJSON-1716948367 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:07:18.955678 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-6b4b9da3-5abd-4e22-aa22-74612fb33de6 tempest-VolumesTestJSON-1716948367 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:07:18.960963 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-6b4b9da3-5abd-4e22-aa22-74612fb33de6 tempest-VolumesTestJSON-1716948367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (059f7264-0506-412b-ab8d-927f334ab4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-994abfac-15ec-409e-816d-ca7441f8f8d8', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:19.009143 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-6b4b9da3-5abd-4e22-aa22-74612fb33de6 tempest-VolumesTestJSON-1716948367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6442044-2198-4a65-a49b-36a2b10f077e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:19.040045 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-6b4b9da3-5abd-4e22-aa22-74612fb33de6 tempest-VolumesTestJSON-1716948367 None] Volume volume-994abfac-15ec-409e-816d-ca7441f8f8d8 (994abfac-15ec-409e-816d-ca7441f8f8d8): created successfully May 07 22:07:19.051264 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-6b4b9da3-5abd-4e22-aa22-74612fb33de6 tempest-VolumesTestJSON-1716948367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6442044-2198-4a65-a49b-36a2b10f077e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:19.071202 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-6b4b9da3-5abd-4e22-aa22-74612fb33de6 tempest-VolumesTestJSON-1716948367 None] Flow 'volume_create_manager' (81f51e65-dd0c-4233-b729-83291c568027) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:07:19.099894 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-6b4b9da3-5abd-4e22-aa22-74612fb33de6 tempest-VolumesTestJSON-1716948367 None] Created volume successfully. May 07 22:07:20.392983 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-58424663-2715-4d45-a581-0e61fb9aa86c tempest-VolumesTestJSON-1716948367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:07:20.486068 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-58424663-2715-4d45-a581-0e61fb9aa86c tempest-VolumesTestJSON-1716948367 None] Flow 'volume_create_manager' (7ee9fac2-e49d-4bb6-a495-3ca5c6a8a7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:07:20.503547 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-58424663-2715-4d45-a581-0e61fb9aa86c tempest-VolumesTestJSON-1716948367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c468b09-f6d5-48dc-bbaa-eebfc30db7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:20.571707 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-58424663-2715-4d45-a581-0e61fb9aa86c tempest-VolumesTestJSON-1716948367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c468b09-f6d5-48dc-bbaa-eebfc30db7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-206542896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=84e7a4f5-5a3a-4c8c-8c06-3be2f34259ab,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e26f8701226f4b8cbedae536d77c9c61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:07:20Z,use_quota=True,user_id='9c29470ef66e4f3fb42580aadd704908',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:20.577319 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-58424663-2715-4d45-a581-0e61fb9aa86c tempest-VolumesTestJSON-1716948367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3ed8ccf-dd85-495b-910f-7cfef39e26f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:20.596831 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-58424663-2715-4d45-a581-0e61fb9aa86c tempest-VolumesTestJSON-1716948367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3ed8ccf-dd85-495b-910f-7cfef39e26f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:20.608889 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-58424663-2715-4d45-a581-0e61fb9aa86c tempest-VolumesTestJSON-1716948367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78019880-3af1-4754-bc58-418bdb079792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:20.629230 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-58424663-2715-4d45-a581-0e61fb9aa86c tempest-VolumesTestJSON-1716948367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78019880-3af1-4754-bc58-418bdb079792) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84e7a4f5-5a3a-4c8c-8c06-3be2f34259ab', 'volume_name': 'volume-84e7a4f5-5a3a-4c8c-8c06-3be2f34259ab', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:20.634440 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-58424663-2715-4d45-a581-0e61fb9aa86c tempest-VolumesTestJSON-1716948367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5151298-8853-46b1-930e-6806eea1c16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:20.650013 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-58424663-2715-4d45-a581-0e61fb9aa86c tempest-VolumesTestJSON-1716948367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5151298-8853-46b1-930e-6806eea1c16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:20.658283 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-58424663-2715-4d45-a581-0e61fb9aa86c tempest-VolumesTestJSON-1716948367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (335bb8bb-bfc8-4c03-81f1-62c296aaa238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:20.665928 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-58424663-2715-4d45-a581-0e61fb9aa86c tempest-VolumesTestJSON-1716948367 None] Volume 84e7a4f5-5a3a-4c8c-8c06-3be2f34259ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84e7a4f5-5a3a-4c8c-8c06-3be2f34259ab', 'volume_size': 1} May 07 22:07:20.668433 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-58424663-2715-4d45-a581-0e61fb9aa86c tempest-VolumesTestJSON-1716948367 None] creating volume 'volume-84e7a4f5-5a3a-4c8c-8c06-3be2f34259ab' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:07:20.669146 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-58424663-2715-4d45-a581-0e61fb9aa86c tempest-VolumesTestJSON-1716948367 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:07:20.826261 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-58424663-2715-4d45-a581-0e61fb9aa86c tempest-VolumesTestJSON-1716948367 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:07:20.827692 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-58424663-2715-4d45-a581-0e61fb9aa86c tempest-VolumesTestJSON-1716948367 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:07:20.834275 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-58424663-2715-4d45-a581-0e61fb9aa86c tempest-VolumesTestJSON-1716948367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (335bb8bb-bfc8-4c03-81f1-62c296aaa238) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84e7a4f5-5a3a-4c8c-8c06-3be2f34259ab', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:20.849259 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-58424663-2715-4d45-a581-0e61fb9aa86c tempest-VolumesTestJSON-1716948367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43f118e9-76aa-4cfb-920f-25826fa8e258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:20.888960 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-58424663-2715-4d45-a581-0e61fb9aa86c tempest-VolumesTestJSON-1716948367 None] Volume volume-84e7a4f5-5a3a-4c8c-8c06-3be2f34259ab (84e7a4f5-5a3a-4c8c-8c06-3be2f34259ab): created successfully May 07 22:07:20.892724 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-58424663-2715-4d45-a581-0e61fb9aa86c tempest-VolumesTestJSON-1716948367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43f118e9-76aa-4cfb-920f-25826fa8e258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:20.898676 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-58424663-2715-4d45-a581-0e61fb9aa86c tempest-VolumesTestJSON-1716948367 None] Flow 'volume_create_manager' (7ee9fac2-e49d-4bb6-a495-3ca5c6a8a7ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:07:20.924505 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-58424663-2715-4d45-a581-0e61fb9aa86c tempest-VolumesTestJSON-1716948367 None] Created volume successfully. May 07 22:07:23.219243 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-340fca5e-7099-4aa8-af94-f5b7a34cbe85 tempest-VolumesTestJSON-1716948367 None] Lock "b'cinder-84e7a4f5-5a3a-4c8c-8c06-3be2f34259ab-delete_volume'" acquired by "delete_volume" :: waited 0.044s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:07:23.329204 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-340fca5e-7099-4aa8-af94-f5b7a34cbe85 tempest-VolumesTestJSON-1716948367 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:07:23.452782 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-340fca5e-7099-4aa8-af94-f5b7a34cbe85 tempest-VolumesTestJSON-1716948367 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:07:23.453403 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-340fca5e-7099-4aa8-af94-f5b7a34cbe85 tempest-VolumesTestJSON-1716948367 None] Volume volume-84e7a4f5-5a3a-4c8c-8c06-3be2f34259ab is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:07:23.469594 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-340fca5e-7099-4aa8-af94-f5b7a34cbe85 tempest-VolumesTestJSON-1716948367 None] deleting rbd volume volume-84e7a4f5-5a3a-4c8c-8c06-3be2f34259ab {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:07:24.007911 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-340fca5e-7099-4aa8-af94-f5b7a34cbe85 tempest-VolumesTestJSON-1716948367 None] Created reservations ['b617c41d-980b-4536-939c-19edd87c2bd9', '2ae131e6-ae4c-48d0-9e81-267d8ec4c98e', '33e06662-1d87-4ce3-ac7c-e59a49f8eddb', '2868bfe4-c0ff-49f2-94ca-034e453d0d4b'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:07:24.110452 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-340fca5e-7099-4aa8-af94-f5b7a34cbe85 tempest-VolumesTestJSON-1716948367 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:07:24.188113 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-340fca5e-7099-4aa8-af94-f5b7a34cbe85 tempest-VolumesTestJSON-1716948367 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:07:24.274033 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-340fca5e-7099-4aa8-af94-f5b7a34cbe85 tempest-VolumesTestJSON-1716948367 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:07:24.278850 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-340fca5e-7099-4aa8-af94-f5b7a34cbe85 tempest-VolumesTestJSON-1716948367 None] Deleted volume successfully. May 07 22:07:24.297136 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-340fca5e-7099-4aa8-af94-f5b7a34cbe85 tempest-VolumesTestJSON-1716948367 None] Lock "b'cinder-84e7a4f5-5a3a-4c8c-8c06-3be2f34259ab-delete_volume'" released by "delete_volume" :: held 1.079s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:07:24.460372 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-2de967ad-f12e-4552-85c3-db8324e8e506 tempest-VolumesTestJSON-1716948367 None] Lock "b'cinder-994abfac-15ec-409e-816d-ca7441f8f8d8-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:07:24.521505 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-2de967ad-f12e-4552-85c3-db8324e8e506 tempest-VolumesTestJSON-1716948367 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:07:24.624168 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-2de967ad-f12e-4552-85c3-db8324e8e506 tempest-VolumesTestJSON-1716948367 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:07:24.624705 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-2de967ad-f12e-4552-85c3-db8324e8e506 tempest-VolumesTestJSON-1716948367 None] Volume volume-994abfac-15ec-409e-816d-ca7441f8f8d8 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:07:24.640638 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-2de967ad-f12e-4552-85c3-db8324e8e506 tempest-VolumesTestJSON-1716948367 None] deleting rbd volume volume-994abfac-15ec-409e-816d-ca7441f8f8d8 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:07:25.272333 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-2de967ad-f12e-4552-85c3-db8324e8e506 tempest-VolumesTestJSON-1716948367 None] Created reservations ['0db12626-2ce1-4999-a84b-745c02c8ced0', '89d7eb78-c31d-4ea4-868d-f6fddac4ff52', '22b43857-d579-4907-8d29-e061d6c389ea', '2607d024-e565-4d19-b1d4-6b11d99c3d74'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:07:25.378794 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-2de967ad-f12e-4552-85c3-db8324e8e506 tempest-VolumesTestJSON-1716948367 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:07:25.476779 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-2de967ad-f12e-4552-85c3-db8324e8e506 tempest-VolumesTestJSON-1716948367 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:07:25.538885 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-2de967ad-f12e-4552-85c3-db8324e8e506 tempest-VolumesTestJSON-1716948367 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:07:25.549575 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-2de967ad-f12e-4552-85c3-db8324e8e506 tempest-VolumesTestJSON-1716948367 None] Deleted volume successfully. May 07 22:07:25.575069 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-2de967ad-f12e-4552-85c3-db8324e8e506 tempest-VolumesTestJSON-1716948367 None] Lock "b'cinder-994abfac-15ec-409e-816d-ca7441f8f8d8-delete_volume'" released by "delete_volume" :: held 1.115s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:07:25.754125 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-da803b1e-529f-43fe-b650-191828742e46 tempest-VolumesTestJSON-1716948367 None] Lock "b'cinder-afe5cc01-8331-432e-bba2-58a01d7c8178-delete_volume'" acquired by "delete_volume" :: waited 0.040s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:07:25.915787 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-da803b1e-529f-43fe-b650-191828742e46 tempest-VolumesTestJSON-1716948367 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:07:26.048913 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-da803b1e-529f-43fe-b650-191828742e46 tempest-VolumesTestJSON-1716948367 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:07:26.049474 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-da803b1e-529f-43fe-b650-191828742e46 tempest-VolumesTestJSON-1716948367 None] Volume volume-afe5cc01-8331-432e-bba2-58a01d7c8178 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:07:26.074493 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-da803b1e-529f-43fe-b650-191828742e46 tempest-VolumesTestJSON-1716948367 None] deleting rbd volume volume-afe5cc01-8331-432e-bba2-58a01d7c8178 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:07:26.594427 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-da803b1e-529f-43fe-b650-191828742e46 tempest-VolumesTestJSON-1716948367 None] Created reservations ['f7bc2beb-98a8-4771-a357-e9ce2b4842c4', 'cf08d3a3-3a34-4f7d-b355-c8851196842a', '73312e74-95e6-478b-a049-452cfa436e55', '6ff09a99-66b8-4d23-ae37-1292641205b5'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:07:26.650948 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-da803b1e-529f-43fe-b650-191828742e46 tempest-VolumesTestJSON-1716948367 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:07:26.707271 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-da803b1e-529f-43fe-b650-191828742e46 tempest-VolumesTestJSON-1716948367 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:07:26.805929 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-da803b1e-529f-43fe-b650-191828742e46 tempest-VolumesTestJSON-1716948367 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:07:26.819874 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-da803b1e-529f-43fe-b650-191828742e46 tempest-VolumesTestJSON-1716948367 None] Deleted volume successfully. May 07 22:07:26.855893 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-da803b1e-529f-43fe-b650-191828742e46 tempest-VolumesTestJSON-1716948367 None] Lock "b'cinder-afe5cc01-8331-432e-bba2-58a01d7c8178-delete_volume'" released by "delete_volume" :: held 1.102s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:07:30.757129 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:07:30.757967 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:07:30.820738 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:07:30.906805 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:07:31.631245 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-56fbff2f-e9f6-4602-b021-a1a78abe23ba tempest-VolumesListAdminTestJSON-1920713413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:07:31.740045 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-56fbff2f-e9f6-4602-b021-a1a78abe23ba tempest-VolumesListAdminTestJSON-1920713413 None] Flow 'volume_create_manager' (68c2f63f-31ff-4dbf-96b8-0134f51e2054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:07:31.762371 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-56fbff2f-e9f6-4602-b021-a1a78abe23ba tempest-VolumesListAdminTestJSON-1920713413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7feeb030-13c7-4cd6-8aee-6d920e5d4653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:31.828391 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-56fbff2f-e9f6-4602-b021-a1a78abe23ba tempest-VolumesListAdminTestJSON-1920713413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7feeb030-13c7-4cd6-8aee-6d920e5d4653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-363636278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b4a104bc-d8b5-4824-a752-7d6477ec3f5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71bfb23676c24e00b5997394686be11b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:07:32Z,use_quota=True,user_id='957bab5b90134d2cb1c1cf7b0dce10ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:31.856364 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-56fbff2f-e9f6-4602-b021-a1a78abe23ba tempest-VolumesListAdminTestJSON-1920713413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b9257e5-dc84-4b98-bbe8-340433f5a8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:31.868420 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-56fbff2f-e9f6-4602-b021-a1a78abe23ba tempest-VolumesListAdminTestJSON-1920713413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b9257e5-dc84-4b98-bbe8-340433f5a8c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:31.884102 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-56fbff2f-e9f6-4602-b021-a1a78abe23ba tempest-VolumesListAdminTestJSON-1920713413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d4b64e7-92f7-4e78-a9c9-556418baacf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:31.896203 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-56fbff2f-e9f6-4602-b021-a1a78abe23ba tempest-VolumesListAdminTestJSON-1920713413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d4b64e7-92f7-4e78-a9c9-556418baacf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4a104bc-d8b5-4824-a752-7d6477ec3f5b', 'volume_name': 'volume-b4a104bc-d8b5-4824-a752-7d6477ec3f5b', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:31.908713 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-56fbff2f-e9f6-4602-b021-a1a78abe23ba tempest-VolumesListAdminTestJSON-1920713413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fed28061-9824-40a4-8a03-c8bb049b7fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:31.928932 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-56fbff2f-e9f6-4602-b021-a1a78abe23ba tempest-VolumesListAdminTestJSON-1920713413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fed28061-9824-40a4-8a03-c8bb049b7fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:31.945351 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-56fbff2f-e9f6-4602-b021-a1a78abe23ba tempest-VolumesListAdminTestJSON-1920713413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d64cd9b4-2678-4b1a-ac8e-c12e8b8cf8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:31.948053 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-56fbff2f-e9f6-4602-b021-a1a78abe23ba tempest-VolumesListAdminTestJSON-1920713413 None] Volume b4a104bc-d8b5-4824-a752-7d6477ec3f5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4a104bc-d8b5-4824-a752-7d6477ec3f5b', 'volume_size': 1} May 07 22:07:31.949077 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-56fbff2f-e9f6-4602-b021-a1a78abe23ba tempest-VolumesListAdminTestJSON-1920713413 None] creating volume 'volume-b4a104bc-d8b5-4824-a752-7d6477ec3f5b' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:07:31.952118 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-56fbff2f-e9f6-4602-b021-a1a78abe23ba tempest-VolumesListAdminTestJSON-1920713413 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:07:32.119542 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-56fbff2f-e9f6-4602-b021-a1a78abe23ba tempest-VolumesListAdminTestJSON-1920713413 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:07:32.120493 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-56fbff2f-e9f6-4602-b021-a1a78abe23ba tempest-VolumesListAdminTestJSON-1920713413 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:07:32.128345 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-56fbff2f-e9f6-4602-b021-a1a78abe23ba tempest-VolumesListAdminTestJSON-1920713413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d64cd9b4-2678-4b1a-ac8e-c12e8b8cf8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4a104bc-d8b5-4824-a752-7d6477ec3f5b', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:32.139824 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-56fbff2f-e9f6-4602-b021-a1a78abe23ba tempest-VolumesListAdminTestJSON-1920713413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e5d2aae-1244-4ce3-a850-aa19dd2c8fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:32.153602 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-56fbff2f-e9f6-4602-b021-a1a78abe23ba tempest-VolumesListAdminTestJSON-1920713413 None] Volume volume-b4a104bc-d8b5-4824-a752-7d6477ec3f5b (b4a104bc-d8b5-4824-a752-7d6477ec3f5b): created successfully May 07 22:07:32.159562 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-56fbff2f-e9f6-4602-b021-a1a78abe23ba tempest-VolumesListAdminTestJSON-1920713413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e5d2aae-1244-4ce3-a850-aa19dd2c8fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:32.166049 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-56fbff2f-e9f6-4602-b021-a1a78abe23ba tempest-VolumesListAdminTestJSON-1920713413 None] Flow 'volume_create_manager' (68c2f63f-31ff-4dbf-96b8-0134f51e2054) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:07:32.177980 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-56fbff2f-e9f6-4602-b021-a1a78abe23ba tempest-VolumesListAdminTestJSON-1920713413 None] Created volume successfully. May 07 22:07:33.594211 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-61387900-b1de-45a7-9fa1-89e49172a3fb tempest-VolumesListAdminTestJSON-1920713413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:07:33.643825 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-61387900-b1de-45a7-9fa1-89e49172a3fb tempest-VolumesListAdminTestJSON-1920713413 None] Flow 'volume_create_manager' (e7b34b2f-79a1-4b7c-aeaf-092a753f1dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:07:33.661188 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-61387900-b1de-45a7-9fa1-89e49172a3fb tempest-VolumesListAdminTestJSON-1920713413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42438cad-cc42-4f31-96e2-0a1b5d2c8985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:33.791568 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-61387900-b1de-45a7-9fa1-89e49172a3fb tempest-VolumesListAdminTestJSON-1920713413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42438cad-cc42-4f31-96e2-0a1b5d2c8985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-190246679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=57c211d8-a82a-4d9b-89aa-f438dfbe48d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71bfb23676c24e00b5997394686be11b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:07:34Z,use_quota=True,user_id='957bab5b90134d2cb1c1cf7b0dce10ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:33.804071 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-61387900-b1de-45a7-9fa1-89e49172a3fb tempest-VolumesListAdminTestJSON-1920713413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d8af47f-1d2a-489f-ba69-38e7b9de4096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:33.819721 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-61387900-b1de-45a7-9fa1-89e49172a3fb tempest-VolumesListAdminTestJSON-1920713413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d8af47f-1d2a-489f-ba69-38e7b9de4096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:33.834881 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-61387900-b1de-45a7-9fa1-89e49172a3fb tempest-VolumesListAdminTestJSON-1920713413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37e11e95-1398-4fc4-bd36-5a8e3c9d976c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:33.849881 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-61387900-b1de-45a7-9fa1-89e49172a3fb tempest-VolumesListAdminTestJSON-1920713413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37e11e95-1398-4fc4-bd36-5a8e3c9d976c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57c211d8-a82a-4d9b-89aa-f438dfbe48d0', 'volume_name': 'volume-57c211d8-a82a-4d9b-89aa-f438dfbe48d0', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:33.855306 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-61387900-b1de-45a7-9fa1-89e49172a3fb tempest-VolumesListAdminTestJSON-1920713413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (613c7042-822d-41ad-a47b-21733a0f4fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:33.875084 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-61387900-b1de-45a7-9fa1-89e49172a3fb tempest-VolumesListAdminTestJSON-1920713413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (613c7042-822d-41ad-a47b-21733a0f4fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:33.903330 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-61387900-b1de-45a7-9fa1-89e49172a3fb tempest-VolumesListAdminTestJSON-1920713413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89b8a531-0f2e-4924-933b-f4b92526f837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:33.907639 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-61387900-b1de-45a7-9fa1-89e49172a3fb tempest-VolumesListAdminTestJSON-1920713413 None] Volume 57c211d8-a82a-4d9b-89aa-f438dfbe48d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57c211d8-a82a-4d9b-89aa-f438dfbe48d0', 'volume_size': 1} May 07 22:07:33.908038 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-61387900-b1de-45a7-9fa1-89e49172a3fb tempest-VolumesListAdminTestJSON-1920713413 None] creating volume 'volume-57c211d8-a82a-4d9b-89aa-f438dfbe48d0' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:07:33.908731 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-61387900-b1de-45a7-9fa1-89e49172a3fb tempest-VolumesListAdminTestJSON-1920713413 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:07:34.119233 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-61387900-b1de-45a7-9fa1-89e49172a3fb tempest-VolumesListAdminTestJSON-1920713413 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:07:34.119855 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-61387900-b1de-45a7-9fa1-89e49172a3fb tempest-VolumesListAdminTestJSON-1920713413 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:07:34.125335 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-61387900-b1de-45a7-9fa1-89e49172a3fb tempest-VolumesListAdminTestJSON-1920713413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89b8a531-0f2e-4924-933b-f4b92526f837) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57c211d8-a82a-4d9b-89aa-f438dfbe48d0', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:34.130958 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-61387900-b1de-45a7-9fa1-89e49172a3fb tempest-VolumesListAdminTestJSON-1920713413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb825c2e-de8a-4901-ac78-1e639cbcd6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:34.170385 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-61387900-b1de-45a7-9fa1-89e49172a3fb tempest-VolumesListAdminTestJSON-1920713413 None] Volume volume-57c211d8-a82a-4d9b-89aa-f438dfbe48d0 (57c211d8-a82a-4d9b-89aa-f438dfbe48d0): created successfully May 07 22:07:34.183316 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-61387900-b1de-45a7-9fa1-89e49172a3fb tempest-VolumesListAdminTestJSON-1920713413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb825c2e-de8a-4901-ac78-1e639cbcd6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:34.192587 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-61387900-b1de-45a7-9fa1-89e49172a3fb tempest-VolumesListAdminTestJSON-1920713413 None] Flow 'volume_create_manager' (e7b34b2f-79a1-4b7c-aeaf-092a753f1dcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:07:34.258909 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-61387900-b1de-45a7-9fa1-89e49172a3fb tempest-VolumesListAdminTestJSON-1920713413 None] Created volume successfully. May 07 22:07:35.327627 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-e32a0a21-c04d-448b-ae27-ef307602189c tempest-VolumesListAdminTestJSON-1920713413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:07:35.440803 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-e32a0a21-c04d-448b-ae27-ef307602189c tempest-VolumesListAdminTestJSON-1920713413 None] Flow 'volume_create_manager' (ea293a8b-ecd3-4ce0-9856-e512e39b78cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:07:35.473588 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-e32a0a21-c04d-448b-ae27-ef307602189c tempest-VolumesListAdminTestJSON-1920713413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a920386a-ef6d-4f9d-b866-d51968c0f143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:35.518136 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-e32a0a21-c04d-448b-ae27-ef307602189c tempest-VolumesListAdminTestJSON-1920713413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a920386a-ef6d-4f9d-b866-d51968c0f143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1478868839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2535b430-e09b-490f-9bbc-a05e9e28d4db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71bfb23676c24e00b5997394686be11b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:07:35Z,use_quota=True,user_id='957bab5b90134d2cb1c1cf7b0dce10ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:35.523476 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-e32a0a21-c04d-448b-ae27-ef307602189c tempest-VolumesListAdminTestJSON-1920713413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e077f145-4e9f-4e4b-9484-a0c6da42fac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:35.527930 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-e32a0a21-c04d-448b-ae27-ef307602189c tempest-VolumesListAdminTestJSON-1920713413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e077f145-4e9f-4e4b-9484-a0c6da42fac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:35.534455 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-e32a0a21-c04d-448b-ae27-ef307602189c tempest-VolumesListAdminTestJSON-1920713413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12025054-9aff-481b-ad58-cebf7420db19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:35.539023 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-e32a0a21-c04d-448b-ae27-ef307602189c tempest-VolumesListAdminTestJSON-1920713413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12025054-9aff-481b-ad58-cebf7420db19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2535b430-e09b-490f-9bbc-a05e9e28d4db', 'volume_name': 'volume-2535b430-e09b-490f-9bbc-a05e9e28d4db', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:35.545334 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-e32a0a21-c04d-448b-ae27-ef307602189c tempest-VolumesListAdminTestJSON-1920713413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48c89a44-c98e-431c-8876-179e18bac79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:35.550196 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-e32a0a21-c04d-448b-ae27-ef307602189c tempest-VolumesListAdminTestJSON-1920713413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48c89a44-c98e-431c-8876-179e18bac79b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:35.556176 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-e32a0a21-c04d-448b-ae27-ef307602189c tempest-VolumesListAdminTestJSON-1920713413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (528a21bb-cbfb-41ec-a048-391f8467bae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:35.557623 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-e32a0a21-c04d-448b-ae27-ef307602189c tempest-VolumesListAdminTestJSON-1920713413 None] Volume 2535b430-e09b-490f-9bbc-a05e9e28d4db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2535b430-e09b-490f-9bbc-a05e9e28d4db', 'volume_size': 1} May 07 22:07:35.558267 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-e32a0a21-c04d-448b-ae27-ef307602189c tempest-VolumesListAdminTestJSON-1920713413 None] creating volume 'volume-2535b430-e09b-490f-9bbc-a05e9e28d4db' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:07:35.559404 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-e32a0a21-c04d-448b-ae27-ef307602189c tempest-VolumesListAdminTestJSON-1920713413 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:07:35.745224 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-e32a0a21-c04d-448b-ae27-ef307602189c tempest-VolumesListAdminTestJSON-1920713413 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:07:35.745875 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-e32a0a21-c04d-448b-ae27-ef307602189c tempest-VolumesListAdminTestJSON-1920713413 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:07:35.752258 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-e32a0a21-c04d-448b-ae27-ef307602189c tempest-VolumesListAdminTestJSON-1920713413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (528a21bb-cbfb-41ec-a048-391f8467bae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2535b430-e09b-490f-9bbc-a05e9e28d4db', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:35.757561 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-e32a0a21-c04d-448b-ae27-ef307602189c tempest-VolumesListAdminTestJSON-1920713413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bf05a82-f6c6-4ae8-b10d-3c14f23b25f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:35.775018 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-e32a0a21-c04d-448b-ae27-ef307602189c tempest-VolumesListAdminTestJSON-1920713413 None] Volume volume-2535b430-e09b-490f-9bbc-a05e9e28d4db (2535b430-e09b-490f-9bbc-a05e9e28d4db): created successfully May 07 22:07:35.781618 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-e32a0a21-c04d-448b-ae27-ef307602189c tempest-VolumesListAdminTestJSON-1920713413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bf05a82-f6c6-4ae8-b10d-3c14f23b25f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:35.796712 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-e32a0a21-c04d-448b-ae27-ef307602189c tempest-VolumesListAdminTestJSON-1920713413 None] Flow 'volume_create_manager' (ea293a8b-ecd3-4ce0-9856-e512e39b78cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:07:35.828724 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-e32a0a21-c04d-448b-ae27-ef307602189c tempest-VolumesListAdminTestJSON-1920713413 None] Created volume successfully. May 07 22:07:37.750277 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-9043f4cb-4e77-4212-9cc6-2778b8a93246 tempest-VolumesListAdminTestJSON-991066392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:07:37.836660 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-9043f4cb-4e77-4212-9cc6-2778b8a93246 tempest-VolumesListAdminTestJSON-991066392 None] Flow 'volume_create_manager' (f374a854-c374-43d8-96ae-cdfd51f5f79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:07:37.859291 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-9043f4cb-4e77-4212-9cc6-2778b8a93246 tempest-VolumesListAdminTestJSON-991066392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a1531d8-4951-49b7-adac-9776623972fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:37.897861 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-9043f4cb-4e77-4212-9cc6-2778b8a93246 tempest-VolumesListAdminTestJSON-991066392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a1531d8-4951-49b7-adac-9776623972fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:07:37Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4fe01fcb-26cb-4c01-bc81-8bdb3db560b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='643fb689449f4071a7fcf8ad37ef9793',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:07:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:07:38Z,use_quota=True,user_id='bbc6679a5ae54263acbd3ad68883dfbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:37.915742 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-9043f4cb-4e77-4212-9cc6-2778b8a93246 tempest-VolumesListAdminTestJSON-991066392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ee4b25d-6ef5-421e-9822-f86281cd5f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:37.932395 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-9043f4cb-4e77-4212-9cc6-2778b8a93246 tempest-VolumesListAdminTestJSON-991066392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ee4b25d-6ef5-421e-9822-f86281cd5f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:37.948131 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-9043f4cb-4e77-4212-9cc6-2778b8a93246 tempest-VolumesListAdminTestJSON-991066392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10469335-76a4-42ae-91d6-3ee0372be805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:37.959773 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-9043f4cb-4e77-4212-9cc6-2778b8a93246 tempest-VolumesListAdminTestJSON-991066392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10469335-76a4-42ae-91d6-3ee0372be805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fe01fcb-26cb-4c01-bc81-8bdb3db560b4', 'volume_name': 'volume-4fe01fcb-26cb-4c01-bc81-8bdb3db560b4', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:37.974119 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-9043f4cb-4e77-4212-9cc6-2778b8a93246 tempest-VolumesListAdminTestJSON-991066392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8fd9aaf-f4c0-4932-9dc2-d95aeffad07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:38.003203 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-9043f4cb-4e77-4212-9cc6-2778b8a93246 tempest-VolumesListAdminTestJSON-991066392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8fd9aaf-f4c0-4932-9dc2-d95aeffad07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:38.031746 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-9043f4cb-4e77-4212-9cc6-2778b8a93246 tempest-VolumesListAdminTestJSON-991066392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aee7dbf1-2c58-42c6-92df-6912f3db7d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:38.039976 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-9043f4cb-4e77-4212-9cc6-2778b8a93246 tempest-VolumesListAdminTestJSON-991066392 None] Volume 4fe01fcb-26cb-4c01-bc81-8bdb3db560b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fe01fcb-26cb-4c01-bc81-8bdb3db560b4', 'volume_size': 1} May 07 22:07:38.040487 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-9043f4cb-4e77-4212-9cc6-2778b8a93246 tempest-VolumesListAdminTestJSON-991066392 None] creating volume 'volume-4fe01fcb-26cb-4c01-bc81-8bdb3db560b4' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:07:38.043164 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-9043f4cb-4e77-4212-9cc6-2778b8a93246 tempest-VolumesListAdminTestJSON-991066392 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:07:38.235263 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-9043f4cb-4e77-4212-9cc6-2778b8a93246 tempest-VolumesListAdminTestJSON-991066392 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:07:38.235914 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-9043f4cb-4e77-4212-9cc6-2778b8a93246 tempest-VolumesListAdminTestJSON-991066392 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:07:38.242580 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-9043f4cb-4e77-4212-9cc6-2778b8a93246 tempest-VolumesListAdminTestJSON-991066392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aee7dbf1-2c58-42c6-92df-6912f3db7d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fe01fcb-26cb-4c01-bc81-8bdb3db560b4', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:38.256144 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-9043f4cb-4e77-4212-9cc6-2778b8a93246 tempest-VolumesListAdminTestJSON-991066392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (802ffb18-16ef-4ec0-a614-43d5ed2790bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:38.280695 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-9043f4cb-4e77-4212-9cc6-2778b8a93246 tempest-VolumesListAdminTestJSON-991066392 None] Volume volume-4fe01fcb-26cb-4c01-bc81-8bdb3db560b4 (4fe01fcb-26cb-4c01-bc81-8bdb3db560b4): created successfully May 07 22:07:38.291768 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-9043f4cb-4e77-4212-9cc6-2778b8a93246 tempest-VolumesListAdminTestJSON-991066392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (802ffb18-16ef-4ec0-a614-43d5ed2790bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:38.332080 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-9043f4cb-4e77-4212-9cc6-2778b8a93246 tempest-VolumesListAdminTestJSON-991066392 None] Flow 'volume_create_manager' (f374a854-c374-43d8-96ae-cdfd51f5f79b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:07:38.392823 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-9043f4cb-4e77-4212-9cc6-2778b8a93246 tempest-VolumesListAdminTestJSON-991066392 None] Created volume successfully. May 07 22:07:38.850315 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-b02e7b3d-5593-486f-8e3f-1857751cb800 tempest-VolumesListAdminTestJSON-991066392 None] Lock "b'cinder-4fe01fcb-26cb-4c01-bc81-8bdb3db560b4-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:07:38.899712 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b02e7b3d-5593-486f-8e3f-1857751cb800 tempest-VolumesListAdminTestJSON-991066392 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:07:39.052392 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b02e7b3d-5593-486f-8e3f-1857751cb800 tempest-VolumesListAdminTestJSON-991066392 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:07:39.053045 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b02e7b3d-5593-486f-8e3f-1857751cb800 tempest-VolumesListAdminTestJSON-991066392 None] Volume volume-4fe01fcb-26cb-4c01-bc81-8bdb3db560b4 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:07:39.074047 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b02e7b3d-5593-486f-8e3f-1857751cb800 tempest-VolumesListAdminTestJSON-991066392 None] deleting rbd volume volume-4fe01fcb-26cb-4c01-bc81-8bdb3db560b4 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:07:39.090058 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-d75e0ce7-d350-4d04-8cf0-a39b6198568a tempest-VolumesListAdminTestJSON-1920713413 None] Lock "b'cinder-2535b430-e09b-490f-9bbc-a05e9e28d4db-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:07:39.225840 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d75e0ce7-d350-4d04-8cf0-a39b6198568a tempest-VolumesListAdminTestJSON-1920713413 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:07:39.361972 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d75e0ce7-d350-4d04-8cf0-a39b6198568a tempest-VolumesListAdminTestJSON-1920713413 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:07:39.363160 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d75e0ce7-d350-4d04-8cf0-a39b6198568a tempest-VolumesListAdminTestJSON-1920713413 None] Volume volume-2535b430-e09b-490f-9bbc-a05e9e28d4db is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:07:39.385513 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d75e0ce7-d350-4d04-8cf0-a39b6198568a tempest-VolumesListAdminTestJSON-1920713413 None] deleting rbd volume volume-2535b430-e09b-490f-9bbc-a05e9e28d4db {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:07:39.912058 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-b02e7b3d-5593-486f-8e3f-1857751cb800 tempest-VolumesListAdminTestJSON-991066392 None] Created reservations ['6cb0a63f-b745-4592-b5b5-0842a3377469', '79eff417-3558-4045-9a62-f32cd833fa12', 'b7befa38-d417-496a-a223-89bbe0a97d73', 'fa54b2ba-fe5d-456b-9589-d6759d093a12'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:07:40.036034 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b02e7b3d-5593-486f-8e3f-1857751cb800 tempest-VolumesListAdminTestJSON-991066392 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:07:40.098299 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b02e7b3d-5593-486f-8e3f-1857751cb800 tempest-VolumesListAdminTestJSON-991066392 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:07:40.161572 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-b02e7b3d-5593-486f-8e3f-1857751cb800 tempest-VolumesListAdminTestJSON-991066392 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:07:40.186038 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-b02e7b3d-5593-486f-8e3f-1857751cb800 tempest-VolumesListAdminTestJSON-991066392 None] Deleted volume successfully. May 07 22:07:40.241816 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-b02e7b3d-5593-486f-8e3f-1857751cb800 tempest-VolumesListAdminTestJSON-991066392 None] Lock "b'cinder-4fe01fcb-26cb-4c01-bc81-8bdb3db560b4-delete_volume'" released by "delete_volume" :: held 1.394s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:07:40.295797 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-d75e0ce7-d350-4d04-8cf0-a39b6198568a tempest-VolumesListAdminTestJSON-1920713413 None] Created reservations ['0b8f4a74-1797-4e22-be99-4e30490d5d1a', 'bbdf4579-1b72-4fc4-b4e0-e1d3e8ec9c19', 'ef01e919-5e21-4831-a0a5-1effefbd0184', '92e43c87-0df2-425b-80da-9d50a419b2a2'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:07:40.439089 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d75e0ce7-d350-4d04-8cf0-a39b6198568a tempest-VolumesListAdminTestJSON-1920713413 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:07:40.534801 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d75e0ce7-d350-4d04-8cf0-a39b6198568a tempest-VolumesListAdminTestJSON-1920713413 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:07:40.616072 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-d75e0ce7-d350-4d04-8cf0-a39b6198568a tempest-VolumesListAdminTestJSON-1920713413 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:07:40.627642 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-d75e0ce7-d350-4d04-8cf0-a39b6198568a tempest-VolumesListAdminTestJSON-1920713413 None] Deleted volume successfully. May 07 22:07:40.678362 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-d75e0ce7-d350-4d04-8cf0-a39b6198568a tempest-VolumesListAdminTestJSON-1920713413 None] Lock "b'cinder-2535b430-e09b-490f-9bbc-a05e9e28d4db-delete_volume'" released by "delete_volume" :: held 1.588s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:07:41.414237 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-319761cc-8e54-4a13-acb3-13f0b846d09f tempest-VolumesListAdminTestJSON-1920713413 None] Lock "b'cinder-57c211d8-a82a-4d9b-89aa-f438dfbe48d0-delete_volume'" acquired by "delete_volume" :: waited 0.026s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:07:41.493055 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-319761cc-8e54-4a13-acb3-13f0b846d09f tempest-VolumesListAdminTestJSON-1920713413 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:07:41.595804 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-319761cc-8e54-4a13-acb3-13f0b846d09f tempest-VolumesListAdminTestJSON-1920713413 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:07:41.596230 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-319761cc-8e54-4a13-acb3-13f0b846d09f tempest-VolumesListAdminTestJSON-1920713413 None] Volume volume-57c211d8-a82a-4d9b-89aa-f438dfbe48d0 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:07:41.605203 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-319761cc-8e54-4a13-acb3-13f0b846d09f tempest-VolumesListAdminTestJSON-1920713413 None] deleting rbd volume volume-57c211d8-a82a-4d9b-89aa-f438dfbe48d0 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:07:42.233408 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-319761cc-8e54-4a13-acb3-13f0b846d09f tempest-VolumesListAdminTestJSON-1920713413 None] Created reservations ['26c85025-e8b7-4439-b42b-89085193854c', '99d1cb77-f5bf-45de-a0f4-06048294c7bc', '62f561eb-13cb-495b-9bbc-bf8abef2672c', '335a8e66-1744-4d10-90d0-2a2b31112629'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:07:42.361820 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-319761cc-8e54-4a13-acb3-13f0b846d09f tempest-VolumesListAdminTestJSON-1920713413 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:07:42.457302 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-319761cc-8e54-4a13-acb3-13f0b846d09f tempest-VolumesListAdminTestJSON-1920713413 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:07:42.534210 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-319761cc-8e54-4a13-acb3-13f0b846d09f tempest-VolumesListAdminTestJSON-1920713413 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:07:42.538424 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-319761cc-8e54-4a13-acb3-13f0b846d09f tempest-VolumesListAdminTestJSON-1920713413 None] Deleted volume successfully. May 07 22:07:42.556167 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-319761cc-8e54-4a13-acb3-13f0b846d09f tempest-VolumesListAdminTestJSON-1920713413 None] Lock "b'cinder-57c211d8-a82a-4d9b-89aa-f438dfbe48d0-delete_volume'" released by "delete_volume" :: held 1.141s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:07:42.687310 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-66a3ebe2-1c33-484f-b39a-ea6f2da2a527 tempest-VolumesListAdminTestJSON-1920713413 None] Lock "b'cinder-b4a104bc-d8b5-4824-a752-7d6477ec3f5b-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:07:42.772550 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-66a3ebe2-1c33-484f-b39a-ea6f2da2a527 tempest-VolumesListAdminTestJSON-1920713413 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:07:42.907484 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-66a3ebe2-1c33-484f-b39a-ea6f2da2a527 tempest-VolumesListAdminTestJSON-1920713413 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:07:42.908380 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-66a3ebe2-1c33-484f-b39a-ea6f2da2a527 tempest-VolumesListAdminTestJSON-1920713413 None] Volume volume-b4a104bc-d8b5-4824-a752-7d6477ec3f5b is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:07:42.921966 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-66a3ebe2-1c33-484f-b39a-ea6f2da2a527 tempest-VolumesListAdminTestJSON-1920713413 None] deleting rbd volume volume-b4a104bc-d8b5-4824-a752-7d6477ec3f5b {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:07:43.361449 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-66a3ebe2-1c33-484f-b39a-ea6f2da2a527 tempest-VolumesListAdminTestJSON-1920713413 None] Created reservations ['c0f9eb96-529d-4a77-8271-2fd43abfe766', '62b4708b-97ec-4539-ae48-ac5d8f0de13e', '009b949c-5cab-43e6-b2e2-e8a38e299c74', '0c6a86cc-5e10-484c-8b44-8f38c7eee084'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:07:43.488197 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-66a3ebe2-1c33-484f-b39a-ea6f2da2a527 tempest-VolumesListAdminTestJSON-1920713413 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:07:43.548028 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-66a3ebe2-1c33-484f-b39a-ea6f2da2a527 tempest-VolumesListAdminTestJSON-1920713413 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:07:43.629361 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-66a3ebe2-1c33-484f-b39a-ea6f2da2a527 tempest-VolumesListAdminTestJSON-1920713413 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:07:43.633836 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-66a3ebe2-1c33-484f-b39a-ea6f2da2a527 tempest-VolumesListAdminTestJSON-1920713413 None] Deleted volume successfully. May 07 22:07:43.655031 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-66a3ebe2-1c33-484f-b39a-ea6f2da2a527 tempest-VolumesListAdminTestJSON-1920713413 None] Lock "b'cinder-b4a104bc-d8b5-4824-a752-7d6477ec3f5b-delete_volume'" released by "delete_volume" :: held 0.968s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:07:53.378893 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-64c8b5e0-d78a-44f5-b329-9e98ced56829 tempest-VolumeQuotasNegativeTestJSON-789192459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:07:53.398817 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-64c8b5e0-d78a-44f5-b329-9e98ced56829 tempest-VolumeQuotasNegativeTestJSON-789192459 None] Flow 'volume_create_manager' (6a2b74cd-fe25-4fe2-bdfc-f13999264dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:07:53.406212 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-64c8b5e0-d78a-44f5-b329-9e98ced56829 tempest-VolumeQuotasNegativeTestJSON-789192459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5464708-1ea0-4e4c-b453-0ae7a6bcf68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:53.422513 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-64c8b5e0-d78a-44f5-b329-9e98ced56829 tempest-VolumeQuotasNegativeTestJSON-789192459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5464708-1ea0-4e4c-b453-0ae7a6bcf68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:07:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-508741101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=75dec44d-1e28-4430-a1a7-cfa5809f22db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3391a37a10c644b093470d0b903ff818',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:07:53Z,use_quota=True,user_id='98884898865847848cbd7c9601a4488a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:53.428421 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-64c8b5e0-d78a-44f5-b329-9e98ced56829 tempest-VolumeQuotasNegativeTestJSON-789192459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99714fd9-36f4-43bd-9357-2dd197f40038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:53.433222 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-64c8b5e0-d78a-44f5-b329-9e98ced56829 tempest-VolumeQuotasNegativeTestJSON-789192459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99714fd9-36f4-43bd-9357-2dd197f40038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:53.440143 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-64c8b5e0-d78a-44f5-b329-9e98ced56829 tempest-VolumeQuotasNegativeTestJSON-789192459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16cfe029-417d-4d0a-9375-d7396347bb1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:53.444404 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-64c8b5e0-d78a-44f5-b329-9e98ced56829 tempest-VolumeQuotasNegativeTestJSON-789192459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16cfe029-417d-4d0a-9375-d7396347bb1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75dec44d-1e28-4430-a1a7-cfa5809f22db', 'volume_name': 'volume-75dec44d-1e28-4430-a1a7-cfa5809f22db', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:53.450693 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-64c8b5e0-d78a-44f5-b329-9e98ced56829 tempest-VolumeQuotasNegativeTestJSON-789192459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97dde25d-aecc-4a17-96a9-73392529c6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:53.454655 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-64c8b5e0-d78a-44f5-b329-9e98ced56829 tempest-VolumeQuotasNegativeTestJSON-789192459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97dde25d-aecc-4a17-96a9-73392529c6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:53.459491 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-64c8b5e0-d78a-44f5-b329-9e98ced56829 tempest-VolumeQuotasNegativeTestJSON-789192459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da10d233-6f6a-4cc5-a0b5-522ba41affbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:53.460587 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-64c8b5e0-d78a-44f5-b329-9e98ced56829 tempest-VolumeQuotasNegativeTestJSON-789192459 None] Volume 75dec44d-1e28-4430-a1a7-cfa5809f22db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75dec44d-1e28-4430-a1a7-cfa5809f22db', 'volume_size': 1} May 07 22:07:53.460971 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-64c8b5e0-d78a-44f5-b329-9e98ced56829 tempest-VolumeQuotasNegativeTestJSON-789192459 None] creating volume 'volume-75dec44d-1e28-4430-a1a7-cfa5809f22db' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:07:53.461760 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-64c8b5e0-d78a-44f5-b329-9e98ced56829 tempest-VolumeQuotasNegativeTestJSON-789192459 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:07:53.526530 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-64c8b5e0-d78a-44f5-b329-9e98ced56829 tempest-VolumeQuotasNegativeTestJSON-789192459 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:07:53.527079 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-64c8b5e0-d78a-44f5-b329-9e98ced56829 tempest-VolumeQuotasNegativeTestJSON-789192459 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:07:53.531754 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-64c8b5e0-d78a-44f5-b329-9e98ced56829 tempest-VolumeQuotasNegativeTestJSON-789192459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da10d233-6f6a-4cc5-a0b5-522ba41affbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75dec44d-1e28-4430-a1a7-cfa5809f22db', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:53.536892 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-64c8b5e0-d78a-44f5-b329-9e98ced56829 tempest-VolumeQuotasNegativeTestJSON-789192459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd5fdc03-d6de-43fa-9997-81845c74d347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:53.551524 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-64c8b5e0-d78a-44f5-b329-9e98ced56829 tempest-VolumeQuotasNegativeTestJSON-789192459 None] Volume volume-75dec44d-1e28-4430-a1a7-cfa5809f22db (75dec44d-1e28-4430-a1a7-cfa5809f22db): created successfully May 07 22:07:53.556501 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-64c8b5e0-d78a-44f5-b329-9e98ced56829 tempest-VolumeQuotasNegativeTestJSON-789192459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd5fdc03-d6de-43fa-9997-81845c74d347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:53.564299 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-64c8b5e0-d78a-44f5-b329-9e98ced56829 tempest-VolumeQuotasNegativeTestJSON-789192459 None] Flow 'volume_create_manager' (6a2b74cd-fe25-4fe2-bdfc-f13999264dec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:07:53.573596 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-64c8b5e0-d78a-44f5-b329-9e98ced56829 tempest-VolumeQuotasNegativeTestJSON-789192459 None] Created volume successfully. May 07 22:07:55.564544 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-71ad6f6d-2841-41f0-8d64-09936dc2ce68 tempest-VolumeQuotasNegativeTestJSON-789192459 None] Lock "b'cinder-75dec44d-1e28-4430-a1a7-cfa5809f22db-delete_volume'" acquired by "delete_volume" :: waited 0.036s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:07:55.605026 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-32b90275-4fdf-4265-b103-95412d2a272a tempest-VolumesTransfersV355Test-1169103744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:07:55.635850 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-32b90275-4fdf-4265-b103-95412d2a272a tempest-VolumesTransfersV355Test-1169103744 None] Flow 'volume_create_manager' (b5e98d31-fc08-4639-9a18-c7e6e7761943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:07:55.643659 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-32b90275-4fdf-4265-b103-95412d2a272a tempest-VolumesTransfersV355Test-1169103744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39863b35-f43a-4b83-bac8-42587970f9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:55.667393 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-32b90275-4fdf-4265-b103-95412d2a272a tempest-VolumesTransfersV355Test-1169103744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39863b35-f43a-4b83-bac8-42587970f9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1934271523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=95db368e-c2a6-4c8d-a386-1450c4b3b222,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57a0ca9121124ab694106520a0e9e439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:07:56Z,use_quota=True,user_id='371ab34d1e4a4cb299a2479b648b1f21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:55.673875 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-32b90275-4fdf-4265-b103-95412d2a272a tempest-VolumesTransfersV355Test-1169103744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9122dfc1-93ba-47ee-8ee3-cbf784d8e7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:55.679962 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-32b90275-4fdf-4265-b103-95412d2a272a tempest-VolumesTransfersV355Test-1169103744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9122dfc1-93ba-47ee-8ee3-cbf784d8e7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:55.687417 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-32b90275-4fdf-4265-b103-95412d2a272a tempest-VolumesTransfersV355Test-1169103744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8865fa52-54e0-4452-96c1-debab896ddf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:55.692008 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-32b90275-4fdf-4265-b103-95412d2a272a tempest-VolumesTransfersV355Test-1169103744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8865fa52-54e0-4452-96c1-debab896ddf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95db368e-c2a6-4c8d-a386-1450c4b3b222', 'volume_name': 'volume-95db368e-c2a6-4c8d-a386-1450c4b3b222', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:55.698402 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-32b90275-4fdf-4265-b103-95412d2a272a tempest-VolumesTransfersV355Test-1169103744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1d78812-5e28-4530-a54b-ac42a2cc4337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:55.702607 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-32b90275-4fdf-4265-b103-95412d2a272a tempest-VolumesTransfersV355Test-1169103744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1d78812-5e28-4530-a54b-ac42a2cc4337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:55.707915 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-32b90275-4fdf-4265-b103-95412d2a272a tempest-VolumesTransfersV355Test-1169103744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1fbb79b-cd4e-4a28-b117-4e9b8901530c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:55.709202 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-32b90275-4fdf-4265-b103-95412d2a272a tempest-VolumesTransfersV355Test-1169103744 None] Volume 95db368e-c2a6-4c8d-a386-1450c4b3b222: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95db368e-c2a6-4c8d-a386-1450c4b3b222', 'volume_size': 1} May 07 22:07:55.709660 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-32b90275-4fdf-4265-b103-95412d2a272a tempest-VolumesTransfersV355Test-1169103744 None] creating volume 'volume-95db368e-c2a6-4c8d-a386-1450c4b3b222' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:07:55.711260 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-32b90275-4fdf-4265-b103-95412d2a272a tempest-VolumesTransfersV355Test-1169103744 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:07:55.776223 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-71ad6f6d-2841-41f0-8d64-09936dc2ce68 tempest-VolumeQuotasNegativeTestJSON-789192459 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:07:55.839805 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-71ad6f6d-2841-41f0-8d64-09936dc2ce68 tempest-VolumeQuotasNegativeTestJSON-789192459 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:07:55.840351 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-71ad6f6d-2841-41f0-8d64-09936dc2ce68 tempest-VolumeQuotasNegativeTestJSON-789192459 None] Volume volume-75dec44d-1e28-4430-a1a7-cfa5809f22db is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:07:55.848707 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-71ad6f6d-2841-41f0-8d64-09936dc2ce68 tempest-VolumeQuotasNegativeTestJSON-789192459 None] deleting rbd volume volume-75dec44d-1e28-4430-a1a7-cfa5809f22db {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:07:55.861764 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-32b90275-4fdf-4265-b103-95412d2a272a tempest-VolumesTransfersV355Test-1169103744 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:07:55.862475 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-32b90275-4fdf-4265-b103-95412d2a272a tempest-VolumesTransfersV355Test-1169103744 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:07:55.867821 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-32b90275-4fdf-4265-b103-95412d2a272a tempest-VolumesTransfersV355Test-1169103744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1fbb79b-cd4e-4a28-b117-4e9b8901530c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95db368e-c2a6-4c8d-a386-1450c4b3b222', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:55.878000 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-32b90275-4fdf-4265-b103-95412d2a272a tempest-VolumesTransfersV355Test-1169103744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab0ce500-0c50-4594-8d67-e56e448ed6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:07:55.905872 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-32b90275-4fdf-4265-b103-95412d2a272a tempest-VolumesTransfersV355Test-1169103744 None] Volume volume-95db368e-c2a6-4c8d-a386-1450c4b3b222 (95db368e-c2a6-4c8d-a386-1450c4b3b222): created successfully May 07 22:07:55.913227 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-32b90275-4fdf-4265-b103-95412d2a272a tempest-VolumesTransfersV355Test-1169103744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab0ce500-0c50-4594-8d67-e56e448ed6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:07:55.925356 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-32b90275-4fdf-4265-b103-95412d2a272a tempest-VolumesTransfersV355Test-1169103744 None] Flow 'volume_create_manager' (b5e98d31-fc08-4639-9a18-c7e6e7761943) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:07:55.938477 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-32b90275-4fdf-4265-b103-95412d2a272a tempest-VolumesTransfersV355Test-1169103744 None] Created volume successfully. May 07 22:07:56.304198 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-71ad6f6d-2841-41f0-8d64-09936dc2ce68 tempest-VolumeQuotasNegativeTestJSON-789192459 None] Created reservations ['9a429b16-6ae1-435e-9ba8-31bb615045a8', '6f7e1bce-d8cd-4037-982e-21a4bebbddb1', 'd6a4f913-67ca-41ec-8ac6-904c1d279523', '6bde2ecf-a886-44bb-b803-c469be59b54c'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:07:56.399080 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-71ad6f6d-2841-41f0-8d64-09936dc2ce68 tempest-VolumeQuotasNegativeTestJSON-789192459 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:07:56.468321 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-71ad6f6d-2841-41f0-8d64-09936dc2ce68 tempest-VolumeQuotasNegativeTestJSON-789192459 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:07:56.562805 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-71ad6f6d-2841-41f0-8d64-09936dc2ce68 tempest-VolumeQuotasNegativeTestJSON-789192459 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:07:56.567756 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-71ad6f6d-2841-41f0-8d64-09936dc2ce68 tempest-VolumeQuotasNegativeTestJSON-789192459 None] Deleted volume successfully. May 07 22:07:56.591606 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-71ad6f6d-2841-41f0-8d64-09936dc2ce68 tempest-VolumeQuotasNegativeTestJSON-789192459 None] Lock "b'cinder-75dec44d-1e28-4430-a1a7-cfa5809f22db-delete_volume'" released by "delete_volume" :: held 1.023s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:07:57.894609 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-275c5fd2-b23d-42f5-9fc7-e69c73edfb8b tempest-VolumesTransfersV355Test-913183559 None] Transfer volume completed successfully. May 07 22:07:59.130582 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-7bcdff4d-a261-4076-b8a6-0f647f946f1a tempest-VolumesTransfersV355Test-376963174 None] Lock "b'cinder-95db368e-c2a6-4c8d-a386-1450c4b3b222-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:07:59.174535 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-7bcdff4d-a261-4076-b8a6-0f647f946f1a tempest-VolumesTransfersV355Test-376963174 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:07:59.268928 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-7bcdff4d-a261-4076-b8a6-0f647f946f1a tempest-VolumesTransfersV355Test-376963174 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:07:59.269351 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-7bcdff4d-a261-4076-b8a6-0f647f946f1a tempest-VolumesTransfersV355Test-376963174 None] Volume volume-95db368e-c2a6-4c8d-a386-1450c4b3b222 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:07:59.282558 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-7bcdff4d-a261-4076-b8a6-0f647f946f1a tempest-VolumesTransfersV355Test-376963174 None] deleting rbd volume volume-95db368e-c2a6-4c8d-a386-1450c4b3b222 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:07:59.824957 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-7bcdff4d-a261-4076-b8a6-0f647f946f1a tempest-VolumesTransfersV355Test-376963174 None] Created reservations ['f8a8fcc0-2747-4cf1-9675-d3f18cbbdb60', '6d49186b-c81b-4c30-9c09-bfa94525133b', 'a0a1c69b-dcb8-47e6-aaef-da5ff1982fec', 'a2449084-1b77-414f-af6d-5b5f67ac0ace'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:07:59.909598 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-7bcdff4d-a261-4076-b8a6-0f647f946f1a tempest-VolumesTransfersV355Test-376963174 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:07:59.973345 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-7bcdff4d-a261-4076-b8a6-0f647f946f1a tempest-VolumesTransfersV355Test-376963174 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:08:00.041646 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-7bcdff4d-a261-4076-b8a6-0f647f946f1a tempest-VolumesTransfersV355Test-376963174 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:08:00.047348 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-7bcdff4d-a261-4076-b8a6-0f647f946f1a tempest-VolumesTransfersV355Test-376963174 None] Deleted volume successfully. May 07 22:08:00.066419 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-7bcdff4d-a261-4076-b8a6-0f647f946f1a tempest-VolumesTransfersV355Test-376963174 None] Lock "b'cinder-95db368e-c2a6-4c8d-a386-1450c4b3b222-delete_volume'" released by "delete_volume" :: held 0.935s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:08:00.872532 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a120874-52b4-4d06-84aa-b11cb9fbb13d tempest-VolumesTransfersV355Test-1169103744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:08:00.951741 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7a120874-52b4-4d06-84aa-b11cb9fbb13d tempest-VolumesTransfersV355Test-1169103744 None] Flow 'volume_create_manager' (bc026a06-9585-4735-890d-1a0cca484fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:08:00.961274 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7a120874-52b4-4d06-84aa-b11cb9fbb13d tempest-VolumesTransfersV355Test-1169103744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47d6e746-05ff-45f4-b980-b891802551a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:08:00.981910 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7a120874-52b4-4d06-84aa-b11cb9fbb13d tempest-VolumesTransfersV355Test-1169103744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47d6e746-05ff-45f4-b980-b891802551a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-252120753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3c2aa99f-dc35-494d-9e8d-7dab3e5b1f54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57a0ca9121124ab694106520a0e9e439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:08:01Z,use_quota=True,user_id='371ab34d1e4a4cb299a2479b648b1f21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:08:00.991067 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7a120874-52b4-4d06-84aa-b11cb9fbb13d tempest-VolumesTransfersV355Test-1169103744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c68aacca-f5fd-449e-b587-786ef3942637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:08:00.997326 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7a120874-52b4-4d06-84aa-b11cb9fbb13d tempest-VolumesTransfersV355Test-1169103744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c68aacca-f5fd-449e-b587-786ef3942637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:08:01.005306 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7a120874-52b4-4d06-84aa-b11cb9fbb13d tempest-VolumesTransfersV355Test-1169103744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00cab9c8-39c9-40e1-a5ed-d404acc98542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:08:01.010309 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7a120874-52b4-4d06-84aa-b11cb9fbb13d tempest-VolumesTransfersV355Test-1169103744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00cab9c8-39c9-40e1-a5ed-d404acc98542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c2aa99f-dc35-494d-9e8d-7dab3e5b1f54', 'volume_name': 'volume-3c2aa99f-dc35-494d-9e8d-7dab3e5b1f54', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:08:01.016658 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7a120874-52b4-4d06-84aa-b11cb9fbb13d tempest-VolumesTransfersV355Test-1169103744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d438a3c8-c111-43b5-b2e6-044cfa723294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:08:01.022817 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7a120874-52b4-4d06-84aa-b11cb9fbb13d tempest-VolumesTransfersV355Test-1169103744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d438a3c8-c111-43b5-b2e6-044cfa723294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:08:01.029594 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7a120874-52b4-4d06-84aa-b11cb9fbb13d tempest-VolumesTransfersV355Test-1169103744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0517d26-8865-4f6c-aa76-96fb937b109d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:08:01.030950 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-7a120874-52b4-4d06-84aa-b11cb9fbb13d tempest-VolumesTransfersV355Test-1169103744 None] Volume 3c2aa99f-dc35-494d-9e8d-7dab3e5b1f54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c2aa99f-dc35-494d-9e8d-7dab3e5b1f54', 'volume_size': 1} May 07 22:08:01.031642 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-7a120874-52b4-4d06-84aa-b11cb9fbb13d tempest-VolumesTransfersV355Test-1169103744 None] creating volume 'volume-3c2aa99f-dc35-494d-9e8d-7dab3e5b1f54' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:08:01.032593 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-7a120874-52b4-4d06-84aa-b11cb9fbb13d tempest-VolumesTransfersV355Test-1169103744 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:08:01.160072 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-7a120874-52b4-4d06-84aa-b11cb9fbb13d tempest-VolumesTransfersV355Test-1169103744 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:08:01.160932 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-7a120874-52b4-4d06-84aa-b11cb9fbb13d tempest-VolumesTransfersV355Test-1169103744 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:08:01.168542 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7a120874-52b4-4d06-84aa-b11cb9fbb13d tempest-VolumesTransfersV355Test-1169103744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0517d26-8865-4f6c-aa76-96fb937b109d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c2aa99f-dc35-494d-9e8d-7dab3e5b1f54', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:08:01.176200 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7a120874-52b4-4d06-84aa-b11cb9fbb13d tempest-VolumesTransfersV355Test-1169103744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee624a7-79fa-41af-be06-0a6ea0016255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:08:01.193527 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-7a120874-52b4-4d06-84aa-b11cb9fbb13d tempest-VolumesTransfersV355Test-1169103744 None] Volume volume-3c2aa99f-dc35-494d-9e8d-7dab3e5b1f54 (3c2aa99f-dc35-494d-9e8d-7dab3e5b1f54): created successfully May 07 22:08:01.199277 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7a120874-52b4-4d06-84aa-b11cb9fbb13d tempest-VolumesTransfersV355Test-1169103744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee624a7-79fa-41af-be06-0a6ea0016255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:08:01.217081 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7a120874-52b4-4d06-84aa-b11cb9fbb13d tempest-VolumesTransfersV355Test-1169103744 None] Flow 'volume_create_manager' (bc026a06-9585-4735-890d-1a0cca484fdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:08:01.233867 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-7a120874-52b4-4d06-84aa-b11cb9fbb13d tempest-VolumesTransfersV355Test-1169103744 None] Created volume successfully. May 07 22:08:02.303513 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-6d1036a3-2c8d-4fee-8246-b07922926f4c tempest-VolumesTransfersV355Test-376963174 None] Lock "b'cinder-3c2aa99f-dc35-494d-9e8d-7dab3e5b1f54-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:08:02.383449 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-6d1036a3-2c8d-4fee-8246-b07922926f4c tempest-VolumesTransfersV355Test-376963174 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:08:02.501968 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-6d1036a3-2c8d-4fee-8246-b07922926f4c tempest-VolumesTransfersV355Test-376963174 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:08:02.507633 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-6d1036a3-2c8d-4fee-8246-b07922926f4c tempest-VolumesTransfersV355Test-376963174 None] Volume volume-3c2aa99f-dc35-494d-9e8d-7dab3e5b1f54 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:08:02.525008 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-6d1036a3-2c8d-4fee-8246-b07922926f4c tempest-VolumesTransfersV355Test-376963174 None] deleting rbd volume volume-3c2aa99f-dc35-494d-9e8d-7dab3e5b1f54 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:08:03.001624 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-6d1036a3-2c8d-4fee-8246-b07922926f4c tempest-VolumesTransfersV355Test-376963174 None] Created reservations ['2ff090c5-d8ed-46e6-98cf-c5355436c3f6', '94fc37b8-81b1-4955-a503-7e5bd8ff2241', '8f2018bb-ce9d-470b-a4fa-4c19f9ec1567', 'dc671a83-e0cc-4b77-be90-7659da53f22f'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:08:03.102153 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-6d1036a3-2c8d-4fee-8246-b07922926f4c tempest-VolumesTransfersV355Test-376963174 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:08:03.169337 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-6d1036a3-2c8d-4fee-8246-b07922926f4c tempest-VolumesTransfersV355Test-376963174 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:08:03.263749 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-6d1036a3-2c8d-4fee-8246-b07922926f4c tempest-VolumesTransfersV355Test-376963174 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:08:03.268025 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-6d1036a3-2c8d-4fee-8246-b07922926f4c tempest-VolumesTransfersV355Test-376963174 None] Deleted volume successfully. May 07 22:08:03.292892 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-6d1036a3-2c8d-4fee-8246-b07922926f4c tempest-VolumesTransfersV355Test-376963174 None] Lock "b'cinder-3c2aa99f-dc35-494d-9e8d-7dab3e5b1f54-delete_volume'" released by "delete_volume" :: held 0.986s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:08:05.670527 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff15ecf5-c242-4bab-89a4-04249d02bc34 tempest-VolumeRetypeWithoutMigrationTest-912643075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:08:05.698005 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-ff15ecf5-c242-4bab-89a4-04249d02bc34 tempest-VolumeRetypeWithoutMigrationTest-912643075 None] Flow 'volume_create_manager' (36d48c45-df7f-4a90-b237-ff4a2bddbfed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:08:05.706411 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-ff15ecf5-c242-4bab-89a4-04249d02bc34 tempest-VolumeRetypeWithoutMigrationTest-912643075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b150025d-6da2-4ee1-ac53-17ffc9b37984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:08:05.725646 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-ff15ecf5-c242-4bab-89a4-04249d02bc34 tempest-VolumeRetypeWithoutMigrationTest-912643075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b150025d-6da2-4ee1-ac53-17ffc9b37984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:08:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2048323002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2b330d22-1a10-4478-a9b3-a1be4f27d9ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ada272cf0693430583f1dc2c0e59c479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:08:06Z,use_quota=True,user_id='97be6b6eca8f4da6bbae59449ff0ed2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba3ff87e-af4e-45d5-a3a7-b8434dc32c2c),volume_type_id=ba3ff87e-af4e-45d5-a3a7-b8434dc32c2c)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:08:05.733542 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-ff15ecf5-c242-4bab-89a4-04249d02bc34 tempest-VolumeRetypeWithoutMigrationTest-912643075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c118e43-69bb-47ab-ae93-84cc94dccd63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:08:05.738393 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-ff15ecf5-c242-4bab-89a4-04249d02bc34 tempest-VolumeRetypeWithoutMigrationTest-912643075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c118e43-69bb-47ab-ae93-84cc94dccd63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:08:05.744413 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-ff15ecf5-c242-4bab-89a4-04249d02bc34 tempest-VolumeRetypeWithoutMigrationTest-912643075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fbf22b1-3a55-4a25-8790-6ad4eeafb028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:08:05.750272 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-ff15ecf5-c242-4bab-89a4-04249d02bc34 tempest-VolumeRetypeWithoutMigrationTest-912643075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fbf22b1-3a55-4a25-8790-6ad4eeafb028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b330d22-1a10-4478-a9b3-a1be4f27d9ca', 'volume_name': 'volume-2b330d22-1a10-4478-a9b3-a1be4f27d9ca', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:08:05.755660 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-ff15ecf5-c242-4bab-89a4-04249d02bc34 tempest-VolumeRetypeWithoutMigrationTest-912643075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cd33ec7-2b0e-49f6-869a-cf4696e5a8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:08:05.760145 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-ff15ecf5-c242-4bab-89a4-04249d02bc34 tempest-VolumeRetypeWithoutMigrationTest-912643075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cd33ec7-2b0e-49f6-869a-cf4696e5a8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:08:05.768989 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-ff15ecf5-c242-4bab-89a4-04249d02bc34 tempest-VolumeRetypeWithoutMigrationTest-912643075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40dbc380-880b-40c6-bf09-8f78667cc93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:08:05.771857 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-ff15ecf5-c242-4bab-89a4-04249d02bc34 tempest-VolumeRetypeWithoutMigrationTest-912643075 None] Volume 2b330d22-1a10-4478-a9b3-a1be4f27d9ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b330d22-1a10-4478-a9b3-a1be4f27d9ca', 'volume_size': 1} May 07 22:08:05.772434 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-ff15ecf5-c242-4bab-89a4-04249d02bc34 tempest-VolumeRetypeWithoutMigrationTest-912643075 None] creating volume 'volume-2b330d22-1a10-4478-a9b3-a1be4f27d9ca' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:08:05.773393 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-ff15ecf5-c242-4bab-89a4-04249d02bc34 tempest-VolumeRetypeWithoutMigrationTest-912643075 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:08:05.916025 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-ff15ecf5-c242-4bab-89a4-04249d02bc34 tempest-VolumeRetypeWithoutMigrationTest-912643075 None] extra_specs: {} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:08:05.916624 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-ff15ecf5-c242-4bab-89a4-04249d02bc34 tempest-VolumeRetypeWithoutMigrationTest-912643075 None] extra_specs: {} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:08:05.922445 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-ff15ecf5-c242-4bab-89a4-04249d02bc34 tempest-VolumeRetypeWithoutMigrationTest-912643075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40dbc380-880b-40c6-bf09-8f78667cc93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b330d22-1a10-4478-a9b3-a1be4f27d9ca', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:08:05.931581 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-ff15ecf5-c242-4bab-89a4-04249d02bc34 tempest-VolumeRetypeWithoutMigrationTest-912643075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66babfb2-092b-4fb6-99e1-3581a7e8bce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:08:05.966345 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-ff15ecf5-c242-4bab-89a4-04249d02bc34 tempest-VolumeRetypeWithoutMigrationTest-912643075 None] Volume volume-2b330d22-1a10-4478-a9b3-a1be4f27d9ca (2b330d22-1a10-4478-a9b3-a1be4f27d9ca): created successfully May 07 22:08:05.974394 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-ff15ecf5-c242-4bab-89a4-04249d02bc34 tempest-VolumeRetypeWithoutMigrationTest-912643075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66babfb2-092b-4fb6-99e1-3581a7e8bce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:08:05.984422 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-ff15ecf5-c242-4bab-89a4-04249d02bc34 tempest-VolumeRetypeWithoutMigrationTest-912643075 None] Flow 'volume_create_manager' (36d48c45-df7f-4a90-b237-ff4a2bddbfed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:08:05.997169 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-ff15ecf5-c242-4bab-89a4-04249d02bc34 tempest-VolumeRetypeWithoutMigrationTest-912643075 None] Created volume successfully. May 07 22:08:07.354646 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d73f939f-89a3-4cf6-8ced-3a303a867d34 tempest-VolumeRetypeWithoutMigrationTest-912643075 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:08:07.416433 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d73f939f-89a3-4cf6-8ced-3a303a867d34 tempest-VolumeRetypeWithoutMigrationTest-912643075 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:08:07.478012 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-d73f939f-89a3-4cf6-8ced-3a303a867d34 tempest-VolumeRetypeWithoutMigrationTest-912643075 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:08:07.482727 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-d73f939f-89a3-4cf6-8ced-3a303a867d34 tempest-VolumeRetypeWithoutMigrationTest-912643075 None] Retype volume completed successfully. May 07 22:08:08.593410 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-75edafa3-af3c-46af-bc93-692fdbbc1aab tempest-VolumeRetypeWithoutMigrationTest-912643075 None] Lock "b'cinder-2b330d22-1a10-4478-a9b3-a1be4f27d9ca-delete_volume'" acquired by "delete_volume" :: waited 0.034s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:08:08.727440 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-75edafa3-af3c-46af-bc93-692fdbbc1aab tempest-VolumeRetypeWithoutMigrationTest-912643075 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:08:08.838617 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-75edafa3-af3c-46af-bc93-692fdbbc1aab tempest-VolumeRetypeWithoutMigrationTest-912643075 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:08:08.839296 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-75edafa3-af3c-46af-bc93-692fdbbc1aab tempest-VolumeRetypeWithoutMigrationTest-912643075 None] Volume volume-2b330d22-1a10-4478-a9b3-a1be4f27d9ca is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:08:08.849132 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-75edafa3-af3c-46af-bc93-692fdbbc1aab tempest-VolumeRetypeWithoutMigrationTest-912643075 None] deleting rbd volume volume-2b330d22-1a10-4478-a9b3-a1be4f27d9ca {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:08:09.372929 ncdv-master-1 cinder-volume[129946]: WARNING cinder.quota [None req-75edafa3-af3c-46af-bc93-692fdbbc1aab tempest-VolumeRetypeWithoutMigrationTest-912643075 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. May 07 22:08:09.373768 ncdv-master-1 cinder-volume[129946]: WARNING cinder.quota [None req-75edafa3-af3c-46af-bc93-692fdbbc1aab tempest-VolumeRetypeWithoutMigrationTest-912643075 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. May 07 22:08:09.405253 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-75edafa3-af3c-46af-bc93-692fdbbc1aab tempest-VolumeRetypeWithoutMigrationTest-912643075 None] Created reservations ['33b5a0a1-93d7-4a04-ad46-cac6da0bbb86', '18453f9c-f707-4b85-b766-ead9a039f9d3', 'b0284190-a890-46c9-8e40-7d2b504d5294', '697aa3b0-3ea0-4960-8032-6d400d5aeb9a'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:08:09.511645 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-75edafa3-af3c-46af-bc93-692fdbbc1aab tempest-VolumeRetypeWithoutMigrationTest-912643075 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:08:09.564451 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-75edafa3-af3c-46af-bc93-692fdbbc1aab tempest-VolumeRetypeWithoutMigrationTest-912643075 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:08:09.644318 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-75edafa3-af3c-46af-bc93-692fdbbc1aab tempest-VolumeRetypeWithoutMigrationTest-912643075 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:08:09.662847 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-75edafa3-af3c-46af-bc93-692fdbbc1aab tempest-VolumeRetypeWithoutMigrationTest-912643075 None] Deleted volume successfully. May 07 22:08:09.690749 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-75edafa3-af3c-46af-bc93-692fdbbc1aab tempest-VolumeRetypeWithoutMigrationTest-912643075 None] Lock "b'cinder-2b330d22-1a10-4478-a9b3-a1be4f27d9ca-delete_volume'" released by "delete_volume" :: held 1.097s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:08:13.995788 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-02c2d68f-3c82-4d27-804b-1c551c24c410 tempest-VolumesSnapshotTestJSON-1726756463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:08:14.050139 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-02c2d68f-3c82-4d27-804b-1c551c24c410 tempest-VolumesSnapshotTestJSON-1726756463 None] Flow 'volume_create_manager' (bd6b0de0-056e-4c54-92ab-f6c1b5b0925c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:08:14.060961 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-02c2d68f-3c82-4d27-804b-1c551c24c410 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fe83852-dd54-45c1-9db4-a07336b47525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:08:14.080051 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-02c2d68f-3c82-4d27-804b-1c551c24c410 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fe83852-dd54-45c1-9db4-a07336b47525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2040323234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=28875749-3b9f-4237-b844-689c84a5f03f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72be56c2d4a54014a8f741c451fe014e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:08:14Z,use_quota=True,user_id='97ef9a3039534d90ba9d268970cbe9d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:08:14.090327 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-02c2d68f-3c82-4d27-804b-1c551c24c410 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b2b4f15-f315-44e3-944b-bb2a6aa09146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:08:14.096202 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-02c2d68f-3c82-4d27-804b-1c551c24c410 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b2b4f15-f315-44e3-944b-bb2a6aa09146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:08:14.103280 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-02c2d68f-3c82-4d27-804b-1c551c24c410 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0456328b-62ee-4c54-8e27-82888fa40cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:08:14.109692 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-02c2d68f-3c82-4d27-804b-1c551c24c410 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0456328b-62ee-4c54-8e27-82888fa40cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28875749-3b9f-4237-b844-689c84a5f03f', 'volume_name': 'volume-28875749-3b9f-4237-b844-689c84a5f03f', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:08:14.117216 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-02c2d68f-3c82-4d27-804b-1c551c24c410 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc5f6f7f-9148-41da-a0f9-12de40ca114f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:08:14.121852 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-02c2d68f-3c82-4d27-804b-1c551c24c410 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc5f6f7f-9148-41da-a0f9-12de40ca114f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:08:14.127706 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-02c2d68f-3c82-4d27-804b-1c551c24c410 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2358ce5b-6ceb-4521-a26f-5a80c908103b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:08:14.129197 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-02c2d68f-3c82-4d27-804b-1c551c24c410 tempest-VolumesSnapshotTestJSON-1726756463 None] Volume 28875749-3b9f-4237-b844-689c84a5f03f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28875749-3b9f-4237-b844-689c84a5f03f', 'volume_size': 1} May 07 22:08:14.129900 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-02c2d68f-3c82-4d27-804b-1c551c24c410 tempest-VolumesSnapshotTestJSON-1726756463 None] creating volume 'volume-28875749-3b9f-4237-b844-689c84a5f03f' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:08:14.130803 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-02c2d68f-3c82-4d27-804b-1c551c24c410 tempest-VolumesSnapshotTestJSON-1726756463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:08:14.233546 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-02c2d68f-3c82-4d27-804b-1c551c24c410 tempest-VolumesSnapshotTestJSON-1726756463 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:08:14.234038 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-02c2d68f-3c82-4d27-804b-1c551c24c410 tempest-VolumesSnapshotTestJSON-1726756463 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:08:14.241472 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-02c2d68f-3c82-4d27-804b-1c551c24c410 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2358ce5b-6ceb-4521-a26f-5a80c908103b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28875749-3b9f-4237-b844-689c84a5f03f', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:08:14.247284 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-02c2d68f-3c82-4d27-804b-1c551c24c410 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03df80a4-14f7-4f53-aced-923b0121dcd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:08:14.259316 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-02c2d68f-3c82-4d27-804b-1c551c24c410 tempest-VolumesSnapshotTestJSON-1726756463 None] Volume volume-28875749-3b9f-4237-b844-689c84a5f03f (28875749-3b9f-4237-b844-689c84a5f03f): created successfully May 07 22:08:14.263661 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-02c2d68f-3c82-4d27-804b-1c551c24c410 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03df80a4-14f7-4f53-aced-923b0121dcd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:08:14.273088 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-02c2d68f-3c82-4d27-804b-1c551c24c410 tempest-VolumesSnapshotTestJSON-1726756463 None] Flow 'volume_create_manager' (bd6b0de0-056e-4c54-92ab-f6c1b5b0925c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:08:14.287525 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-02c2d68f-3c82-4d27-804b-1c551c24c410 tempest-VolumesSnapshotTestJSON-1726756463 None] Created volume successfully. May 07 22:08:15.329481 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-56290d32-6691-4469-9a33-b9749ca072c5 tempest-VolumesSnapshotTestJSON-1726756463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:08:16.459137 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-56290d32-6691-4469-9a33-b9749ca072c5 tempest-VolumesSnapshotTestJSON-1726756463 None] Create snapshot completed successfully May 07 22:08:17.836070 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.driver [None req-c167969e-cf8c-4534-9947-92b94b05ed91 tempest-VolumesSnapshotTestJSON-1726756463 None] Creating a new backup for volume volume-28875749-3b9f-4237-b844-689c84a5f03f. {{(pid=129946) _get_backup_volume_temp_volume /opt/stack/cinder/cinder/volume/driver.py:1213}} May 07 22:08:17.977364 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-c167969e-cf8c-4534-9947-92b94b05ed91 tempest-VolumesSnapshotTestJSON-1726756463 None] cloning volumes/volume-28875749-3b9f-4237-b844-689c84a5f03f@snapshot-f269fe76-0736-470f-aa1e-6e252c4dee4e to volume-fb5e7fa1-3cf2-4391-b44a-3169654739e7 {{(pid=129946) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1091}} May 07 22:08:17.978928 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-c167969e-cf8c-4534-9947-92b94b05ed91 tempest-VolumesSnapshotTestJSON-1726756463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:08:18.087193 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-c167969e-cf8c-4534-9947-92b94b05ed91 tempest-VolumesSnapshotTestJSON-1726756463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:08:18.182348 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-a10e5e5e-7848-4ceb-9d08-00310560c491 tempest-VolumeTypesTest-6358366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:08:18.223452 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a10e5e5e-7848-4ceb-9d08-00310560c491 tempest-VolumeTypesTest-6358366 None] Flow 'volume_create_manager' (22dcb59b-2304-445d-bf08-a37d69578d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:08:18.242166 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a10e5e5e-7848-4ceb-9d08-00310560c491 tempest-VolumeTypesTest-6358366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9de1cbba-7334-4121-a314-403f559f9184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:08:18.293925 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a10e5e5e-7848-4ceb-9d08-00310560c491 tempest-VolumeTypesTest-6358366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9de1cbba-7334-4121-a314-403f559f9184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:08:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesTest-volume-1087973873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=dc3b911d-00b9-43b1-ae91-bf453af4fb5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51018c16b81247ff8a3cfe8ba2f8fd13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:08:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:08:18Z,use_quota=True,user_id='93dc261b78a349bcb8fce05d488ed8a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f681bef1-32c4-4b0d-875b-ba47634f5c5c),volume_type_id=f681bef1-32c4-4b0d-875b-ba47634f5c5c)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:08:18.313495 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a10e5e5e-7848-4ceb-9d08-00310560c491 tempest-VolumeTypesTest-6358366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2967363c-cdf5-41c6-a06f-8e5144075913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:08:18.333575 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a10e5e5e-7848-4ceb-9d08-00310560c491 tempest-VolumeTypesTest-6358366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2967363c-cdf5-41c6-a06f-8e5144075913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:08:18.349920 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a10e5e5e-7848-4ceb-9d08-00310560c491 tempest-VolumeTypesTest-6358366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c00f7beb-dc54-46d3-854b-7e9928205c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:08:18.356075 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a10e5e5e-7848-4ceb-9d08-00310560c491 tempest-VolumeTypesTest-6358366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c00f7beb-dc54-46d3-854b-7e9928205c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc3b911d-00b9-43b1-ae91-bf453af4fb5f', 'volume_name': 'volume-dc3b911d-00b9-43b1-ae91-bf453af4fb5f', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:08:18.363585 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a10e5e5e-7848-4ceb-9d08-00310560c491 tempest-VolumeTypesTest-6358366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d41269b-fcea-41ab-a48c-90288fe2dde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:08:18.368096 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a10e5e5e-7848-4ceb-9d08-00310560c491 tempest-VolumeTypesTest-6358366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d41269b-fcea-41ab-a48c-90288fe2dde1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:08:18.374106 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a10e5e5e-7848-4ceb-9d08-00310560c491 tempest-VolumeTypesTest-6358366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bad42a22-34f2-43c9-82a0-842b95a77f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:08:18.375349 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-a10e5e5e-7848-4ceb-9d08-00310560c491 tempest-VolumeTypesTest-6358366 None] Volume dc3b911d-00b9-43b1-ae91-bf453af4fb5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc3b911d-00b9-43b1-ae91-bf453af4fb5f', 'volume_size': 1} May 07 22:08:18.375925 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-a10e5e5e-7848-4ceb-9d08-00310560c491 tempest-VolumeTypesTest-6358366 None] creating volume 'volume-dc3b911d-00b9-43b1-ae91-bf453af4fb5f' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:08:18.376759 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-a10e5e5e-7848-4ceb-9d08-00310560c491 tempest-VolumeTypesTest-6358366 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:08:18.434909 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-c167969e-cf8c-4534-9947-92b94b05ed91 tempest-VolumesSnapshotTestJSON-1726756463 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:08:18.435379 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-c167969e-cf8c-4534-9947-92b94b05ed91 tempest-VolumesSnapshotTestJSON-1726756463 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:08:18.488904 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-c167969e-cf8c-4534-9947-92b94b05ed91 tempest-VolumesSnapshotTestJSON-1726756463 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-05-07T22:08:17Z,data_timestamp=2022-05-07T22:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Backup-325745070',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=c003f529-0a51-47c4-b662-aeae7a5cf4dc,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='72be56c2d4a54014a8f741c451fe014e',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id='f269fe76-0736-470f-aa1e-6e252c4dee4e',status='creating',temp_snapshot_id=None,temp_volume_id='fb5e7fa1-3cf2-4391-b44a-3169654739e7',updated_at=None,user_id='97ef9a3039534d90ba9d268970cbe9d4',volume_id=28875749-3b9f-4237-b844-689c84a5f03f) May 07 22:08:18.490285 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.backup.rpcapi [None req-c167969e-cf8c-4534-9947-92b94b05ed91 tempest-VolumesSnapshotTestJSON-1726756463 None] continue_backup in rpcapi backup_id c003f529-0a51-47c4-b662-aeae7a5cf4dc {{(pid=129946) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} May 07 22:08:18.528127 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-a10e5e5e-7848-4ceb-9d08-00310560c491 tempest-VolumeTypesTest-6358366 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:08:18.528522 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-a10e5e5e-7848-4ceb-9d08-00310560c491 tempest-VolumeTypesTest-6358366 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:08:18.535577 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a10e5e5e-7848-4ceb-9d08-00310560c491 tempest-VolumeTypesTest-6358366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bad42a22-34f2-43c9-82a0-842b95a77f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc3b911d-00b9-43b1-ae91-bf453af4fb5f', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:08:18.550310 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a10e5e5e-7848-4ceb-9d08-00310560c491 tempest-VolumeTypesTest-6358366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c6356f1-f14a-4c83-9359-08479c49476e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:08:18.572005 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-a10e5e5e-7848-4ceb-9d08-00310560c491 tempest-VolumeTypesTest-6358366 None] Volume volume-dc3b911d-00b9-43b1-ae91-bf453af4fb5f (dc3b911d-00b9-43b1-ae91-bf453af4fb5f): created successfully May 07 22:08:18.583742 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a10e5e5e-7848-4ceb-9d08-00310560c491 tempest-VolumeTypesTest-6358366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c6356f1-f14a-4c83-9359-08479c49476e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:08:18.595524 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a10e5e5e-7848-4ceb-9d08-00310560c491 tempest-VolumeTypesTest-6358366 None] Flow 'volume_create_manager' (22dcb59b-2304-445d-bf08-a37d69578d66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:08:18.619661 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-a10e5e5e-7848-4ceb-9d08-00310560c491 tempest-VolumeTypesTest-6358366 None] Created volume successfully. May 07 22:08:18.826933 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [None req-c167969e-cf8c-4534-9947-92b94b05ed91 tempest-VolumesSnapshotTestJSON-1726756463 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 22:08:19.656914 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-43ee4455-3883-42a7-8fee-0623e798777b tempest-VolumeTypesTest-6358366 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:08:19.752745 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-43ee4455-3883-42a7-8fee-0623e798777b tempest-VolumeTypesTest-6358366 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:08:19.814289 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-43ee4455-3883-42a7-8fee-0623e798777b tempest-VolumeTypesTest-6358366 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:08:19.821509 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-43ee4455-3883-42a7-8fee-0623e798777b tempest-VolumeTypesTest-6358366 None] Retype volume completed successfully. May 07 22:08:20.135034 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [None req-c167969e-cf8c-4534-9947-92b94b05ed91 tempest-VolumesSnapshotTestJSON-1726756463 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.307s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 22:08:20.137684 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-c167969e-cf8c-4534-9947-92b94b05ed91 tempest-VolumesSnapshotTestJSON-1726756463 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-fb5e7fa1-3cf2-4391-b44a-3169654739e7', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3ca0b836-1cfe-436a-b0fa-deb74d3203d9', 'volume_id': 'fb5e7fa1-3cf2-4391-b44a-3169654739e7', 'discard': True}} {{(pid=129946) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 07 22:08:20.177478 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-c167969e-cf8c-4534-9947-92b94b05ed91 tempest-VolumesSnapshotTestJSON-1726756463 None] Initialize volume connection completed successfully. May 07 22:08:22.537181 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-14ab5b4e-640e-4ae4-b824-004bbaccbc65 tempest-VolumeTypesTest-6358366 None] Lock "b'cinder-dc3b911d-00b9-43b1-ae91-bf453af4fb5f-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:08:22.619663 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-14ab5b4e-640e-4ae4-b824-004bbaccbc65 tempest-VolumeTypesTest-6358366 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:08:22.750366 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-14ab5b4e-640e-4ae4-b824-004bbaccbc65 tempest-VolumeTypesTest-6358366 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:08:22.751249 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-14ab5b4e-640e-4ae4-b824-004bbaccbc65 tempest-VolumeTypesTest-6358366 None] Volume volume-dc3b911d-00b9-43b1-ae91-bf453af4fb5f is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:08:22.776773 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-14ab5b4e-640e-4ae4-b824-004bbaccbc65 tempest-VolumeTypesTest-6358366 None] deleting rbd volume volume-dc3b911d-00b9-43b1-ae91-bf453af4fb5f {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:08:23.555658 ncdv-master-1 cinder-volume[129946]: WARNING cinder.quota [None req-14ab5b4e-640e-4ae4-b824-004bbaccbc65 tempest-VolumeTypesTest-6358366 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesTest-volume-type-1013807177 is set by the default quota flag: quota_volumes_tempest-VolumeTypesTest-volume-type-1013807177, it is now deprecated. Please use the default quota class for default quota. May 07 22:08:23.556637 ncdv-master-1 cinder-volume[129946]: WARNING cinder.quota [None req-14ab5b4e-640e-4ae4-b824-004bbaccbc65 tempest-VolumeTypesTest-6358366 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesTest-volume-type-1013807177 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesTest-volume-type-1013807177, it is now deprecated. Please use the default quota class for default quota. May 07 22:08:23.597045 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-14ab5b4e-640e-4ae4-b824-004bbaccbc65 tempest-VolumeTypesTest-6358366 None] Created reservations ['65039e23-65c4-4106-b2c1-7d9f27b77757', 'aa562dc3-c77e-4e2e-8513-fbee0944a98c', 'ae3bb106-af33-49cc-877e-4bcd7bbdf5ce', '9a3d19e5-0f07-4dd8-8ccd-1a197ca271c1'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:08:23.708087 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-14ab5b4e-640e-4ae4-b824-004bbaccbc65 tempest-VolumeTypesTest-6358366 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:08:23.838491 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-14ab5b4e-640e-4ae4-b824-004bbaccbc65 tempest-VolumeTypesTest-6358366 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:08:23.938499 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-14ab5b4e-640e-4ae4-b824-004bbaccbc65 tempest-VolumeTypesTest-6358366 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:08:23.944535 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-14ab5b4e-640e-4ae4-b824-004bbaccbc65 tempest-VolumeTypesTest-6358366 None] Deleted volume successfully. May 07 22:08:23.989977 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-14ab5b4e-640e-4ae4-b824-004bbaccbc65 tempest-VolumeTypesTest-6358366 None] Lock "b'cinder-dc3b911d-00b9-43b1-ae91-bf453af4fb5f-delete_volume'" released by "delete_volume" :: held 1.448s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:08:30.762068 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:08:30.763706 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:08:30.846524 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:08:30.907995 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:08:35.912478 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-917ca6f8-11d8-4143-80a6-07e19a1c412c tempest-VolumesBackupsTest-1817505426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:08:35.982393 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-917ca6f8-11d8-4143-80a6-07e19a1c412c tempest-VolumesBackupsTest-1817505426 None] Flow 'volume_create_manager' (41b85aea-b2dc-4c55-b8be-fc986073f4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:08:35.994463 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-917ca6f8-11d8-4143-80a6-07e19a1c412c tempest-VolumesBackupsTest-1817505426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d3c21d6-ebfa-4ec3-8697-8aed80cc89ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:08:36.035923 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-917ca6f8-11d8-4143-80a6-07e19a1c412c tempest-VolumesBackupsTest-1817505426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d3c21d6-ebfa-4ec3-8697-8aed80cc89ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-423550985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=aeca4df0-304c-4201-9f83-f45ab5b82bd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2bec96bf83d4fb296cbb8aeb28d576e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:08:36Z,use_quota=True,user_id='38e6d754538146aea01b0f51c8e2cc2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:08:36.068487 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-917ca6f8-11d8-4143-80a6-07e19a1c412c tempest-VolumesBackupsTest-1817505426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (515ad11d-3ef1-4647-b002-ea41105c2560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:08:36.093998 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-917ca6f8-11d8-4143-80a6-07e19a1c412c tempest-VolumesBackupsTest-1817505426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (515ad11d-3ef1-4647-b002-ea41105c2560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:08:36.105583 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-917ca6f8-11d8-4143-80a6-07e19a1c412c tempest-VolumesBackupsTest-1817505426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77bea29b-3100-40e7-bcd2-bb71029b3f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:08:36.115217 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-917ca6f8-11d8-4143-80a6-07e19a1c412c tempest-VolumesBackupsTest-1817505426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77bea29b-3100-40e7-bcd2-bb71029b3f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aeca4df0-304c-4201-9f83-f45ab5b82bd9', 'volume_name': 'volume-aeca4df0-304c-4201-9f83-f45ab5b82bd9', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:08:36.128557 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-917ca6f8-11d8-4143-80a6-07e19a1c412c tempest-VolumesBackupsTest-1817505426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c178f306-4c96-4c51-86a9-f7f664dba651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:08:36.133191 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-917ca6f8-11d8-4143-80a6-07e19a1c412c tempest-VolumesBackupsTest-1817505426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c178f306-4c96-4c51-86a9-f7f664dba651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:08:36.150229 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-917ca6f8-11d8-4143-80a6-07e19a1c412c tempest-VolumesBackupsTest-1817505426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5330816-f31d-4a5c-9e47-791fcb058cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:08:36.152025 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-917ca6f8-11d8-4143-80a6-07e19a1c412c tempest-VolumesBackupsTest-1817505426 None] Volume aeca4df0-304c-4201-9f83-f45ab5b82bd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aeca4df0-304c-4201-9f83-f45ab5b82bd9', 'volume_size': 1} May 07 22:08:36.153563 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-917ca6f8-11d8-4143-80a6-07e19a1c412c tempest-VolumesBackupsTest-1817505426 None] creating volume 'volume-aeca4df0-304c-4201-9f83-f45ab5b82bd9' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:08:36.155042 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-917ca6f8-11d8-4143-80a6-07e19a1c412c tempest-VolumesBackupsTest-1817505426 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:08:36.338661 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-917ca6f8-11d8-4143-80a6-07e19a1c412c tempest-VolumesBackupsTest-1817505426 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:08:36.339990 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-917ca6f8-11d8-4143-80a6-07e19a1c412c tempest-VolumesBackupsTest-1817505426 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:08:36.343955 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-917ca6f8-11d8-4143-80a6-07e19a1c412c tempest-VolumesBackupsTest-1817505426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5330816-f31d-4a5c-9e47-791fcb058cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aeca4df0-304c-4201-9f83-f45ab5b82bd9', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:08:36.349022 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-917ca6f8-11d8-4143-80a6-07e19a1c412c tempest-VolumesBackupsTest-1817505426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c48140b-1a00-475a-954b-81bf299edc5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:08:36.371029 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-917ca6f8-11d8-4143-80a6-07e19a1c412c tempest-VolumesBackupsTest-1817505426 None] Volume volume-aeca4df0-304c-4201-9f83-f45ab5b82bd9 (aeca4df0-304c-4201-9f83-f45ab5b82bd9): created successfully May 07 22:08:36.375406 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-917ca6f8-11d8-4143-80a6-07e19a1c412c tempest-VolumesBackupsTest-1817505426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c48140b-1a00-475a-954b-81bf299edc5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:08:36.390390 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-917ca6f8-11d8-4143-80a6-07e19a1c412c tempest-VolumesBackupsTest-1817505426 None] Flow 'volume_create_manager' (41b85aea-b2dc-4c55-b8be-fc986073f4c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:08:36.413916 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-917ca6f8-11d8-4143-80a6-07e19a1c412c tempest-VolumesBackupsTest-1817505426 None] Created volume successfully. May 07 22:08:38.058520 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-c167969e-cf8c-4534-9947-92b94b05ed91 tempest-VolumesSnapshotTestJSON-1726756463 None] Terminate volume connection completed successfully. May 07 22:08:38.101968 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-c167969e-cf8c-4534-9947-92b94b05ed91 tempest-VolumesSnapshotTestJSON-1726756463 None] Remove volume export completed successfully. May 07 22:08:38.170643 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-c167969e-cf8c-4534-9947-92b94b05ed91 tempest-VolumesSnapshotTestJSON-1726756463 None] Lock "b'cinder-fb5e7fa1-3cf2-4391-b44a-3169654739e7-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:08:38.192835 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-c167969e-cf8c-4534-9947-92b94b05ed91 tempest-VolumesSnapshotTestJSON-1726756463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:08:38.301612 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-c167969e-cf8c-4534-9947-92b94b05ed91 tempest-VolumesSnapshotTestJSON-1726756463 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:08:38.320363 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-c167969e-cf8c-4534-9947-92b94b05ed91 tempest-VolumesSnapshotTestJSON-1726756463 None] deleting rbd volume volume-fb5e7fa1-3cf2-4391-b44a-3169654739e7 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:08:39.076068 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-c167969e-cf8c-4534-9947-92b94b05ed91 tempest-VolumesSnapshotTestJSON-1726756463 None] Deleted volume successfully. May 07 22:08:39.083596 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-c167969e-cf8c-4534-9947-92b94b05ed91 tempest-VolumesSnapshotTestJSON-1726756463 None] Lock "b'cinder-fb5e7fa1-3cf2-4391-b44a-3169654739e7-delete_volume'" released by "delete_volume" :: held 0.914s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:08:55.439301 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-29db8738-6c6c-40c3-9351-fd5518ad2fa9 req-614f32c9-8409-40a9-8285-fabbb935894a tempest-VolumesBackupsTest-1817505426 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 22:08:57.124784 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-29db8738-6c6c-40c3-9351-fd5518ad2fa9 req-614f32c9-8409-40a9-8285-fabbb935894a tempest-VolumesBackupsTest-1817505426 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.686s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 22:08:57.127875 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-29db8738-6c6c-40c3-9351-fd5518ad2fa9 req-614f32c9-8409-40a9-8285-fabbb935894a tempest-VolumesBackupsTest-1817505426 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-aeca4df0-304c-4201-9f83-f45ab5b82bd9', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3ca0b836-1cfe-436a-b0fa-deb74d3203d9', 'volume_id': 'aeca4df0-304c-4201-9f83-f45ab5b82bd9', 'discard': True}} {{(pid=129946) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 07 22:08:57.189972 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-29db8738-6c6c-40c3-9351-fd5518ad2fa9 req-614f32c9-8409-40a9-8285-fabbb935894a tempest-VolumesBackupsTest-1817505426 None] Connection info returned from driver {'name': 'volumes/volume-aeca4df0-304c-4201-9f83-f45ab5b82bd9', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'aeca4df0-304c-4201-9f83-f45ab5b82bd9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'dbecd5cd-38f9-4681-8f2f-926756140cb8'} {{(pid=129946) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 07 22:08:57.292193 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-29db8738-6c6c-40c3-9351-fd5518ad2fa9 req-614f32c9-8409-40a9-8285-fabbb935894a tempest-VolumesBackupsTest-1817505426 None] attachment_update completed successfully. May 07 22:09:00.146227 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-d5f04209-3b70-48a1-b0fc-f615c459bce5 tempest-VolumesBackupsTest-1817505426 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-05-07T22:08:59Z,data_timestamp=2022-05-07T22:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1809999679',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=fa1cebef-76a3-4a6a-9a02-031f6821fa00,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='e2bec96bf83d4fb296cbb8aeb28d576e',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='38e6d754538146aea01b0f51c8e2cc2f',volume_id=aeca4df0-304c-4201-9f83-f45ab5b82bd9) May 07 22:09:00.147215 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.backup.rpcapi [None req-d5f04209-3b70-48a1-b0fc-f615c459bce5 tempest-VolumesBackupsTest-1817505426 None] continue_backup in rpcapi backup_id fa1cebef-76a3-4a6a-9a02-031f6821fa00 {{(pid=129946) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} May 07 22:09:00.504153 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [None req-d5f04209-3b70-48a1-b0fc-f615c459bce5 tempest-VolumesBackupsTest-1817505426 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 22:09:02.073449 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9d3fb01-bc92-4475-bcfd-05766640b31d tempest-VolumesSnapshotTestJSON-1726756463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:09:02.231491 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d9d3fb01-bc92-4475-bcfd-05766640b31d tempest-VolumesSnapshotTestJSON-1726756463 None] Flow 'volume_create_manager' (8b9c16b4-1aad-488b-9994-462ed9acc698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:09:02.245327 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d9d3fb01-bc92-4475-bcfd-05766640b31d tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (857cd0c8-05f4-4b8f-92ce-045fa1d76988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:09:02.299464 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d9d3fb01-bc92-4475-bcfd-05766640b31d tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (857cd0c8-05f4-4b8f-92ce-045fa1d76988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2113641916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=75dd9e1d-41d8-4373-81eb-a9b8cb88a957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72be56c2d4a54014a8f741c451fe014e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:09:02Z,use_quota=True,user_id='97ef9a3039534d90ba9d268970cbe9d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:09:02.308880 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d9d3fb01-bc92-4475-bcfd-05766640b31d tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80a12c86-48a0-40a5-8ba9-1b2885f61ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:09:02.318875 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d9d3fb01-bc92-4475-bcfd-05766640b31d tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80a12c86-48a0-40a5-8ba9-1b2885f61ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:09:02.351773 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d9d3fb01-bc92-4475-bcfd-05766640b31d tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19138272-76ae-4998-aefc-d49a652acedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:09:02.390716 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [None req-d5f04209-3b70-48a1-b0fc-f615c459bce5 tempest-VolumesBackupsTest-1817505426 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.887s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 22:09:02.396647 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d5f04209-3b70-48a1-b0fc-f615c459bce5 tempest-VolumesBackupsTest-1817505426 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-aeca4df0-304c-4201-9f83-f45ab5b82bd9', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3ca0b836-1cfe-436a-b0fa-deb74d3203d9', 'volume_id': 'aeca4df0-304c-4201-9f83-f45ab5b82bd9', 'discard': True}} {{(pid=129946) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 07 22:09:02.519906 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-d5f04209-3b70-48a1-b0fc-f615c459bce5 tempest-VolumesBackupsTest-1817505426 None] Initialize volume connection completed successfully. May 07 22:09:02.567983 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d9d3fb01-bc92-4475-bcfd-05766640b31d tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19138272-76ae-4998-aefc-d49a652acedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '75dd9e1d-41d8-4373-81eb-a9b8cb88a957', 'volume_name': 'volume-75dd9e1d-41d8-4373-81eb-a9b8cb88a957', 'volume_size': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e2f828af0706465883131e16cb564d05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'created_at': datetime.datetime(2022, 5, 7, 21, 36, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:09:02.582970 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d9d3fb01-bc92-4475-bcfd-05766640b31d tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b03cf4f3-6762-4097-8590-3757839d4739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:09:02.590478 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d9d3fb01-bc92-4475-bcfd-05766640b31d tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b03cf4f3-6762-4097-8590-3757839d4739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:09:02.604170 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d9d3fb01-bc92-4475-bcfd-05766640b31d tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d7a1840-1dda-45d5-ba8c-d984222df95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:09:02.605884 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-d9d3fb01-bc92-4475-bcfd-05766640b31d tempest-VolumesSnapshotTestJSON-1726756463 None] Volume 75dd9e1d-41d8-4373-81eb-a9b8cb88a957: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-75dd9e1d-41d8-4373-81eb-a9b8cb88a957', 'volume_size': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e2f828af0706465883131e16cb564d05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'created_at': datetime.datetime(2022, 5, 7, 21, 36, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } May 07 22:09:02.607236 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9d3fb01-bc92-4475-bcfd-05766640b31d tempest-VolumesSnapshotTestJSON-1726756463 None] Cloning 75dd9e1d-41d8-4373-81eb-a9b8cb88a957 from image 3756ae98-5c12-48e7-920e-ef5d1dd5543c at location (None, None). {{(pid=129946) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} May 07 22:09:02.620512 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-d9d3fb01-bc92-4475-bcfd-05766640b31d tempest-VolumesSnapshotTestJSON-1726756463 None] Lock "b'cinder-3756ae98-5c12-48e7-920e-ef5d1dd5543c'" acquired by "_prepare_image_cache_entry" :: waited 0.012s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:09:02.662373 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-d9d3fb01-bc92-4475-bcfd-05766640b31d tempest-VolumesSnapshotTestJSON-1726756463 None] Found image-volume cache entry: {'id': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'volume_id': '82279f40-9683-441f-a541-0db8b9177f48', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9), 'last_used': datetime.datetime(2022, 5, 7, 22, 9, 2, 646877)}. {{(pid=129946) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 07 22:09:02.664279 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-d9d3fb01-bc92-4475-bcfd-05766640b31d tempest-VolumesSnapshotTestJSON-1726756463 None] Image-volume cache entry image_update_at = 2022-05-07 21:37:09+00:00, requested image updated_at = 2022-05-07 21:37:09+00:00. {{(pid=129946) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 07 22:09:02.664947 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9d3fb01-bc92-4475-bcfd-05766640b31d tempest-VolumesSnapshotTestJSON-1726756463 None] Found cache entry for image = 3756ae98-5c12-48e7-920e-ef5d1dd5543c on host ncdv-master-1@ceph#ceph. {{(pid=129946) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} May 07 22:09:02.676804 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-d9d3fb01-bc92-4475-bcfd-05766640b31d tempest-VolumesSnapshotTestJSON-1726756463 None] Lock "b'cinder-3756ae98-5c12-48e7-920e-ef5d1dd5543c'" released by "_prepare_image_cache_entry" :: held 0.053s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:09:02.679929 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9d3fb01-bc92-4475-bcfd-05766640b31d tempest-VolumesSnapshotTestJSON-1726756463 None] Attempting to retrieve cache entry for image = 3756ae98-5c12-48e7-920e-ef5d1dd5543c on host ncdv-master-1@ceph#ceph. {{(pid=129946) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} May 07 22:09:02.699199 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-d9d3fb01-bc92-4475-bcfd-05766640b31d tempest-VolumesSnapshotTestJSON-1726756463 None] Found image-volume cache entry: {'id': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'volume_id': '82279f40-9683-441f-a541-0db8b9177f48', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9), 'last_used': datetime.datetime(2022, 5, 7, 22, 9, 2, 689283)}. {{(pid=129946) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 07 22:09:02.700716 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-d9d3fb01-bc92-4475-bcfd-05766640b31d tempest-VolumesSnapshotTestJSON-1726756463 None] Image-volume cache entry image_update_at = 2022-05-07 21:37:09+00:00, requested image updated_at = 2022-05-07 21:37:09+00:00. {{(pid=129946) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 07 22:09:02.705444 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9d3fb01-bc92-4475-bcfd-05766640b31d tempest-VolumesSnapshotTestJSON-1726756463 None] Creating from source image-volume 82279f40-9683-441f-a541-0db8b9177f48 {{(pid=129946) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} May 07 22:09:02.746278 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d9d3fb01-bc92-4475-bcfd-05766640b31d tempest-VolumesSnapshotTestJSON-1726756463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:09:02.887774 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d9d3fb01-bc92-4475-bcfd-05766640b31d tempest-VolumesSnapshotTestJSON-1726756463 None] creating snapshot='volume-75dd9e1d-41d8-4373-81eb-a9b8cb88a957.clone_snap' {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} May 07 22:09:03.828732 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d9d3fb01-bc92-4475-bcfd-05766640b31d tempest-VolumesSnapshotTestJSON-1726756463 None] cloning 'volume-82279f40-9683-441f-a541-0db8b9177f48@volume-75dd9e1d-41d8-4373-81eb-a9b8cb88a957.clone_snap' to 'volume-75dd9e1d-41d8-4373-81eb-a9b8cb88a957' {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 07 22:09:04.099396 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d9d3fb01-bc92-4475-bcfd-05766640b31d tempest-VolumesSnapshotTestJSON-1726756463 None] Volume volume-3864f924-91b4-4015-ab37-8bdbf8ad652d.deleted is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:09:04.100612 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d9d3fb01-bc92-4475-bcfd-05766640b31d tempest-VolumesSnapshotTestJSON-1726756463 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:09:04.101000 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d9d3fb01-bc92-4475-bcfd-05766640b31d tempest-VolumesSnapshotTestJSON-1726756463 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:09:04.165778 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d9d3fb01-bc92-4475-bcfd-05766640b31d tempest-VolumesSnapshotTestJSON-1726756463 None] clone created successfully {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} May 07 22:09:04.166523 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.volume_utils [None req-d9d3fb01-bc92-4475-bcfd-05766640b31d tempest-VolumesSnapshotTestJSON-1726756463 None] Marking volume 75dd9e1d-41d8-4373-81eb-a9b8cb88a957 as bootable. {{(pid=129946) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} May 07 22:09:04.183609 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9d3fb01-bc92-4475-bcfd-05766640b31d tempest-VolumesSnapshotTestJSON-1726756463 None] Copying metadata from image 3756ae98-5c12-48e7-920e-ef5d1dd5543c to 75dd9e1d-41d8-4373-81eb-a9b8cb88a957. {{(pid=129946) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} May 07 22:09:04.184313 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9d3fb01-bc92-4475-bcfd-05766640b31d tempest-VolumesSnapshotTestJSON-1726756463 None] Creating volume glance metadata for volume 75dd9e1d-41d8-4373-81eb-a9b8cb88a957 backed by image 3756ae98-5c12-48e7-920e-ef5d1dd5543c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129946) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} May 07 22:09:04.286725 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d9d3fb01-bc92-4475-bcfd-05766640b31d tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d7a1840-1dda-45d5-ba8c-d984222df95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75dd9e1d-41d8-4373-81eb-a9b8cb88a957', 'volume_size': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e2f828af0706465883131e16cb564d05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'created_at': datetime.datetime(2022, 5, 7, 21, 36, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:09:04.294925 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d9d3fb01-bc92-4475-bcfd-05766640b31d tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4d831a9-4c48-4fbe-9184-a5dcf57a3aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:09:04.310835 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-d9d3fb01-bc92-4475-bcfd-05766640b31d tempest-VolumesSnapshotTestJSON-1726756463 None] Volume volume-75dd9e1d-41d8-4373-81eb-a9b8cb88a957 (75dd9e1d-41d8-4373-81eb-a9b8cb88a957): created successfully May 07 22:09:04.324651 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d9d3fb01-bc92-4475-bcfd-05766640b31d tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4d831a9-4c48-4fbe-9184-a5dcf57a3aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:09:04.333707 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d9d3fb01-bc92-4475-bcfd-05766640b31d tempest-VolumesSnapshotTestJSON-1726756463 None] Flow 'volume_create_manager' (8b9c16b4-1aad-488b-9994-462ed9acc698) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:09:04.350992 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-d9d3fb01-bc92-4475-bcfd-05766640b31d tempest-VolumesSnapshotTestJSON-1726756463 None] Created volume successfully. May 07 22:09:05.109609 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-d5f04209-3b70-48a1-b0fc-f615c459bce5 tempest-VolumesBackupsTest-1817505426 None] Terminate volume connection completed successfully. May 07 22:09:05.161405 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-d5f04209-3b70-48a1-b0fc-f615c459bce5 tempest-VolumesBackupsTest-1817505426 None] Remove volume export completed successfully. May 07 22:09:06.225188 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-b40c0114-2e31-4b4b-a75e-91d9777d16d8 req-e2e95410-db24-41fa-a88f-dd5e35bc2562 tempest-VolumesSnapshotTestJSON-1726756463 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 22:09:07.625410 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-b40c0114-2e31-4b4b-a75e-91d9777d16d8 req-e2e95410-db24-41fa-a88f-dd5e35bc2562 tempest-VolumesSnapshotTestJSON-1726756463 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.400s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 22:09:07.626210 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-b40c0114-2e31-4b4b-a75e-91d9777d16d8 req-e2e95410-db24-41fa-a88f-dd5e35bc2562 tempest-VolumesSnapshotTestJSON-1726756463 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-75dd9e1d-41d8-4373-81eb-a9b8cb88a957', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3ca0b836-1cfe-436a-b0fa-deb74d3203d9', 'volume_id': '75dd9e1d-41d8-4373-81eb-a9b8cb88a957', 'discard': True}} {{(pid=129946) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 07 22:09:07.693828 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-b40c0114-2e31-4b4b-a75e-91d9777d16d8 req-e2e95410-db24-41fa-a88f-dd5e35bc2562 tempest-VolumesSnapshotTestJSON-1726756463 None] Connection info returned from driver {'name': 'volumes/volume-75dd9e1d-41d8-4373-81eb-a9b8cb88a957', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '75dd9e1d-41d8-4373-81eb-a9b8cb88a957', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '7423ea71-0bdf-4bae-b179-b892d871f771'} {{(pid=129946) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 07 22:09:07.818968 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-b40c0114-2e31-4b4b-a75e-91d9777d16d8 req-e2e95410-db24-41fa-a88f-dd5e35bc2562 tempest-VolumesSnapshotTestJSON-1726756463 None] attachment_update completed successfully. May 07 22:09:08.893738 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-5d45f2ff-22a2-42b3-b649-e4f1f711ec80 req-ee732ad9-dc5d-4ae1-8cb7-b70bc3ec6e32 tempest-VolumesBackupsTest-1817505426 None] Terminate volume connection completed successfully. May 07 22:09:08.896198 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-5d45f2ff-22a2-42b3-b649-e4f1f711ec80 req-ee732ad9-dc5d-4ae1-8cb7-b70bc3ec6e32 tempest-VolumesBackupsTest-1817505426 None] Deleting attachment dbecd5cd-38f9-4681-8f2f-926756140cb8. {{(pid=129946) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 07 22:09:10.015724 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0628c7e3-6d9f-4ba6-b648-9045c78e7c4e tempest-VolumesSnapshotTestJSON-1726756463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:09:10.749060 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-0628c7e3-6d9f-4ba6-b648-9045c78e7c4e tempest-VolumesSnapshotTestJSON-1726756463 None] Create snapshot completed successfully May 07 22:09:11.463853 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-3fd1afd5-25aa-4433-9c89-3d29821e16df tempest-VolumesSnapshotTestJSON-1726756463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:09:12.730417 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-3fd1afd5-25aa-4433-9c89-3d29821e16df tempest-VolumesSnapshotTestJSON-1726756463 None] Create snapshot completed successfully May 07 22:09:13.892788 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-ac6e08e1-ee5f-41cb-9450-fb2895b83dea tempest-VolumesSnapshotTestJSON-1726756463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:09:14.733753 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-ac6e08e1-ee5f-41cb-9450-fb2895b83dea tempest-VolumesSnapshotTestJSON-1726756463 None] Create snapshot completed successfully May 07 22:09:14.778238 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-8bd1648c-a48c-464d-b0e3-c6b2a5ae8f3e tempest-VolumesBackupsTest-1817505426 None] Lock "b'cinder-aeca4df0-304c-4201-9f83-f45ab5b82bd9-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:09:14.849636 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-8bd1648c-a48c-464d-b0e3-c6b2a5ae8f3e tempest-VolumesBackupsTest-1817505426 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:09:15.572649 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-8bd1648c-a48c-464d-b0e3-c6b2a5ae8f3e tempest-VolumesBackupsTest-1817505426 None] Volume volume-aeca4df0-304c-4201-9f83-f45ab5b82bd9 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:09:15.602328 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-8bd1648c-a48c-464d-b0e3-c6b2a5ae8f3e tempest-VolumesBackupsTest-1817505426 None] deleting rbd volume volume-aeca4df0-304c-4201-9f83-f45ab5b82bd9 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:09:15.630413 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-e7ff2ecd-1d77-44cf-973d-40b1adc0d04e tempest-VolumesSnapshotTestJSON-1726756463 None] Lock "b'cinder-fa8403c2-2455-4ba0-bfc8-358c41a64270-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.020s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:09:15.632635 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-e7ff2ecd-1d77-44cf-973d-40b1adc0d04e tempest-VolumesSnapshotTestJSON-1726756463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:09:16.214253 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-8bd1648c-a48c-464d-b0e3-c6b2a5ae8f3e tempest-VolumesBackupsTest-1817505426 None] Created reservations ['03f21dd8-e332-43b6-b908-bae33dc1c65f', '1595e4ab-2343-4eac-bbb1-9123036bccbf', 'd1561393-67bc-40d9-826e-205e65f1254e', '266e6440-fa0d-49c8-8a4d-9593addb7f1e'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:09:16.316493 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-8bd1648c-a48c-464d-b0e3-c6b2a5ae8f3e tempest-VolumesBackupsTest-1817505426 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:09:16.398243 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-8bd1648c-a48c-464d-b0e3-c6b2a5ae8f3e tempest-VolumesBackupsTest-1817505426 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:09:16.482406 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-8bd1648c-a48c-464d-b0e3-c6b2a5ae8f3e tempest-VolumesBackupsTest-1817505426 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:09:16.487691 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-8bd1648c-a48c-464d-b0e3-c6b2a5ae8f3e tempest-VolumesBackupsTest-1817505426 None] Deleted volume successfully. May 07 22:09:16.515389 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-8bd1648c-a48c-464d-b0e3-c6b2a5ae8f3e tempest-VolumesBackupsTest-1817505426 None] Lock "b'cinder-aeca4df0-304c-4201-9f83-f45ab5b82bd9-delete_volume'" released by "delete_volume" :: held 1.738s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:09:17.930248 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-def96b36-0a2c-4dd7-b571-fa74ef9626d4 tempest-VolumesBackupsTest-1817505426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:09:17.995331 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-def96b36-0a2c-4dd7-b571-fa74ef9626d4 tempest-VolumesBackupsTest-1817505426 None] Flow 'volume_create_manager' (00a69ae6-9b76-4d1c-862b-0cb04cc4a56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:09:18.011261 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-def96b36-0a2c-4dd7-b571-fa74ef9626d4 tempest-VolumesBackupsTest-1817505426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a5218f5-4a75-4a80-b9d9-de4bbcf037a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:09:18.040609 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-def96b36-0a2c-4dd7-b571-fa74ef9626d4 tempest-VolumesBackupsTest-1817505426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a5218f5-4a75-4a80-b9d9-de4bbcf037a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-1129610591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ee967edb-ea50-423b-8d88-03897f067e75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2bec96bf83d4fb296cbb8aeb28d576e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:09:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:09:18Z,use_quota=True,user_id='38e6d754538146aea01b0f51c8e2cc2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:09:18.052156 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-def96b36-0a2c-4dd7-b571-fa74ef9626d4 tempest-VolumesBackupsTest-1817505426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0b3567f-8eb6-4a32-b1c6-198164910e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:09:18.059172 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-def96b36-0a2c-4dd7-b571-fa74ef9626d4 tempest-VolumesBackupsTest-1817505426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0b3567f-8eb6-4a32-b1c6-198164910e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:09:18.075042 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-def96b36-0a2c-4dd7-b571-fa74ef9626d4 tempest-VolumesBackupsTest-1817505426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b82f432-a03f-485d-9883-4b5805ab8bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:09:18.241470 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-def96b36-0a2c-4dd7-b571-fa74ef9626d4 tempest-VolumesBackupsTest-1817505426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b82f432-a03f-485d-9883-4b5805ab8bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ee967edb-ea50-423b-8d88-03897f067e75', 'volume_name': 'volume-ee967edb-ea50-423b-8d88-03897f067e75', 'volume_size': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e2f828af0706465883131e16cb564d05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'created_at': datetime.datetime(2022, 5, 7, 21, 36, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:09:18.247797 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-def96b36-0a2c-4dd7-b571-fa74ef9626d4 tempest-VolumesBackupsTest-1817505426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (113d4c2c-7e6f-4204-b392-4204db56755e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:09:18.252661 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-def96b36-0a2c-4dd7-b571-fa74ef9626d4 tempest-VolumesBackupsTest-1817505426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (113d4c2c-7e6f-4204-b392-4204db56755e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:09:18.257861 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-def96b36-0a2c-4dd7-b571-fa74ef9626d4 tempest-VolumesBackupsTest-1817505426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abdf2f95-4024-40c7-b8a2-db64d23cd7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:09:18.266938 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-def96b36-0a2c-4dd7-b571-fa74ef9626d4 tempest-VolumesBackupsTest-1817505426 None] Volume ee967edb-ea50-423b-8d88-03897f067e75: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ee967edb-ea50-423b-8d88-03897f067e75', 'volume_size': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e2f828af0706465883131e16cb564d05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'created_at': datetime.datetime(2022, 5, 7, 21, 36, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } May 07 22:09:18.267840 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-def96b36-0a2c-4dd7-b571-fa74ef9626d4 tempest-VolumesBackupsTest-1817505426 None] Cloning ee967edb-ea50-423b-8d88-03897f067e75 from image 3756ae98-5c12-48e7-920e-ef5d1dd5543c at location (None, None). {{(pid=129946) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} May 07 22:09:18.291274 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-def96b36-0a2c-4dd7-b571-fa74ef9626d4 tempest-VolumesBackupsTest-1817505426 None] Lock "b'cinder-3756ae98-5c12-48e7-920e-ef5d1dd5543c'" acquired by "_prepare_image_cache_entry" :: waited 0.022s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:09:18.311756 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-def96b36-0a2c-4dd7-b571-fa74ef9626d4 tempest-VolumesBackupsTest-1817505426 None] Found image-volume cache entry: {'id': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'volume_id': '82279f40-9683-441f-a541-0db8b9177f48', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9), 'last_used': datetime.datetime(2022, 5, 7, 22, 9, 18, 303199)}. {{(pid=129946) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 07 22:09:18.313220 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-def96b36-0a2c-4dd7-b571-fa74ef9626d4 tempest-VolumesBackupsTest-1817505426 None] Image-volume cache entry image_update_at = 2022-05-07 21:37:09+00:00, requested image updated_at = 2022-05-07 21:37:09+00:00. {{(pid=129946) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 07 22:09:18.313744 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-def96b36-0a2c-4dd7-b571-fa74ef9626d4 tempest-VolumesBackupsTest-1817505426 None] Found cache entry for image = 3756ae98-5c12-48e7-920e-ef5d1dd5543c on host ncdv-master-1@ceph#ceph. {{(pid=129946) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} May 07 22:09:18.322831 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-def96b36-0a2c-4dd7-b571-fa74ef9626d4 tempest-VolumesBackupsTest-1817505426 None] Lock "b'cinder-3756ae98-5c12-48e7-920e-ef5d1dd5543c'" released by "_prepare_image_cache_entry" :: held 0.031s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:09:18.335966 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-def96b36-0a2c-4dd7-b571-fa74ef9626d4 tempest-VolumesBackupsTest-1817505426 None] Attempting to retrieve cache entry for image = 3756ae98-5c12-48e7-920e-ef5d1dd5543c on host ncdv-master-1@ceph#ceph. {{(pid=129946) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} May 07 22:09:18.343066 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-def96b36-0a2c-4dd7-b571-fa74ef9626d4 tempest-VolumesBackupsTest-1817505426 None] Found image-volume cache entry: {'id': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'volume_id': '82279f40-9683-441f-a541-0db8b9177f48', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9), 'last_used': datetime.datetime(2022, 5, 7, 22, 9, 18, 340514)}. {{(pid=129946) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 07 22:09:18.343852 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-def96b36-0a2c-4dd7-b571-fa74ef9626d4 tempest-VolumesBackupsTest-1817505426 None] Image-volume cache entry image_update_at = 2022-05-07 21:37:09+00:00, requested image updated_at = 2022-05-07 21:37:09+00:00. {{(pid=129946) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 07 22:09:18.344487 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-def96b36-0a2c-4dd7-b571-fa74ef9626d4 tempest-VolumesBackupsTest-1817505426 None] Creating from source image-volume 82279f40-9683-441f-a541-0db8b9177f48 {{(pid=129946) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} May 07 22:09:18.356294 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-def96b36-0a2c-4dd7-b571-fa74ef9626d4 tempest-VolumesBackupsTest-1817505426 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:09:18.445987 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-def96b36-0a2c-4dd7-b571-fa74ef9626d4 tempest-VolumesBackupsTest-1817505426 None] creating snapshot='volume-ee967edb-ea50-423b-8d88-03897f067e75.clone_snap' {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} May 07 22:09:18.764000 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-def96b36-0a2c-4dd7-b571-fa74ef9626d4 tempest-VolumesBackupsTest-1817505426 None] cloning 'volume-82279f40-9683-441f-a541-0db8b9177f48@volume-ee967edb-ea50-423b-8d88-03897f067e75.clone_snap' to 'volume-ee967edb-ea50-423b-8d88-03897f067e75' {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 07 22:09:19.091332 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-def96b36-0a2c-4dd7-b571-fa74ef9626d4 tempest-VolumesBackupsTest-1817505426 None] Volume volume-3864f924-91b4-4015-ab37-8bdbf8ad652d.deleted is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:09:19.092372 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-def96b36-0a2c-4dd7-b571-fa74ef9626d4 tempest-VolumesBackupsTest-1817505426 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:09:19.093086 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-def96b36-0a2c-4dd7-b571-fa74ef9626d4 tempest-VolumesBackupsTest-1817505426 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:09:19.146873 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-def96b36-0a2c-4dd7-b571-fa74ef9626d4 tempest-VolumesBackupsTest-1817505426 None] clone created successfully {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} May 07 22:09:19.148432 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.volume_utils [None req-def96b36-0a2c-4dd7-b571-fa74ef9626d4 tempest-VolumesBackupsTest-1817505426 None] Marking volume ee967edb-ea50-423b-8d88-03897f067e75 as bootable. {{(pid=129946) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} May 07 22:09:19.163824 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-def96b36-0a2c-4dd7-b571-fa74ef9626d4 tempest-VolumesBackupsTest-1817505426 None] Copying metadata from image 3756ae98-5c12-48e7-920e-ef5d1dd5543c to ee967edb-ea50-423b-8d88-03897f067e75. {{(pid=129946) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} May 07 22:09:19.164303 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-def96b36-0a2c-4dd7-b571-fa74ef9626d4 tempest-VolumesBackupsTest-1817505426 None] Creating volume glance metadata for volume ee967edb-ea50-423b-8d88-03897f067e75 backed by image 3756ae98-5c12-48e7-920e-ef5d1dd5543c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129946) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} May 07 22:09:19.322515 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-def96b36-0a2c-4dd7-b571-fa74ef9626d4 tempest-VolumesBackupsTest-1817505426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abdf2f95-4024-40c7-b8a2-db64d23cd7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee967edb-ea50-423b-8d88-03897f067e75', 'volume_size': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e2f828af0706465883131e16cb564d05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'created_at': datetime.datetime(2022, 5, 7, 21, 36, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:09:19.333318 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-def96b36-0a2c-4dd7-b571-fa74ef9626d4 tempest-VolumesBackupsTest-1817505426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f183658-ca96-4d8e-a0d4-bff33a543ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:09:19.357907 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-def96b36-0a2c-4dd7-b571-fa74ef9626d4 tempest-VolumesBackupsTest-1817505426 None] Volume volume-ee967edb-ea50-423b-8d88-03897f067e75 (ee967edb-ea50-423b-8d88-03897f067e75): created successfully May 07 22:09:19.363066 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-def96b36-0a2c-4dd7-b571-fa74ef9626d4 tempest-VolumesBackupsTest-1817505426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f183658-ca96-4d8e-a0d4-bff33a543ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:09:19.375364 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-def96b36-0a2c-4dd7-b571-fa74ef9626d4 tempest-VolumesBackupsTest-1817505426 None] Flow 'volume_create_manager' (00a69ae6-9b76-4d1c-862b-0cb04cc4a56d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:09:19.400832 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-def96b36-0a2c-4dd7-b571-fa74ef9626d4 tempest-VolumesBackupsTest-1817505426 None] Created volume successfully. May 07 22:09:20.417220 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-e44fb534-9fac-4cd5-9872-f97c96c89f7b tempest-VolumesBackupsTest-1817505426 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-05-07T22:09:20Z,data_timestamp=2022-05-07T22:09:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-601449591',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=e44184b1-0f9f-4e9c-a865-dd57d2a803d0,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='e2bec96bf83d4fb296cbb8aeb28d576e',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='38e6d754538146aea01b0f51c8e2cc2f',volume_id=ee967edb-ea50-423b-8d88-03897f067e75) May 07 22:09:20.424642 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.backup.rpcapi [None req-e44fb534-9fac-4cd5-9872-f97c96c89f7b tempest-VolumesBackupsTest-1817505426 None] continue_backup in rpcapi backup_id e44184b1-0f9f-4e9c-a865-dd57d2a803d0 {{(pid=129946) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} May 07 22:09:20.814545 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [None req-e44fb534-9fac-4cd5-9872-f97c96c89f7b tempest-VolumesBackupsTest-1817505426 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 22:09:21.943622 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [None req-e44fb534-9fac-4cd5-9872-f97c96c89f7b tempest-VolumesBackupsTest-1817505426 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.127s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 22:09:21.945823 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-e44fb534-9fac-4cd5-9872-f97c96c89f7b tempest-VolumesBackupsTest-1817505426 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ee967edb-ea50-423b-8d88-03897f067e75', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3ca0b836-1cfe-436a-b0fa-deb74d3203d9', 'volume_id': 'ee967edb-ea50-423b-8d88-03897f067e75', 'discard': True}} {{(pid=129946) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 07 22:09:21.991094 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-e44fb534-9fac-4cd5-9872-f97c96c89f7b tempest-VolumesBackupsTest-1817505426 None] Initialize volume connection completed successfully. May 07 22:09:30.764533 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:09:30.766187 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:09:30.852141 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:09:30.915069 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:09:31.802707 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-e44fb534-9fac-4cd5-9872-f97c96c89f7b tempest-VolumesBackupsTest-1817505426 None] Terminate volume connection completed successfully. May 07 22:09:31.829107 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-e44fb534-9fac-4cd5-9872-f97c96c89f7b tempest-VolumesBackupsTest-1817505426 None] Remove volume export completed successfully. May 07 22:09:32.549971 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-34510e99-4c28-41e6-b03e-dbbc79248a29 tempest-VolumesBackupsTest-1817505426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:09:32.619532 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-34510e99-4c28-41e6-b03e-dbbc79248a29 tempest-VolumesBackupsTest-1817505426 None] Flow 'volume_create_manager' (c0ec225a-b1cc-42b3-b53b-2e7fa949e3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:09:32.628705 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-34510e99-4c28-41e6-b03e-dbbc79248a29 tempest-VolumesBackupsTest-1817505426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9d85ac3-1716-4296-8d31-e0eca8935595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:09:32.650546 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-34510e99-4c28-41e6-b03e-dbbc79248a29 tempest-VolumesBackupsTest-1817505426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9d85ac3-1716-4296-8d31-e0eca8935595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:09:32Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_e44184b1-0f9f-4e9c-a865-dd57d2a803d0',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9014cf04-9841-4a31-911d-9904ead789e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2bec96bf83d4fb296cbb8aeb28d576e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:09:32Z,use_quota=True,user_id='38e6d754538146aea01b0f51c8e2cc2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:09:32.657637 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-34510e99-4c28-41e6-b03e-dbbc79248a29 tempest-VolumesBackupsTest-1817505426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (629919e1-1f43-4e3b-bfa0-246476de7a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:09:32.665065 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-34510e99-4c28-41e6-b03e-dbbc79248a29 tempest-VolumesBackupsTest-1817505426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (629919e1-1f43-4e3b-bfa0-246476de7a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:09:32.672151 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-34510e99-4c28-41e6-b03e-dbbc79248a29 tempest-VolumesBackupsTest-1817505426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (488061d9-5ff9-47e5-968e-e48e53fec698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:09:32.678442 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-34510e99-4c28-41e6-b03e-dbbc79248a29 tempest-VolumesBackupsTest-1817505426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (488061d9-5ff9-47e5-968e-e48e53fec698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9014cf04-9841-4a31-911d-9904ead789e7', 'volume_name': 'volume-9014cf04-9841-4a31-911d-9904ead789e7', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:09:32.687278 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-34510e99-4c28-41e6-b03e-dbbc79248a29 tempest-VolumesBackupsTest-1817505426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee05e7da-0384-4698-97c4-7dfb1255a0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:09:32.693162 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-34510e99-4c28-41e6-b03e-dbbc79248a29 tempest-VolumesBackupsTest-1817505426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee05e7da-0384-4698-97c4-7dfb1255a0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:09:32.700166 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-34510e99-4c28-41e6-b03e-dbbc79248a29 tempest-VolumesBackupsTest-1817505426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3348144c-6416-4193-9826-6cce4013f7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:09:32.701723 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-34510e99-4c28-41e6-b03e-dbbc79248a29 tempest-VolumesBackupsTest-1817505426 None] Volume 9014cf04-9841-4a31-911d-9904ead789e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9014cf04-9841-4a31-911d-9904ead789e7', 'volume_size': 1} May 07 22:09:32.702544 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-34510e99-4c28-41e6-b03e-dbbc79248a29 tempest-VolumesBackupsTest-1817505426 None] creating volume 'volume-9014cf04-9841-4a31-911d-9904ead789e7' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:09:32.703747 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-34510e99-4c28-41e6-b03e-dbbc79248a29 tempest-VolumesBackupsTest-1817505426 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:09:32.835796 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-34510e99-4c28-41e6-b03e-dbbc79248a29 tempest-VolumesBackupsTest-1817505426 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:09:32.837961 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-34510e99-4c28-41e6-b03e-dbbc79248a29 tempest-VolumesBackupsTest-1817505426 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:09:32.844623 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-34510e99-4c28-41e6-b03e-dbbc79248a29 tempest-VolumesBackupsTest-1817505426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3348144c-6416-4193-9826-6cce4013f7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9014cf04-9841-4a31-911d-9904ead789e7', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:09:32.863759 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-34510e99-4c28-41e6-b03e-dbbc79248a29 tempest-VolumesBackupsTest-1817505426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6826160b-9d80-4782-a83e-78065647c701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:09:32.875748 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-34510e99-4c28-41e6-b03e-dbbc79248a29 tempest-VolumesBackupsTest-1817505426 None] Volume volume-9014cf04-9841-4a31-911d-9904ead789e7 (9014cf04-9841-4a31-911d-9904ead789e7): created successfully May 07 22:09:32.881763 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-34510e99-4c28-41e6-b03e-dbbc79248a29 tempest-VolumesBackupsTest-1817505426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6826160b-9d80-4782-a83e-78065647c701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:09:32.890781 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-34510e99-4c28-41e6-b03e-dbbc79248a29 tempest-VolumesBackupsTest-1817505426 None] Flow 'volume_create_manager' (c0ec225a-b1cc-42b3-b53b-2e7fa949e3e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:09:32.907977 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-34510e99-4c28-41e6-b03e-dbbc79248a29 tempest-VolumesBackupsTest-1817505426 None] Created volume successfully. May 07 22:09:33.770581 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [None req-34510e99-4c28-41e6-b03e-dbbc79248a29 tempest-VolumesBackupsTest-1817505426 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 22:09:34.952486 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [None req-34510e99-4c28-41e6-b03e-dbbc79248a29 tempest-VolumesBackupsTest-1817505426 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.182s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 22:09:34.953616 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-34510e99-4c28-41e6-b03e-dbbc79248a29 tempest-VolumesBackupsTest-1817505426 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9014cf04-9841-4a31-911d-9904ead789e7', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3ca0b836-1cfe-436a-b0fa-deb74d3203d9', 'volume_id': '9014cf04-9841-4a31-911d-9904ead789e7', 'discard': True}} {{(pid=129946) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 07 22:09:34.990813 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-34510e99-4c28-41e6-b03e-dbbc79248a29 tempest-VolumesBackupsTest-1817505426 None] Initialize volume connection completed successfully. May 07 22:09:43.061981 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-34510e99-4c28-41e6-b03e-dbbc79248a29 tempest-VolumesBackupsTest-1817505426 None] Terminate volume connection completed successfully. May 07 22:09:43.100434 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-34510e99-4c28-41e6-b03e-dbbc79248a29 tempest-VolumesBackupsTest-1817505426 None] Remove volume export completed successfully. May 07 22:09:44.369112 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-6f2d6550-5afc-4ca7-ace4-45107a045614 tempest-VolumesBackupsTest-1817505426 None] Lock "b'cinder-9014cf04-9841-4a31-911d-9904ead789e7-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:09:44.456406 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-6f2d6550-5afc-4ca7-ace4-45107a045614 tempest-VolumesBackupsTest-1817505426 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:09:45.647516 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-6f2d6550-5afc-4ca7-ace4-45107a045614 tempest-VolumesBackupsTest-1817505426 None] Volume volume-9014cf04-9841-4a31-911d-9904ead789e7 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:09:45.677824 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-6f2d6550-5afc-4ca7-ace4-45107a045614 tempest-VolumesBackupsTest-1817505426 None] deleting rbd volume volume-9014cf04-9841-4a31-911d-9904ead789e7 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:09:46.044470 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-e7ff2ecd-1d77-44cf-973d-40b1adc0d04e tempest-VolumesSnapshotTestJSON-1726756463 None] Created reservations ['eb99f4a1-2da1-410b-95af-ae9225a674a4', '7a62bb8b-47ae-41be-9f76-e3e4785d2a4c', 'fc3c42af-bc4e-49d2-b77e-86adbfe082c4', '70c5a401-828f-4e6b-88bb-71fb2144354a'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:09:46.121222 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-e7ff2ecd-1d77-44cf-973d-40b1adc0d04e tempest-VolumesSnapshotTestJSON-1726756463 None] Delete snapshot completed successfully. May 07 22:09:46.129739 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-e7ff2ecd-1d77-44cf-973d-40b1adc0d04e tempest-VolumesSnapshotTestJSON-1726756463 None] Lock "b'cinder-fa8403c2-2455-4ba0-bfc8-358c41a64270-delete_snapshot'" released by "delete_snapshot" :: held 30.497s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:09:46.937051 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-6f2d6550-5afc-4ca7-ace4-45107a045614 tempest-VolumesBackupsTest-1817505426 None] Created reservations ['653a9f90-ba37-4f32-8c2d-a1fd858323ad', 'a01b065e-6b23-414e-bd73-417648266a51', '1d8d7fb5-0c56-4440-adb7-ee65d1c5ee88', '9fe84658-4a26-4dec-bf76-2aa8cf66b1d1'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:09:47.047016 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-0fbc2d10-d523-4ca1-9e04-cfb50f958f56 tempest-VolumesSnapshotTestJSON-1726756463 None] Lock "b'cinder-2ca69f11-a625-4269-9296-8db4b3183df1-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.026s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:09:47.049700 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0fbc2d10-d523-4ca1-9e04-cfb50f958f56 tempest-VolumesSnapshotTestJSON-1726756463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:09:47.215520 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-6f2d6550-5afc-4ca7-ace4-45107a045614 tempest-VolumesBackupsTest-1817505426 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:09:47.285014 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-6f2d6550-5afc-4ca7-ace4-45107a045614 tempest-VolumesBackupsTest-1817505426 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:09:47.350522 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-6f2d6550-5afc-4ca7-ace4-45107a045614 tempest-VolumesBackupsTest-1817505426 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:09:47.362102 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-6f2d6550-5afc-4ca7-ace4-45107a045614 tempest-VolumesBackupsTest-1817505426 None] Deleted volume successfully. May 07 22:09:47.393345 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-6f2d6550-5afc-4ca7-ace4-45107a045614 tempest-VolumesBackupsTest-1817505426 None] Lock "b'cinder-9014cf04-9841-4a31-911d-9904ead789e7-delete_volume'" released by "delete_volume" :: held 3.024s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:09:51.176112 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-0546b5ea-39f7-4fc9-b569-d01b1cd4beca tempest-VolumesBackupsTest-1817505426 None] Lock "b'cinder-ee967edb-ea50-423b-8d88-03897f067e75-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:09:51.252740 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0546b5ea-39f7-4fc9-b569-d01b1cd4beca tempest-VolumesBackupsTest-1817505426 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:09:51.867179 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0546b5ea-39f7-4fc9-b569-d01b1cd4beca tempest-VolumesBackupsTest-1817505426 None] deleting rbd volume volume-ee967edb-ea50-423b-8d88-03897f067e75 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:09:52.387267 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0546b5ea-39f7-4fc9-b569-d01b1cd4beca tempest-VolumesBackupsTest-1817505426 None] volume is a clone so cleaning references {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} May 07 22:09:52.451534 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0546b5ea-39f7-4fc9-b569-d01b1cd4beca tempest-VolumesBackupsTest-1817505426 None] deleting parent snapshot volume-ee967edb-ea50-423b-8d88-03897f067e75.clone_snap {{(pid=129946) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} May 07 22:09:52.902023 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-0546b5ea-39f7-4fc9-b569-d01b1cd4beca tempest-VolumesBackupsTest-1817505426 None] Created reservations ['8b7b397c-893e-4c6b-b858-abee9c9caba9', '7814c73e-21f2-4253-aabb-f91984248885', '7e17bcec-6dd8-45d0-9414-4768f3eed2b5', '256ca484-2c4c-4602-9b03-cb6dbce8abdd'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:09:53.015989 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0546b5ea-39f7-4fc9-b569-d01b1cd4beca tempest-VolumesBackupsTest-1817505426 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:09:53.105520 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0546b5ea-39f7-4fc9-b569-d01b1cd4beca tempest-VolumesBackupsTest-1817505426 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:09:53.184553 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-0546b5ea-39f7-4fc9-b569-d01b1cd4beca tempest-VolumesBackupsTest-1817505426 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:09:53.188809 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-0546b5ea-39f7-4fc9-b569-d01b1cd4beca tempest-VolumesBackupsTest-1817505426 None] Deleted volume successfully. May 07 22:09:53.217013 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-0546b5ea-39f7-4fc9-b569-d01b1cd4beca tempest-VolumesBackupsTest-1817505426 None] Lock "b'cinder-ee967edb-ea50-423b-8d88-03897f067e75-delete_volume'" released by "delete_volume" :: held 2.041s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:09:56.937881 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-93230b11-a15f-4889-a017-ac80d714bfee tempest-VolumesBackupsV39Test-412393331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:09:56.972349 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-93230b11-a15f-4889-a017-ac80d714bfee tempest-VolumesBackupsV39Test-412393331 None] Flow 'volume_create_manager' (649c0a24-88df-4d22-b2ce-d34853abcf7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:09:56.980293 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-93230b11-a15f-4889-a017-ac80d714bfee tempest-VolumesBackupsV39Test-412393331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b32f26fe-4b00-4cbd-a78b-ae6a0917d37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:09:56.999971 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-93230b11-a15f-4889-a017-ac80d714bfee tempest-VolumesBackupsV39Test-412393331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b32f26fe-4b00-4cbd-a78b-ae6a0917d37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Volume-1381579413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2f787811-5f92-4037-af1b-c30ab8a36498,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='270c72ab746a472d9bc29941c34f86e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:09:57Z,use_quota=True,user_id='579aa8931a494de8bd0c337d020421d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:09:57.005881 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-93230b11-a15f-4889-a017-ac80d714bfee tempest-VolumesBackupsV39Test-412393331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92f1e9ab-5aee-4168-9b4f-b80044df9009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:09:57.010430 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-93230b11-a15f-4889-a017-ac80d714bfee tempest-VolumesBackupsV39Test-412393331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92f1e9ab-5aee-4168-9b4f-b80044df9009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:09:57.016200 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-93230b11-a15f-4889-a017-ac80d714bfee tempest-VolumesBackupsV39Test-412393331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62c3f9ac-27b9-4660-b70b-2a18690db4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:09:57.021004 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-93230b11-a15f-4889-a017-ac80d714bfee tempest-VolumesBackupsV39Test-412393331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62c3f9ac-27b9-4660-b70b-2a18690db4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f787811-5f92-4037-af1b-c30ab8a36498', 'volume_name': 'volume-2f787811-5f92-4037-af1b-c30ab8a36498', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:09:57.028886 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-93230b11-a15f-4889-a017-ac80d714bfee tempest-VolumesBackupsV39Test-412393331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0ca6587-c07f-4c94-9154-2c58ed4d084d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:09:57.034486 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-93230b11-a15f-4889-a017-ac80d714bfee tempest-VolumesBackupsV39Test-412393331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0ca6587-c07f-4c94-9154-2c58ed4d084d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:09:57.042538 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-93230b11-a15f-4889-a017-ac80d714bfee tempest-VolumesBackupsV39Test-412393331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f95461a6-f3c1-4dde-b61e-429f86dc38ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:09:57.044500 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-93230b11-a15f-4889-a017-ac80d714bfee tempest-VolumesBackupsV39Test-412393331 None] Volume 2f787811-5f92-4037-af1b-c30ab8a36498: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f787811-5f92-4037-af1b-c30ab8a36498', 'volume_size': 1} May 07 22:09:57.045284 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-93230b11-a15f-4889-a017-ac80d714bfee tempest-VolumesBackupsV39Test-412393331 None] creating volume 'volume-2f787811-5f92-4037-af1b-c30ab8a36498' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:09:57.046407 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-93230b11-a15f-4889-a017-ac80d714bfee tempest-VolumesBackupsV39Test-412393331 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:09:57.167711 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-93230b11-a15f-4889-a017-ac80d714bfee tempest-VolumesBackupsV39Test-412393331 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:09:57.168525 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-93230b11-a15f-4889-a017-ac80d714bfee tempest-VolumesBackupsV39Test-412393331 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:09:57.173997 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-93230b11-a15f-4889-a017-ac80d714bfee tempest-VolumesBackupsV39Test-412393331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f95461a6-f3c1-4dde-b61e-429f86dc38ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f787811-5f92-4037-af1b-c30ab8a36498', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:09:57.181814 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-93230b11-a15f-4889-a017-ac80d714bfee tempest-VolumesBackupsV39Test-412393331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d190bac-820f-4fe3-a153-9e83a373cbf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:09:57.193550 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-93230b11-a15f-4889-a017-ac80d714bfee tempest-VolumesBackupsV39Test-412393331 None] Volume volume-2f787811-5f92-4037-af1b-c30ab8a36498 (2f787811-5f92-4037-af1b-c30ab8a36498): created successfully May 07 22:09:57.199106 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-93230b11-a15f-4889-a017-ac80d714bfee tempest-VolumesBackupsV39Test-412393331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d190bac-820f-4fe3-a153-9e83a373cbf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:09:57.206695 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-93230b11-a15f-4889-a017-ac80d714bfee tempest-VolumesBackupsV39Test-412393331 None] Flow 'volume_create_manager' (649c0a24-88df-4d22-b2ce-d34853abcf7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:09:57.233040 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-93230b11-a15f-4889-a017-ac80d714bfee tempest-VolumesBackupsV39Test-412393331 None] Created volume successfully. May 07 22:09:58.320350 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-3e7dc908-41e3-4719-8be4-fd8085df7d99 tempest-VolumesBackupsV39Test-412393331 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-05-07T22:09:58Z,data_timestamp=2022-05-07T22:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Backup-1738268498',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=bf1ec83c-ae3f-4463-8ab5-0a650aa070b0,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='270c72ab746a472d9bc29941c34f86e5',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='579aa8931a494de8bd0c337d020421d2',volume_id=2f787811-5f92-4037-af1b-c30ab8a36498) May 07 22:09:58.329354 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.backup.rpcapi [None req-3e7dc908-41e3-4719-8be4-fd8085df7d99 tempest-VolumesBackupsV39Test-412393331 None] continue_backup in rpcapi backup_id bf1ec83c-ae3f-4463-8ab5-0a650aa070b0 {{(pid=129946) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} May 07 22:09:58.689355 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [None req-3e7dc908-41e3-4719-8be4-fd8085df7d99 tempest-VolumesBackupsV39Test-412393331 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 22:09:59.669565 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [None req-3e7dc908-41e3-4719-8be4-fd8085df7d99 tempest-VolumesBackupsV39Test-412393331 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.980s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 22:09:59.671142 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-3e7dc908-41e3-4719-8be4-fd8085df7d99 tempest-VolumesBackupsV39Test-412393331 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2f787811-5f92-4037-af1b-c30ab8a36498', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3ca0b836-1cfe-436a-b0fa-deb74d3203d9', 'volume_id': '2f787811-5f92-4037-af1b-c30ab8a36498', 'discard': True}} {{(pid=129946) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 07 22:09:59.699367 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-3e7dc908-41e3-4719-8be4-fd8085df7d99 tempest-VolumesBackupsV39Test-412393331 None] Initialize volume connection completed successfully. May 07 22:10:02.105396 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-3e7dc908-41e3-4719-8be4-fd8085df7d99 tempest-VolumesBackupsV39Test-412393331 None] Terminate volume connection completed successfully. May 07 22:10:02.207627 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-3e7dc908-41e3-4719-8be4-fd8085df7d99 tempest-VolumesBackupsV39Test-412393331 None] Remove volume export completed successfully. May 07 22:10:04.998792 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-0500af1f-c16d-41ed-9d6b-e34fe0c764db tempest-VolumesBackupsV39Test-412393331 None] Lock "b'cinder-2f787811-5f92-4037-af1b-c30ab8a36498-delete_volume'" acquired by "delete_volume" :: waited 0.026s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:10:05.057502 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0500af1f-c16d-41ed-9d6b-e34fe0c764db tempest-VolumesBackupsV39Test-412393331 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:10:05.843117 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0500af1f-c16d-41ed-9d6b-e34fe0c764db tempest-VolumesBackupsV39Test-412393331 None] Volume volume-2f787811-5f92-4037-af1b-c30ab8a36498 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:10:05.865065 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0500af1f-c16d-41ed-9d6b-e34fe0c764db tempest-VolumesBackupsV39Test-412393331 None] deleting rbd volume volume-2f787811-5f92-4037-af1b-c30ab8a36498 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:10:06.408226 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-0500af1f-c16d-41ed-9d6b-e34fe0c764db tempest-VolumesBackupsV39Test-412393331 None] Created reservations ['019013fe-27e8-4b4b-8b01-be343d9e1a8f', '6577464c-f6ea-43c6-980b-14ab20f0a56d', 'd4e6ce1d-9e25-4e9f-a584-90a2fcdb48e6', '9eeba8a9-3fbf-41f5-a170-9bd278c34336'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:10:06.488790 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0500af1f-c16d-41ed-9d6b-e34fe0c764db tempest-VolumesBackupsV39Test-412393331 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:10:06.534342 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0500af1f-c16d-41ed-9d6b-e34fe0c764db tempest-VolumesBackupsV39Test-412393331 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:10:06.595647 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-0500af1f-c16d-41ed-9d6b-e34fe0c764db tempest-VolumesBackupsV39Test-412393331 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:10:06.606998 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-0500af1f-c16d-41ed-9d6b-e34fe0c764db tempest-VolumesBackupsV39Test-412393331 None] Deleted volume successfully. May 07 22:10:06.623026 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-0500af1f-c16d-41ed-9d6b-e34fe0c764db tempest-VolumesBackupsV39Test-412393331 None] Lock "b'cinder-2f787811-5f92-4037-af1b-c30ab8a36498-delete_volume'" released by "delete_volume" :: held 1.624s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:10:12.098522 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-63155943-f465-4ec1-9015-e4bc1a8bfdeb tempest-VolumesSnapshotNegativeTestJSON-1258195487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:10:12.149517 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-63155943-f465-4ec1-9015-e4bc1a8bfdeb tempest-VolumesSnapshotNegativeTestJSON-1258195487 None] Flow 'volume_create_manager' (6adf5886-1192-4055-9515-6532559b8a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:10:12.158960 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-63155943-f465-4ec1-9015-e4bc1a8bfdeb tempest-VolumesSnapshotNegativeTestJSON-1258195487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a07ea0a-09b9-4f75-a1da-57f7572fd50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:10:12.198607 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-63155943-f465-4ec1-9015-e4bc1a8bfdeb tempest-VolumesSnapshotNegativeTestJSON-1258195487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a07ea0a-09b9-4f75-a1da-57f7572fd50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1278529319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a9196093-62ce-4171-965b-32398f47e3ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11a7b67ca3b142f09ff7699978984298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:10:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:10:12Z,use_quota=True,user_id='8b7de7ee67b04fa085d425d16299bef5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:10:12.227272 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-63155943-f465-4ec1-9015-e4bc1a8bfdeb tempest-VolumesSnapshotNegativeTestJSON-1258195487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e53e12d1-9a18-4d21-b751-1842cfee124d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:10:12.234204 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-63155943-f465-4ec1-9015-e4bc1a8bfdeb tempest-VolumesSnapshotNegativeTestJSON-1258195487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e53e12d1-9a18-4d21-b751-1842cfee124d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:10:12.255934 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-63155943-f465-4ec1-9015-e4bc1a8bfdeb tempest-VolumesSnapshotNegativeTestJSON-1258195487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a3ee676-6934-4463-a61a-76a6f1b2ebe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:10:12.266754 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-63155943-f465-4ec1-9015-e4bc1a8bfdeb tempest-VolumesSnapshotNegativeTestJSON-1258195487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a3ee676-6934-4463-a61a-76a6f1b2ebe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9196093-62ce-4171-965b-32398f47e3ac', 'volume_name': 'volume-a9196093-62ce-4171-965b-32398f47e3ac', 'volume_size': 2}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:10:12.294345 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-63155943-f465-4ec1-9015-e4bc1a8bfdeb tempest-VolumesSnapshotNegativeTestJSON-1258195487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (419ba3dd-6531-4357-9f50-bb6b0aabc3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:10:12.316071 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-63155943-f465-4ec1-9015-e4bc1a8bfdeb tempest-VolumesSnapshotNegativeTestJSON-1258195487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (419ba3dd-6531-4357-9f50-bb6b0aabc3d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:10:12.326991 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-63155943-f465-4ec1-9015-e4bc1a8bfdeb tempest-VolumesSnapshotNegativeTestJSON-1258195487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e79c28cf-760f-4338-9ee6-651c6dbf79ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:10:12.330291 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-63155943-f465-4ec1-9015-e4bc1a8bfdeb tempest-VolumesSnapshotNegativeTestJSON-1258195487 None] Volume a9196093-62ce-4171-965b-32398f47e3ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9196093-62ce-4171-965b-32398f47e3ac', 'volume_size': 2} May 07 22:10:12.331234 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-63155943-f465-4ec1-9015-e4bc1a8bfdeb tempest-VolumesSnapshotNegativeTestJSON-1258195487 None] creating volume 'volume-a9196093-62ce-4171-965b-32398f47e3ac' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:10:12.333954 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-63155943-f465-4ec1-9015-e4bc1a8bfdeb tempest-VolumesSnapshotNegativeTestJSON-1258195487 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:10:12.549787 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-63155943-f465-4ec1-9015-e4bc1a8bfdeb tempest-VolumesSnapshotNegativeTestJSON-1258195487 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:10:12.550563 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-63155943-f465-4ec1-9015-e4bc1a8bfdeb tempest-VolumesSnapshotNegativeTestJSON-1258195487 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:10:12.556003 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-63155943-f465-4ec1-9015-e4bc1a8bfdeb tempest-VolumesSnapshotNegativeTestJSON-1258195487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e79c28cf-760f-4338-9ee6-651c6dbf79ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9196093-62ce-4171-965b-32398f47e3ac', 'volume_size': 2}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:10:12.570591 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-63155943-f465-4ec1-9015-e4bc1a8bfdeb tempest-VolumesSnapshotNegativeTestJSON-1258195487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da113f65-df5f-467f-bc35-649097955d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:10:12.615196 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-63155943-f465-4ec1-9015-e4bc1a8bfdeb tempest-VolumesSnapshotNegativeTestJSON-1258195487 None] Volume volume-a9196093-62ce-4171-965b-32398f47e3ac (a9196093-62ce-4171-965b-32398f47e3ac): created successfully May 07 22:10:12.621517 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-63155943-f465-4ec1-9015-e4bc1a8bfdeb tempest-VolumesSnapshotNegativeTestJSON-1258195487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da113f65-df5f-467f-bc35-649097955d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:10:12.638105 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-63155943-f465-4ec1-9015-e4bc1a8bfdeb tempest-VolumesSnapshotNegativeTestJSON-1258195487 None] Flow 'volume_create_manager' (6adf5886-1192-4055-9515-6532559b8a45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:10:12.671184 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-63155943-f465-4ec1-9015-e4bc1a8bfdeb tempest-VolumesSnapshotNegativeTestJSON-1258195487 None] Created volume successfully. May 07 22:10:13.527718 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-360a3c82-6cd2-486f-bdf0-f2e26c27e4bd tempest-VolumesSnapshotNegativeTestJSON-1258195487 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:10:14.877357 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-360a3c82-6cd2-486f-bdf0-f2e26c27e4bd tempest-VolumesSnapshotNegativeTestJSON-1258195487 None] Create snapshot completed successfully May 07 22:10:15.812583 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-7f5aef33-f446-4773-8fc3-27906f617d6c tempest-VolumesSnapshotNegativeTestJSON-1258195487 None] Lock "b'cinder-83c25257-80df-4e9c-bdf8-0be140627a93-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:10:15.815707 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-7f5aef33-f446-4773-8fc3-27906f617d6c tempest-VolumesSnapshotNegativeTestJSON-1258195487 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:10:16.988775 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-7f5aef33-f446-4773-8fc3-27906f617d6c tempest-VolumesSnapshotNegativeTestJSON-1258195487 None] Created reservations ['e1d1eec0-f414-45c2-ac9a-c5cac045f5db', '69bcff38-d567-4727-aab1-14e777b5ee27', '51c6a91c-67b6-4ff6-8f36-beccc294adcc', '1a96768e-34b1-4481-993a-99811091a31e'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:10:17.106113 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-7f5aef33-f446-4773-8fc3-27906f617d6c tempest-VolumesSnapshotNegativeTestJSON-1258195487 None] Delete snapshot completed successfully. May 07 22:10:17.113479 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-7f5aef33-f446-4773-8fc3-27906f617d6c tempest-VolumesSnapshotNegativeTestJSON-1258195487 None] Lock "b'cinder-83c25257-80df-4e9c-bdf8-0be140627a93-delete_snapshot'" released by "delete_snapshot" :: held 1.301s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:10:17.553068 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-0fbc2d10-d523-4ca1-9e04-cfb50f958f56 tempest-VolumesSnapshotTestJSON-1726756463 None] Created reservations ['21aea828-74fd-4956-a01b-c4bf63412f44', 'd6326ea0-9c6e-4607-b832-bf228f9dea90', '07551846-8d16-4315-bfd1-e9607886d88d', '55c5e63f-1042-459e-9745-18eb72cf745b'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:10:17.651039 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-0fbc2d10-d523-4ca1-9e04-cfb50f958f56 tempest-VolumesSnapshotTestJSON-1726756463 None] Delete snapshot completed successfully. May 07 22:10:17.658230 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-0fbc2d10-d523-4ca1-9e04-cfb50f958f56 tempest-VolumesSnapshotTestJSON-1726756463 None] Lock "b'cinder-2ca69f11-a625-4269-9296-8db4b3183df1-delete_snapshot'" released by "delete_snapshot" :: held 30.611s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:10:17.840666 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-86ea4032-7823-4318-9e70-39e77fceaa59 tempest-VolumesSnapshotTestJSON-1726756463 None] Lock "b'cinder-679a0fc0-e910-4dcd-b53c-8367193219eb-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.015s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:10:17.840666 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-86ea4032-7823-4318-9e70-39e77fceaa59 tempest-VolumesSnapshotTestJSON-1726756463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:10:18.082812 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-44b97252-8e7c-4ce3-8119-e620f5898096 tempest-VolumesSnapshotNegativeTestJSON-1258195487 None] Lock "b'cinder-a9196093-62ce-4171-965b-32398f47e3ac-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:10:18.150870 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-44b97252-8e7c-4ce3-8119-e620f5898096 tempest-VolumesSnapshotNegativeTestJSON-1258195487 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:10:18.275105 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-44b97252-8e7c-4ce3-8119-e620f5898096 tempest-VolumesSnapshotNegativeTestJSON-1258195487 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:10:18.275809 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-44b97252-8e7c-4ce3-8119-e620f5898096 tempest-VolumesSnapshotNegativeTestJSON-1258195487 None] Volume volume-a9196093-62ce-4171-965b-32398f47e3ac is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:10:18.291594 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-44b97252-8e7c-4ce3-8119-e620f5898096 tempest-VolumesSnapshotNegativeTestJSON-1258195487 None] deleting rbd volume volume-a9196093-62ce-4171-965b-32398f47e3ac {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:10:18.877929 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-44b97252-8e7c-4ce3-8119-e620f5898096 tempest-VolumesSnapshotNegativeTestJSON-1258195487 None] Created reservations ['638c9312-d6f5-48c8-97c0-ca31fcc3aacf', '98eaee1a-c878-41e7-b1a1-5b99759df70c', 'cf7a3509-a016-4673-9792-f93c977e0be7', '9302e62f-4397-4eeb-a0d0-48da9640beb8'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:10:18.989484 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-44b97252-8e7c-4ce3-8119-e620f5898096 tempest-VolumesSnapshotNegativeTestJSON-1258195487 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:10:19.099726 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-44b97252-8e7c-4ce3-8119-e620f5898096 tempest-VolumesSnapshotNegativeTestJSON-1258195487 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:10:19.209712 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-44b97252-8e7c-4ce3-8119-e620f5898096 tempest-VolumesSnapshotNegativeTestJSON-1258195487 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:10:19.223815 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-44b97252-8e7c-4ce3-8119-e620f5898096 tempest-VolumesSnapshotNegativeTestJSON-1258195487 None] Deleted volume successfully. May 07 22:10:19.248916 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-44b97252-8e7c-4ce3-8119-e620f5898096 tempest-VolumesSnapshotNegativeTestJSON-1258195487 None] Lock "b'cinder-a9196093-62ce-4171-965b-32398f47e3ac-delete_volume'" released by "delete_volume" :: held 1.166s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:10:20.904237 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-bad5c5ca-cc5e-41d2-9f8b-061864975856 tempest-TestVolumeBackupRestore-1882080688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:10:20.932722 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-bad5c5ca-cc5e-41d2-9f8b-061864975856 tempest-TestVolumeBackupRestore-1882080688 None] Flow 'volume_create_manager' (5b8c2f6b-26aa-4936-ae90-bc564c7ceb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:10:20.940965 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-bad5c5ca-cc5e-41d2-9f8b-061864975856 tempest-TestVolumeBackupRestore-1882080688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac92a60a-90ad-49b9-b46e-7d2f903627f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:10:20.967549 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-bad5c5ca-cc5e-41d2-9f8b-061864975856 tempest-TestVolumeBackupRestore-1882080688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac92a60a-90ad-49b9-b46e-7d2f903627f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-volume-1808413879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=96b33d38-3791-4ff9-9b96-17fce364b1fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d70782066cce4f2fbf5744b63e4195cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:10:21Z,use_quota=True,user_id='4f4cbf51481d45de862752fe273dceda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:10:20.974442 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-bad5c5ca-cc5e-41d2-9f8b-061864975856 tempest-TestVolumeBackupRestore-1882080688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afe406b5-499a-45f3-abe5-f246d14610c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:10:20.979983 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-bad5c5ca-cc5e-41d2-9f8b-061864975856 tempest-TestVolumeBackupRestore-1882080688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afe406b5-499a-45f3-abe5-f246d14610c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:10:20.987948 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-bad5c5ca-cc5e-41d2-9f8b-061864975856 tempest-TestVolumeBackupRestore-1882080688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8ad79d9-f04d-4a34-b6f8-96bb3cb678f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:10:21.156073 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-bad5c5ca-cc5e-41d2-9f8b-061864975856 tempest-TestVolumeBackupRestore-1882080688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8ad79d9-f04d-4a34-b6f8-96bb3cb678f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '96b33d38-3791-4ff9-9b96-17fce364b1fb', 'volume_name': 'volume-96b33d38-3791-4ff9-9b96-17fce364b1fb', 'volume_size': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e2f828af0706465883131e16cb564d05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'created_at': datetime.datetime(2022, 5, 7, 21, 36, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:10:21.177239 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-bad5c5ca-cc5e-41d2-9f8b-061864975856 tempest-TestVolumeBackupRestore-1882080688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (240bff8a-da74-4750-8e0c-30ef0c368898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:10:21.186968 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-bad5c5ca-cc5e-41d2-9f8b-061864975856 tempest-TestVolumeBackupRestore-1882080688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (240bff8a-da74-4750-8e0c-30ef0c368898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:10:21.192645 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-bad5c5ca-cc5e-41d2-9f8b-061864975856 tempest-TestVolumeBackupRestore-1882080688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c2824de-6a5c-4d4e-bf02-02a80f4e1806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:10:21.197457 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-bad5c5ca-cc5e-41d2-9f8b-061864975856 tempest-TestVolumeBackupRestore-1882080688 None] Volume 96b33d38-3791-4ff9-9b96-17fce364b1fb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-96b33d38-3791-4ff9-9b96-17fce364b1fb', 'volume_size': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e2f828af0706465883131e16cb564d05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'created_at': datetime.datetime(2022, 5, 7, 21, 36, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } May 07 22:10:21.198360 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-bad5c5ca-cc5e-41d2-9f8b-061864975856 tempest-TestVolumeBackupRestore-1882080688 None] Cloning 96b33d38-3791-4ff9-9b96-17fce364b1fb from image 3756ae98-5c12-48e7-920e-ef5d1dd5543c at location (None, None). {{(pid=129946) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} May 07 22:10:21.226076 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-bad5c5ca-cc5e-41d2-9f8b-061864975856 tempest-TestVolumeBackupRestore-1882080688 None] Lock "b'cinder-3756ae98-5c12-48e7-920e-ef5d1dd5543c'" acquired by "_prepare_image_cache_entry" :: waited 0.025s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:10:21.262837 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-bad5c5ca-cc5e-41d2-9f8b-061864975856 tempest-TestVolumeBackupRestore-1882080688 None] Found image-volume cache entry: {'id': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'volume_id': '82279f40-9683-441f-a541-0db8b9177f48', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9), 'last_used': datetime.datetime(2022, 5, 7, 22, 10, 21, 241662)}. {{(pid=129946) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 07 22:10:21.264828 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-bad5c5ca-cc5e-41d2-9f8b-061864975856 tempest-TestVolumeBackupRestore-1882080688 None] Image-volume cache entry image_update_at = 2022-05-07 21:37:09+00:00, requested image updated_at = 2022-05-07 21:37:09+00:00. {{(pid=129946) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 07 22:10:21.281587 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-bad5c5ca-cc5e-41d2-9f8b-061864975856 tempest-TestVolumeBackupRestore-1882080688 None] Found cache entry for image = 3756ae98-5c12-48e7-920e-ef5d1dd5543c on host ncdv-master-1@ceph#ceph. {{(pid=129946) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} May 07 22:10:21.299622 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-bad5c5ca-cc5e-41d2-9f8b-061864975856 tempest-TestVolumeBackupRestore-1882080688 None] Lock "b'cinder-3756ae98-5c12-48e7-920e-ef5d1dd5543c'" released by "_prepare_image_cache_entry" :: held 0.073s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:10:21.302736 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-bad5c5ca-cc5e-41d2-9f8b-061864975856 tempest-TestVolumeBackupRestore-1882080688 None] Attempting to retrieve cache entry for image = 3756ae98-5c12-48e7-920e-ef5d1dd5543c on host ncdv-master-1@ceph#ceph. {{(pid=129946) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} May 07 22:10:21.317785 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-bad5c5ca-cc5e-41d2-9f8b-061864975856 tempest-TestVolumeBackupRestore-1882080688 None] Found image-volume cache entry: {'id': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'volume_id': '82279f40-9683-441f-a541-0db8b9177f48', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9), 'last_used': datetime.datetime(2022, 5, 7, 22, 10, 21, 310974)}. {{(pid=129946) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 07 22:10:21.320007 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-bad5c5ca-cc5e-41d2-9f8b-061864975856 tempest-TestVolumeBackupRestore-1882080688 None] Image-volume cache entry image_update_at = 2022-05-07 21:37:09+00:00, requested image updated_at = 2022-05-07 21:37:09+00:00. {{(pid=129946) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 07 22:10:21.321246 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-bad5c5ca-cc5e-41d2-9f8b-061864975856 tempest-TestVolumeBackupRestore-1882080688 None] Creating from source image-volume 82279f40-9683-441f-a541-0db8b9177f48 {{(pid=129946) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} May 07 22:10:21.379245 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-bad5c5ca-cc5e-41d2-9f8b-061864975856 tempest-TestVolumeBackupRestore-1882080688 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:10:21.518061 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-bad5c5ca-cc5e-41d2-9f8b-061864975856 tempest-TestVolumeBackupRestore-1882080688 None] creating snapshot='volume-96b33d38-3791-4ff9-9b96-17fce364b1fb.clone_snap' {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} May 07 22:10:22.010344 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-bad5c5ca-cc5e-41d2-9f8b-061864975856 tempest-TestVolumeBackupRestore-1882080688 None] cloning 'volume-82279f40-9683-441f-a541-0db8b9177f48@volume-96b33d38-3791-4ff9-9b96-17fce364b1fb.clone_snap' to 'volume-96b33d38-3791-4ff9-9b96-17fce364b1fb' {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 07 22:10:22.285174 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-bad5c5ca-cc5e-41d2-9f8b-061864975856 tempest-TestVolumeBackupRestore-1882080688 None] Volume volume-3864f924-91b4-4015-ab37-8bdbf8ad652d.deleted is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:10:22.287307 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-bad5c5ca-cc5e-41d2-9f8b-061864975856 tempest-TestVolumeBackupRestore-1882080688 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:10:22.287928 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-bad5c5ca-cc5e-41d2-9f8b-061864975856 tempest-TestVolumeBackupRestore-1882080688 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:10:22.327476 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-bad5c5ca-cc5e-41d2-9f8b-061864975856 tempest-TestVolumeBackupRestore-1882080688 None] clone created successfully {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} May 07 22:10:22.328373 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.volume_utils [None req-bad5c5ca-cc5e-41d2-9f8b-061864975856 tempest-TestVolumeBackupRestore-1882080688 None] Marking volume 96b33d38-3791-4ff9-9b96-17fce364b1fb as bootable. {{(pid=129946) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} May 07 22:10:22.341237 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-bad5c5ca-cc5e-41d2-9f8b-061864975856 tempest-TestVolumeBackupRestore-1882080688 None] Copying metadata from image 3756ae98-5c12-48e7-920e-ef5d1dd5543c to 96b33d38-3791-4ff9-9b96-17fce364b1fb. {{(pid=129946) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} May 07 22:10:22.342018 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-bad5c5ca-cc5e-41d2-9f8b-061864975856 tempest-TestVolumeBackupRestore-1882080688 None] Creating volume glance metadata for volume 96b33d38-3791-4ff9-9b96-17fce364b1fb backed by image 3756ae98-5c12-48e7-920e-ef5d1dd5543c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129946) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} May 07 22:10:22.443618 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-bad5c5ca-cc5e-41d2-9f8b-061864975856 tempest-TestVolumeBackupRestore-1882080688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c2824de-6a5c-4d4e-bf02-02a80f4e1806) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96b33d38-3791-4ff9-9b96-17fce364b1fb', 'volume_size': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e2f828af0706465883131e16cb564d05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'created_at': datetime.datetime(2022, 5, 7, 21, 36, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:10:22.451846 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-bad5c5ca-cc5e-41d2-9f8b-061864975856 tempest-TestVolumeBackupRestore-1882080688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (713dfc72-a381-4589-b60e-dac57feaa095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:10:22.478476 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-bad5c5ca-cc5e-41d2-9f8b-061864975856 tempest-TestVolumeBackupRestore-1882080688 None] Volume volume-96b33d38-3791-4ff9-9b96-17fce364b1fb (96b33d38-3791-4ff9-9b96-17fce364b1fb): created successfully May 07 22:10:22.483003 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-bad5c5ca-cc5e-41d2-9f8b-061864975856 tempest-TestVolumeBackupRestore-1882080688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (713dfc72-a381-4589-b60e-dac57feaa095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:10:22.497305 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-bad5c5ca-cc5e-41d2-9f8b-061864975856 tempest-TestVolumeBackupRestore-1882080688 None] Flow 'volume_create_manager' (5b8c2f6b-26aa-4936-ae90-bc564c7ceb14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:10:22.526411 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-bad5c5ca-cc5e-41d2-9f8b-061864975856 tempest-TestVolumeBackupRestore-1882080688 None] Created volume successfully. May 07 22:10:23.468611 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-afe7c794-194b-407d-bfd8-2397956a0f4f tempest-TestVolumeBackupRestore-1882080688 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-05-07T22:10:23Z,data_timestamp=2022-05-07T22:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=7835d3b6-ffbb-47df-80ed-ab232cb47e0a,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='d70782066cce4f2fbf5744b63e4195cb',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='4f4cbf51481d45de862752fe273dceda',volume_id=96b33d38-3791-4ff9-9b96-17fce364b1fb) May 07 22:10:23.469379 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.backup.rpcapi [None req-afe7c794-194b-407d-bfd8-2397956a0f4f tempest-TestVolumeBackupRestore-1882080688 None] continue_backup in rpcapi backup_id 7835d3b6-ffbb-47df-80ed-ab232cb47e0a {{(pid=129946) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} May 07 22:10:23.771767 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [None req-afe7c794-194b-407d-bfd8-2397956a0f4f tempest-TestVolumeBackupRestore-1882080688 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 22:10:24.993616 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [None req-afe7c794-194b-407d-bfd8-2397956a0f4f tempest-TestVolumeBackupRestore-1882080688 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.221s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 22:10:24.994854 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-afe7c794-194b-407d-bfd8-2397956a0f4f tempest-TestVolumeBackupRestore-1882080688 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-96b33d38-3791-4ff9-9b96-17fce364b1fb', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3ca0b836-1cfe-436a-b0fa-deb74d3203d9', 'volume_id': '96b33d38-3791-4ff9-9b96-17fce364b1fb', 'discard': True}} {{(pid=129946) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 07 22:10:25.013466 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-afe7c794-194b-407d-bfd8-2397956a0f4f tempest-TestVolumeBackupRestore-1882080688 None] Initialize volume connection completed successfully. May 07 22:10:30.766878 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:10:30.769428 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:10:30.877429 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:10:31.002992 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:10:33.017611 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-afe7c794-194b-407d-bfd8-2397956a0f4f tempest-TestVolumeBackupRestore-1882080688 None] Terminate volume connection completed successfully. May 07 22:10:33.087775 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-afe7c794-194b-407d-bfd8-2397956a0f4f tempest-TestVolumeBackupRestore-1882080688 None] Remove volume export completed successfully. May 07 22:10:34.531918 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-544e87a9-e44d-4d0b-816e-fbeafd054123 tempest-TestVolumeBackupRestore-1882080688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:10:34.584963 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-544e87a9-e44d-4d0b-816e-fbeafd054123 tempest-TestVolumeBackupRestore-1882080688 None] Flow 'volume_create_manager' (2efbb129-845a-4e41-acf3-817c40424185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:10:34.593169 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-544e87a9-e44d-4d0b-816e-fbeafd054123 tempest-TestVolumeBackupRestore-1882080688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac9a0dfb-6c05-4917-9969-00773e929193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:10:34.616267 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-544e87a9-e44d-4d0b-816e-fbeafd054123 tempest-TestVolumeBackupRestore-1882080688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac9a0dfb-6c05-4917-9969-00773e929193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:10:34Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_7835d3b6-ffbb-47df-80ed-ab232cb47e0a',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e4dd549f-c9a7-465c-a9bc-ac93b42c54fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d70782066cce4f2fbf5744b63e4195cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:10:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:10:34Z,use_quota=True,user_id='4f4cbf51481d45de862752fe273dceda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:10:34.626995 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-544e87a9-e44d-4d0b-816e-fbeafd054123 tempest-TestVolumeBackupRestore-1882080688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abb17a67-0d76-407f-b9ce-ec5652f11221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:10:34.631319 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-544e87a9-e44d-4d0b-816e-fbeafd054123 tempest-TestVolumeBackupRestore-1882080688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abb17a67-0d76-407f-b9ce-ec5652f11221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:10:34.640233 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-544e87a9-e44d-4d0b-816e-fbeafd054123 tempest-TestVolumeBackupRestore-1882080688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da8360e2-e0c4-4195-8748-3f957e765616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:10:34.645410 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-544e87a9-e44d-4d0b-816e-fbeafd054123 tempest-TestVolumeBackupRestore-1882080688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da8360e2-e0c4-4195-8748-3f957e765616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4dd549f-c9a7-465c-a9bc-ac93b42c54fe', 'volume_name': 'volume-e4dd549f-c9a7-465c-a9bc-ac93b42c54fe', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:10:34.652878 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-544e87a9-e44d-4d0b-816e-fbeafd054123 tempest-TestVolumeBackupRestore-1882080688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (585b6ca4-9d86-4a12-95c7-db49c45cefaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:10:34.658017 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-544e87a9-e44d-4d0b-816e-fbeafd054123 tempest-TestVolumeBackupRestore-1882080688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (585b6ca4-9d86-4a12-95c7-db49c45cefaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:10:34.664461 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-544e87a9-e44d-4d0b-816e-fbeafd054123 tempest-TestVolumeBackupRestore-1882080688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c45c67b-afb7-4ab3-a22d-25407ae59125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:10:34.666300 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-544e87a9-e44d-4d0b-816e-fbeafd054123 tempest-TestVolumeBackupRestore-1882080688 None] Volume e4dd549f-c9a7-465c-a9bc-ac93b42c54fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4dd549f-c9a7-465c-a9bc-ac93b42c54fe', 'volume_size': 1} May 07 22:10:34.666908 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-544e87a9-e44d-4d0b-816e-fbeafd054123 tempest-TestVolumeBackupRestore-1882080688 None] creating volume 'volume-e4dd549f-c9a7-465c-a9bc-ac93b42c54fe' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:10:34.668086 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-544e87a9-e44d-4d0b-816e-fbeafd054123 tempest-TestVolumeBackupRestore-1882080688 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:10:34.843576 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-544e87a9-e44d-4d0b-816e-fbeafd054123 tempest-TestVolumeBackupRestore-1882080688 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:10:34.843962 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-544e87a9-e44d-4d0b-816e-fbeafd054123 tempest-TestVolumeBackupRestore-1882080688 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:10:34.848753 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-544e87a9-e44d-4d0b-816e-fbeafd054123 tempest-TestVolumeBackupRestore-1882080688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c45c67b-afb7-4ab3-a22d-25407ae59125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4dd549f-c9a7-465c-a9bc-ac93b42c54fe', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:10:34.858494 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-544e87a9-e44d-4d0b-816e-fbeafd054123 tempest-TestVolumeBackupRestore-1882080688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e0a80f7-b124-462f-a6d7-5d528e004afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:10:34.883138 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-544e87a9-e44d-4d0b-816e-fbeafd054123 tempest-TestVolumeBackupRestore-1882080688 None] Volume volume-e4dd549f-c9a7-465c-a9bc-ac93b42c54fe (e4dd549f-c9a7-465c-a9bc-ac93b42c54fe): created successfully May 07 22:10:34.887784 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-544e87a9-e44d-4d0b-816e-fbeafd054123 tempest-TestVolumeBackupRestore-1882080688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e0a80f7-b124-462f-a6d7-5d528e004afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:10:34.894177 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-544e87a9-e44d-4d0b-816e-fbeafd054123 tempest-TestVolumeBackupRestore-1882080688 None] Flow 'volume_create_manager' (2efbb129-845a-4e41-acf3-817c40424185) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:10:34.906746 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-544e87a9-e44d-4d0b-816e-fbeafd054123 tempest-TestVolumeBackupRestore-1882080688 None] Created volume successfully. May 07 22:10:35.704764 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [None req-544e87a9-e44d-4d0b-816e-fbeafd054123 tempest-TestVolumeBackupRestore-1882080688 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 22:10:36.712270 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [None req-544e87a9-e44d-4d0b-816e-fbeafd054123 tempest-TestVolumeBackupRestore-1882080688 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.007s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 22:10:36.713939 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-544e87a9-e44d-4d0b-816e-fbeafd054123 tempest-TestVolumeBackupRestore-1882080688 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e4dd549f-c9a7-465c-a9bc-ac93b42c54fe', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3ca0b836-1cfe-436a-b0fa-deb74d3203d9', 'volume_id': 'e4dd549f-c9a7-465c-a9bc-ac93b42c54fe', 'discard': True}} {{(pid=129946) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 07 22:10:36.752779 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-544e87a9-e44d-4d0b-816e-fbeafd054123 tempest-TestVolumeBackupRestore-1882080688 None] Initialize volume connection completed successfully. May 07 22:10:44.446306 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-544e87a9-e44d-4d0b-816e-fbeafd054123 tempest-TestVolumeBackupRestore-1882080688 None] Terminate volume connection completed successfully. May 07 22:10:44.481102 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-544e87a9-e44d-4d0b-816e-fbeafd054123 tempest-TestVolumeBackupRestore-1882080688 None] Remove volume export completed successfully. May 07 22:10:48.252606 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-86ea4032-7823-4318-9e70-39e77fceaa59 tempest-VolumesSnapshotTestJSON-1726756463 None] Created reservations ['8368347d-862e-48ee-ab7f-37b0286dca5a', 'a7bb6258-bd8e-4381-812f-1df79691e632', '7f29e36e-c490-440d-a778-744cf3b65602', '5e7488e7-7e1f-4a76-b4a7-bb25c242f648'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:10:48.321090 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-86ea4032-7823-4318-9e70-39e77fceaa59 tempest-VolumesSnapshotTestJSON-1726756463 None] Delete snapshot completed successfully. May 07 22:10:48.326906 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-86ea4032-7823-4318-9e70-39e77fceaa59 tempest-VolumesSnapshotTestJSON-1726756463 None] Lock "b'cinder-679a0fc0-e910-4dcd-b53c-8367193219eb-delete_snapshot'" released by "delete_snapshot" :: held 30.489s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:10:49.771428 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-41ad0d2e-0473-4519-a85d-94374f48842a req-b405ee3d-f8ac-4dc5-844d-305bf9e7d70e tempest-VolumesSnapshotTestJSON-1726756463 None] Terminate volume connection completed successfully. May 07 22:10:49.772498 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-41ad0d2e-0473-4519-a85d-94374f48842a req-b405ee3d-f8ac-4dc5-844d-305bf9e7d70e tempest-VolumesSnapshotTestJSON-1726756463 None] Deleting attachment 7423ea71-0bdf-4bae-b179-b892d871f771. {{(pid=129946) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 07 22:10:54.467569 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-227f2d85-1039-4da6-b9af-a03f072bdda3 req-21c7479c-56d2-4b70-98c7-e1d4695a5367 tempest-TestVolumeBackupRestore-1882080688 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 22:10:55.648641 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-227f2d85-1039-4da6-b9af-a03f072bdda3 req-21c7479c-56d2-4b70-98c7-e1d4695a5367 tempest-TestVolumeBackupRestore-1882080688 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.179s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 22:10:55.651178 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-227f2d85-1039-4da6-b9af-a03f072bdda3 req-21c7479c-56d2-4b70-98c7-e1d4695a5367 tempest-TestVolumeBackupRestore-1882080688 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e4dd549f-c9a7-465c-a9bc-ac93b42c54fe', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3ca0b836-1cfe-436a-b0fa-deb74d3203d9', 'volume_id': 'e4dd549f-c9a7-465c-a9bc-ac93b42c54fe', 'discard': True}} {{(pid=129946) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 07 22:10:55.682565 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-227f2d85-1039-4da6-b9af-a03f072bdda3 req-21c7479c-56d2-4b70-98c7-e1d4695a5367 tempest-TestVolumeBackupRestore-1882080688 None] Connection info returned from driver {'name': 'volumes/volume-e4dd549f-c9a7-465c-a9bc-ac93b42c54fe', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e4dd549f-c9a7-465c-a9bc-ac93b42c54fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'e598fdae-c08d-4c10-aecb-19b3a7455bec'} {{(pid=129946) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 07 22:10:55.829456 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-227f2d85-1039-4da6-b9af-a03f072bdda3 req-21c7479c-56d2-4b70-98c7-e1d4695a5367 tempest-TestVolumeBackupRestore-1882080688 None] attachment_update completed successfully. May 07 22:10:56.417169 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-dc04384c-dfb2-41f9-8d69-36338cf281c9 tempest-VolumesSnapshotTestJSON-1726756463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:10:56.927848 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-dc04384c-dfb2-41f9-8d69-36338cf281c9 tempest-VolumesSnapshotTestJSON-1726756463 None] Create snapshot completed successfully May 07 22:10:57.777339 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-edc64788-c770-47eb-b808-7cbf258ba1c4 tempest-VolumesSnapshotTestJSON-1726756463 None] Lock "b'cinder-caf8d29b-69e9-47dd-9599-eb0b973bad3b-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.042s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:10:57.778818 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-edc64788-c770-47eb-b808-7cbf258ba1c4 tempest-VolumesSnapshotTestJSON-1726756463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:10:58.975640 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-edc64788-c770-47eb-b808-7cbf258ba1c4 tempest-VolumesSnapshotTestJSON-1726756463 None] Created reservations ['0e0be170-fdb9-4b04-aafd-5ebadd5ee087', '6194b8e6-aec0-4266-85ec-5783c75e3c02', '0130c105-c35d-4490-9c9c-7293bbbf38a1', '20a5cef3-9643-49fe-9253-b406b458c569'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:10:59.043201 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-edc64788-c770-47eb-b808-7cbf258ba1c4 tempest-VolumesSnapshotTestJSON-1726756463 None] Delete snapshot completed successfully. May 07 22:10:59.052039 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-edc64788-c770-47eb-b808-7cbf258ba1c4 tempest-VolumesSnapshotTestJSON-1726756463 None] Lock "b'cinder-caf8d29b-69e9-47dd-9599-eb0b973bad3b-delete_snapshot'" released by "delete_snapshot" :: held 1.274s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:11:00.377671 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-5e1ea023-7e25-4efe-8fdb-414c5f0c5164 tempest-VolumesSnapshotTestJSON-1726756463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:11:01.067483 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-5e1ea023-7e25-4efe-8fdb-414c5f0c5164 tempest-VolumesSnapshotTestJSON-1726756463 None] Create snapshot completed successfully May 07 22:11:24.817302 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-680d70b6-7388-4ef6-bb7a-4279169afd2f req-c6765cb7-99ee-4917-b115-a297c6b80e45 tempest-VolumesSnapshotTestJSON-1726756463 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 22:11:26.018029 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-680d70b6-7388-4ef6-bb7a-4279169afd2f req-c6765cb7-99ee-4917-b115-a297c6b80e45 tempest-VolumesSnapshotTestJSON-1726756463 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.200s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 22:11:26.019060 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-680d70b6-7388-4ef6-bb7a-4279169afd2f req-c6765cb7-99ee-4917-b115-a297c6b80e45 tempest-VolumesSnapshotTestJSON-1726756463 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-28875749-3b9f-4237-b844-689c84a5f03f', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3ca0b836-1cfe-436a-b0fa-deb74d3203d9', 'volume_id': '28875749-3b9f-4237-b844-689c84a5f03f', 'discard': True}} {{(pid=129946) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 07 22:11:26.048350 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-680d70b6-7388-4ef6-bb7a-4279169afd2f req-c6765cb7-99ee-4917-b115-a297c6b80e45 tempest-VolumesSnapshotTestJSON-1726756463 None] Connection info returned from driver {'name': 'volumes/volume-28875749-3b9f-4237-b844-689c84a5f03f', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '28875749-3b9f-4237-b844-689c84a5f03f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'af4934a4-e9ed-46cb-a0f7-d2f38651482d'} {{(pid=129946) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 07 22:11:26.105219 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-680d70b6-7388-4ef6-bb7a-4279169afd2f req-c6765cb7-99ee-4917-b115-a297c6b80e45 tempest-VolumesSnapshotTestJSON-1726756463 None] attachment_update completed successfully. May 07 22:11:28.252044 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-5e70e898-2e8c-411d-a642-d24787fde86a tempest-VolumesSnapshotTestJSON-1726756463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:11:28.951746 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-5e70e898-2e8c-411d-a642-d24787fde86a tempest-VolumesSnapshotTestJSON-1726756463 None] Create snapshot completed successfully May 07 22:11:29.749263 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-adf76b7f-14a0-44b3-9f6f-a8c2bb2533d4 tempest-VolumesSnapshotTestJSON-1726756463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:11:30.767532 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:11:30.768859 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:11:30.847118 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:11:30.939250 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:11:31.036890 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-adf76b7f-14a0-44b3-9f6f-a8c2bb2533d4 tempest-VolumesSnapshotTestJSON-1726756463 None] Create snapshot completed successfully May 07 22:11:31.913304 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-76994b05-79ab-4870-81b9-0465dec82281 tempest-VolumesSnapshotTestJSON-1726756463 None] Lock "b'cinder-25f3f2c8-e51d-42e9-9a56-21c99d4f1c4e-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.051s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:11:31.921136 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-76994b05-79ab-4870-81b9-0465dec82281 tempest-VolumesSnapshotTestJSON-1726756463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:12:02.225192 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-76994b05-79ab-4870-81b9-0465dec82281 tempest-VolumesSnapshotTestJSON-1726756463 None] Created reservations ['7202cb0b-e565-4289-8646-54ba5b7070c2', '6ee450fe-0189-4a8a-94e5-88565db270eb', 'c09fe44d-eae3-47c1-b8ef-f917f7770732', '08189b38-6833-4adc-a728-67f78b218026'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:12:02.277543 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-76994b05-79ab-4870-81b9-0465dec82281 tempest-VolumesSnapshotTestJSON-1726756463 None] Delete snapshot completed successfully. May 07 22:12:02.282572 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-76994b05-79ab-4870-81b9-0465dec82281 tempest-VolumesSnapshotTestJSON-1726756463 None] Lock "b'cinder-25f3f2c8-e51d-42e9-9a56-21c99d4f1c4e-delete_snapshot'" released by "delete_snapshot" :: held 30.369s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:12:02.429356 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-852bdcb3-06bf-4c05-bb2a-44babad59970 tempest-VolumesSnapshotTestJSON-1726756463 None] Lock "b'cinder-162b717b-29d1-469b-93f8-b4defbcff1f3-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.019s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:12:02.432360 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-852bdcb3-06bf-4c05-bb2a-44babad59970 tempest-VolumesSnapshotTestJSON-1726756463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:12:24.364339 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-f72d6a05-17f0-42df-ab46-a732ad738dcf tempest-TestVolumeBootPattern-860620187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:12:24.418839 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f72d6a05-17f0-42df-ab46-a732ad738dcf tempest-TestVolumeBootPattern-860620187 None] Flow 'volume_create_manager' (4e2e9a6f-526d-475c-ba22-9f0bb3846355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:12:24.447911 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f72d6a05-17f0-42df-ab46-a732ad738dcf tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (856a84d4-5fdc-48c5-8565-0fc9dfb3692d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:12:24.497541 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f72d6a05-17f0-42df-ab46-a732ad738dcf tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (856a84d4-5fdc-48c5-8565-0fc9dfb3692d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1965254642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=245353b2-c3f4-4312-a59d-98b625fafddf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3657e8df46a4252b9eb1eb159306a66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:12:24Z,use_quota=True,user_id='9b4988836610494ab48a138bd43d5b52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:12:24.517178 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f72d6a05-17f0-42df-ab46-a732ad738dcf tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3d359e8-2ba8-452c-bd46-8bf4d72a560b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:12:24.522201 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f72d6a05-17f0-42df-ab46-a732ad738dcf tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3d359e8-2ba8-452c-bd46-8bf4d72a560b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:12:24.539167 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f72d6a05-17f0-42df-ab46-a732ad738dcf tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6161f142-24e8-4044-8483-77af531e2708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:12:24.680796 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f72d6a05-17f0-42df-ab46-a732ad738dcf tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6161f142-24e8-4044-8483-77af531e2708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '245353b2-c3f4-4312-a59d-98b625fafddf', 'volume_name': 'volume-245353b2-c3f4-4312-a59d-98b625fafddf', 'volume_size': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e2f828af0706465883131e16cb564d05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'created_at': datetime.datetime(2022, 5, 7, 21, 36, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:12:24.686917 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f72d6a05-17f0-42df-ab46-a732ad738dcf tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c2ecba1-d921-4786-9c95-1714df8ad4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:12:24.692161 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f72d6a05-17f0-42df-ab46-a732ad738dcf tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c2ecba1-d921-4786-9c95-1714df8ad4b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:12:24.698205 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f72d6a05-17f0-42df-ab46-a732ad738dcf tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (842fdea6-3c50-4925-9763-f8b6e62b5cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:12:24.699735 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-f72d6a05-17f0-42df-ab46-a732ad738dcf tempest-TestVolumeBootPattern-860620187 None] Volume 245353b2-c3f4-4312-a59d-98b625fafddf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-245353b2-c3f4-4312-a59d-98b625fafddf', 'volume_size': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e2f828af0706465883131e16cb564d05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'created_at': datetime.datetime(2022, 5, 7, 21, 36, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } May 07 22:12:24.700513 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-f72d6a05-17f0-42df-ab46-a732ad738dcf tempest-TestVolumeBootPattern-860620187 None] Cloning 245353b2-c3f4-4312-a59d-98b625fafddf from image 3756ae98-5c12-48e7-920e-ef5d1dd5543c at location (None, None). {{(pid=129946) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} May 07 22:12:24.714711 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-f72d6a05-17f0-42df-ab46-a732ad738dcf tempest-TestVolumeBootPattern-860620187 None] Lock "b'cinder-3756ae98-5c12-48e7-920e-ef5d1dd5543c'" acquired by "_prepare_image_cache_entry" :: waited 0.013s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:12:24.731755 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-f72d6a05-17f0-42df-ab46-a732ad738dcf tempest-TestVolumeBootPattern-860620187 None] Found image-volume cache entry: {'id': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'volume_id': '82279f40-9683-441f-a541-0db8b9177f48', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9), 'last_used': datetime.datetime(2022, 5, 7, 22, 12, 24, 719674)}. {{(pid=129946) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 07 22:12:24.732600 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-f72d6a05-17f0-42df-ab46-a732ad738dcf tempest-TestVolumeBootPattern-860620187 None] Image-volume cache entry image_update_at = 2022-05-07 21:37:09+00:00, requested image updated_at = 2022-05-07 21:37:09+00:00. {{(pid=129946) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 07 22:12:24.733892 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-f72d6a05-17f0-42df-ab46-a732ad738dcf tempest-TestVolumeBootPattern-860620187 None] Found cache entry for image = 3756ae98-5c12-48e7-920e-ef5d1dd5543c on host ncdv-master-1@ceph#ceph. {{(pid=129946) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} May 07 22:12:24.752414 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-f72d6a05-17f0-42df-ab46-a732ad738dcf tempest-TestVolumeBootPattern-860620187 None] Lock "b'cinder-3756ae98-5c12-48e7-920e-ef5d1dd5543c'" released by "_prepare_image_cache_entry" :: held 0.038s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:12:24.753700 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-f72d6a05-17f0-42df-ab46-a732ad738dcf tempest-TestVolumeBootPattern-860620187 None] Attempting to retrieve cache entry for image = 3756ae98-5c12-48e7-920e-ef5d1dd5543c on host ncdv-master-1@ceph#ceph. {{(pid=129946) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} May 07 22:12:24.762635 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-f72d6a05-17f0-42df-ab46-a732ad738dcf tempest-TestVolumeBootPattern-860620187 None] Found image-volume cache entry: {'id': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'volume_id': '82279f40-9683-441f-a541-0db8b9177f48', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9), 'last_used': datetime.datetime(2022, 5, 7, 22, 12, 24, 759964)}. {{(pid=129946) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 07 22:12:24.763680 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-f72d6a05-17f0-42df-ab46-a732ad738dcf tempest-TestVolumeBootPattern-860620187 None] Image-volume cache entry image_update_at = 2022-05-07 21:37:09+00:00, requested image updated_at = 2022-05-07 21:37:09+00:00. {{(pid=129946) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 07 22:12:24.764082 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-f72d6a05-17f0-42df-ab46-a732ad738dcf tempest-TestVolumeBootPattern-860620187 None] Creating from source image-volume 82279f40-9683-441f-a541-0db8b9177f48 {{(pid=129946) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} May 07 22:12:24.778569 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-f72d6a05-17f0-42df-ab46-a732ad738dcf tempest-TestVolumeBootPattern-860620187 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:12:24.867733 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-f72d6a05-17f0-42df-ab46-a732ad738dcf tempest-TestVolumeBootPattern-860620187 None] creating snapshot='volume-245353b2-c3f4-4312-a59d-98b625fafddf.clone_snap' {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} May 07 22:12:25.574711 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-f72d6a05-17f0-42df-ab46-a732ad738dcf tempest-TestVolumeBootPattern-860620187 None] cloning 'volume-82279f40-9683-441f-a541-0db8b9177f48@volume-245353b2-c3f4-4312-a59d-98b625fafddf.clone_snap' to 'volume-245353b2-c3f4-4312-a59d-98b625fafddf' {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 07 22:12:25.863463 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-f72d6a05-17f0-42df-ab46-a732ad738dcf tempest-TestVolumeBootPattern-860620187 None] Volume volume-3864f924-91b4-4015-ab37-8bdbf8ad652d.deleted is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:12:25.864733 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-f72d6a05-17f0-42df-ab46-a732ad738dcf tempest-TestVolumeBootPattern-860620187 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:12:25.865221 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-f72d6a05-17f0-42df-ab46-a732ad738dcf tempest-TestVolumeBootPattern-860620187 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:12:25.920093 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-f72d6a05-17f0-42df-ab46-a732ad738dcf tempest-TestVolumeBootPattern-860620187 None] clone created successfully {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} May 07 22:12:25.920974 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.volume_utils [None req-f72d6a05-17f0-42df-ab46-a732ad738dcf tempest-TestVolumeBootPattern-860620187 None] Marking volume 245353b2-c3f4-4312-a59d-98b625fafddf as bootable. {{(pid=129946) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} May 07 22:12:25.955489 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-f72d6a05-17f0-42df-ab46-a732ad738dcf tempest-TestVolumeBootPattern-860620187 None] Copying metadata from image 3756ae98-5c12-48e7-920e-ef5d1dd5543c to 245353b2-c3f4-4312-a59d-98b625fafddf. {{(pid=129946) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} May 07 22:12:25.958258 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-f72d6a05-17f0-42df-ab46-a732ad738dcf tempest-TestVolumeBootPattern-860620187 None] Creating volume glance metadata for volume 245353b2-c3f4-4312-a59d-98b625fafddf backed by image 3756ae98-5c12-48e7-920e-ef5d1dd5543c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129946) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} May 07 22:12:26.076996 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f72d6a05-17f0-42df-ab46-a732ad738dcf tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (842fdea6-3c50-4925-9763-f8b6e62b5cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-245353b2-c3f4-4312-a59d-98b625fafddf', 'volume_size': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e2f828af0706465883131e16cb564d05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'created_at': datetime.datetime(2022, 5, 7, 21, 36, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:12:26.093034 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f72d6a05-17f0-42df-ab46-a732ad738dcf tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49b0b43c-9bf8-4f06-a0ce-63d90b3181ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:12:26.108566 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-f72d6a05-17f0-42df-ab46-a732ad738dcf tempest-TestVolumeBootPattern-860620187 None] Volume volume-245353b2-c3f4-4312-a59d-98b625fafddf (245353b2-c3f4-4312-a59d-98b625fafddf): created successfully May 07 22:12:26.114698 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f72d6a05-17f0-42df-ab46-a732ad738dcf tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49b0b43c-9bf8-4f06-a0ce-63d90b3181ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:12:26.132340 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f72d6a05-17f0-42df-ab46-a732ad738dcf tempest-TestVolumeBootPattern-860620187 None] Flow 'volume_create_manager' (4e2e9a6f-526d-475c-ba22-9f0bb3846355) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:12:26.152204 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-f72d6a05-17f0-42df-ab46-a732ad738dcf tempest-TestVolumeBootPattern-860620187 None] Created volume successfully. May 07 22:12:26.558320 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-1fa5338e-1975-418a-8258-db7d6cadbb43 req-dac200e4-e2db-4ddf-aa05-dde3ec494b0a tempest-TestVolumeBackupRestore-1882080688 None] Terminate volume connection completed successfully. May 07 22:12:26.558939 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-1fa5338e-1975-418a-8258-db7d6cadbb43 req-dac200e4-e2db-4ddf-aa05-dde3ec494b0a tempest-TestVolumeBackupRestore-1882080688 None] Deleting attachment e598fdae-c08d-4c10-aecb-19b3a7455bec. {{(pid=129946) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 07 22:12:27.082581 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-faf0d6a7-7dfc-4fb9-8d67-2b1065a37193 tempest-TestVolumeBootPattern-860620187 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:12:28.102206 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-faf0d6a7-7dfc-4fb9-8d67-2b1065a37193 tempest-TestVolumeBootPattern-860620187 None] Create snapshot completed successfully May 07 22:12:29.272158 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-ea190138-6f25-420d-8857-18a53e844ec9 tempest-TestVolumeBackupRestore-1882080688 None] Lock "b'cinder-e4dd549f-c9a7-465c-a9bc-ac93b42c54fe-delete_volume'" acquired by "delete_volume" :: waited 0.026s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:12:29.388062 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-ea190138-6f25-420d-8857-18a53e844ec9 tempest-TestVolumeBackupRestore-1882080688 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:12:29.933280 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-ea190138-6f25-420d-8857-18a53e844ec9 tempest-TestVolumeBackupRestore-1882080688 None] Volume volume-e4dd549f-c9a7-465c-a9bc-ac93b42c54fe is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:12:30.020430 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-ea190138-6f25-420d-8857-18a53e844ec9 tempest-TestVolumeBackupRestore-1882080688 None] deleting rbd volume volume-e4dd549f-c9a7-465c-a9bc-ac93b42c54fe {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:12:30.067962 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-a6fb4a72-e731-4d9c-8294-47a1b3b13aa3 tempest-TestVolumeBackupRestore-1882080688 None] Lock "b'cinder-96b33d38-3791-4ff9-9b96-17fce364b1fb-delete_volume'" acquired by "delete_volume" :: waited 0.039s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:12:30.138050 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-a6fb4a72-e731-4d9c-8294-47a1b3b13aa3 tempest-TestVolumeBackupRestore-1882080688 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:12:31.156521 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-a6fb4a72-e731-4d9c-8294-47a1b3b13aa3 tempest-TestVolumeBackupRestore-1882080688 None] deleting rbd volume volume-96b33d38-3791-4ff9-9b96-17fce364b1fb {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:12:31.161088 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:12:31.161783 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:12:31.255824 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:12:31.318229 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:12:31.556197 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-ea190138-6f25-420d-8857-18a53e844ec9 tempest-TestVolumeBackupRestore-1882080688 None] Created reservations ['ebc02f28-c659-4571-a4de-06cec6a1ef53', '6294d671-6d56-4d38-8e0f-a267eab50640', '62b7067b-6ccb-4bdb-b88b-bd34300963c2', '2cc267fa-7239-4b4a-b242-e818048ade57'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:12:31.723310 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-ea190138-6f25-420d-8857-18a53e844ec9 tempest-TestVolumeBackupRestore-1882080688 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:12:31.804245 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-ea190138-6f25-420d-8857-18a53e844ec9 tempest-TestVolumeBackupRestore-1882080688 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:12:31.884897 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-ea190138-6f25-420d-8857-18a53e844ec9 tempest-TestVolumeBackupRestore-1882080688 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:12:31.887068 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-a6fb4a72-e731-4d9c-8294-47a1b3b13aa3 tempest-TestVolumeBackupRestore-1882080688 None] volume is a clone so cleaning references {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} May 07 22:12:31.945467 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-a6fb4a72-e731-4d9c-8294-47a1b3b13aa3 tempest-TestVolumeBackupRestore-1882080688 None] deleting parent snapshot volume-96b33d38-3791-4ff9-9b96-17fce364b1fb.clone_snap {{(pid=129946) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} May 07 22:12:33.082589 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-ea190138-6f25-420d-8857-18a53e844ec9 tempest-TestVolumeBackupRestore-1882080688 None] Deleted volume successfully. May 07 22:12:33.135027 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-ea190138-6f25-420d-8857-18a53e844ec9 tempest-TestVolumeBackupRestore-1882080688 None] Lock "b'cinder-e4dd549f-c9a7-465c-a9bc-ac93b42c54fe-delete_volume'" released by "delete_volume" :: held 3.863s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:12:33.212470 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-a6fb4a72-e731-4d9c-8294-47a1b3b13aa3 tempest-TestVolumeBackupRestore-1882080688 None] Created reservations ['2f49f04e-e00e-42bb-b87d-26b74a693bfb', '61056b51-7026-4460-8059-8d438461ee5e', '84dcee03-7012-4420-a9a9-9059ae7e280a', '715e2594-7356-4618-bb70-d1289ddf7385'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:12:33.263865 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-852bdcb3-06bf-4c05-bb2a-44babad59970 tempest-VolumesSnapshotTestJSON-1726756463 None] Created reservations ['b69caacc-b6ea-44bd-8987-6b155d8dd1c6', '684fe9dd-ab2a-4fdf-844b-3f9d7c7f9606', '34d69e6c-4ea6-4d93-9b87-08b05dc60fe9', 'a10005d8-1eb0-4310-a290-b9bc413a02f0'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:12:33.335812 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-a6fb4a72-e731-4d9c-8294-47a1b3b13aa3 tempest-TestVolumeBackupRestore-1882080688 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:12:33.414845 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-a6fb4a72-e731-4d9c-8294-47a1b3b13aa3 tempest-TestVolumeBackupRestore-1882080688 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:12:33.465196 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-a6fb4a72-e731-4d9c-8294-47a1b3b13aa3 tempest-TestVolumeBackupRestore-1882080688 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:12:33.472228 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-a6fb4a72-e731-4d9c-8294-47a1b3b13aa3 tempest-TestVolumeBackupRestore-1882080688 None] Deleted volume successfully. May 07 22:12:33.511299 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-a6fb4a72-e731-4d9c-8294-47a1b3b13aa3 tempest-TestVolumeBackupRestore-1882080688 None] Lock "b'cinder-96b33d38-3791-4ff9-9b96-17fce364b1fb-delete_volume'" released by "delete_volume" :: held 3.442s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:12:33.538355 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-852bdcb3-06bf-4c05-bb2a-44babad59970 tempest-VolumesSnapshotTestJSON-1726756463 None] Delete snapshot completed successfully. May 07 22:12:33.544855 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-852bdcb3-06bf-4c05-bb2a-44babad59970 tempest-VolumesSnapshotTestJSON-1726756463 None] Lock "b'cinder-162b717b-29d1-469b-93f8-b4defbcff1f3-delete_snapshot'" released by "delete_snapshot" :: held 31.116s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:12:34.049285 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [req-a32d7a68-4c36-426b-9311-0d450929ab88 req-42f92fe3-1055-462d-8962-8e6da93defcd tempest-TestVolumeBootPattern-860620187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:12:34.115983 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-a32d7a68-4c36-426b-9311-0d450929ab88 req-42f92fe3-1055-462d-8962-8e6da93defcd tempest-TestVolumeBootPattern-860620187 None] Flow 'volume_create_manager' (d8cd64ef-6227-40f2-8b93-71fdbbb70e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:12:34.135983 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-a32d7a68-4c36-426b-9311-0d450929ab88 req-42f92fe3-1055-462d-8962-8e6da93defcd tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f53e7689-d6c5-4acd-a389-f36c9448f1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:12:34.157241 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-a32d7a68-4c36-426b-9311-0d450929ab88 req-42f92fe3-1055-462d-8962-8e6da93defcd tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f53e7689-d6c5-4acd-a389-f36c9448f1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:12:34Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1d37c15d-f551-45eb-9bb5-9b1c3469c4f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3657e8df46a4252b9eb1eb159306a66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=93e0a080-2e21-4a61-ae4e-18f16e01c432,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:12:34Z,use_quota=True,user_id='9b4988836610494ab48a138bd43d5b52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:12:34.176411 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-a32d7a68-4c36-426b-9311-0d450929ab88 req-42f92fe3-1055-462d-8962-8e6da93defcd tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (323c4530-ac8e-4068-814a-31fa8e580278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:12:34.193473 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-a32d7a68-4c36-426b-9311-0d450929ab88 req-42f92fe3-1055-462d-8962-8e6da93defcd tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (323c4530-ac8e-4068-814a-31fa8e580278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:12:34.199641 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-a32d7a68-4c36-426b-9311-0d450929ab88 req-42f92fe3-1055-462d-8962-8e6da93defcd tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29c39e6d-b829-4196-8989-45fd0793979a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:12:34.206056 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-a32d7a68-4c36-426b-9311-0d450929ab88 req-42f92fe3-1055-462d-8962-8e6da93defcd tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29c39e6d-b829-4196-8989-45fd0793979a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1d37c15d-f551-45eb-9bb5-9b1c3469c4f2', 'volume_name': 'volume-1d37c15d-f551-45eb-9bb5-9b1c3469c4f2', 'volume_size': 1, 'snapshot_id': '93e0a080-2e21-4a61-ae4e-18f16e01c432'}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:12:34.227324 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-a32d7a68-4c36-426b-9311-0d450929ab88 req-42f92fe3-1055-462d-8962-8e6da93defcd tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a16e5ee-5bd6-40fc-a638-17823ca246ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:12:34.232047 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-a32d7a68-4c36-426b-9311-0d450929ab88 req-42f92fe3-1055-462d-8962-8e6da93defcd tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a16e5ee-5bd6-40fc-a638-17823ca246ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:12:34.239367 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-a32d7a68-4c36-426b-9311-0d450929ab88 req-42f92fe3-1055-462d-8962-8e6da93defcd tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a843f3d8-5bda-4854-a2cf-9059a2188239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:12:34.254950 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [req-a32d7a68-4c36-426b-9311-0d450929ab88 req-42f92fe3-1055-462d-8962-8e6da93defcd tempest-TestVolumeBootPattern-860620187 None] Volume 1d37c15d-f551-45eb-9bb5-9b1c3469c4f2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1d37c15d-f551-45eb-9bb5-9b1c3469c4f2', 'volume_size': 1, 'snapshot_id': '93e0a080-2e21-4a61-ae4e-18f16e01c432'} May 07 22:12:34.280880 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-a32d7a68-4c36-426b-9311-0d450929ab88 req-42f92fe3-1055-462d-8962-8e6da93defcd tempest-TestVolumeBootPattern-860620187 None] cloning volumes/volume-245353b2-c3f4-4312-a59d-98b625fafddf@snapshot-93e0a080-2e21-4a61-ae4e-18f16e01c432 to volume-1d37c15d-f551-45eb-9bb5-9b1c3469c4f2 {{(pid=129946) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1091}} May 07 22:12:34.303120 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-a32d7a68-4c36-426b-9311-0d450929ab88 req-42f92fe3-1055-462d-8962-8e6da93defcd tempest-TestVolumeBootPattern-860620187 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:12:34.427214 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-a32d7a68-4c36-426b-9311-0d450929ab88 req-42f92fe3-1055-462d-8962-8e6da93defcd tempest-TestVolumeBootPattern-860620187 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:12:34.533987 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-e80dffe0-3163-4a5d-8e62-00c2a52fa49b tempest-VolumesSnapshotTestJSON-1726756463 None] Lock "b'cinder-6bdcd291-3b32-4a2d-befd-d710cb9326f8-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.027s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:12:34.540800 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-e80dffe0-3163-4a5d-8e62-00c2a52fa49b tempest-VolumesSnapshotTestJSON-1726756463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:12:34.696564 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-a32d7a68-4c36-426b-9311-0d450929ab88 req-42f92fe3-1055-462d-8962-8e6da93defcd tempest-TestVolumeBootPattern-860620187 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:12:34.696937 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-a32d7a68-4c36-426b-9311-0d450929ab88 req-42f92fe3-1055-462d-8962-8e6da93defcd tempest-TestVolumeBootPattern-860620187 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:12:34.729662 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.volume_utils [req-a32d7a68-4c36-426b-9311-0d450929ab88 req-42f92fe3-1055-462d-8962-8e6da93defcd tempest-TestVolumeBootPattern-860620187 None] Marking volume 1d37c15d-f551-45eb-9bb5-9b1c3469c4f2 as bootable. {{(pid=129946) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} May 07 22:12:34.738807 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [req-a32d7a68-4c36-426b-9311-0d450929ab88 req-42f92fe3-1055-462d-8962-8e6da93defcd tempest-TestVolumeBootPattern-860620187 None] Copying metadata from snapshot 93e0a080-2e21-4a61-ae4e-18f16e01c432 to 1d37c15d-f551-45eb-9bb5-9b1c3469c4f2. {{(pid=129946) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:427}} May 07 22:12:34.780013 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-a32d7a68-4c36-426b-9311-0d450929ab88 req-42f92fe3-1055-462d-8962-8e6da93defcd tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a843f3d8-5bda-4854-a2cf-9059a2188239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d37c15d-f551-45eb-9bb5-9b1c3469c4f2', 'volume_size': 1, 'snapshot_id': '93e0a080-2e21-4a61-ae4e-18f16e01c432'}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:12:34.785957 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-a32d7a68-4c36-426b-9311-0d450929ab88 req-42f92fe3-1055-462d-8962-8e6da93defcd tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90dfde8b-0d28-4d9d-931a-fa2c972f638f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:12:34.796298 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [req-a32d7a68-4c36-426b-9311-0d450929ab88 req-42f92fe3-1055-462d-8962-8e6da93defcd tempest-TestVolumeBootPattern-860620187 None] Volume volume-1d37c15d-f551-45eb-9bb5-9b1c3469c4f2 (1d37c15d-f551-45eb-9bb5-9b1c3469c4f2): created successfully May 07 22:12:34.800854 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-a32d7a68-4c36-426b-9311-0d450929ab88 req-42f92fe3-1055-462d-8962-8e6da93defcd tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90dfde8b-0d28-4d9d-931a-fa2c972f638f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:12:34.808175 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-a32d7a68-4c36-426b-9311-0d450929ab88 req-42f92fe3-1055-462d-8962-8e6da93defcd tempest-TestVolumeBootPattern-860620187 None] Flow 'volume_create_manager' (d8cd64ef-6227-40f2-8b93-71fdbbb70e5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:12:34.823018 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-a32d7a68-4c36-426b-9311-0d450929ab88 req-42f92fe3-1055-462d-8962-8e6da93defcd tempest-TestVolumeBootPattern-860620187 None] Created volume successfully. May 07 22:12:37.430649 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-a32d7a68-4c36-426b-9311-0d450929ab88 req-55f18525-ecda-4526-a71d-a6ddc89d850f tempest-TestVolumeBootPattern-860620187 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 22:12:38.820084 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-a32d7a68-4c36-426b-9311-0d450929ab88 req-55f18525-ecda-4526-a71d-a6ddc89d850f tempest-TestVolumeBootPattern-860620187 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.389s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 22:12:38.821074 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-a32d7a68-4c36-426b-9311-0d450929ab88 req-55f18525-ecda-4526-a71d-a6ddc89d850f tempest-TestVolumeBootPattern-860620187 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1d37c15d-f551-45eb-9bb5-9b1c3469c4f2', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3ca0b836-1cfe-436a-b0fa-deb74d3203d9', 'volume_id': '1d37c15d-f551-45eb-9bb5-9b1c3469c4f2', 'discard': True}} {{(pid=129946) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 07 22:12:38.876833 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-a32d7a68-4c36-426b-9311-0d450929ab88 req-55f18525-ecda-4526-a71d-a6ddc89d850f tempest-TestVolumeBootPattern-860620187 None] Connection info returned from driver {'name': 'volumes/volume-1d37c15d-f551-45eb-9bb5-9b1c3469c4f2', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1d37c15d-f551-45eb-9bb5-9b1c3469c4f2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '55b676ee-3ca3-4e8b-afde-1f8089cfb9e6'} {{(pid=129946) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 07 22:12:38.979531 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-a32d7a68-4c36-426b-9311-0d450929ab88 req-55f18525-ecda-4526-a71d-a6ddc89d850f tempest-TestVolumeBootPattern-860620187 None] attachment_update completed successfully. May 07 22:12:44.291757 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-b6ceefb8-c00c-4884-966f-20adeaedf011 tempest-GroupsTest-1561337077 None] Group tempest-Group1-1175320010: creating May 07 22:12:44.317932 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-b6ceefb8-c00c-4884-966f-20adeaedf011 tempest-GroupsTest-1561337077 None] Group tempest-Group1-1175320010: created successfully May 07 22:12:44.334629 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-b6ceefb8-c00c-4884-966f-20adeaedf011 tempest-GroupsTest-1561337077 None] Create group completed successfully. May 07 22:12:45.493723 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-592d3713-1eb3-44ba-8679-bf5e1df8a137 tempest-GroupsTest-1561337077 None] Group tempest-Group2-1778397989: creating May 07 22:12:45.522108 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-592d3713-1eb3-44ba-8679-bf5e1df8a137 tempest-GroupsTest-1561337077 None] Group tempest-Group2-1778397989: created successfully May 07 22:12:45.538293 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-592d3713-1eb3-44ba-8679-bf5e1df8a137 tempest-GroupsTest-1561337077 None] Create group completed successfully. May 07 22:12:47.195220 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c88bd71-df00-4d71-be67-ba5b7a6832e9 tempest-GroupsTest-1561337077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:12:47.223738 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4c88bd71-df00-4d71-be67-ba5b7a6832e9 tempest-GroupsTest-1561337077 None] Flow 'volume_create_manager' (a3744cc3-842a-4bd0-a568-4b973afcd477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:12:47.234945 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4c88bd71-df00-4d71-be67-ba5b7a6832e9 tempest-GroupsTest-1561337077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92810ff3-a8a3-4cd1-8a59-621fc64d0bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:12:47.252926 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4c88bd71-df00-4d71-be67-ba5b7a6832e9 tempest-GroupsTest-1561337077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92810ff3-a8a3-4cd1-8a59-621fc64d0bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1410064480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2198fcfb-1449-4733-b2f3-c5c97cb4e512,host='ncdv-master-1@ceph#ceph',id=7e0970e3-afbc-4798-b000-d7293b10aee8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dbdd61ff73f47a88777a750e5994457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:12:47Z,use_quota=True,user_id='ac26310ffe63499cb9d12b9c4e2c8ad3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3890708e-fd43-4be5-b65e-1dca84b0ba06),volume_type_id=3890708e-fd43-4be5-b65e-1dca84b0ba06)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:12:47.261002 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4c88bd71-df00-4d71-be67-ba5b7a6832e9 tempest-GroupsTest-1561337077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfbaa3cd-d27c-4360-b505-8a6e7461f0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:12:47.267606 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4c88bd71-df00-4d71-be67-ba5b7a6832e9 tempest-GroupsTest-1561337077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfbaa3cd-d27c-4360-b505-8a6e7461f0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:12:47.274711 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4c88bd71-df00-4d71-be67-ba5b7a6832e9 tempest-GroupsTest-1561337077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1b5e3aa-fd10-4a54-ae69-19f4a31b474b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:12:47.279581 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4c88bd71-df00-4d71-be67-ba5b7a6832e9 tempest-GroupsTest-1561337077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1b5e3aa-fd10-4a54-ae69-19f4a31b474b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e0970e3-afbc-4798-b000-d7293b10aee8', 'volume_name': 'volume-7e0970e3-afbc-4798-b000-d7293b10aee8', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:12:47.287604 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4c88bd71-df00-4d71-be67-ba5b7a6832e9 tempest-GroupsTest-1561337077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9ff1236-26b8-4b06-a3ef-9206e68af3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:12:47.293657 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4c88bd71-df00-4d71-be67-ba5b7a6832e9 tempest-GroupsTest-1561337077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9ff1236-26b8-4b06-a3ef-9206e68af3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:12:47.299355 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4c88bd71-df00-4d71-be67-ba5b7a6832e9 tempest-GroupsTest-1561337077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11a39260-8560-43f1-b725-bc8dc67a0d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:12:47.302714 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-4c88bd71-df00-4d71-be67-ba5b7a6832e9 tempest-GroupsTest-1561337077 None] Volume 7e0970e3-afbc-4798-b000-d7293b10aee8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e0970e3-afbc-4798-b000-d7293b10aee8', 'volume_size': 1} May 07 22:12:47.303394 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-4c88bd71-df00-4d71-be67-ba5b7a6832e9 tempest-GroupsTest-1561337077 None] creating volume 'volume-7e0970e3-afbc-4798-b000-d7293b10aee8' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:12:47.304449 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-4c88bd71-df00-4d71-be67-ba5b7a6832e9 tempest-GroupsTest-1561337077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:12:47.445259 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-4c88bd71-df00-4d71-be67-ba5b7a6832e9 tempest-GroupsTest-1561337077 None] extra_specs: {} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:12:47.445691 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-4c88bd71-df00-4d71-be67-ba5b7a6832e9 tempest-GroupsTest-1561337077 None] extra_specs: {} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:12:47.451186 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4c88bd71-df00-4d71-be67-ba5b7a6832e9 tempest-GroupsTest-1561337077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11a39260-8560-43f1-b725-bc8dc67a0d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e0970e3-afbc-4798-b000-d7293b10aee8', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:12:47.459248 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4c88bd71-df00-4d71-be67-ba5b7a6832e9 tempest-GroupsTest-1561337077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09c10457-ce4f-49e4-a2bf-d631e20f129c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:12:47.472583 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-4c88bd71-df00-4d71-be67-ba5b7a6832e9 tempest-GroupsTest-1561337077 None] Volume volume-7e0970e3-afbc-4798-b000-d7293b10aee8 (7e0970e3-afbc-4798-b000-d7293b10aee8): created successfully May 07 22:12:47.478681 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4c88bd71-df00-4d71-be67-ba5b7a6832e9 tempest-GroupsTest-1561337077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09c10457-ce4f-49e4-a2bf-d631e20f129c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:12:47.487739 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4c88bd71-df00-4d71-be67-ba5b7a6832e9 tempest-GroupsTest-1561337077 None] Flow 'volume_create_manager' (a3744cc3-842a-4bd0-a568-4b973afcd477) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:12:47.512505 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-4c88bd71-df00-4d71-be67-ba5b7a6832e9 tempest-GroupsTest-1561337077 None] Created volume successfully. May 07 22:12:49.016871 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b16a1d7b-be25-4c8f-b40f-f4c5277d61e9 tempest-GroupsTest-1561337077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:12:49.069839 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b16a1d7b-be25-4c8f-b40f-f4c5277d61e9 tempest-GroupsTest-1561337077 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:12:49.073560 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b16a1d7b-be25-4c8f-b40f-f4c5277d61e9 tempest-GroupsTest-1561337077 None] Volume volume-7e0970e3-afbc-4798-b000-d7293b10aee8 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:12:49.083070 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b16a1d7b-be25-4c8f-b40f-f4c5277d61e9 tempest-GroupsTest-1561337077 None] deleting rbd volume volume-7e0970e3-afbc-4798-b000-d7293b10aee8 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:12:49.571164 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-b16a1d7b-be25-4c8f-b40f-f4c5277d61e9 tempest-GroupsTest-1561337077 None] Created reservations ['49ab8109-2cfe-4c36-9f55-1416bde19cb2'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:12:49.603876 ncdv-master-1 cinder-volume[129946]: WARNING cinder.quota [None req-b16a1d7b-be25-4c8f-b40f-f4c5277d61e9 tempest-GroupsTest-1561337077 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-616842127 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-616842127, it is now deprecated. Please use the default quota class for default quota. May 07 22:12:49.604822 ncdv-master-1 cinder-volume[129946]: WARNING cinder.quota [None req-b16a1d7b-be25-4c8f-b40f-f4c5277d61e9 tempest-GroupsTest-1561337077 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-616842127 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-616842127, it is now deprecated. Please use the default quota class for default quota. May 07 22:12:49.626970 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-b16a1d7b-be25-4c8f-b40f-f4c5277d61e9 tempest-GroupsTest-1561337077 None] Created reservations ['547aab08-68ae-4a6e-ab6a-f37878c74192', '0c5480a8-a0d8-4c9a-ad33-9e6236c4deb2', '0ec53163-d86b-4328-bc6b-91bdfc738822', 'e55e1b66-3e69-444e-834d-1366170ed228'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:12:49.779576 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b16a1d7b-be25-4c8f-b40f-f4c5277d61e9 tempest-GroupsTest-1561337077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:12:49.820601 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b16a1d7b-be25-4c8f-b40f-f4c5277d61e9 tempest-GroupsTest-1561337077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:12:49.865922 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-b16a1d7b-be25-4c8f-b40f-f4c5277d61e9 tempest-GroupsTest-1561337077 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:12:49.871432 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-b16a1d7b-be25-4c8f-b40f-f4c5277d61e9 tempest-GroupsTest-1561337077 None] Delete group completed successfully. May 07 22:12:50.432094 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-9c0cb958-7eef-43f2-b07f-dd81ba042a88 tempest-GroupsTest-1561337077 None] Created reservations ['51b7d4f9-a233-40b1-b224-e83db74892d1'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:12:50.493460 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-9c0cb958-7eef-43f2-b07f-dd81ba042a88 tempest-GroupsTest-1561337077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:12:50.572424 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-9c0cb958-7eef-43f2-b07f-dd81ba042a88 tempest-GroupsTest-1561337077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:12:50.652366 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-9c0cb958-7eef-43f2-b07f-dd81ba042a88 tempest-GroupsTest-1561337077 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:12:50.665527 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-9c0cb958-7eef-43f2-b07f-dd81ba042a88 tempest-GroupsTest-1561337077 None] Delete group completed successfully. May 07 22:12:51.935849 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-16321b1b-8b2d-48de-81ba-39c9f984e1f0 tempest-GroupsTest-1561337077 None] Group tempest-GroupsTest-Group-916888365: creating May 07 22:12:51.955984 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-16321b1b-8b2d-48de-81ba-39c9f984e1f0 tempest-GroupsTest-1561337077 None] Group tempest-GroupsTest-Group-916888365: created successfully May 07 22:12:51.968825 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-16321b1b-8b2d-48de-81ba-39c9f984e1f0 tempest-GroupsTest-1561337077 None] Create group completed successfully. May 07 22:12:53.598343 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-493d62cb-3e03-41d1-89ee-c9209fb31836 tempest-GroupsTest-1561337077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:12:53.626806 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-493d62cb-3e03-41d1-89ee-c9209fb31836 tempest-GroupsTest-1561337077 None] Flow 'volume_create_manager' (5993ab7b-f84c-488e-8678-b46d187f9f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:12:53.635590 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-493d62cb-3e03-41d1-89ee-c9209fb31836 tempest-GroupsTest-1561337077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7967e34-a003-4b8d-8752-accb3084f598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:12:53.665513 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-493d62cb-3e03-41d1-89ee-c9209fb31836 tempest-GroupsTest-1561337077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7967e34-a003-4b8d-8752-accb3084f598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:12:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-1850199650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5c828cf4-762e-45be-8249-f912a54441bf,host='ncdv-master-1@ceph#ceph',id=add357b2-8f5b-4715-90f6-dd8541e81209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dbdd61ff73f47a88777a750e5994457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:12:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:12:54Z,use_quota=True,user_id='ac26310ffe63499cb9d12b9c4e2c8ad3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed311266-79bb-4e73-ae36-ab78a43cb4d7),volume_type_id=ed311266-79bb-4e73-ae36-ab78a43cb4d7)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:12:53.672556 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-493d62cb-3e03-41d1-89ee-c9209fb31836 tempest-GroupsTest-1561337077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76684a90-7c3a-4c57-97e6-d66f6fbe00b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:12:53.679306 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-493d62cb-3e03-41d1-89ee-c9209fb31836 tempest-GroupsTest-1561337077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76684a90-7c3a-4c57-97e6-d66f6fbe00b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:12:53.687077 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-493d62cb-3e03-41d1-89ee-c9209fb31836 tempest-GroupsTest-1561337077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (261b87c5-d7e7-4d1a-8a1e-da5bc84dfa5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:12:53.692566 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-493d62cb-3e03-41d1-89ee-c9209fb31836 tempest-GroupsTest-1561337077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (261b87c5-d7e7-4d1a-8a1e-da5bc84dfa5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'add357b2-8f5b-4715-90f6-dd8541e81209', 'volume_name': 'volume-add357b2-8f5b-4715-90f6-dd8541e81209', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:12:53.698044 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-493d62cb-3e03-41d1-89ee-c9209fb31836 tempest-GroupsTest-1561337077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecf4c9ef-00ad-463b-815f-2b39caf0d1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:12:53.702332 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-493d62cb-3e03-41d1-89ee-c9209fb31836 tempest-GroupsTest-1561337077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecf4c9ef-00ad-463b-815f-2b39caf0d1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:12:53.710524 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-493d62cb-3e03-41d1-89ee-c9209fb31836 tempest-GroupsTest-1561337077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8b1644d-8241-4f03-9534-78758229652c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:12:53.712650 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-493d62cb-3e03-41d1-89ee-c9209fb31836 tempest-GroupsTest-1561337077 None] Volume add357b2-8f5b-4715-90f6-dd8541e81209: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-add357b2-8f5b-4715-90f6-dd8541e81209', 'volume_size': 1} May 07 22:12:53.713242 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-493d62cb-3e03-41d1-89ee-c9209fb31836 tempest-GroupsTest-1561337077 None] creating volume 'volume-add357b2-8f5b-4715-90f6-dd8541e81209' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:12:53.714840 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-493d62cb-3e03-41d1-89ee-c9209fb31836 tempest-GroupsTest-1561337077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:12:53.825628 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-493d62cb-3e03-41d1-89ee-c9209fb31836 tempest-GroupsTest-1561337077 None] extra_specs: {} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:12:53.826308 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-493d62cb-3e03-41d1-89ee-c9209fb31836 tempest-GroupsTest-1561337077 None] extra_specs: {} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:12:53.837798 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-493d62cb-3e03-41d1-89ee-c9209fb31836 tempest-GroupsTest-1561337077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8b1644d-8241-4f03-9534-78758229652c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-add357b2-8f5b-4715-90f6-dd8541e81209', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:12:53.849062 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-493d62cb-3e03-41d1-89ee-c9209fb31836 tempest-GroupsTest-1561337077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ce31f9d-7902-41a5-b85c-5c24d4618910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:12:53.885493 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-493d62cb-3e03-41d1-89ee-c9209fb31836 tempest-GroupsTest-1561337077 None] Volume volume-add357b2-8f5b-4715-90f6-dd8541e81209 (add357b2-8f5b-4715-90f6-dd8541e81209): created successfully May 07 22:12:53.901908 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-493d62cb-3e03-41d1-89ee-c9209fb31836 tempest-GroupsTest-1561337077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ce31f9d-7902-41a5-b85c-5c24d4618910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:12:53.917102 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-493d62cb-3e03-41d1-89ee-c9209fb31836 tempest-GroupsTest-1561337077 None] Flow 'volume_create_manager' (5993ab7b-f84c-488e-8678-b46d187f9f3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:12:53.939601 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-493d62cb-3e03-41d1-89ee-c9209fb31836 tempest-GroupsTest-1561337077 None] Created volume successfully. May 07 22:12:55.091196 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae0190b7-d749-4c23-90c0-2abf30f0920b tempest-GroupsTest-1561337077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:12:55.133145 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-ae0190b7-d749-4c23-90c0-2abf30f0920b tempest-GroupsTest-1561337077 None] Flow 'volume_create_manager' (1d9184b9-12b0-445b-ac36-ac827c3421b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:12:55.142499 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-ae0190b7-d749-4c23-90c0-2abf30f0920b tempest-GroupsTest-1561337077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa721188-e2ee-4a7b-a2e5-5b9af5d6483d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:12:55.169689 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-ae0190b7-d749-4c23-90c0-2abf30f0920b tempest-GroupsTest-1561337077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa721188-e2ee-4a7b-a2e5-5b9af5d6483d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-403479153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5c828cf4-762e-45be-8249-f912a54441bf,host='ncdv-master-1@ceph#ceph',id=3f0b20af-f976-4930-be5a-26a0725cf620,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dbdd61ff73f47a88777a750e5994457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:12:55Z,use_quota=True,user_id='ac26310ffe63499cb9d12b9c4e2c8ad3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed311266-79bb-4e73-ae36-ab78a43cb4d7),volume_type_id=ed311266-79bb-4e73-ae36-ab78a43cb4d7)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:12:55.185599 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-ae0190b7-d749-4c23-90c0-2abf30f0920b tempest-GroupsTest-1561337077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01651ca0-554a-48ab-a975-30648c09b38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:12:55.191652 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-ae0190b7-d749-4c23-90c0-2abf30f0920b tempest-GroupsTest-1561337077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01651ca0-554a-48ab-a975-30648c09b38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:12:55.207824 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-ae0190b7-d749-4c23-90c0-2abf30f0920b tempest-GroupsTest-1561337077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba8a706d-c9a8-4969-b78a-f11a1ad3abb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:12:55.221428 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-ae0190b7-d749-4c23-90c0-2abf30f0920b tempest-GroupsTest-1561337077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba8a706d-c9a8-4969-b78a-f11a1ad3abb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f0b20af-f976-4930-be5a-26a0725cf620', 'volume_name': 'volume-3f0b20af-f976-4930-be5a-26a0725cf620', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:12:55.227156 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-ae0190b7-d749-4c23-90c0-2abf30f0920b tempest-GroupsTest-1561337077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1b2f374-af52-49df-af46-eba843ee23b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:12:55.231704 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-ae0190b7-d749-4c23-90c0-2abf30f0920b tempest-GroupsTest-1561337077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1b2f374-af52-49df-af46-eba843ee23b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:12:55.237407 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-ae0190b7-d749-4c23-90c0-2abf30f0920b tempest-GroupsTest-1561337077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fabde8e3-f6ea-4cde-96e4-e402c3f56782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:12:55.239461 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-ae0190b7-d749-4c23-90c0-2abf30f0920b tempest-GroupsTest-1561337077 None] Volume 3f0b20af-f976-4930-be5a-26a0725cf620: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f0b20af-f976-4930-be5a-26a0725cf620', 'volume_size': 1} May 07 22:12:55.240039 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-ae0190b7-d749-4c23-90c0-2abf30f0920b tempest-GroupsTest-1561337077 None] creating volume 'volume-3f0b20af-f976-4930-be5a-26a0725cf620' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:12:55.241009 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-ae0190b7-d749-4c23-90c0-2abf30f0920b tempest-GroupsTest-1561337077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:12:55.380245 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-ae0190b7-d749-4c23-90c0-2abf30f0920b tempest-GroupsTest-1561337077 None] extra_specs: {} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:12:55.380870 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-ae0190b7-d749-4c23-90c0-2abf30f0920b tempest-GroupsTest-1561337077 None] extra_specs: {} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:12:55.386184 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-ae0190b7-d749-4c23-90c0-2abf30f0920b tempest-GroupsTest-1561337077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fabde8e3-f6ea-4cde-96e4-e402c3f56782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f0b20af-f976-4930-be5a-26a0725cf620', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:12:55.396602 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-ae0190b7-d749-4c23-90c0-2abf30f0920b tempest-GroupsTest-1561337077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb685a96-d580-419d-af8e-f756319e73c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:12:55.414256 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-ae0190b7-d749-4c23-90c0-2abf30f0920b tempest-GroupsTest-1561337077 None] Volume volume-3f0b20af-f976-4930-be5a-26a0725cf620 (3f0b20af-f976-4930-be5a-26a0725cf620): created successfully May 07 22:12:55.420318 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-ae0190b7-d749-4c23-90c0-2abf30f0920b tempest-GroupsTest-1561337077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb685a96-d580-419d-af8e-f756319e73c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:12:55.430370 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-ae0190b7-d749-4c23-90c0-2abf30f0920b tempest-GroupsTest-1561337077 None] Flow 'volume_create_manager' (1d9184b9-12b0-445b-ac36-ac827c3421b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:12:55.441710 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-ae0190b7-d749-4c23-90c0-2abf30f0920b tempest-GroupsTest-1561337077 None] Created volume successfully. May 07 22:12:56.344321 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-f130c797-dbed-4de7-be60-e315d27e8c21 tempest-GroupsTest-1561337077 None] Update group completed successfully. May 07 22:12:57.025446 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-4c61c82c-7ab8-4f96-bdf2-408975bd220d req-b0269158-11bf-4365-9763-7c367bd62067 tempest-TestVolumeBootPattern-860620187 None] Terminate volume connection completed successfully. May 07 22:12:57.025865 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-4c61c82c-7ab8-4f96-bdf2-408975bd220d req-b0269158-11bf-4365-9763-7c367bd62067 tempest-TestVolumeBootPattern-860620187 None] Deleting attachment 55b676ee-3ca3-4e8b-afde-1f8089cfb9e6. {{(pid=129946) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 07 22:12:57.237513 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [req-4c61c82c-7ab8-4f96-bdf2-408975bd220d req-a29791c2-9a05-4b8f-af59-cd6ef74dcb92 tempest-TestVolumeBootPattern-860620187 None] Lock "b'cinder-1d37c15d-f551-45eb-9bb5-9b1c3469c4f2-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:12:57.280396 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-4c61c82c-7ab8-4f96-bdf2-408975bd220d req-a29791c2-9a05-4b8f-af59-cd6ef74dcb92 tempest-TestVolumeBootPattern-860620187 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:12:57.440712 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-4c61c82c-7ab8-4f96-bdf2-408975bd220d req-a29791c2-9a05-4b8f-af59-cd6ef74dcb92 tempest-TestVolumeBootPattern-860620187 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:12:57.452129 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-4c61c82c-7ab8-4f96-bdf2-408975bd220d req-a29791c2-9a05-4b8f-af59-cd6ef74dcb92 tempest-TestVolumeBootPattern-860620187 None] deleting rbd volume volume-1d37c15d-f551-45eb-9bb5-9b1c3469c4f2 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:12:57.914428 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-36a2803e-e49f-4a6b-a33d-6fdeeb4e1517 tempest-GroupsTest-1561337077 None] Update group completed successfully. May 07 22:12:58.020595 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [req-4c61c82c-7ab8-4f96-bdf2-408975bd220d req-a29791c2-9a05-4b8f-af59-cd6ef74dcb92 tempest-TestVolumeBootPattern-860620187 None] Created reservations ['b2b8598d-bcc3-4b52-a908-920c6dfdc728', 'b3cc7483-f11c-4255-b8dd-9298aeb5c8ea', '2b171ffd-e260-498c-865f-9491c6f0b01d', '9957cd2c-6984-4db3-a1ad-0d522db11109'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:12:58.088908 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-4c61c82c-7ab8-4f96-bdf2-408975bd220d req-a29791c2-9a05-4b8f-af59-cd6ef74dcb92 tempest-TestVolumeBootPattern-860620187 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:12:58.190705 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-4c61c82c-7ab8-4f96-bdf2-408975bd220d req-a29791c2-9a05-4b8f-af59-cd6ef74dcb92 tempest-TestVolumeBootPattern-860620187 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:12:58.261140 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [req-4c61c82c-7ab8-4f96-bdf2-408975bd220d req-a29791c2-9a05-4b8f-af59-cd6ef74dcb92 tempest-TestVolumeBootPattern-860620187 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:12:58.265580 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-4c61c82c-7ab8-4f96-bdf2-408975bd220d req-a29791c2-9a05-4b8f-af59-cd6ef74dcb92 tempest-TestVolumeBootPattern-860620187 None] Deleted volume successfully. May 07 22:12:58.291291 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [req-4c61c82c-7ab8-4f96-bdf2-408975bd220d req-a29791c2-9a05-4b8f-af59-cd6ef74dcb92 tempest-TestVolumeBootPattern-860620187 None] Lock "b'cinder-1d37c15d-f551-45eb-9bb5-9b1c3469c4f2-delete_volume'" released by "delete_volume" :: held 1.054s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:12:59.366666 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-9a752d48-d139-45a5-8908-238a51c7b4ab tempest-TestVolumeBootPattern-860620187 None] Lock "b'cinder-93e0a080-2e21-4a61-ae4e-18f16e01c432-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:12:59.368312 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-9a752d48-d139-45a5-8908-238a51c7b4ab tempest-TestVolumeBootPattern-860620187 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:12:59.578275 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-6e738e29-7078-4b7d-9075-62e86479d29a tempest-GroupsTest-1561337077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:12:59.671444 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-6e738e29-7078-4b7d-9075-62e86479d29a tempest-GroupsTest-1561337077 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:12:59.671945 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-6e738e29-7078-4b7d-9075-62e86479d29a tempest-GroupsTest-1561337077 None] Volume volume-3f0b20af-f976-4930-be5a-26a0725cf620 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:12:59.678628 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-6e738e29-7078-4b7d-9075-62e86479d29a tempest-GroupsTest-1561337077 None] deleting rbd volume volume-3f0b20af-f976-4930-be5a-26a0725cf620 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:12:59.998824 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-6e738e29-7078-4b7d-9075-62e86479d29a tempest-GroupsTest-1561337077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:00.104754 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-6e738e29-7078-4b7d-9075-62e86479d29a tempest-GroupsTest-1561337077 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:13:00.105177 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-6e738e29-7078-4b7d-9075-62e86479d29a tempest-GroupsTest-1561337077 None] Volume volume-add357b2-8f5b-4715-90f6-dd8541e81209 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:13:00.115855 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-6e738e29-7078-4b7d-9075-62e86479d29a tempest-GroupsTest-1561337077 None] deleting rbd volume volume-add357b2-8f5b-4715-90f6-dd8541e81209 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:13:00.583862 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-9a752d48-d139-45a5-8908-238a51c7b4ab tempest-TestVolumeBootPattern-860620187 None] Created reservations ['503cbc93-e864-45cf-97e6-e0259b2340d3', '83ba23fb-3b20-4ef5-9310-f3654df1392b', '7442b7ec-9ecb-4388-beb1-de5af5578a37', '0445253f-8113-4816-9a45-1d1412a92b8e'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:13:00.656094 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-9a752d48-d139-45a5-8908-238a51c7b4ab tempest-TestVolumeBootPattern-860620187 None] Delete snapshot completed successfully. May 07 22:13:00.672631 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-9a752d48-d139-45a5-8908-238a51c7b4ab tempest-TestVolumeBootPattern-860620187 None] Lock "b'cinder-93e0a080-2e21-4a61-ae4e-18f16e01c432-delete_snapshot'" released by "delete_snapshot" :: held 1.306s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:13:00.732875 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-6e738e29-7078-4b7d-9075-62e86479d29a tempest-GroupsTest-1561337077 None] Created reservations ['2914c471-9b12-404e-9a07-b106572c3d6a'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:13:00.792511 ncdv-master-1 cinder-volume[129946]: WARNING cinder.quota [None req-6e738e29-7078-4b7d-9075-62e86479d29a tempest-GroupsTest-1561337077 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-365748539 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-365748539, it is now deprecated. Please use the default quota class for default quota. May 07 22:13:00.798323 ncdv-master-1 cinder-volume[129946]: WARNING cinder.quota [None req-6e738e29-7078-4b7d-9075-62e86479d29a tempest-GroupsTest-1561337077 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-365748539 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-365748539, it is now deprecated. Please use the default quota class for default quota. May 07 22:13:00.829558 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-6e738e29-7078-4b7d-9075-62e86479d29a tempest-GroupsTest-1561337077 None] Created reservations ['4e1107b6-99ae-4239-b678-7c9baccdca2c', '7d3f5d51-a6c0-4aa2-ab46-ce06d032f280', 'ee2f2a19-046c-4643-8326-53ea893c71a6', 'a744a1a2-62a0-4aa1-af8c-8a94f463ad80'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:13:01.082821 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-6e738e29-7078-4b7d-9075-62e86479d29a tempest-GroupsTest-1561337077 None] Created reservations ['0f5f9bde-a853-40b8-b0c6-91a0a18bf84e', '3fadf4e1-4d37-4fdc-90e6-eca2690a2664', 'a70842a6-144c-41b3-834c-941cee45e3e7', '984a1ace-823b-4080-8939-036bd6038f12'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:13:01.212085 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-6e738e29-7078-4b7d-9075-62e86479d29a tempest-GroupsTest-1561337077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:01.273275 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-6e738e29-7078-4b7d-9075-62e86479d29a tempest-GroupsTest-1561337077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:01.333174 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-6e738e29-7078-4b7d-9075-62e86479d29a tempest-GroupsTest-1561337077 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:13:01.344855 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-6e738e29-7078-4b7d-9075-62e86479d29a tempest-GroupsTest-1561337077 None] Delete group completed successfully. May 07 22:13:01.577293 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-2c90bf15-c9b8-4cbe-ba6c-d58f1b78d60b tempest-TestVolumeBootPattern-860620187 None] Lock "b'cinder-245353b2-c3f4-4312-a59d-98b625fafddf-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:13:01.633321 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-2c90bf15-c9b8-4cbe-ba6c-d58f1b78d60b tempest-TestVolumeBootPattern-860620187 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:01.749853 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-2c90bf15-c9b8-4cbe-ba6c-d58f1b78d60b tempest-TestVolumeBootPattern-860620187 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:13:01.760126 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-2c90bf15-c9b8-4cbe-ba6c-d58f1b78d60b tempest-TestVolumeBootPattern-860620187 None] deleting rbd volume volume-245353b2-c3f4-4312-a59d-98b625fafddf {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:13:02.192460 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-2c90bf15-c9b8-4cbe-ba6c-d58f1b78d60b tempest-TestVolumeBootPattern-860620187 None] volume is a clone so cleaning references {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} May 07 22:13:02.232272 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-2c90bf15-c9b8-4cbe-ba6c-d58f1b78d60b tempest-TestVolumeBootPattern-860620187 None] deleting parent snapshot volume-245353b2-c3f4-4312-a59d-98b625fafddf.clone_snap {{(pid=129946) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} May 07 22:13:02.574110 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-2c90bf15-c9b8-4cbe-ba6c-d58f1b78d60b tempest-TestVolumeBootPattern-860620187 None] Created reservations ['69ced99e-5afe-40cc-bd94-e6e951aee77e', '4c9891b2-9b08-450d-9842-c95b520a0621', 'cce92de5-10fa-4853-92fd-f63dc335f446', 'b5bd06e3-3a1f-45c3-87c6-954249ff793b'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:13:02.661370 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-2c90bf15-c9b8-4cbe-ba6c-d58f1b78d60b tempest-TestVolumeBootPattern-860620187 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:02.738612 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-2c90bf15-c9b8-4cbe-ba6c-d58f1b78d60b tempest-TestVolumeBootPattern-860620187 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:02.809279 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-2c90bf15-c9b8-4cbe-ba6c-d58f1b78d60b tempest-TestVolumeBootPattern-860620187 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:13:02.814084 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-2c90bf15-c9b8-4cbe-ba6c-d58f1b78d60b tempest-TestVolumeBootPattern-860620187 None] Deleted volume successfully. May 07 22:13:02.828883 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-2c90bf15-c9b8-4cbe-ba6c-d58f1b78d60b tempest-TestVolumeBootPattern-860620187 None] Lock "b'cinder-245353b2-c3f4-4312-a59d-98b625fafddf-delete_volume'" released by "delete_volume" :: held 1.252s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:13:03.248939 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-326500c5-a26f-4560-9864-617fd34c1784 tempest-TestVolumeBootPattern-860620187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:13:03.270249 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-326500c5-a26f-4560-9864-617fd34c1784 tempest-TestVolumeBootPattern-860620187 None] Flow 'volume_create_manager' (5b531a39-9bb7-4340-a425-d9d849cb71bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:13:03.277965 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-326500c5-a26f-4560-9864-617fd34c1784 tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45eebfc9-5a57-4e87-8336-7863a0a11bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:03.301887 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-326500c5-a26f-4560-9864-617fd34c1784 tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45eebfc9-5a57-4e87-8336-7863a0a11bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:13:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-679988945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9a081585-6d81-4d08-8c50-ae0498445a58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3657e8df46a4252b9eb1eb159306a66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:13:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:13:03Z,use_quota=True,user_id='9b4988836610494ab48a138bd43d5b52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:03.309770 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-326500c5-a26f-4560-9864-617fd34c1784 tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73bebdc6-8a01-4421-867e-b7b9262c0b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:03.314132 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-326500c5-a26f-4560-9864-617fd34c1784 tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73bebdc6-8a01-4421-867e-b7b9262c0b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:03.319571 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-326500c5-a26f-4560-9864-617fd34c1784 tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d60950c1-4c1f-4e1f-bd9f-de4dad49fe6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:03.416154 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-326500c5-a26f-4560-9864-617fd34c1784 tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d60950c1-4c1f-4e1f-bd9f-de4dad49fe6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9a081585-6d81-4d08-8c50-ae0498445a58', 'volume_name': 'volume-9a081585-6d81-4d08-8c50-ae0498445a58', 'volume_size': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e2f828af0706465883131e16cb564d05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'created_at': datetime.datetime(2022, 5, 7, 21, 36, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:03.421868 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-326500c5-a26f-4560-9864-617fd34c1784 tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d39887c-36fa-450a-9d3f-1ff726d5e987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:03.427640 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-326500c5-a26f-4560-9864-617fd34c1784 tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d39887c-36fa-450a-9d3f-1ff726d5e987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:03.433510 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-326500c5-a26f-4560-9864-617fd34c1784 tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54523cb0-7461-41a4-8fb4-2dd60d663b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:03.434992 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-326500c5-a26f-4560-9864-617fd34c1784 tempest-TestVolumeBootPattern-860620187 None] Volume 9a081585-6d81-4d08-8c50-ae0498445a58: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9a081585-6d81-4d08-8c50-ae0498445a58', 'volume_size': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e2f828af0706465883131e16cb564d05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'created_at': datetime.datetime(2022, 5, 7, 21, 36, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } May 07 22:13:03.435656 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-326500c5-a26f-4560-9864-617fd34c1784 tempest-TestVolumeBootPattern-860620187 None] Cloning 9a081585-6d81-4d08-8c50-ae0498445a58 from image 3756ae98-5c12-48e7-920e-ef5d1dd5543c at location (None, None). {{(pid=129946) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} May 07 22:13:03.444265 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-326500c5-a26f-4560-9864-617fd34c1784 tempest-TestVolumeBootPattern-860620187 None] Lock "b'cinder-3756ae98-5c12-48e7-920e-ef5d1dd5543c'" acquired by "_prepare_image_cache_entry" :: waited 0.007s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:13:03.455346 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-326500c5-a26f-4560-9864-617fd34c1784 tempest-TestVolumeBootPattern-860620187 None] Found image-volume cache entry: {'id': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'volume_id': '82279f40-9683-441f-a541-0db8b9177f48', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9), 'last_used': datetime.datetime(2022, 5, 7, 22, 13, 3, 448467)}. {{(pid=129946) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 07 22:13:03.456083 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-326500c5-a26f-4560-9864-617fd34c1784 tempest-TestVolumeBootPattern-860620187 None] Image-volume cache entry image_update_at = 2022-05-07 21:37:09+00:00, requested image updated_at = 2022-05-07 21:37:09+00:00. {{(pid=129946) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 07 22:13:03.456493 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-326500c5-a26f-4560-9864-617fd34c1784 tempest-TestVolumeBootPattern-860620187 None] Found cache entry for image = 3756ae98-5c12-48e7-920e-ef5d1dd5543c on host ncdv-master-1@ceph#ceph. {{(pid=129946) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} May 07 22:13:03.461455 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-326500c5-a26f-4560-9864-617fd34c1784 tempest-TestVolumeBootPattern-860620187 None] Lock "b'cinder-3756ae98-5c12-48e7-920e-ef5d1dd5543c'" released by "_prepare_image_cache_entry" :: held 0.017s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:13:03.462501 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-326500c5-a26f-4560-9864-617fd34c1784 tempest-TestVolumeBootPattern-860620187 None] Attempting to retrieve cache entry for image = 3756ae98-5c12-48e7-920e-ef5d1dd5543c on host ncdv-master-1@ceph#ceph. {{(pid=129946) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} May 07 22:13:03.469047 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-326500c5-a26f-4560-9864-617fd34c1784 tempest-TestVolumeBootPattern-860620187 None] Found image-volume cache entry: {'id': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'volume_id': '82279f40-9683-441f-a541-0db8b9177f48', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9), 'last_used': datetime.datetime(2022, 5, 7, 22, 13, 3, 466583)}. {{(pid=129946) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 07 22:13:03.469472 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-326500c5-a26f-4560-9864-617fd34c1784 tempest-TestVolumeBootPattern-860620187 None] Image-volume cache entry image_update_at = 2022-05-07 21:37:09+00:00, requested image updated_at = 2022-05-07 21:37:09+00:00. {{(pid=129946) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 07 22:13:03.469957 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-326500c5-a26f-4560-9864-617fd34c1784 tempest-TestVolumeBootPattern-860620187 None] Creating from source image-volume 82279f40-9683-441f-a541-0db8b9177f48 {{(pid=129946) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} May 07 22:13:03.484160 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-326500c5-a26f-4560-9864-617fd34c1784 tempest-TestVolumeBootPattern-860620187 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:03.567252 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-326500c5-a26f-4560-9864-617fd34c1784 tempest-TestVolumeBootPattern-860620187 None] creating snapshot='volume-9a081585-6d81-4d08-8c50-ae0498445a58.clone_snap' {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} May 07 22:13:04.525816 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-326500c5-a26f-4560-9864-617fd34c1784 tempest-TestVolumeBootPattern-860620187 None] cloning 'volume-82279f40-9683-441f-a541-0db8b9177f48@volume-9a081585-6d81-4d08-8c50-ae0498445a58.clone_snap' to 'volume-9a081585-6d81-4d08-8c50-ae0498445a58' {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 07 22:13:04.736497 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-326500c5-a26f-4560-9864-617fd34c1784 tempest-TestVolumeBootPattern-860620187 None] Volume volume-3864f924-91b4-4015-ab37-8bdbf8ad652d.deleted is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:13:04.738503 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-326500c5-a26f-4560-9864-617fd34c1784 tempest-TestVolumeBootPattern-860620187 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:13:04.739171 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-326500c5-a26f-4560-9864-617fd34c1784 tempest-TestVolumeBootPattern-860620187 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:13:04.766181 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-326500c5-a26f-4560-9864-617fd34c1784 tempest-TestVolumeBootPattern-860620187 None] clone created successfully {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} May 07 22:13:04.767140 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.volume_utils [None req-326500c5-a26f-4560-9864-617fd34c1784 tempest-TestVolumeBootPattern-860620187 None] Marking volume 9a081585-6d81-4d08-8c50-ae0498445a58 as bootable. {{(pid=129946) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} May 07 22:13:04.781291 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-326500c5-a26f-4560-9864-617fd34c1784 tempest-TestVolumeBootPattern-860620187 None] Copying metadata from image 3756ae98-5c12-48e7-920e-ef5d1dd5543c to 9a081585-6d81-4d08-8c50-ae0498445a58. {{(pid=129946) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} May 07 22:13:04.782536 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-326500c5-a26f-4560-9864-617fd34c1784 tempest-TestVolumeBootPattern-860620187 None] Creating volume glance metadata for volume 9a081585-6d81-4d08-8c50-ae0498445a58 backed by image 3756ae98-5c12-48e7-920e-ef5d1dd5543c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129946) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} May 07 22:13:04.960089 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-326500c5-a26f-4560-9864-617fd34c1784 tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54523cb0-7461-41a4-8fb4-2dd60d663b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a081585-6d81-4d08-8c50-ae0498445a58', 'volume_size': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e2f828af0706465883131e16cb564d05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'created_at': datetime.datetime(2022, 5, 7, 21, 36, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:04.979215 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-326500c5-a26f-4560-9864-617fd34c1784 tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d70c0e6-20e9-40d5-9813-25b87c80305e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:04.998380 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-326500c5-a26f-4560-9864-617fd34c1784 tempest-TestVolumeBootPattern-860620187 None] Volume volume-9a081585-6d81-4d08-8c50-ae0498445a58 (9a081585-6d81-4d08-8c50-ae0498445a58): created successfully May 07 22:13:05.005395 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-326500c5-a26f-4560-9864-617fd34c1784 tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d70c0e6-20e9-40d5-9813-25b87c80305e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:05.012493 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-326500c5-a26f-4560-9864-617fd34c1784 tempest-TestVolumeBootPattern-860620187 None] Flow 'volume_create_manager' (5b531a39-9bb7-4340-a425-d9d849cb71bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:13:05.020600 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-e80dffe0-3163-4a5d-8e62-00c2a52fa49b tempest-VolumesSnapshotTestJSON-1726756463 None] Created reservations ['65db6d84-2c19-4d4d-b634-d78c2b7ca99b', '15ca5bab-cb51-497f-8ea8-41a0a4865ef0', '3ff84a9b-7cbb-42ee-9cc7-8a52bdc45700', '031c7d30-d0a6-41a0-b2de-25a93dc0c5ec'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:13:05.038172 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-326500c5-a26f-4560-9864-617fd34c1784 tempest-TestVolumeBootPattern-860620187 None] Created volume successfully. May 07 22:13:05.130458 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-e80dffe0-3163-4a5d-8e62-00c2a52fa49b tempest-VolumesSnapshotTestJSON-1726756463 None] Delete snapshot completed successfully. May 07 22:13:05.135925 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-e80dffe0-3163-4a5d-8e62-00c2a52fa49b tempest-VolumesSnapshotTestJSON-1726756463 None] Lock "b'cinder-6bdcd291-3b32-4a2d-befd-d710cb9326f8-delete_snapshot'" released by "delete_snapshot" :: held 30.602s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:13:06.809627 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-47105e26-5595-4676-96da-a226f1737807 req-43f099e7-b559-4918-ab91-927b21018bdc tempest-VolumesSnapshotTestJSON-1726756463 None] Terminate volume connection completed successfully. May 07 22:13:06.810474 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-47105e26-5595-4676-96da-a226f1737807 req-43f099e7-b559-4918-ab91-927b21018bdc tempest-VolumesSnapshotTestJSON-1726756463 None] Deleting attachment af4934a4-e9ed-46cb-a0f7-d2f38651482d. {{(pid=129946) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 07 22:13:10.063250 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-09f60f01-39cb-4db9-a0b5-a5201a9bcb51 req-6b673d71-b682-4b3a-a654-c1244acc7da2 tempest-TestVolumeBootPattern-860620187 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 22:13:11.025513 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-09f60f01-39cb-4db9-a0b5-a5201a9bcb51 req-6b673d71-b682-4b3a-a654-c1244acc7da2 tempest-TestVolumeBootPattern-860620187 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.016s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 22:13:11.026333 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-09f60f01-39cb-4db9-a0b5-a5201a9bcb51 req-6b673d71-b682-4b3a-a654-c1244acc7da2 tempest-TestVolumeBootPattern-860620187 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9a081585-6d81-4d08-8c50-ae0498445a58', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3ca0b836-1cfe-436a-b0fa-deb74d3203d9', 'volume_id': '9a081585-6d81-4d08-8c50-ae0498445a58', 'discard': True}} {{(pid=129946) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 07 22:13:11.076174 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-09f60f01-39cb-4db9-a0b5-a5201a9bcb51 req-6b673d71-b682-4b3a-a654-c1244acc7da2 tempest-TestVolumeBootPattern-860620187 None] Connection info returned from driver {'name': 'volumes/volume-9a081585-6d81-4d08-8c50-ae0498445a58', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '9a081585-6d81-4d08-8c50-ae0498445a58', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '5e049b6a-ac7b-41a5-bc29-1281c86efbc7'} {{(pid=129946) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 07 22:13:11.221639 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-09f60f01-39cb-4db9-a0b5-a5201a9bcb51 req-6b673d71-b682-4b3a-a654-c1244acc7da2 tempest-TestVolumeBootPattern-860620187 None] attachment_update completed successfully. May 07 22:13:14.254602 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b964934-cd32-435f-919a-edbbcc452579 tempest-VolumesSnapshotTestJSON-1726756463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:13:14.313512 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-6b964934-cd32-435f-919a-edbbcc452579 tempest-VolumesSnapshotTestJSON-1726756463 None] Flow 'volume_create_manager' (ef5c5474-9361-46d3-a376-48cfecc03627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:13:14.333253 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-6b964934-cd32-435f-919a-edbbcc452579 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5625563-1adb-489d-bdfe-82186a3286e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:14.377941 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-6b964934-cd32-435f-919a-edbbcc452579 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5625563-1adb-489d-bdfe-82186a3286e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1959133509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f3b7da6f-e5da-4aae-b2d5-8de13cfba398,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72be56c2d4a54014a8f741c451fe014e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:13:14Z,use_quota=True,user_id='97ef9a3039534d90ba9d268970cbe9d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:14.391319 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-6b964934-cd32-435f-919a-edbbcc452579 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deac0764-5742-47f4-add6-2cfe883de799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:14.399643 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-6b964934-cd32-435f-919a-edbbcc452579 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deac0764-5742-47f4-add6-2cfe883de799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:14.407571 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-6b964934-cd32-435f-919a-edbbcc452579 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34252d8c-2757-4941-88aa-977169bfe08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:14.418335 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-6b964934-cd32-435f-919a-edbbcc452579 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34252d8c-2757-4941-88aa-977169bfe08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3b7da6f-e5da-4aae-b2d5-8de13cfba398', 'volume_name': 'volume-f3b7da6f-e5da-4aae-b2d5-8de13cfba398', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:14.426402 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-6b964934-cd32-435f-919a-edbbcc452579 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4209c4fe-7065-48e0-b1b7-30acd446de73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:14.443594 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-6b964934-cd32-435f-919a-edbbcc452579 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4209c4fe-7065-48e0-b1b7-30acd446de73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:14.451211 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-6b964934-cd32-435f-919a-edbbcc452579 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d850ceb-6cbd-4526-aff5-5a7a05aa3ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:14.452671 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-6b964934-cd32-435f-919a-edbbcc452579 tempest-VolumesSnapshotTestJSON-1726756463 None] Volume f3b7da6f-e5da-4aae-b2d5-8de13cfba398: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3b7da6f-e5da-4aae-b2d5-8de13cfba398', 'volume_size': 1} May 07 22:13:14.453344 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-6b964934-cd32-435f-919a-edbbcc452579 tempest-VolumesSnapshotTestJSON-1726756463 None] creating volume 'volume-f3b7da6f-e5da-4aae-b2d5-8de13cfba398' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:13:14.459297 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-6b964934-cd32-435f-919a-edbbcc452579 tempest-VolumesSnapshotTestJSON-1726756463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:14.583215 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-6b964934-cd32-435f-919a-edbbcc452579 tempest-VolumesSnapshotTestJSON-1726756463 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:13:14.584786 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-6b964934-cd32-435f-919a-edbbcc452579 tempest-VolumesSnapshotTestJSON-1726756463 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:13:14.592939 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-6b964934-cd32-435f-919a-edbbcc452579 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d850ceb-6cbd-4526-aff5-5a7a05aa3ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3b7da6f-e5da-4aae-b2d5-8de13cfba398', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:14.599188 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-6b964934-cd32-435f-919a-edbbcc452579 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (079df1a9-f0a9-4613-be13-9703b5b08766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:14.612973 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-6b964934-cd32-435f-919a-edbbcc452579 tempest-VolumesSnapshotTestJSON-1726756463 None] Volume volume-f3b7da6f-e5da-4aae-b2d5-8de13cfba398 (f3b7da6f-e5da-4aae-b2d5-8de13cfba398): created successfully May 07 22:13:14.617799 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-6b964934-cd32-435f-919a-edbbcc452579 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (079df1a9-f0a9-4613-be13-9703b5b08766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:14.631483 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-6b964934-cd32-435f-919a-edbbcc452579 tempest-VolumesSnapshotTestJSON-1726756463 None] Flow 'volume_create_manager' (ef5c5474-9361-46d3-a376-48cfecc03627) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:13:14.643287 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-6b964934-cd32-435f-919a-edbbcc452579 tempest-VolumesSnapshotTestJSON-1726756463 None] Created volume successfully. May 07 22:13:15.643312 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-4ed095e7-c5ca-4c76-aae2-55b44c6b2ed0 tempest-VolumesSnapshotTestJSON-1726756463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:16.600333 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-4ed095e7-c5ca-4c76-aae2-55b44c6b2ed0 tempest-VolumesSnapshotTestJSON-1726756463 None] Create snapshot completed successfully May 07 22:13:18.543261 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-110b3788-f281-47f5-bc7c-3c862a1ea916 tempest-VolumesSnapshotTestJSON-1726756463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:13:18.601102 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-110b3788-f281-47f5-bc7c-3c862a1ea916 tempest-VolumesSnapshotTestJSON-1726756463 None] Flow 'volume_create_manager' (86c66ee6-0814-4dc6-82e0-0bb579bb47d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:13:18.621278 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-110b3788-f281-47f5-bc7c-3c862a1ea916 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f25e11a3-32cc-4730-8fd8-5452a40d3fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:18.653953 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-110b3788-f281-47f5-bc7c-3c862a1ea916 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f25e11a3-32cc-4730-8fd8-5452a40d3fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1765952940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=42f4626c-46bb-4637-8f90-bd2e7b4f0ac7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72be56c2d4a54014a8f741c451fe014e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:13:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=b47cee24-925b-40f2-b297-ef1fdea84dde,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:13:18Z,use_quota=True,user_id='97ef9a3039534d90ba9d268970cbe9d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:18.663370 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-110b3788-f281-47f5-bc7c-3c862a1ea916 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (155848cf-7025-4f5f-bde7-87ccfca02e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:18.668545 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-110b3788-f281-47f5-bc7c-3c862a1ea916 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (155848cf-7025-4f5f-bde7-87ccfca02e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:18.676774 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-110b3788-f281-47f5-bc7c-3c862a1ea916 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96275968-6c71-4970-81da-4121f4bfd1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:18.682394 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-110b3788-f281-47f5-bc7c-3c862a1ea916 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96275968-6c71-4970-81da-4121f4bfd1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '42f4626c-46bb-4637-8f90-bd2e7b4f0ac7', 'volume_name': 'volume-42f4626c-46bb-4637-8f90-bd2e7b4f0ac7', 'volume_size': 2, 'snapshot_id': 'b47cee24-925b-40f2-b297-ef1fdea84dde'}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:18.690207 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-110b3788-f281-47f5-bc7c-3c862a1ea916 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7292b8c5-738a-476a-b659-6217b79a350f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:18.695023 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-110b3788-f281-47f5-bc7c-3c862a1ea916 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7292b8c5-738a-476a-b659-6217b79a350f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:18.701583 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-110b3788-f281-47f5-bc7c-3c862a1ea916 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0956b392-3e8b-467e-9d27-9d39e655313d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:18.703837 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-110b3788-f281-47f5-bc7c-3c862a1ea916 tempest-VolumesSnapshotTestJSON-1726756463 None] Volume 42f4626c-46bb-4637-8f90-bd2e7b4f0ac7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-42f4626c-46bb-4637-8f90-bd2e7b4f0ac7', 'volume_size': 2, 'snapshot_id': 'b47cee24-925b-40f2-b297-ef1fdea84dde'} May 07 22:13:18.746696 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-110b3788-f281-47f5-bc7c-3c862a1ea916 tempest-VolumesSnapshotTestJSON-1726756463 None] cloning volumes/volume-f3b7da6f-e5da-4aae-b2d5-8de13cfba398@snapshot-b47cee24-925b-40f2-b297-ef1fdea84dde to volume-42f4626c-46bb-4637-8f90-bd2e7b4f0ac7 {{(pid=129946) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1091}} May 07 22:13:18.747732 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-110b3788-f281-47f5-bc7c-3c862a1ea916 tempest-VolumesSnapshotTestJSON-1726756463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:18.845384 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-110b3788-f281-47f5-bc7c-3c862a1ea916 tempest-VolumesSnapshotTestJSON-1726756463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:19.127193 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-110b3788-f281-47f5-bc7c-3c862a1ea916 tempest-VolumesSnapshotTestJSON-1726756463 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:13:19.127664 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-110b3788-f281-47f5-bc7c-3c862a1ea916 tempest-VolumesSnapshotTestJSON-1726756463 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:13:19.138413 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-110b3788-f281-47f5-bc7c-3c862a1ea916 tempest-VolumesSnapshotTestJSON-1726756463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:19.526164 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-110b3788-f281-47f5-bc7c-3c862a1ea916 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0956b392-3e8b-467e-9d27-9d39e655313d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42f4626c-46bb-4637-8f90-bd2e7b4f0ac7', 'volume_size': 2, 'snapshot_id': 'b47cee24-925b-40f2-b297-ef1fdea84dde'}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:19.572311 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-110b3788-f281-47f5-bc7c-3c862a1ea916 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2db07be6-3aa8-4057-9052-fd43bd2ec103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:19.594732 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-110b3788-f281-47f5-bc7c-3c862a1ea916 tempest-VolumesSnapshotTestJSON-1726756463 None] Volume volume-42f4626c-46bb-4637-8f90-bd2e7b4f0ac7 (42f4626c-46bb-4637-8f90-bd2e7b4f0ac7): created successfully May 07 22:13:19.605692 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-110b3788-f281-47f5-bc7c-3c862a1ea916 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2db07be6-3aa8-4057-9052-fd43bd2ec103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:19.615557 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-110b3788-f281-47f5-bc7c-3c862a1ea916 tempest-VolumesSnapshotTestJSON-1726756463 None] Flow 'volume_create_manager' (86c66ee6-0814-4dc6-82e0-0bb579bb47d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:13:19.644603 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-110b3788-f281-47f5-bc7c-3c862a1ea916 tempest-VolumesSnapshotTestJSON-1726756463 None] Created volume successfully. May 07 22:13:20.867822 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-bc4bab22-580a-44fe-87cc-32f5feb99eaa tempest-VolumesSnapshotTestJSON-1726756463 None] Lock "b'cinder-42f4626c-46bb-4637-8f90-bd2e7b4f0ac7-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:13:20.971305 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-bc4bab22-580a-44fe-87cc-32f5feb99eaa tempest-VolumesSnapshotTestJSON-1726756463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:21.113141 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-bc4bab22-580a-44fe-87cc-32f5feb99eaa tempest-VolumesSnapshotTestJSON-1726756463 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:13:21.129919 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-bc4bab22-580a-44fe-87cc-32f5feb99eaa tempest-VolumesSnapshotTestJSON-1726756463 None] deleting rbd volume volume-42f4626c-46bb-4637-8f90-bd2e7b4f0ac7 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:13:21.670984 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-bc4bab22-580a-44fe-87cc-32f5feb99eaa tempest-VolumesSnapshotTestJSON-1726756463 None] Created reservations ['4ef472e7-91ef-41da-a856-6697f8843ce4', '56643ff4-e781-4c9f-b135-e2cb9dfd26cb', 'b29e4377-c1e1-474c-9f0b-0b0d0dc8fd98', '2405b9cc-cb8d-4a3a-9ac5-e9354efc99da'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:13:21.789821 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-bc4bab22-580a-44fe-87cc-32f5feb99eaa tempest-VolumesSnapshotTestJSON-1726756463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:21.893125 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-bc4bab22-580a-44fe-87cc-32f5feb99eaa tempest-VolumesSnapshotTestJSON-1726756463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:21.958304 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-bc4bab22-580a-44fe-87cc-32f5feb99eaa tempest-VolumesSnapshotTestJSON-1726756463 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:13:21.967051 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-bc4bab22-580a-44fe-87cc-32f5feb99eaa tempest-VolumesSnapshotTestJSON-1726756463 None] Deleted volume successfully. May 07 22:13:22.024986 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-bc4bab22-580a-44fe-87cc-32f5feb99eaa tempest-VolumesSnapshotTestJSON-1726756463 None] Lock "b'cinder-42f4626c-46bb-4637-8f90-bd2e7b4f0ac7-delete_volume'" released by "delete_volume" :: held 1.150s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:13:22.765253 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7ded0c7-669b-494c-9bd8-7acf9dad08d8 tempest-VolumesSnapshotTestJSON-1726756463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:13:22.807603 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-c7ded0c7-669b-494c-9bd8-7acf9dad08d8 tempest-VolumesSnapshotTestJSON-1726756463 None] Flow 'volume_create_manager' (b9d62c6e-8334-4524-8437-00ae1a3e54d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:13:22.818533 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-c7ded0c7-669b-494c-9bd8-7acf9dad08d8 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f6d36f6-aeb0-4319-92b3-dc3761623fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:22.840856 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-c7ded0c7-669b-494c-9bd8-7acf9dad08d8 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f6d36f6-aeb0-4319-92b3-dc3761623fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-252068531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=30769e6c-6167-442f-8c17-d9e0c4cf97e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72be56c2d4a54014a8f741c451fe014e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:13:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:13:23Z,use_quota=True,user_id='97ef9a3039534d90ba9d268970cbe9d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:22.851686 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-c7ded0c7-669b-494c-9bd8-7acf9dad08d8 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51a79ddb-5e94-4023-8b55-9084c759db72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:22.862331 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-c7ded0c7-669b-494c-9bd8-7acf9dad08d8 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51a79ddb-5e94-4023-8b55-9084c759db72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:22.877042 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-c7ded0c7-669b-494c-9bd8-7acf9dad08d8 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64d9daf2-a504-4900-bcc3-a29c85c539d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:22.883245 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-c7ded0c7-669b-494c-9bd8-7acf9dad08d8 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64d9daf2-a504-4900-bcc3-a29c85c539d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30769e6c-6167-442f-8c17-d9e0c4cf97e2', 'volume_name': 'volume-30769e6c-6167-442f-8c17-d9e0c4cf97e2', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:22.910238 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-c7ded0c7-669b-494c-9bd8-7acf9dad08d8 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76afa991-631a-499a-a5a1-e9f7f58d4315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:22.918265 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-c7ded0c7-669b-494c-9bd8-7acf9dad08d8 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76afa991-631a-499a-a5a1-e9f7f58d4315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:22.932162 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-c7ded0c7-669b-494c-9bd8-7acf9dad08d8 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a73ae111-06d9-4479-bcc2-d70db592144f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:22.936861 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-c7ded0c7-669b-494c-9bd8-7acf9dad08d8 tempest-VolumesSnapshotTestJSON-1726756463 None] Volume 30769e6c-6167-442f-8c17-d9e0c4cf97e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30769e6c-6167-442f-8c17-d9e0c4cf97e2', 'volume_size': 1} May 07 22:13:22.938946 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-c7ded0c7-669b-494c-9bd8-7acf9dad08d8 tempest-VolumesSnapshotTestJSON-1726756463 None] creating volume 'volume-30769e6c-6167-442f-8c17-d9e0c4cf97e2' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:13:22.939792 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-c7ded0c7-669b-494c-9bd8-7acf9dad08d8 tempest-VolumesSnapshotTestJSON-1726756463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:23.127658 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-c7ded0c7-669b-494c-9bd8-7acf9dad08d8 tempest-VolumesSnapshotTestJSON-1726756463 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:13:23.128043 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-c7ded0c7-669b-494c-9bd8-7acf9dad08d8 tempest-VolumesSnapshotTestJSON-1726756463 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:13:23.135471 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-c7ded0c7-669b-494c-9bd8-7acf9dad08d8 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a73ae111-06d9-4479-bcc2-d70db592144f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30769e6c-6167-442f-8c17-d9e0c4cf97e2', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:23.140400 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-c7ded0c7-669b-494c-9bd8-7acf9dad08d8 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17c4ca15-180b-48fe-87e1-4156d3cd3725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:23.165424 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-c7ded0c7-669b-494c-9bd8-7acf9dad08d8 tempest-VolumesSnapshotTestJSON-1726756463 None] Volume volume-30769e6c-6167-442f-8c17-d9e0c4cf97e2 (30769e6c-6167-442f-8c17-d9e0c4cf97e2): created successfully May 07 22:13:23.173424 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-c7ded0c7-669b-494c-9bd8-7acf9dad08d8 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17c4ca15-180b-48fe-87e1-4156d3cd3725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:23.184656 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-c7ded0c7-669b-494c-9bd8-7acf9dad08d8 tempest-VolumesSnapshotTestJSON-1726756463 None] Flow 'volume_create_manager' (b9d62c6e-8334-4524-8437-00ae1a3e54d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:13:23.207089 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-c7ded0c7-669b-494c-9bd8-7acf9dad08d8 tempest-VolumesSnapshotTestJSON-1726756463 None] Created volume successfully. May 07 22:13:24.083794 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-ff4c69d5-18bb-4e54-81de-fa13418a5968 tempest-VolumesSnapshotTestJSON-1726756463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:24.795355 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-ff4c69d5-18bb-4e54-81de-fa13418a5968 tempest-VolumesSnapshotTestJSON-1726756463 None] Create snapshot completed successfully May 07 22:13:25.767569 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-57de548a-770b-406d-a0e4-57e89838ae07 tempest-VolumesSnapshotTestJSON-1726756463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:13:25.799831 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-57de548a-770b-406d-a0e4-57e89838ae07 tempest-VolumesSnapshotTestJSON-1726756463 None] Flow 'volume_create_manager' (a0d64b13-e165-4954-b189-848a85528a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:13:25.807357 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-57de548a-770b-406d-a0e4-57e89838ae07 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3245128a-0323-4136-a15a-d7cc2299ddb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:25.827252 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-57de548a-770b-406d-a0e4-57e89838ae07 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3245128a-0323-4136-a15a-d7cc2299ddb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1224258888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b3e0be88-c36e-4386-963e-c5930b21b401,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72be56c2d4a54014a8f741c451fe014e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:13:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cb7058ae-fd8e-4050-9e06-45b34aaf2aae,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:13:26Z,use_quota=True,user_id='97ef9a3039534d90ba9d268970cbe9d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:25.833731 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-57de548a-770b-406d-a0e4-57e89838ae07 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcd15f9c-d32e-43a8-8965-8785bef32616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:25.838639 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-57de548a-770b-406d-a0e4-57e89838ae07 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcd15f9c-d32e-43a8-8965-8785bef32616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:25.844060 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-57de548a-770b-406d-a0e4-57e89838ae07 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6315c775-706a-4fda-b079-60b3bb724a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:25.849032 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-57de548a-770b-406d-a0e4-57e89838ae07 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6315c775-706a-4fda-b079-60b3bb724a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b3e0be88-c36e-4386-963e-c5930b21b401', 'volume_name': 'volume-b3e0be88-c36e-4386-963e-c5930b21b401', 'volume_size': 1, 'snapshot_id': 'cb7058ae-fd8e-4050-9e06-45b34aaf2aae'}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:25.863400 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-57de548a-770b-406d-a0e4-57e89838ae07 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0911b08e-ae67-4a7e-986a-00eb2366c5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:25.868250 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-57de548a-770b-406d-a0e4-57e89838ae07 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0911b08e-ae67-4a7e-986a-00eb2366c5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:25.873232 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-57de548a-770b-406d-a0e4-57e89838ae07 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc2ca604-05ab-4432-8831-ca0e40c324e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:25.875257 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-57de548a-770b-406d-a0e4-57e89838ae07 tempest-VolumesSnapshotTestJSON-1726756463 None] Volume b3e0be88-c36e-4386-963e-c5930b21b401: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b3e0be88-c36e-4386-963e-c5930b21b401', 'volume_size': 1, 'snapshot_id': 'cb7058ae-fd8e-4050-9e06-45b34aaf2aae'} May 07 22:13:25.900471 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-57de548a-770b-406d-a0e4-57e89838ae07 tempest-VolumesSnapshotTestJSON-1726756463 None] cloning volumes/volume-30769e6c-6167-442f-8c17-d9e0c4cf97e2@snapshot-cb7058ae-fd8e-4050-9e06-45b34aaf2aae to volume-b3e0be88-c36e-4386-963e-c5930b21b401 {{(pid=129946) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1091}} May 07 22:13:25.901265 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-57de548a-770b-406d-a0e4-57e89838ae07 tempest-VolumesSnapshotTestJSON-1726756463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:25.964361 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-57de548a-770b-406d-a0e4-57e89838ae07 tempest-VolumesSnapshotTestJSON-1726756463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:26.141547 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-57de548a-770b-406d-a0e4-57e89838ae07 tempest-VolumesSnapshotTestJSON-1726756463 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:13:26.143013 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-57de548a-770b-406d-a0e4-57e89838ae07 tempest-VolumesSnapshotTestJSON-1726756463 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:13:26.186325 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-57de548a-770b-406d-a0e4-57e89838ae07 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc2ca604-05ab-4432-8831-ca0e40c324e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3e0be88-c36e-4386-963e-c5930b21b401', 'volume_size': 1, 'snapshot_id': 'cb7058ae-fd8e-4050-9e06-45b34aaf2aae'}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:26.208347 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-57de548a-770b-406d-a0e4-57e89838ae07 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce80ac0b-ee65-492b-8988-fc5a270600dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:26.227168 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-57de548a-770b-406d-a0e4-57e89838ae07 tempest-VolumesSnapshotTestJSON-1726756463 None] Volume volume-b3e0be88-c36e-4386-963e-c5930b21b401 (b3e0be88-c36e-4386-963e-c5930b21b401): created successfully May 07 22:13:26.230747 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-57de548a-770b-406d-a0e4-57e89838ae07 tempest-VolumesSnapshotTestJSON-1726756463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce80ac0b-ee65-492b-8988-fc5a270600dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:26.241351 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-57de548a-770b-406d-a0e4-57e89838ae07 tempest-VolumesSnapshotTestJSON-1726756463 None] Flow 'volume_create_manager' (a0d64b13-e165-4954-b189-848a85528a65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:13:26.261920 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-57de548a-770b-406d-a0e4-57e89838ae07 tempest-VolumesSnapshotTestJSON-1726756463 None] Created volume successfully. May 07 22:13:26.843478 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-604f69c1-e02f-4ca2-9dad-64e7100030ff tempest-VolumesSnapshotTestJSON-1726756463 None] Lock "b'cinder-b3e0be88-c36e-4386-963e-c5930b21b401-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:13:26.915843 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-604f69c1-e02f-4ca2-9dad-64e7100030ff tempest-VolumesSnapshotTestJSON-1726756463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:27.013521 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-604f69c1-e02f-4ca2-9dad-64e7100030ff tempest-VolumesSnapshotTestJSON-1726756463 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:13:27.020643 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-604f69c1-e02f-4ca2-9dad-64e7100030ff tempest-VolumesSnapshotTestJSON-1726756463 None] deleting rbd volume volume-b3e0be88-c36e-4386-963e-c5930b21b401 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:13:27.455605 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-604f69c1-e02f-4ca2-9dad-64e7100030ff tempest-VolumesSnapshotTestJSON-1726756463 None] Created reservations ['fe389c36-cdd7-4ebc-bace-1954df7d824e', 'bcd9abfe-e6b1-4f0c-8402-9d166681e6a4', '7f774ef0-ccd6-41c6-a606-6d846b3669e2', '2b32a22d-ed8a-42da-857d-cec970c7d096'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:13:27.532066 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-604f69c1-e02f-4ca2-9dad-64e7100030ff tempest-VolumesSnapshotTestJSON-1726756463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:27.584358 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-604f69c1-e02f-4ca2-9dad-64e7100030ff tempest-VolumesSnapshotTestJSON-1726756463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:27.647888 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-604f69c1-e02f-4ca2-9dad-64e7100030ff tempest-VolumesSnapshotTestJSON-1726756463 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:13:27.652972 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-604f69c1-e02f-4ca2-9dad-64e7100030ff tempest-VolumesSnapshotTestJSON-1726756463 None] Deleted volume successfully. May 07 22:13:27.669047 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-604f69c1-e02f-4ca2-9dad-64e7100030ff tempest-VolumesSnapshotTestJSON-1726756463 None] Lock "b'cinder-b3e0be88-c36e-4386-963e-c5930b21b401-delete_volume'" released by "delete_volume" :: held 0.826s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:13:28.091477 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-b97942be-f349-4db2-8716-ef215f3c902f tempest-VolumesSnapshotTestJSON-1726756463 None] Lock "b'cinder-cb7058ae-fd8e-4050-9e06-45b34aaf2aae-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.015s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:13:28.097018 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b97942be-f349-4db2-8716-ef215f3c902f tempest-VolumesSnapshotTestJSON-1726756463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:28.298758 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-c5002c4c-36fc-4823-8994-6eba09c6e6f3 req-a0d17cbc-a96a-4671-82ff-89b61ecbd762 tempest-TestVolumeBootPattern-860620187 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:29.262206 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-b97942be-f349-4db2-8716-ef215f3c902f tempest-VolumesSnapshotTestJSON-1726756463 None] Created reservations ['101ae54f-034f-48bf-a33a-9d0b83f5562c', '8b228d6f-d62e-4073-9d65-10b5075a5823', '72578eae-62d3-4c00-b5a4-6ee1838a34e7', '0255d5e6-6fd0-437e-bdaa-6ef6a6048f1c'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:13:29.354336 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-c5002c4c-36fc-4823-8994-6eba09c6e6f3 req-a0d17cbc-a96a-4671-82ff-89b61ecbd762 tempest-TestVolumeBootPattern-860620187 None] Create snapshot completed successfully May 07 22:13:29.367865 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-b97942be-f349-4db2-8716-ef215f3c902f tempest-VolumesSnapshotTestJSON-1726756463 None] Delete snapshot completed successfully. May 07 22:13:29.374941 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-b97942be-f349-4db2-8716-ef215f3c902f tempest-VolumesSnapshotTestJSON-1726756463 None] Lock "b'cinder-cb7058ae-fd8e-4050-9e06-45b34aaf2aae-delete_snapshot'" released by "delete_snapshot" :: held 1.285s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:13:30.352699 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-5cc97ad9-4a87-4006-8033-9a3744c1255c tempest-VolumesSnapshotTestJSON-1726756463 None] Lock "b'cinder-30769e6c-6167-442f-8c17-d9e0c4cf97e2-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:13:30.415481 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-5cc97ad9-4a87-4006-8033-9a3744c1255c tempest-VolumesSnapshotTestJSON-1726756463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:30.506367 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-5cc97ad9-4a87-4006-8033-9a3744c1255c tempest-VolumesSnapshotTestJSON-1726756463 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:13:30.506896 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-5cc97ad9-4a87-4006-8033-9a3744c1255c tempest-VolumesSnapshotTestJSON-1726756463 None] Volume volume-30769e6c-6167-442f-8c17-d9e0c4cf97e2 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:13:30.524757 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-5cc97ad9-4a87-4006-8033-9a3744c1255c tempest-VolumesSnapshotTestJSON-1726756463 None] deleting rbd volume volume-30769e6c-6167-442f-8c17-d9e0c4cf97e2 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:13:31.188128 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:13:31.189215 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:31.286409 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:31.366307 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:13:31.409650 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-5cc97ad9-4a87-4006-8033-9a3744c1255c tempest-VolumesSnapshotTestJSON-1726756463 None] Created reservations ['f4a004a2-8fb2-45da-a6b3-e6aa64972a4a', 'fd6eef90-fdfd-4b44-83ce-104d1fcb43cb', '2e43957b-47c1-4798-aaaa-f742252ff857', '8efd5b81-ead7-4c2d-9c9d-d83ac81cf51b'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:13:31.525211 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-5cc97ad9-4a87-4006-8033-9a3744c1255c tempest-VolumesSnapshotTestJSON-1726756463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:31.617744 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-5cc97ad9-4a87-4006-8033-9a3744c1255c tempest-VolumesSnapshotTestJSON-1726756463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:31.729419 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-5cc97ad9-4a87-4006-8033-9a3744c1255c tempest-VolumesSnapshotTestJSON-1726756463 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:13:31.744751 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-5cc97ad9-4a87-4006-8033-9a3744c1255c tempest-VolumesSnapshotTestJSON-1726756463 None] Deleted volume successfully. May 07 22:13:31.778428 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-1bb6ab48-1b6a-4c85-8612-a3e0be6edd55 tempest-VolumesSnapshotTestJSON-1726756463 None] Lock "b'cinder-b47cee24-925b-40f2-b297-ef1fdea84dde-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.043s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:13:31.780494 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-1bb6ab48-1b6a-4c85-8612-a3e0be6edd55 tempest-VolumesSnapshotTestJSON-1726756463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:31.856866 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-5cc97ad9-4a87-4006-8033-9a3744c1255c tempest-VolumesSnapshotTestJSON-1726756463 None] Lock "b'cinder-30769e6c-6167-442f-8c17-d9e0c4cf97e2-delete_volume'" released by "delete_volume" :: held 1.504s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:13:32.321380 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-1bb6ab48-1b6a-4c85-8612-a3e0be6edd55 tempest-VolumesSnapshotTestJSON-1726756463 None] Created reservations ['efbb61e1-b46d-4640-a716-fc8e34de8457', '9b183b0d-ff60-4a9e-a213-418152145257', '37882a65-5400-435e-890a-f761fddb8cf9', '5d39ba17-c84f-49a0-842b-b32ed1b892c3'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:13:32.410227 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-1bb6ab48-1b6a-4c85-8612-a3e0be6edd55 tempest-VolumesSnapshotTestJSON-1726756463 None] Delete snapshot completed successfully. May 07 22:13:32.415075 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-1bb6ab48-1b6a-4c85-8612-a3e0be6edd55 tempest-VolumesSnapshotTestJSON-1726756463 None] Lock "b'cinder-b47cee24-925b-40f2-b297-ef1fdea84dde-delete_snapshot'" released by "delete_snapshot" :: held 0.637s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:13:32.869398 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-12d25204-82c5-4a82-99b6-e24bde6bef8f tempest-VolumesSnapshotTestJSON-1726756463 None] Lock "b'cinder-f3b7da6f-e5da-4aae-b2d5-8de13cfba398-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:13:32.992885 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-12d25204-82c5-4a82-99b6-e24bde6bef8f tempest-VolumesSnapshotTestJSON-1726756463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:33.117112 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-12d25204-82c5-4a82-99b6-e24bde6bef8f tempest-VolumesSnapshotTestJSON-1726756463 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:13:33.117781 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-12d25204-82c5-4a82-99b6-e24bde6bef8f tempest-VolumesSnapshotTestJSON-1726756463 None] Volume volume-f3b7da6f-e5da-4aae-b2d5-8de13cfba398 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:13:33.149336 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-12d25204-82c5-4a82-99b6-e24bde6bef8f tempest-VolumesSnapshotTestJSON-1726756463 None] deleting rbd volume volume-f3b7da6f-e5da-4aae-b2d5-8de13cfba398 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:13:33.726255 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-12d25204-82c5-4a82-99b6-e24bde6bef8f tempest-VolumesSnapshotTestJSON-1726756463 None] Created reservations ['6e92998a-79c9-4043-881f-837f65fcdb5e', 'ea0e1692-b7e0-4fe1-9555-a3f2a81365fd', '38e85fcc-eef7-4bb0-8c18-94e800ba083d', 'fed2718f-fdd6-4ba0-a6aa-cdd81d4b214d'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:13:33.803678 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-12d25204-82c5-4a82-99b6-e24bde6bef8f tempest-VolumesSnapshotTestJSON-1726756463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:33.910946 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-12d25204-82c5-4a82-99b6-e24bde6bef8f tempest-VolumesSnapshotTestJSON-1726756463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:33.983546 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-12d25204-82c5-4a82-99b6-e24bde6bef8f tempest-VolumesSnapshotTestJSON-1726756463 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:13:33.988744 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-12d25204-82c5-4a82-99b6-e24bde6bef8f tempest-VolumesSnapshotTestJSON-1726756463 None] Deleted volume successfully. May 07 22:13:34.019825 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-12d25204-82c5-4a82-99b6-e24bde6bef8f tempest-VolumesSnapshotTestJSON-1726756463 None] Lock "b'cinder-f3b7da6f-e5da-4aae-b2d5-8de13cfba398-delete_volume'" released by "delete_volume" :: held 1.150s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:13:34.213463 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [req-f5cf2a65-2e9e-48bf-9493-a6c1773414f4 req-e26aedc5-9f0b-4701-a843-e79462399f75 tempest-TestVolumeBootPattern-860620187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:13:34.289450 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-f5cf2a65-2e9e-48bf-9493-a6c1773414f4 req-e26aedc5-9f0b-4701-a843-e79462399f75 tempest-TestVolumeBootPattern-860620187 None] Flow 'volume_create_manager' (f56ba01c-d115-40af-b527-3148a7469909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:13:34.302003 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-f5cf2a65-2e9e-48bf-9493-a6c1773414f4 req-e26aedc5-9f0b-4701-a843-e79462399f75 tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6ee3d41-2f36-4457-a2fe-0dd144222ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:34.328813 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-f5cf2a65-2e9e-48bf-9493-a6c1773414f4 req-e26aedc5-9f0b-4701-a843-e79462399f75 tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6ee3d41-2f36-4457-a2fe-0dd144222ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:13:34Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=98df53e6-113b-46c3-abcd-bdd3e0d203bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3657e8df46a4252b9eb1eb159306a66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:13:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f9d757db-ff45-4ae6-b388-a2d8a6598713,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:13:34Z,use_quota=True,user_id='9b4988836610494ab48a138bd43d5b52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:34.355976 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-f5cf2a65-2e9e-48bf-9493-a6c1773414f4 req-e26aedc5-9f0b-4701-a843-e79462399f75 tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2826b0e4-f685-448c-8d2e-f295d13673dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:34.365875 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-f5cf2a65-2e9e-48bf-9493-a6c1773414f4 req-e26aedc5-9f0b-4701-a843-e79462399f75 tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2826b0e4-f685-448c-8d2e-f295d13673dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:34.383252 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-f5cf2a65-2e9e-48bf-9493-a6c1773414f4 req-e26aedc5-9f0b-4701-a843-e79462399f75 tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38c461a5-d7bc-40e7-8caf-7b26a4ebe4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:34.395706 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-f5cf2a65-2e9e-48bf-9493-a6c1773414f4 req-e26aedc5-9f0b-4701-a843-e79462399f75 tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38c461a5-d7bc-40e7-8caf-7b26a4ebe4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '98df53e6-113b-46c3-abcd-bdd3e0d203bf', 'volume_name': 'volume-98df53e6-113b-46c3-abcd-bdd3e0d203bf', 'volume_size': 1, 'snapshot_id': 'f9d757db-ff45-4ae6-b388-a2d8a6598713'}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:34.404073 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-f5cf2a65-2e9e-48bf-9493-a6c1773414f4 req-e26aedc5-9f0b-4701-a843-e79462399f75 tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b1bb92-8e04-4586-9476-c5a9306aedbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:34.417325 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-f5cf2a65-2e9e-48bf-9493-a6c1773414f4 req-e26aedc5-9f0b-4701-a843-e79462399f75 tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b1bb92-8e04-4586-9476-c5a9306aedbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:34.427421 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-f5cf2a65-2e9e-48bf-9493-a6c1773414f4 req-e26aedc5-9f0b-4701-a843-e79462399f75 tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d0427ff-901d-46d2-9bee-f7af1fff3d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:34.436705 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [req-f5cf2a65-2e9e-48bf-9493-a6c1773414f4 req-e26aedc5-9f0b-4701-a843-e79462399f75 tempest-TestVolumeBootPattern-860620187 None] Volume 98df53e6-113b-46c3-abcd-bdd3e0d203bf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-98df53e6-113b-46c3-abcd-bdd3e0d203bf', 'volume_size': 1, 'snapshot_id': 'f9d757db-ff45-4ae6-b388-a2d8a6598713'} May 07 22:13:34.465976 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-3709015f-92f8-490e-9ff0-385793cb631e tempest-VolumesSnapshotTestJSON-1726756463 None] Lock "b'cinder-75dd9e1d-41d8-4373-81eb-a9b8cb88a957-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:13:34.483402 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-f5cf2a65-2e9e-48bf-9493-a6c1773414f4 req-e26aedc5-9f0b-4701-a843-e79462399f75 tempest-TestVolumeBootPattern-860620187 None] cloning volumes/volume-9a081585-6d81-4d08-8c50-ae0498445a58@snapshot-f9d757db-ff45-4ae6-b388-a2d8a6598713 to volume-98df53e6-113b-46c3-abcd-bdd3e0d203bf {{(pid=129946) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1091}} May 07 22:13:34.484846 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-f5cf2a65-2e9e-48bf-9493-a6c1773414f4 req-e26aedc5-9f0b-4701-a843-e79462399f75 tempest-TestVolumeBootPattern-860620187 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:34.599297 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-f5cf2a65-2e9e-48bf-9493-a6c1773414f4 req-e26aedc5-9f0b-4701-a843-e79462399f75 tempest-TestVolumeBootPattern-860620187 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:34.700256 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-3709015f-92f8-490e-9ff0-385793cb631e tempest-VolumesSnapshotTestJSON-1726756463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:34.818994 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-3709015f-92f8-490e-9ff0-385793cb631e tempest-VolumesSnapshotTestJSON-1726756463 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:13:34.847528 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-3709015f-92f8-490e-9ff0-385793cb631e tempest-VolumesSnapshotTestJSON-1726756463 None] deleting rbd volume volume-75dd9e1d-41d8-4373-81eb-a9b8cb88a957 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:13:34.863442 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-f5cf2a65-2e9e-48bf-9493-a6c1773414f4 req-e26aedc5-9f0b-4701-a843-e79462399f75 tempest-TestVolumeBootPattern-860620187 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:13:34.864479 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-f5cf2a65-2e9e-48bf-9493-a6c1773414f4 req-e26aedc5-9f0b-4701-a843-e79462399f75 tempest-TestVolumeBootPattern-860620187 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:13:34.905287 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.volume_utils [req-f5cf2a65-2e9e-48bf-9493-a6c1773414f4 req-e26aedc5-9f0b-4701-a843-e79462399f75 tempest-TestVolumeBootPattern-860620187 None] Marking volume 98df53e6-113b-46c3-abcd-bdd3e0d203bf as bootable. {{(pid=129946) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} May 07 22:13:34.925549 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [req-f5cf2a65-2e9e-48bf-9493-a6c1773414f4 req-e26aedc5-9f0b-4701-a843-e79462399f75 tempest-TestVolumeBootPattern-860620187 None] Copying metadata from snapshot f9d757db-ff45-4ae6-b388-a2d8a6598713 to 98df53e6-113b-46c3-abcd-bdd3e0d203bf. {{(pid=129946) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:427}} May 07 22:13:35.024532 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-f5cf2a65-2e9e-48bf-9493-a6c1773414f4 req-e26aedc5-9f0b-4701-a843-e79462399f75 tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d0427ff-901d-46d2-9bee-f7af1fff3d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98df53e6-113b-46c3-abcd-bdd3e0d203bf', 'volume_size': 1, 'snapshot_id': 'f9d757db-ff45-4ae6-b388-a2d8a6598713'}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:35.034941 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-f5cf2a65-2e9e-48bf-9493-a6c1773414f4 req-e26aedc5-9f0b-4701-a843-e79462399f75 tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (336a40a1-95de-4ddf-8667-653c789e24d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:35.048468 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [req-f5cf2a65-2e9e-48bf-9493-a6c1773414f4 req-e26aedc5-9f0b-4701-a843-e79462399f75 tempest-TestVolumeBootPattern-860620187 None] Volume volume-98df53e6-113b-46c3-abcd-bdd3e0d203bf (98df53e6-113b-46c3-abcd-bdd3e0d203bf): created successfully May 07 22:13:35.052658 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-f5cf2a65-2e9e-48bf-9493-a6c1773414f4 req-e26aedc5-9f0b-4701-a843-e79462399f75 tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (336a40a1-95de-4ddf-8667-653c789e24d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:35.067874 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-f5cf2a65-2e9e-48bf-9493-a6c1773414f4 req-e26aedc5-9f0b-4701-a843-e79462399f75 tempest-TestVolumeBootPattern-860620187 None] Flow 'volume_create_manager' (f56ba01c-d115-40af-b527-3148a7469909) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:13:35.101037 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-f5cf2a65-2e9e-48bf-9493-a6c1773414f4 req-e26aedc5-9f0b-4701-a843-e79462399f75 tempest-TestVolumeBootPattern-860620187 None] Created volume successfully. May 07 22:13:35.307695 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-3709015f-92f8-490e-9ff0-385793cb631e tempest-VolumesSnapshotTestJSON-1726756463 None] volume is a clone so cleaning references {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} May 07 22:13:35.365705 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-3709015f-92f8-490e-9ff0-385793cb631e tempest-VolumesSnapshotTestJSON-1726756463 None] deleting parent snapshot volume-75dd9e1d-41d8-4373-81eb-a9b8cb88a957.clone_snap {{(pid=129946) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} May 07 22:13:36.167316 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-3709015f-92f8-490e-9ff0-385793cb631e tempest-VolumesSnapshotTestJSON-1726756463 None] Created reservations ['5166c4f4-4211-4435-b1ae-9010a4921d5f', '8b391f18-a828-4a01-8c0a-a460ff7cd1c4', '49516f3c-afe9-4b6c-9cb2-ad6825ffcaf7', 'ab1ff99c-d9df-4fec-bfa2-82e34cefc8b4'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:13:36.252526 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-3709015f-92f8-490e-9ff0-385793cb631e tempest-VolumesSnapshotTestJSON-1726756463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:36.323552 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-3709015f-92f8-490e-9ff0-385793cb631e tempest-VolumesSnapshotTestJSON-1726756463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:36.442433 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-3709015f-92f8-490e-9ff0-385793cb631e tempest-VolumesSnapshotTestJSON-1726756463 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:13:36.462137 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-3709015f-92f8-490e-9ff0-385793cb631e tempest-VolumesSnapshotTestJSON-1726756463 None] Deleted volume successfully. May 07 22:13:36.490375 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-3709015f-92f8-490e-9ff0-385793cb631e tempest-VolumesSnapshotTestJSON-1726756463 None] Lock "b'cinder-75dd9e1d-41d8-4373-81eb-a9b8cb88a957-delete_volume'" released by "delete_volume" :: held 2.024s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:13:36.816074 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-9838386b-a0b5-437b-b262-f707fc13599b tempest-VolumesSnapshotTestJSON-1726756463 None] Lock "b'cinder-f269fe76-0736-470f-aa1e-6e252c4dee4e-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.021s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:13:36.817852 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-9838386b-a0b5-437b-b262-f707fc13599b tempest-VolumesSnapshotTestJSON-1726756463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:37.624311 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-f5cf2a65-2e9e-48bf-9493-a6c1773414f4 req-3ae1b4d8-1c2a-4925-8f86-eb5373911c8d tempest-TestVolumeBootPattern-860620187 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 22:13:38.249142 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-9838386b-a0b5-437b-b262-f707fc13599b tempest-VolumesSnapshotTestJSON-1726756463 None] Created reservations ['50acab77-b161-4166-94da-3d18265f57a3', 'c5bf940f-4cf3-4ea1-a8d5-977ffa7a2293', '419f51c7-c791-452c-a859-7555ac5a5059', '8c6a192e-5d23-464d-9ab1-fc6085649224'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:13:38.383186 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-9838386b-a0b5-437b-b262-f707fc13599b tempest-VolumesSnapshotTestJSON-1726756463 None] Delete snapshot completed successfully. May 07 22:13:38.389899 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-9838386b-a0b5-437b-b262-f707fc13599b tempest-VolumesSnapshotTestJSON-1726756463 None] Lock "b'cinder-f269fe76-0736-470f-aa1e-6e252c4dee4e-delete_snapshot'" released by "delete_snapshot" :: held 1.578s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:13:39.146417 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-1a279fbd-135c-43b5-b780-89696b3c0738 tempest-VolumesSnapshotTestJSON-1726756463 None] Lock "b'cinder-28875749-3b9f-4237-b844-689c84a5f03f-delete_volume'" acquired by "delete_volume" :: waited 0.054s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:13:39.257167 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-1a279fbd-135c-43b5-b780-89696b3c0738 tempest-VolumesSnapshotTestJSON-1726756463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:39.378082 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-1a279fbd-135c-43b5-b780-89696b3c0738 tempest-VolumesSnapshotTestJSON-1726756463 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:13:39.378624 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-1a279fbd-135c-43b5-b780-89696b3c0738 tempest-VolumesSnapshotTestJSON-1726756463 None] Volume volume-28875749-3b9f-4237-b844-689c84a5f03f is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:13:39.405942 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-1a279fbd-135c-43b5-b780-89696b3c0738 tempest-VolumesSnapshotTestJSON-1726756463 None] deleting rbd volume volume-28875749-3b9f-4237-b844-689c84a5f03f {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:13:39.611794 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-f5cf2a65-2e9e-48bf-9493-a6c1773414f4 req-3ae1b4d8-1c2a-4925-8f86-eb5373911c8d tempest-TestVolumeBootPattern-860620187 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.987s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 22:13:39.612755 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-f5cf2a65-2e9e-48bf-9493-a6c1773414f4 req-3ae1b4d8-1c2a-4925-8f86-eb5373911c8d tempest-TestVolumeBootPattern-860620187 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-98df53e6-113b-46c3-abcd-bdd3e0d203bf', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3ca0b836-1cfe-436a-b0fa-deb74d3203d9', 'volume_id': '98df53e6-113b-46c3-abcd-bdd3e0d203bf', 'discard': True}} {{(pid=129946) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 07 22:13:39.642825 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-f5cf2a65-2e9e-48bf-9493-a6c1773414f4 req-3ae1b4d8-1c2a-4925-8f86-eb5373911c8d tempest-TestVolumeBootPattern-860620187 None] Connection info returned from driver {'name': 'volumes/volume-98df53e6-113b-46c3-abcd-bdd3e0d203bf', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '98df53e6-113b-46c3-abcd-bdd3e0d203bf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '022e2c38-2510-4ad0-9ea5-3a9858bd9d1d'} {{(pid=129946) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 07 22:13:39.760079 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-f5cf2a65-2e9e-48bf-9493-a6c1773414f4 req-3ae1b4d8-1c2a-4925-8f86-eb5373911c8d tempest-TestVolumeBootPattern-860620187 None] attachment_update completed successfully. May 07 22:13:40.036425 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-1a279fbd-135c-43b5-b780-89696b3c0738 tempest-VolumesSnapshotTestJSON-1726756463 None] Created reservations ['9421b8cd-562c-4948-a4be-8a7f6bdaca7b', '2f536449-5c9b-43ff-a309-13e94e78ee46', '79c292fb-4174-4dc8-a356-75a8bb31b7ca', 'f79e6129-231b-42e5-b0d8-4042d8fdd7cb'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:13:40.134304 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-1a279fbd-135c-43b5-b780-89696b3c0738 tempest-VolumesSnapshotTestJSON-1726756463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:40.221479 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-1a279fbd-135c-43b5-b780-89696b3c0738 tempest-VolumesSnapshotTestJSON-1726756463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:40.302822 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-1a279fbd-135c-43b5-b780-89696b3c0738 tempest-VolumesSnapshotTestJSON-1726756463 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:13:40.320582 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-1a279fbd-135c-43b5-b780-89696b3c0738 tempest-VolumesSnapshotTestJSON-1726756463 None] Deleted volume successfully. May 07 22:13:40.345416 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-1a279fbd-135c-43b5-b780-89696b3c0738 tempest-VolumesSnapshotTestJSON-1726756463 None] Lock "b'cinder-28875749-3b9f-4237-b844-689c84a5f03f-delete_volume'" released by "delete_volume" :: held 1.203s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:13:42.627882 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-80d46610-e040-41b6-955c-dd8f2fbe9ee1 tempest-VolumesActionsTest-1113665028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:13:42.662288 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-80d46610-e040-41b6-955c-dd8f2fbe9ee1 tempest-VolumesActionsTest-1113665028 None] Flow 'volume_create_manager' (fdcac597-f921-4103-90db-a69a33d0911e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:13:42.672234 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-80d46610-e040-41b6-955c-dd8f2fbe9ee1 tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05af6706-4e72-42ff-b22d-0e9d401eeb3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:42.701552 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-80d46610-e040-41b6-955c-dd8f2fbe9ee1 tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05af6706-4e72-42ff-b22d-0e9d401eeb3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:13:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-660604643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6e16e33d-37ef-49dc-8546-3ad2cccabd5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d62508bea6e7484ea316f52f4d3b8471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:13:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:13:43Z,use_quota=True,user_id='313cb56eefdd49cab9f9ddcbfea4ab72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:42.711285 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-80d46610-e040-41b6-955c-dd8f2fbe9ee1 tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d67badcb-916f-48c4-8ebd-92a036549798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:42.716736 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-80d46610-e040-41b6-955c-dd8f2fbe9ee1 tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d67badcb-916f-48c4-8ebd-92a036549798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:42.723685 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-80d46610-e040-41b6-955c-dd8f2fbe9ee1 tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6cde2dc-4486-4ae6-aad3-f5ab34c858fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:42.729134 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-80d46610-e040-41b6-955c-dd8f2fbe9ee1 tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6cde2dc-4486-4ae6-aad3-f5ab34c858fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e16e33d-37ef-49dc-8546-3ad2cccabd5e', 'volume_name': 'volume-6e16e33d-37ef-49dc-8546-3ad2cccabd5e', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:42.736990 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-80d46610-e040-41b6-955c-dd8f2fbe9ee1 tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa514d3c-7404-47d1-baac-521106e9dce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:42.741629 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-80d46610-e040-41b6-955c-dd8f2fbe9ee1 tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa514d3c-7404-47d1-baac-521106e9dce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:42.748310 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-80d46610-e040-41b6-955c-dd8f2fbe9ee1 tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80d132f6-4688-4e28-a4b9-aa638161f5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:42.749840 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-80d46610-e040-41b6-955c-dd8f2fbe9ee1 tempest-VolumesActionsTest-1113665028 None] Volume 6e16e33d-37ef-49dc-8546-3ad2cccabd5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e16e33d-37ef-49dc-8546-3ad2cccabd5e', 'volume_size': 1} May 07 22:13:42.750463 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80d46610-e040-41b6-955c-dd8f2fbe9ee1 tempest-VolumesActionsTest-1113665028 None] creating volume 'volume-6e16e33d-37ef-49dc-8546-3ad2cccabd5e' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:13:42.751616 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80d46610-e040-41b6-955c-dd8f2fbe9ee1 tempest-VolumesActionsTest-1113665028 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:42.912619 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80d46610-e040-41b6-955c-dd8f2fbe9ee1 tempest-VolumesActionsTest-1113665028 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:13:42.914559 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80d46610-e040-41b6-955c-dd8f2fbe9ee1 tempest-VolumesActionsTest-1113665028 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:13:42.919064 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-80d46610-e040-41b6-955c-dd8f2fbe9ee1 tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80d132f6-4688-4e28-a4b9-aa638161f5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e16e33d-37ef-49dc-8546-3ad2cccabd5e', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:42.927773 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-80d46610-e040-41b6-955c-dd8f2fbe9ee1 tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8671692b-dbd9-4100-aed8-1f0e6088c464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:42.939042 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-80d46610-e040-41b6-955c-dd8f2fbe9ee1 tempest-VolumesActionsTest-1113665028 None] Volume volume-6e16e33d-37ef-49dc-8546-3ad2cccabd5e (6e16e33d-37ef-49dc-8546-3ad2cccabd5e): created successfully May 07 22:13:42.943415 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-80d46610-e040-41b6-955c-dd8f2fbe9ee1 tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8671692b-dbd9-4100-aed8-1f0e6088c464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:42.951272 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-80d46610-e040-41b6-955c-dd8f2fbe9ee1 tempest-VolumesActionsTest-1113665028 None] Flow 'volume_create_manager' (fdcac597-f921-4103-90db-a69a33d0911e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:13:42.970597 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-80d46610-e040-41b6-955c-dd8f2fbe9ee1 tempest-VolumesActionsTest-1113665028 None] Created volume successfully. May 07 22:13:43.704284 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-d2a7d906-fdf5-4c2a-9f1e-71b42b3dfc6a tempest-VolumesActionsTest-1113665028 None] Lock "b'cinder-6e16e33d-37ef-49dc-8546-3ad2cccabd5e'" acquired by "attach_volume" :: waited 0.018s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:13:43.831395 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-d2a7d906-fdf5-4c2a-9f1e-71b42b3dfc6a tempest-VolumesActionsTest-1113665028 None] Attaching volume 6e16e33d-37ef-49dc-8546-3ad2cccabd5e to instance 4ea99916-97ab-4e68-90bc-a95c38f04964 at mountpoint /dev/sdb on host None. May 07 22:13:43.901104 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-d2a7d906-fdf5-4c2a-9f1e-71b42b3dfc6a tempest-VolumesActionsTest-1113665028 None] Attach volume completed successfully. May 07 22:13:43.908638 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-d2a7d906-fdf5-4c2a-9f1e-71b42b3dfc6a tempest-VolumesActionsTest-1113665028 None] Lock "b'cinder-6e16e33d-37ef-49dc-8546-3ad2cccabd5e'" released by "attach_volume" :: held 0.203s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:13:44.856135 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-b648ed9f-0ab9-4a2c-aa5d-755b1b95ab8d tempest-VolumesActionsTest-1312707754 None] Terminate volume connection completed successfully. May 07 22:13:44.895250 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-b648ed9f-0ab9-4a2c-aa5d-755b1b95ab8d tempest-VolumesActionsTest-1312707754 None] Lock "b'cinder-6e16e33d-37ef-49dc-8546-3ad2cccabd5e-detach_volume'" acquired by "detach_volume" :: waited 0.011s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:13:44.908637 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-b648ed9f-0ab9-4a2c-aa5d-755b1b95ab8d tempest-VolumesActionsTest-1312707754 None] Detaching volume 6e16e33d-37ef-49dc-8546-3ad2cccabd5e from instance 4ea99916-97ab-4e68-90bc-a95c38f04964. May 07 22:13:44.960112 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-b648ed9f-0ab9-4a2c-aa5d-755b1b95ab8d tempest-VolumesActionsTest-1312707754 None] Detach volume completed successfully. May 07 22:13:44.967100 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-b648ed9f-0ab9-4a2c-aa5d-755b1b95ab8d tempest-VolumesActionsTest-1312707754 None] Lock "b'cinder-6e16e33d-37ef-49dc-8546-3ad2cccabd5e-detach_volume'" released by "detach_volume" :: held 0.072s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:13:45.165270 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-38ac8077-a594-44dd-887b-d93e3b3b3e64 tempest-VolumesActionsTest-1113665028 None] Lock "b'cinder-6e16e33d-37ef-49dc-8546-3ad2cccabd5e-detach_volume'" acquired by "detach_volume" :: waited 0.017s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:13:45.165845 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-38ac8077-a594-44dd-887b-d93e3b3b3e64 tempest-VolumesActionsTest-1113665028 None] Volume detach called, but volume not attached. May 07 22:13:45.181693 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-38ac8077-a594-44dd-887b-d93e3b3b3e64 tempest-VolumesActionsTest-1113665028 None] Lock "b'cinder-6e16e33d-37ef-49dc-8546-3ad2cccabd5e-detach_volume'" released by "detach_volume" :: held 0.017s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:13:51.579791 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb484106-ed14-48de-bea9-67e8ad0c39e9 tempest-VolumesActionsTest-1113665028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:13:51.625614 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-fb484106-ed14-48de-bea9-67e8ad0c39e9 tempest-VolumesActionsTest-1113665028 None] Flow 'volume_create_manager' (4fce88db-18b6-4164-bf1a-3f499b197064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:13:51.645232 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-fb484106-ed14-48de-bea9-67e8ad0c39e9 tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbf75144-8e3d-428a-a40b-b44eb7696bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:51.661871 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-fb484106-ed14-48de-bea9-67e8ad0c39e9 tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbf75144-8e3d-428a-a40b-b44eb7696bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1264841423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4a3394df-1605-461c-bd4f-35b7bc45fd78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d62508bea6e7484ea316f52f4d3b8471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:13:52Z,use_quota=True,user_id='313cb56eefdd49cab9f9ddcbfea4ab72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:51.667573 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-fb484106-ed14-48de-bea9-67e8ad0c39e9 tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bd1c215-c74f-4e51-b23e-d18cb454700b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:51.673260 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-fb484106-ed14-48de-bea9-67e8ad0c39e9 tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bd1c215-c74f-4e51-b23e-d18cb454700b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:51.679213 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-fb484106-ed14-48de-bea9-67e8ad0c39e9 tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f68e424e-9096-4512-8b59-0c71ab6b9f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:51.683772 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-fb484106-ed14-48de-bea9-67e8ad0c39e9 tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f68e424e-9096-4512-8b59-0c71ab6b9f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a3394df-1605-461c-bd4f-35b7bc45fd78', 'volume_name': 'volume-4a3394df-1605-461c-bd4f-35b7bc45fd78', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:51.689272 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-fb484106-ed14-48de-bea9-67e8ad0c39e9 tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6706856-40cf-4176-9e8f-1c5677e93d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:51.693790 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-fb484106-ed14-48de-bea9-67e8ad0c39e9 tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6706856-40cf-4176-9e8f-1c5677e93d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:51.699224 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-fb484106-ed14-48de-bea9-67e8ad0c39e9 tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4eaf052-3d14-45d1-b452-79d8f6ee0098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:51.700539 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-fb484106-ed14-48de-bea9-67e8ad0c39e9 tempest-VolumesActionsTest-1113665028 None] Volume 4a3394df-1605-461c-bd4f-35b7bc45fd78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a3394df-1605-461c-bd4f-35b7bc45fd78', 'volume_size': 1} May 07 22:13:51.701104 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-fb484106-ed14-48de-bea9-67e8ad0c39e9 tempest-VolumesActionsTest-1113665028 None] creating volume 'volume-4a3394df-1605-461c-bd4f-35b7bc45fd78' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:13:51.701938 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-fb484106-ed14-48de-bea9-67e8ad0c39e9 tempest-VolumesActionsTest-1113665028 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:51.807122 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-fb484106-ed14-48de-bea9-67e8ad0c39e9 tempest-VolumesActionsTest-1113665028 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:13:51.807717 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-fb484106-ed14-48de-bea9-67e8ad0c39e9 tempest-VolumesActionsTest-1113665028 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:13:51.812300 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-fb484106-ed14-48de-bea9-67e8ad0c39e9 tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4eaf052-3d14-45d1-b452-79d8f6ee0098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a3394df-1605-461c-bd4f-35b7bc45fd78', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:51.831331 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-fb484106-ed14-48de-bea9-67e8ad0c39e9 tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e211e320-ee4a-4167-b59a-b3ef379dea29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:51.842565 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-fb484106-ed14-48de-bea9-67e8ad0c39e9 tempest-VolumesActionsTest-1113665028 None] Volume volume-4a3394df-1605-461c-bd4f-35b7bc45fd78 (4a3394df-1605-461c-bd4f-35b7bc45fd78): created successfully May 07 22:13:51.854625 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-fb484106-ed14-48de-bea9-67e8ad0c39e9 tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e211e320-ee4a-4167-b59a-b3ef379dea29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:51.863997 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-fb484106-ed14-48de-bea9-67e8ad0c39e9 tempest-VolumesActionsTest-1113665028 None] Flow 'volume_create_manager' (4fce88db-18b6-4164-bf1a-3f499b197064) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:13:51.878395 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-fb484106-ed14-48de-bea9-67e8ad0c39e9 tempest-VolumesActionsTest-1113665028 None] Created volume successfully. May 07 22:13:52.871713 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-9fb96281-dcb7-4d1b-9333-41fb717557af tempest-VolumesActionsTest-1312707754 None] Lock "b'cinder-4a3394df-1605-461c-bd4f-35b7bc45fd78-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:13:52.929877 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-9fb96281-dcb7-4d1b-9333-41fb717557af tempest-VolumesActionsTest-1312707754 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:53.053115 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-9fb96281-dcb7-4d1b-9333-41fb717557af tempest-VolumesActionsTest-1312707754 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:13:53.053532 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-9fb96281-dcb7-4d1b-9333-41fb717557af tempest-VolumesActionsTest-1312707754 None] Volume volume-4a3394df-1605-461c-bd4f-35b7bc45fd78 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:13:53.069899 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-9fb96281-dcb7-4d1b-9333-41fb717557af tempest-VolumesActionsTest-1312707754 None] deleting rbd volume volume-4a3394df-1605-461c-bd4f-35b7bc45fd78 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:13:53.693710 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-9fb96281-dcb7-4d1b-9333-41fb717557af tempest-VolumesActionsTest-1312707754 None] Created reservations ['f9833ddc-04d7-4fb1-a8af-301b8cd9dd0f', 'fcc99654-aeff-4e31-9b23-872116d02a18', '8da33ad7-371f-4c4f-bd10-51157d653191', 'd1a05836-10cc-4976-9dfe-4181be3a8122'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:13:53.786165 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-9fb96281-dcb7-4d1b-9333-41fb717557af tempest-VolumesActionsTest-1312707754 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:53.891584 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-9fb96281-dcb7-4d1b-9333-41fb717557af tempest-VolumesActionsTest-1312707754 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:53.957011 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-9fb96281-dcb7-4d1b-9333-41fb717557af tempest-VolumesActionsTest-1312707754 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:13:53.965853 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-9fb96281-dcb7-4d1b-9333-41fb717557af tempest-VolumesActionsTest-1312707754 None] Deleted volume successfully. May 07 22:13:53.995484 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-9fb96281-dcb7-4d1b-9333-41fb717557af tempest-VolumesActionsTest-1312707754 None] Lock "b'cinder-4a3394df-1605-461c-bd4f-35b7bc45fd78-delete_volume'" released by "delete_volume" :: held 1.123s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:13:54.527412 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-4702f112-0e1d-45c2-92c2-d969bc181294 tempest-VolumesActionsTest-1113665028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:13:54.572763 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4702f112-0e1d-45c2-92c2-d969bc181294 tempest-VolumesActionsTest-1113665028 None] Flow 'volume_create_manager' (cbffd93a-2c33-4b9d-9f3c-659decedec75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:13:54.596023 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4702f112-0e1d-45c2-92c2-d969bc181294 tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (680d867c-8fb6-4a57-b786-cf9d89631240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:54.643712 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4702f112-0e1d-45c2-92c2-d969bc181294 tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (680d867c-8fb6-4a57-b786-cf9d89631240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:13:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1960748759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=836d9bdf-7043-4a5f-a763-7322545e97a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d62508bea6e7484ea316f52f4d3b8471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:13:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:13:54Z,use_quota=True,user_id='313cb56eefdd49cab9f9ddcbfea4ab72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:54.650113 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4702f112-0e1d-45c2-92c2-d969bc181294 tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (583177e3-df6c-480c-9640-121234d779be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:54.656328 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4702f112-0e1d-45c2-92c2-d969bc181294 tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (583177e3-df6c-480c-9640-121234d779be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:54.669110 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4702f112-0e1d-45c2-92c2-d969bc181294 tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4ba2ee6-4f5f-42c5-bcdf-ab0baeee45fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:54.674407 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4702f112-0e1d-45c2-92c2-d969bc181294 tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4ba2ee6-4f5f-42c5-bcdf-ab0baeee45fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '836d9bdf-7043-4a5f-a763-7322545e97a6', 'volume_name': 'volume-836d9bdf-7043-4a5f-a763-7322545e97a6', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:54.680535 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4702f112-0e1d-45c2-92c2-d969bc181294 tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff42b759-f2ca-44e8-ba53-f06c709c7712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:54.685257 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4702f112-0e1d-45c2-92c2-d969bc181294 tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff42b759-f2ca-44e8-ba53-f06c709c7712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:54.692632 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4702f112-0e1d-45c2-92c2-d969bc181294 tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f14adfa2-5708-453c-8784-817de8371a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:54.694360 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-4702f112-0e1d-45c2-92c2-d969bc181294 tempest-VolumesActionsTest-1113665028 None] Volume 836d9bdf-7043-4a5f-a763-7322545e97a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-836d9bdf-7043-4a5f-a763-7322545e97a6', 'volume_size': 1} May 07 22:13:54.695116 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-4702f112-0e1d-45c2-92c2-d969bc181294 tempest-VolumesActionsTest-1113665028 None] creating volume 'volume-836d9bdf-7043-4a5f-a763-7322545e97a6' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:13:54.696088 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-4702f112-0e1d-45c2-92c2-d969bc181294 tempest-VolumesActionsTest-1113665028 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:54.818943 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-4702f112-0e1d-45c2-92c2-d969bc181294 tempest-VolumesActionsTest-1113665028 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:13:54.820350 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-4702f112-0e1d-45c2-92c2-d969bc181294 tempest-VolumesActionsTest-1113665028 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:13:54.825757 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4702f112-0e1d-45c2-92c2-d969bc181294 tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f14adfa2-5708-453c-8784-817de8371a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-836d9bdf-7043-4a5f-a763-7322545e97a6', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:54.835297 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4702f112-0e1d-45c2-92c2-d969bc181294 tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0aa6a2c-d84e-48ab-8ce2-8c66d8c2bdd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:54.851062 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-4702f112-0e1d-45c2-92c2-d969bc181294 tempest-VolumesActionsTest-1113665028 None] Volume volume-836d9bdf-7043-4a5f-a763-7322545e97a6 (836d9bdf-7043-4a5f-a763-7322545e97a6): created successfully May 07 22:13:54.860421 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4702f112-0e1d-45c2-92c2-d969bc181294 tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0aa6a2c-d84e-48ab-8ce2-8c66d8c2bdd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:54.872613 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-4702f112-0e1d-45c2-92c2-d969bc181294 tempest-VolumesActionsTest-1113665028 None] Flow 'volume_create_manager' (cbffd93a-2c33-4b9d-9f3c-659decedec75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:13:54.895547 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-4702f112-0e1d-45c2-92c2-d969bc181294 tempest-VolumesActionsTest-1113665028 None] Created volume successfully. May 07 22:13:55.730758 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-2e6939a3-6162-4d46-b4ee-a26f6806a634 req-ed0ce9b8-7484-4f13-a1d3-affe701e8b0e tempest-TestVolumeBootPattern-860620187 None] Terminate volume connection completed successfully. May 07 22:13:55.733302 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-2e6939a3-6162-4d46-b4ee-a26f6806a634 req-ed0ce9b8-7484-4f13-a1d3-affe701e8b0e tempest-TestVolumeBootPattern-860620187 None] Deleting attachment 022e2c38-2510-4ad0-9ea5-3a9858bd9d1d. {{(pid=129946) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 07 22:13:55.776066 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-9972feb8-8b39-4825-af41-f1884093fa76 tempest-VolumesActionsTest-1312707754 None] Lock "b'cinder-836d9bdf-7043-4a5f-a763-7322545e97a6-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:13:55.857242 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-9972feb8-8b39-4825-af41-f1884093fa76 tempest-VolumesActionsTest-1312707754 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:55.963692 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-9972feb8-8b39-4825-af41-f1884093fa76 tempest-VolumesActionsTest-1312707754 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:13:55.964307 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-9972feb8-8b39-4825-af41-f1884093fa76 tempest-VolumesActionsTest-1312707754 None] Volume volume-836d9bdf-7043-4a5f-a763-7322545e97a6 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:13:56.019682 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-9972feb8-8b39-4825-af41-f1884093fa76 tempest-VolumesActionsTest-1312707754 None] deleting rbd volume volume-836d9bdf-7043-4a5f-a763-7322545e97a6 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:13:56.044174 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [req-2e6939a3-6162-4d46-b4ee-a26f6806a634 req-439e515d-8699-475f-8f6e-9250a52731cd tempest-TestVolumeBootPattern-860620187 None] Lock "b'cinder-98df53e6-113b-46c3-abcd-bdd3e0d203bf-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:13:56.184513 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-2e6939a3-6162-4d46-b4ee-a26f6806a634 req-439e515d-8699-475f-8f6e-9250a52731cd tempest-TestVolumeBootPattern-860620187 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:56.440919 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-2e6939a3-6162-4d46-b4ee-a26f6806a634 req-439e515d-8699-475f-8f6e-9250a52731cd tempest-TestVolumeBootPattern-860620187 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:13:56.453233 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-2e6939a3-6162-4d46-b4ee-a26f6806a634 req-439e515d-8699-475f-8f6e-9250a52731cd tempest-TestVolumeBootPattern-860620187 None] deleting rbd volume volume-98df53e6-113b-46c3-abcd-bdd3e0d203bf {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:13:56.744308 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-9972feb8-8b39-4825-af41-f1884093fa76 tempest-VolumesActionsTest-1312707754 None] Created reservations ['c266baec-b888-4afc-9cc8-94d4850b0e65', '0acb0092-32f5-4e64-8ea3-44a383f1887a', '686b3986-ab09-4826-913f-ccd21fddd3f2', '335f6aa0-6013-4cca-895f-04a9ce6959fa'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:13:56.812504 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-9972feb8-8b39-4825-af41-f1884093fa76 tempest-VolumesActionsTest-1312707754 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:56.903615 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-9972feb8-8b39-4825-af41-f1884093fa76 tempest-VolumesActionsTest-1312707754 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:56.983895 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-9972feb8-8b39-4825-af41-f1884093fa76 tempest-VolumesActionsTest-1312707754 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:13:56.989534 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-9972feb8-8b39-4825-af41-f1884093fa76 tempest-VolumesActionsTest-1312707754 None] Deleted volume successfully. May 07 22:13:57.021817 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-9972feb8-8b39-4825-af41-f1884093fa76 tempest-VolumesActionsTest-1312707754 None] Lock "b'cinder-836d9bdf-7043-4a5f-a763-7322545e97a6-delete_volume'" released by "delete_volume" :: held 1.246s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:13:57.180334 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [req-2e6939a3-6162-4d46-b4ee-a26f6806a634 req-439e515d-8699-475f-8f6e-9250a52731cd tempest-TestVolumeBootPattern-860620187 None] Created reservations ['27f45ffd-481c-403d-ac11-acb6449c7b89', '4d6c5707-2185-4c5a-a275-356cbbbb5dfc', '2547de64-62c4-4d38-9f8e-617e14deef53', 'a7439b2b-73dc-4dee-a6b8-60384102f341'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:13:57.283211 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-2e6939a3-6162-4d46-b4ee-a26f6806a634 req-439e515d-8699-475f-8f6e-9250a52731cd tempest-TestVolumeBootPattern-860620187 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:57.344467 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-2e6939a3-6162-4d46-b4ee-a26f6806a634 req-439e515d-8699-475f-8f6e-9250a52731cd tempest-TestVolumeBootPattern-860620187 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:57.463413 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [req-2e6939a3-6162-4d46-b4ee-a26f6806a634 req-439e515d-8699-475f-8f6e-9250a52731cd tempest-TestVolumeBootPattern-860620187 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:13:57.467441 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-2e6939a3-6162-4d46-b4ee-a26f6806a634 req-439e515d-8699-475f-8f6e-9250a52731cd tempest-TestVolumeBootPattern-860620187 None] Deleted volume successfully. May 07 22:13:57.489032 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [req-2e6939a3-6162-4d46-b4ee-a26f6806a634 req-439e515d-8699-475f-8f6e-9250a52731cd tempest-TestVolumeBootPattern-860620187 None] Lock "b'cinder-98df53e6-113b-46c3-abcd-bdd3e0d203bf-delete_volume'" released by "delete_volume" :: held 1.446s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:13:57.546086 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-1b434be3-ca34-4abd-9267-7acf077f5c1f tempest-TestVolumeBootPattern-860620187 None] Lock "b'cinder-f9d757db-ff45-4ae6-b388-a2d8a6598713-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.018s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:13:57.549240 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-1b434be3-ca34-4abd-9267-7acf077f5c1f tempest-TestVolumeBootPattern-860620187 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:57.803218 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-f98ec344-85a9-4be9-9c08-16ba13441d1d tempest-VolumesActionsTest-1113665028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:13:57.855046 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f98ec344-85a9-4be9-9c08-16ba13441d1d tempest-VolumesActionsTest-1113665028 None] Flow 'volume_create_manager' (1c80e8ba-0439-4f64-a461-382e5d5360c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:13:57.864505 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f98ec344-85a9-4be9-9c08-16ba13441d1d tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77fc0e77-f81e-4ed2-9eaa-555d8c921107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:57.895096 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f98ec344-85a9-4be9-9c08-16ba13441d1d tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77fc0e77-f81e-4ed2-9eaa-555d8c921107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:13:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2036898370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d3418ac1-8434-4fc4-a01c-01a16ec29186,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d62508bea6e7484ea316f52f4d3b8471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:13:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:13:58Z,use_quota=True,user_id='313cb56eefdd49cab9f9ddcbfea4ab72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:57.901626 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f98ec344-85a9-4be9-9c08-16ba13441d1d tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0fd0ff0-eda1-42ef-b0f6-db0b4389bc66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:57.907133 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f98ec344-85a9-4be9-9c08-16ba13441d1d tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0fd0ff0-eda1-42ef-b0f6-db0b4389bc66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:57.912772 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f98ec344-85a9-4be9-9c08-16ba13441d1d tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f64e71d-3ed1-4a9b-96d6-3c8b2b3a9b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:57.919087 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f98ec344-85a9-4be9-9c08-16ba13441d1d tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f64e71d-3ed1-4a9b-96d6-3c8b2b3a9b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3418ac1-8434-4fc4-a01c-01a16ec29186', 'volume_name': 'volume-d3418ac1-8434-4fc4-a01c-01a16ec29186', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:57.931817 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f98ec344-85a9-4be9-9c08-16ba13441d1d tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5debcac7-dd1b-4ad5-881e-1bad4501bf6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:57.938387 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f98ec344-85a9-4be9-9c08-16ba13441d1d tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5debcac7-dd1b-4ad5-881e-1bad4501bf6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:57.943760 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f98ec344-85a9-4be9-9c08-16ba13441d1d tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b362e7f-bc13-4191-9fc8-c05f8fa4fcbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:57.945125 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-f98ec344-85a9-4be9-9c08-16ba13441d1d tempest-VolumesActionsTest-1113665028 None] Volume d3418ac1-8434-4fc4-a01c-01a16ec29186: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3418ac1-8434-4fc4-a01c-01a16ec29186', 'volume_size': 1} May 07 22:13:57.945821 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-f98ec344-85a9-4be9-9c08-16ba13441d1d tempest-VolumesActionsTest-1113665028 None] creating volume 'volume-d3418ac1-8434-4fc4-a01c-01a16ec29186' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:13:57.946801 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-f98ec344-85a9-4be9-9c08-16ba13441d1d tempest-VolumesActionsTest-1113665028 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:58.141852 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-f98ec344-85a9-4be9-9c08-16ba13441d1d tempest-VolumesActionsTest-1113665028 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:13:58.142987 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-f98ec344-85a9-4be9-9c08-16ba13441d1d tempest-VolumesActionsTest-1113665028 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:13:58.148401 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f98ec344-85a9-4be9-9c08-16ba13441d1d tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b362e7f-bc13-4191-9fc8-c05f8fa4fcbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3418ac1-8434-4fc4-a01c-01a16ec29186', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:58.159321 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f98ec344-85a9-4be9-9c08-16ba13441d1d tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb7dc3f0-de3e-492b-a9a5-408d577e9b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:13:58.179187 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-f98ec344-85a9-4be9-9c08-16ba13441d1d tempest-VolumesActionsTest-1113665028 None] Volume volume-d3418ac1-8434-4fc4-a01c-01a16ec29186 (d3418ac1-8434-4fc4-a01c-01a16ec29186): created successfully May 07 22:13:58.184358 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f98ec344-85a9-4be9-9c08-16ba13441d1d tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb7dc3f0-de3e-492b-a9a5-408d577e9b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:13:58.192597 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f98ec344-85a9-4be9-9c08-16ba13441d1d tempest-VolumesActionsTest-1113665028 None] Flow 'volume_create_manager' (1c80e8ba-0439-4f64-a461-382e5d5360c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:13:58.226322 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-f98ec344-85a9-4be9-9c08-16ba13441d1d tempest-VolumesActionsTest-1113665028 None] Created volume successfully. May 07 22:13:58.773066 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-0fb295dc-4f4b-42b7-bd94-5520934f609c tempest-VolumesActionsTest-1312707754 None] Lock "b'cinder-d3418ac1-8434-4fc4-a01c-01a16ec29186-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:13:58.839325 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0fb295dc-4f4b-42b7-bd94-5520934f609c tempest-VolumesActionsTest-1312707754 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:58.903290 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0fb295dc-4f4b-42b7-bd94-5520934f609c tempest-VolumesActionsTest-1312707754 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:13:58.903775 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0fb295dc-4f4b-42b7-bd94-5520934f609c tempest-VolumesActionsTest-1312707754 None] Volume volume-d3418ac1-8434-4fc4-a01c-01a16ec29186 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:13:58.912758 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0fb295dc-4f4b-42b7-bd94-5520934f609c tempest-VolumesActionsTest-1312707754 None] deleting rbd volume volume-d3418ac1-8434-4fc4-a01c-01a16ec29186 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:13:59.362889 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-0fb295dc-4f4b-42b7-bd94-5520934f609c tempest-VolumesActionsTest-1312707754 None] Created reservations ['67228294-76c1-41e2-8c64-369413ad7310', '49d30c78-c5f5-4ee2-a0b8-12d31b19516d', '96cd9354-026c-4e57-8de7-e3573a35ad87', '836daa69-6c14-4e1e-ac45-f1c4feb0cd7e'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:13:59.465611 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0fb295dc-4f4b-42b7-bd94-5520934f609c tempest-VolumesActionsTest-1312707754 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:59.529159 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0fb295dc-4f4b-42b7-bd94-5520934f609c tempest-VolumesActionsTest-1312707754 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:13:59.596667 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-0fb295dc-4f4b-42b7-bd94-5520934f609c tempest-VolumesActionsTest-1312707754 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:13:59.602643 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-0fb295dc-4f4b-42b7-bd94-5520934f609c tempest-VolumesActionsTest-1312707754 None] Deleted volume successfully. May 07 22:13:59.624550 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-0fb295dc-4f4b-42b7-bd94-5520934f609c tempest-VolumesActionsTest-1312707754 None] Lock "b'cinder-d3418ac1-8434-4fc4-a01c-01a16ec29186-delete_volume'" released by "delete_volume" :: held 0.851s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:14:00.258136 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-66bd8dea-1664-4289-8497-ec9676b3386b tempest-VolumesActionsTest-1113665028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:14:00.323771 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-66bd8dea-1664-4289-8497-ec9676b3386b tempest-VolumesActionsTest-1113665028 None] Flow 'volume_create_manager' (441ce3a9-efae-40ed-8102-9bb20b2b5fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:14:00.345391 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-66bd8dea-1664-4289-8497-ec9676b3386b tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b35a516-5075-423e-bbbb-6faeea3d9847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:14:00.372437 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-66bd8dea-1664-4289-8497-ec9676b3386b tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b35a516-5075-423e-bbbb-6faeea3d9847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-826697321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0449eff5-8902-48f8-a003-0fb72865c95b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d62508bea6e7484ea316f52f4d3b8471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:14:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:14:00Z,use_quota=True,user_id='313cb56eefdd49cab9f9ddcbfea4ab72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:14:00.394784 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-66bd8dea-1664-4289-8497-ec9676b3386b tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94a65663-e03d-4224-9efd-de657e651aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:14:00.404950 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-66bd8dea-1664-4289-8497-ec9676b3386b tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94a65663-e03d-4224-9efd-de657e651aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:14:00.415369 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-66bd8dea-1664-4289-8497-ec9676b3386b tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aa3b7da-12e0-4a94-9137-2b0751efd7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:14:00.420444 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-66bd8dea-1664-4289-8497-ec9676b3386b tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aa3b7da-12e0-4a94-9137-2b0751efd7df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0449eff5-8902-48f8-a003-0fb72865c95b', 'volume_name': 'volume-0449eff5-8902-48f8-a003-0fb72865c95b', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:14:00.427772 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-66bd8dea-1664-4289-8497-ec9676b3386b tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (774f2998-238e-46e4-a6c4-30491baffb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:14:00.433301 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-66bd8dea-1664-4289-8497-ec9676b3386b tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (774f2998-238e-46e4-a6c4-30491baffb25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:14:00.440486 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-66bd8dea-1664-4289-8497-ec9676b3386b tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e4071f9-ac4f-4819-88ad-2e0041a6219c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:14:00.443348 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-66bd8dea-1664-4289-8497-ec9676b3386b tempest-VolumesActionsTest-1113665028 None] Volume 0449eff5-8902-48f8-a003-0fb72865c95b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0449eff5-8902-48f8-a003-0fb72865c95b', 'volume_size': 1} May 07 22:14:00.443757 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-66bd8dea-1664-4289-8497-ec9676b3386b tempest-VolumesActionsTest-1113665028 None] creating volume 'volume-0449eff5-8902-48f8-a003-0fb72865c95b' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:14:00.446944 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-66bd8dea-1664-4289-8497-ec9676b3386b tempest-VolumesActionsTest-1113665028 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:14:00.604707 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-66bd8dea-1664-4289-8497-ec9676b3386b tempest-VolumesActionsTest-1113665028 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:14:00.605484 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-66bd8dea-1664-4289-8497-ec9676b3386b tempest-VolumesActionsTest-1113665028 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:14:00.617044 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-66bd8dea-1664-4289-8497-ec9676b3386b tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e4071f9-ac4f-4819-88ad-2e0041a6219c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0449eff5-8902-48f8-a003-0fb72865c95b', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:14:00.629834 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-66bd8dea-1664-4289-8497-ec9676b3386b tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61f9c3ac-0473-4581-93bc-e828581322ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:14:00.645657 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-66bd8dea-1664-4289-8497-ec9676b3386b tempest-VolumesActionsTest-1113665028 None] Volume volume-0449eff5-8902-48f8-a003-0fb72865c95b (0449eff5-8902-48f8-a003-0fb72865c95b): created successfully May 07 22:14:00.652076 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-66bd8dea-1664-4289-8497-ec9676b3386b tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61f9c3ac-0473-4581-93bc-e828581322ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:14:00.667786 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-66bd8dea-1664-4289-8497-ec9676b3386b tempest-VolumesActionsTest-1113665028 None] Flow 'volume_create_manager' (441ce3a9-efae-40ed-8102-9bb20b2b5fa7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:14:00.696535 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-66bd8dea-1664-4289-8497-ec9676b3386b tempest-VolumesActionsTest-1113665028 None] Created volume successfully. May 07 22:14:01.568046 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-43955681-702e-4830-94a8-868e02c06b6e tempest-VolumesActionsTest-1312707754 None] Lock "b'cinder-0449eff5-8902-48f8-a003-0fb72865c95b-delete_volume'" acquired by "delete_volume" :: waited 0.026s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:14:01.619164 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-43955681-702e-4830-94a8-868e02c06b6e tempest-VolumesActionsTest-1312707754 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:14:01.719934 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-43955681-702e-4830-94a8-868e02c06b6e tempest-VolumesActionsTest-1312707754 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:14:01.720369 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-43955681-702e-4830-94a8-868e02c06b6e tempest-VolumesActionsTest-1312707754 None] Volume volume-0449eff5-8902-48f8-a003-0fb72865c95b is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:14:01.729089 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-43955681-702e-4830-94a8-868e02c06b6e tempest-VolumesActionsTest-1312707754 None] deleting rbd volume volume-0449eff5-8902-48f8-a003-0fb72865c95b {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:14:02.096449 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-43955681-702e-4830-94a8-868e02c06b6e tempest-VolumesActionsTest-1312707754 None] Created reservations ['76f66b2c-b6db-4b91-b10b-6f249ba071e5', 'e073e395-8048-4274-a21e-98c2178b244e', 'c38425cb-4bf7-46e5-a8d6-c9725bcea4d8', 'f9b448b2-dd42-4555-b561-79cda965b103'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:14:02.169521 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-43955681-702e-4830-94a8-868e02c06b6e tempest-VolumesActionsTest-1312707754 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:14:02.237732 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-43955681-702e-4830-94a8-868e02c06b6e tempest-VolumesActionsTest-1312707754 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:14:02.292275 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-43955681-702e-4830-94a8-868e02c06b6e tempest-VolumesActionsTest-1312707754 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:14:02.296509 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-43955681-702e-4830-94a8-868e02c06b6e tempest-VolumesActionsTest-1312707754 None] Deleted volume successfully. May 07 22:14:02.310802 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-43955681-702e-4830-94a8-868e02c06b6e tempest-VolumesActionsTest-1312707754 None] Lock "b'cinder-0449eff5-8902-48f8-a003-0fb72865c95b-delete_volume'" released by "delete_volume" :: held 0.743s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:14:03.153118 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-3940ee8e-c1c9-4438-8bf2-1a74fa967a16 tempest-VolumesActionsTest-1113665028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:14:03.180933 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-3940ee8e-c1c9-4438-8bf2-1a74fa967a16 tempest-VolumesActionsTest-1113665028 None] Flow 'volume_create_manager' (c161a7de-2139-4b65-b794-9fe97e782335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:14:03.187671 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-3940ee8e-c1c9-4438-8bf2-1a74fa967a16 tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (833bd5ab-c243-442c-9442-b23379c25bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:14:03.206790 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-3940ee8e-c1c9-4438-8bf2-1a74fa967a16 tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (833bd5ab-c243-442c-9442-b23379c25bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1853352358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2201555e-a759-4fb9-a374-101991ad2562,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d62508bea6e7484ea316f52f4d3b8471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:14:03Z,use_quota=True,user_id='313cb56eefdd49cab9f9ddcbfea4ab72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:14:03.213803 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-3940ee8e-c1c9-4438-8bf2-1a74fa967a16 tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cb25b8f-6d4d-4ba6-ada0-db13cf217f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:14:03.218243 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-3940ee8e-c1c9-4438-8bf2-1a74fa967a16 tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cb25b8f-6d4d-4ba6-ada0-db13cf217f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:14:03.224996 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-3940ee8e-c1c9-4438-8bf2-1a74fa967a16 tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80bc2561-4fcc-4080-8562-98e65b57b826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:14:03.229323 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-3940ee8e-c1c9-4438-8bf2-1a74fa967a16 tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80bc2561-4fcc-4080-8562-98e65b57b826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2201555e-a759-4fb9-a374-101991ad2562', 'volume_name': 'volume-2201555e-a759-4fb9-a374-101991ad2562', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:14:03.235360 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-3940ee8e-c1c9-4438-8bf2-1a74fa967a16 tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8566062e-8ac3-4078-9dcd-06175eda7e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:14:03.239796 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-3940ee8e-c1c9-4438-8bf2-1a74fa967a16 tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8566062e-8ac3-4078-9dcd-06175eda7e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:14:03.244841 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-3940ee8e-c1c9-4438-8bf2-1a74fa967a16 tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6533a53-22b4-4c49-b666-fbcbcececc64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:14:03.246072 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-3940ee8e-c1c9-4438-8bf2-1a74fa967a16 tempest-VolumesActionsTest-1113665028 None] Volume 2201555e-a759-4fb9-a374-101991ad2562: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2201555e-a759-4fb9-a374-101991ad2562', 'volume_size': 1} May 07 22:14:03.246531 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-3940ee8e-c1c9-4438-8bf2-1a74fa967a16 tempest-VolumesActionsTest-1113665028 None] creating volume 'volume-2201555e-a759-4fb9-a374-101991ad2562' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:14:03.247404 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-3940ee8e-c1c9-4438-8bf2-1a74fa967a16 tempest-VolumesActionsTest-1113665028 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:14:03.342850 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-3940ee8e-c1c9-4438-8bf2-1a74fa967a16 tempest-VolumesActionsTest-1113665028 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:14:03.343122 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-3940ee8e-c1c9-4438-8bf2-1a74fa967a16 tempest-VolumesActionsTest-1113665028 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:14:03.350849 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-3940ee8e-c1c9-4438-8bf2-1a74fa967a16 tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6533a53-22b4-4c49-b666-fbcbcececc64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2201555e-a759-4fb9-a374-101991ad2562', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:14:03.358206 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-3940ee8e-c1c9-4438-8bf2-1a74fa967a16 tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1071ae80-2dd6-4352-8166-707727a21f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:14:03.371307 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-3940ee8e-c1c9-4438-8bf2-1a74fa967a16 tempest-VolumesActionsTest-1113665028 None] Volume volume-2201555e-a759-4fb9-a374-101991ad2562 (2201555e-a759-4fb9-a374-101991ad2562): created successfully May 07 22:14:03.375855 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-3940ee8e-c1c9-4438-8bf2-1a74fa967a16 tempest-VolumesActionsTest-1113665028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1071ae80-2dd6-4352-8166-707727a21f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:14:03.383047 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-3940ee8e-c1c9-4438-8bf2-1a74fa967a16 tempest-VolumesActionsTest-1113665028 None] Flow 'volume_create_manager' (c161a7de-2139-4b65-b794-9fe97e782335) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:14:03.399816 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-3940ee8e-c1c9-4438-8bf2-1a74fa967a16 tempest-VolumesActionsTest-1113665028 None] Created volume successfully. May 07 22:14:04.807477 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-b8961c48-9462-4b7c-9e58-63c486697931 tempest-VolumesActionsTest-1113665028 None] Lock "b'cinder-2201555e-a759-4fb9-a374-101991ad2562-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:14:04.870645 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b8961c48-9462-4b7c-9e58-63c486697931 tempest-VolumesActionsTest-1113665028 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:14:04.963301 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b8961c48-9462-4b7c-9e58-63c486697931 tempest-VolumesActionsTest-1113665028 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:14:04.964547 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b8961c48-9462-4b7c-9e58-63c486697931 tempest-VolumesActionsTest-1113665028 None] Volume volume-2201555e-a759-4fb9-a374-101991ad2562 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:14:04.977013 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b8961c48-9462-4b7c-9e58-63c486697931 tempest-VolumesActionsTest-1113665028 None] deleting rbd volume volume-2201555e-a759-4fb9-a374-101991ad2562 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:14:05.704143 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-b8961c48-9462-4b7c-9e58-63c486697931 tempest-VolumesActionsTest-1113665028 None] Created reservations ['f0ef124f-903c-48c3-86d5-909d628664a7', '02ff8905-9723-4d98-8c93-f25bbec28647', 'b4ef6824-ce21-4f93-aa36-fd9d590750e5', '9f83ac62-80f1-4368-9740-013274e4c13b'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:14:05.811570 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b8961c48-9462-4b7c-9e58-63c486697931 tempest-VolumesActionsTest-1113665028 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:14:05.860729 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b8961c48-9462-4b7c-9e58-63c486697931 tempest-VolumesActionsTest-1113665028 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:14:05.935507 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-b8961c48-9462-4b7c-9e58-63c486697931 tempest-VolumesActionsTest-1113665028 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:14:05.941837 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-b8961c48-9462-4b7c-9e58-63c486697931 tempest-VolumesActionsTest-1113665028 None] Deleted volume successfully. May 07 22:14:05.964535 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-b8961c48-9462-4b7c-9e58-63c486697931 tempest-VolumesActionsTest-1113665028 None] Lock "b'cinder-2201555e-a759-4fb9-a374-101991ad2562-delete_volume'" released by "delete_volume" :: held 1.157s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:14:06.242371 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-adab2448-c470-4553-baa4-e4ace4b60665 tempest-VolumesActionsTest-1113665028 None] Lock "b'cinder-6e16e33d-37ef-49dc-8546-3ad2cccabd5e-delete_volume'" acquired by "delete_volume" :: waited 0.026s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:14:06.375764 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-adab2448-c470-4553-baa4-e4ace4b60665 tempest-VolumesActionsTest-1113665028 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:14:06.483084 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-adab2448-c470-4553-baa4-e4ace4b60665 tempest-VolumesActionsTest-1113665028 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:14:06.483927 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-adab2448-c470-4553-baa4-e4ace4b60665 tempest-VolumesActionsTest-1113665028 None] Volume volume-6e16e33d-37ef-49dc-8546-3ad2cccabd5e is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:14:06.508989 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-adab2448-c470-4553-baa4-e4ace4b60665 tempest-VolumesActionsTest-1113665028 None] deleting rbd volume volume-6e16e33d-37ef-49dc-8546-3ad2cccabd5e {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:14:07.294729 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-adab2448-c470-4553-baa4-e4ace4b60665 tempest-VolumesActionsTest-1113665028 None] Created reservations ['fcbcccdb-0c8d-46db-8f1a-6c379127cc32', '7ff27abe-a1e1-450b-9ce9-581c1a549dea', 'c117d319-38f4-47f2-bd54-116644cd09ae', 'ed3531f9-efe3-4278-b04a-ad9d2a8a5a84'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:14:07.407386 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-adab2448-c470-4553-baa4-e4ace4b60665 tempest-VolumesActionsTest-1113665028 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:14:07.482562 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-adab2448-c470-4553-baa4-e4ace4b60665 tempest-VolumesActionsTest-1113665028 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:14:07.517004 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-adab2448-c470-4553-baa4-e4ace4b60665 tempest-VolumesActionsTest-1113665028 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:14:07.523614 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-adab2448-c470-4553-baa4-e4ace4b60665 tempest-VolumesActionsTest-1113665028 None] Deleted volume successfully. May 07 22:14:07.557714 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-adab2448-c470-4553-baa4-e4ace4b60665 tempest-VolumesActionsTest-1113665028 None] Lock "b'cinder-6e16e33d-37ef-49dc-8546-3ad2cccabd5e-delete_volume'" released by "delete_volume" :: held 1.315s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:14:28.048975 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-1b434be3-ca34-4abd-9267-7acf077f5c1f tempest-TestVolumeBootPattern-860620187 None] Created reservations ['62ee2703-f3b8-4c88-baa1-1b2d57ee9eb2', 'fc4aa7af-9f94-4e4e-8ef7-502f3bcf1b36', 'c2558a40-a281-478f-b57a-3e1a6d47edde', '794ffa88-3add-4485-bd1d-332d76bf45e3'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:14:28.258004 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-1b434be3-ca34-4abd-9267-7acf077f5c1f tempest-TestVolumeBootPattern-860620187 None] Delete snapshot completed successfully. May 07 22:14:28.270482 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-1b434be3-ca34-4abd-9267-7acf077f5c1f tempest-TestVolumeBootPattern-860620187 None] Lock "b'cinder-f9d757db-ff45-4ae6-b388-a2d8a6598713-delete_snapshot'" released by "delete_snapshot" :: held 30.724s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:14:31.192834 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:14:31.200268 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:14:31.269361 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:14:31.342332 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:14:31.932869 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [req-283e5720-0cd1-432d-bd96-2593e3be1f1d req-4a87c92f-35f8-457c-a0dd-c14bad45d3aa tempest-VolumesSnapshotsTestJSON-1598825046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:14:31.989084 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-283e5720-0cd1-432d-bd96-2593e3be1f1d req-4a87c92f-35f8-457c-a0dd-c14bad45d3aa tempest-VolumesSnapshotsTestJSON-1598825046 None] Flow 'volume_create_manager' (d6b80444-d05c-479b-81e4-adc81a1de964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:14:32.005523 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-283e5720-0cd1-432d-bd96-2593e3be1f1d req-4a87c92f-35f8-457c-a0dd-c14bad45d3aa tempest-VolumesSnapshotsTestJSON-1598825046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b90df5b0-5c4e-4fa9-935f-57fae4501f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:14:32.050695 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-283e5720-0cd1-432d-bd96-2593e3be1f1d req-4a87c92f-35f8-457c-a0dd-c14bad45d3aa tempest-VolumesSnapshotsTestJSON-1598825046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b90df5b0-5c4e-4fa9-935f-57fae4501f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-955329550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=24243580-a0f2-4edd-84d9-cb81af63f8bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39938e8eedcd4eca818171baa6a53cba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:14:32Z,use_quota=True,user_id='a96c59e1f5d64e0ba7559328f5ae9e1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:14:32.074153 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-283e5720-0cd1-432d-bd96-2593e3be1f1d req-4a87c92f-35f8-457c-a0dd-c14bad45d3aa tempest-VolumesSnapshotsTestJSON-1598825046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfa03662-2c1e-402d-95e2-2fdb2314c20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:14:32.088101 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-283e5720-0cd1-432d-bd96-2593e3be1f1d req-4a87c92f-35f8-457c-a0dd-c14bad45d3aa tempest-VolumesSnapshotsTestJSON-1598825046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfa03662-2c1e-402d-95e2-2fdb2314c20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:14:32.101545 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-283e5720-0cd1-432d-bd96-2593e3be1f1d req-4a87c92f-35f8-457c-a0dd-c14bad45d3aa tempest-VolumesSnapshotsTestJSON-1598825046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a16ca41-aa1b-4d1b-bda1-38db6f7e8aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:14:32.121596 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-283e5720-0cd1-432d-bd96-2593e3be1f1d req-4a87c92f-35f8-457c-a0dd-c14bad45d3aa tempest-VolumesSnapshotsTestJSON-1598825046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a16ca41-aa1b-4d1b-bda1-38db6f7e8aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24243580-a0f2-4edd-84d9-cb81af63f8bc', 'volume_name': 'volume-24243580-a0f2-4edd-84d9-cb81af63f8bc', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:14:32.168114 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-283e5720-0cd1-432d-bd96-2593e3be1f1d req-4a87c92f-35f8-457c-a0dd-c14bad45d3aa tempest-VolumesSnapshotsTestJSON-1598825046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1c1dce3-4e32-49b6-83be-9b34f136672f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:14:32.181683 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-283e5720-0cd1-432d-bd96-2593e3be1f1d req-4a87c92f-35f8-457c-a0dd-c14bad45d3aa tempest-VolumesSnapshotsTestJSON-1598825046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1c1dce3-4e32-49b6-83be-9b34f136672f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:14:32.205190 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-283e5720-0cd1-432d-bd96-2593e3be1f1d req-4a87c92f-35f8-457c-a0dd-c14bad45d3aa tempest-VolumesSnapshotsTestJSON-1598825046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d68651a-8192-40f4-b344-956ba551ce79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:14:32.206529 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [req-283e5720-0cd1-432d-bd96-2593e3be1f1d req-4a87c92f-35f8-457c-a0dd-c14bad45d3aa tempest-VolumesSnapshotsTestJSON-1598825046 None] Volume 24243580-a0f2-4edd-84d9-cb81af63f8bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24243580-a0f2-4edd-84d9-cb81af63f8bc', 'volume_size': 1} May 07 22:14:32.207000 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-283e5720-0cd1-432d-bd96-2593e3be1f1d req-4a87c92f-35f8-457c-a0dd-c14bad45d3aa tempest-VolumesSnapshotsTestJSON-1598825046 None] creating volume 'volume-24243580-a0f2-4edd-84d9-cb81af63f8bc' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:14:32.207812 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-283e5720-0cd1-432d-bd96-2593e3be1f1d req-4a87c92f-35f8-457c-a0dd-c14bad45d3aa tempest-VolumesSnapshotsTestJSON-1598825046 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:14:32.440410 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-283e5720-0cd1-432d-bd96-2593e3be1f1d req-4a87c92f-35f8-457c-a0dd-c14bad45d3aa tempest-VolumesSnapshotsTestJSON-1598825046 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:14:32.441044 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-283e5720-0cd1-432d-bd96-2593e3be1f1d req-4a87c92f-35f8-457c-a0dd-c14bad45d3aa tempest-VolumesSnapshotsTestJSON-1598825046 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:14:32.455580 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-283e5720-0cd1-432d-bd96-2593e3be1f1d req-4a87c92f-35f8-457c-a0dd-c14bad45d3aa tempest-VolumesSnapshotsTestJSON-1598825046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d68651a-8192-40f4-b344-956ba551ce79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24243580-a0f2-4edd-84d9-cb81af63f8bc', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:14:32.460709 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-283e5720-0cd1-432d-bd96-2593e3be1f1d req-4a87c92f-35f8-457c-a0dd-c14bad45d3aa tempest-VolumesSnapshotsTestJSON-1598825046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef22f5ec-56a3-49e4-afa0-9a5d1e4837a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:14:32.483628 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [req-283e5720-0cd1-432d-bd96-2593e3be1f1d req-4a87c92f-35f8-457c-a0dd-c14bad45d3aa tempest-VolumesSnapshotsTestJSON-1598825046 None] Volume volume-24243580-a0f2-4edd-84d9-cb81af63f8bc (24243580-a0f2-4edd-84d9-cb81af63f8bc): created successfully May 07 22:14:32.488263 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-283e5720-0cd1-432d-bd96-2593e3be1f1d req-4a87c92f-35f8-457c-a0dd-c14bad45d3aa tempest-VolumesSnapshotsTestJSON-1598825046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef22f5ec-56a3-49e4-afa0-9a5d1e4837a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:14:32.506309 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-283e5720-0cd1-432d-bd96-2593e3be1f1d req-4a87c92f-35f8-457c-a0dd-c14bad45d3aa tempest-VolumesSnapshotsTestJSON-1598825046 None] Flow 'volume_create_manager' (d6b80444-d05c-479b-81e4-adc81a1de964) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:14:32.532027 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-283e5720-0cd1-432d-bd96-2593e3be1f1d req-4a87c92f-35f8-457c-a0dd-c14bad45d3aa tempest-VolumesSnapshotsTestJSON-1598825046 None] Created volume successfully. May 07 22:14:33.364456 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-ceca9557-0bab-4b8b-922e-64c1d96b547f req-317629f8-3d95-4af0-bdca-305d19ed8d78 tempest-VolumesSnapshotsTestJSON-1598825046 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:14:34.724690 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-ceca9557-0bab-4b8b-922e-64c1d96b547f req-317629f8-3d95-4af0-bdca-305d19ed8d78 tempest-VolumesSnapshotsTestJSON-1598825046 None] Create snapshot completed successfully May 07 22:14:34.737478 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-98bad389-d868-40ac-89b6-9e41b66a9ff3 req-da13299c-a153-4520-8418-59cf48eb9dd1 tempest-TestVolumeBootPattern-860620187 None] Terminate volume connection completed successfully. May 07 22:14:34.739333 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-98bad389-d868-40ac-89b6-9e41b66a9ff3 req-da13299c-a153-4520-8418-59cf48eb9dd1 tempest-TestVolumeBootPattern-860620187 None] Deleting attachment 5e049b6a-ac7b-41a5-bc29-1281c86efbc7. {{(pid=129946) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 07 22:14:35.031868 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [req-98bad389-d868-40ac-89b6-9e41b66a9ff3 req-601f9faa-fc3f-4a29-a2be-803cd8f7ccf7 tempest-TestVolumeBootPattern-860620187 None] Lock "b'cinder-9a081585-6d81-4d08-8c50-ae0498445a58-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:14:35.105627 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-98bad389-d868-40ac-89b6-9e41b66a9ff3 req-601f9faa-fc3f-4a29-a2be-803cd8f7ccf7 tempest-TestVolumeBootPattern-860620187 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:14:35.251108 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-98bad389-d868-40ac-89b6-9e41b66a9ff3 req-601f9faa-fc3f-4a29-a2be-803cd8f7ccf7 tempest-TestVolumeBootPattern-860620187 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:14:35.268867 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-98bad389-d868-40ac-89b6-9e41b66a9ff3 req-601f9faa-fc3f-4a29-a2be-803cd8f7ccf7 tempest-TestVolumeBootPattern-860620187 None] deleting rbd volume volume-9a081585-6d81-4d08-8c50-ae0498445a58 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:14:35.940351 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-98bad389-d868-40ac-89b6-9e41b66a9ff3 req-601f9faa-fc3f-4a29-a2be-803cd8f7ccf7 tempest-TestVolumeBootPattern-860620187 None] volume is a clone so cleaning references {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} May 07 22:14:36.007150 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-98bad389-d868-40ac-89b6-9e41b66a9ff3 req-601f9faa-fc3f-4a29-a2be-803cd8f7ccf7 tempest-TestVolumeBootPattern-860620187 None] deleting parent snapshot volume-9a081585-6d81-4d08-8c50-ae0498445a58.clone_snap {{(pid=129946) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} May 07 22:14:37.245796 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [req-7b202fb9-b6c4-4f2f-894b-8a7c14810bfd req-2cf3fa90-95a4-41ec-b986-4ff45d98f0b6 tempest-VolumesSnapshotsTestJSON-1598825046 None] Lock "b'cinder-f313a77d-76d6-4a34-aef5-1f9e36c21cd9-delete_snapshot'" acquired by "delete_snapshot" :: waited 1.322s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:14:37.247278 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-7b202fb9-b6c4-4f2f-894b-8a7c14810bfd req-2cf3fa90-95a4-41ec-b986-4ff45d98f0b6 tempest-VolumesSnapshotsTestJSON-1598825046 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:14:37.375189 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-53b2a9ac-2bd7-4fa6-b584-a302ff89b3b0 tempest-GroupSnapshotsV319Test-2055487738 None] Group tempest-GroupSnapshotsV319Test-Group-1306596132: creating May 07 22:14:37.437802 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-53b2a9ac-2bd7-4fa6-b584-a302ff89b3b0 tempest-GroupSnapshotsV319Test-2055487738 None] Group tempest-GroupSnapshotsV319Test-Group-1306596132: created successfully May 07 22:14:37.451241 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-53b2a9ac-2bd7-4fa6-b584-a302ff89b3b0 tempest-GroupSnapshotsV319Test-2055487738 None] Create group completed successfully. May 07 22:14:37.452679 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [req-98bad389-d868-40ac-89b6-9e41b66a9ff3 req-601f9faa-fc3f-4a29-a2be-803cd8f7ccf7 tempest-TestVolumeBootPattern-860620187 None] Created reservations ['abf2de4e-e264-42eb-9dc9-c6f992098153', '10fbfade-1260-49f2-81dd-f39cfab321d3', '73d2c810-e3e1-448f-a02a-ee8408ecddbe', 'c88f1e7f-810c-44c6-95b4-22e14d318885'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:14:37.530377 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-98bad389-d868-40ac-89b6-9e41b66a9ff3 req-601f9faa-fc3f-4a29-a2be-803cd8f7ccf7 tempest-TestVolumeBootPattern-860620187 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:14:37.599593 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-98bad389-d868-40ac-89b6-9e41b66a9ff3 req-601f9faa-fc3f-4a29-a2be-803cd8f7ccf7 tempest-TestVolumeBootPattern-860620187 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:14:37.663904 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [req-98bad389-d868-40ac-89b6-9e41b66a9ff3 req-601f9faa-fc3f-4a29-a2be-803cd8f7ccf7 tempest-TestVolumeBootPattern-860620187 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:14:37.672578 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-98bad389-d868-40ac-89b6-9e41b66a9ff3 req-601f9faa-fc3f-4a29-a2be-803cd8f7ccf7 tempest-TestVolumeBootPattern-860620187 None] Deleted volume successfully. May 07 22:14:37.700450 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [req-98bad389-d868-40ac-89b6-9e41b66a9ff3 req-601f9faa-fc3f-4a29-a2be-803cd8f7ccf7 tempest-TestVolumeBootPattern-860620187 None] Lock "b'cinder-9a081585-6d81-4d08-8c50-ae0498445a58-delete_volume'" released by "delete_volume" :: held 2.667s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:14:38.412075 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [req-7b202fb9-b6c4-4f2f-894b-8a7c14810bfd req-2cf3fa90-95a4-41ec-b986-4ff45d98f0b6 tempest-VolumesSnapshotsTestJSON-1598825046 None] Created reservations ['56fc983c-273e-4dcd-a3b8-30e070e0d589', '657feec5-8cd2-4828-ab30-ee8cdbe00752', 'be6d99cf-fef4-4ce8-b76f-e329adaf3932', '59d68a11-b46c-4d35-9af7-8338b65c89cb'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:14:38.511726 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-7b202fb9-b6c4-4f2f-894b-8a7c14810bfd req-2cf3fa90-95a4-41ec-b986-4ff45d98f0b6 tempest-VolumesSnapshotsTestJSON-1598825046 None] Delete snapshot completed successfully. May 07 22:14:38.524897 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [req-7b202fb9-b6c4-4f2f-894b-8a7c14810bfd req-2cf3fa90-95a4-41ec-b986-4ff45d98f0b6 tempest-VolumesSnapshotsTestJSON-1598825046 None] Lock "b'cinder-f313a77d-76d6-4a34-aef5-1f9e36c21cd9-delete_snapshot'" released by "delete_snapshot" :: held 1.277s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:14:39.034296 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-07f84db3-615e-4e84-b96f-4d80bff48c0a tempest-GroupSnapshotsV319Test-2055487738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:14:39.076284 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-07f84db3-615e-4e84-b96f-4d80bff48c0a tempest-GroupSnapshotsV319Test-2055487738 None] Flow 'volume_create_manager' (8b118868-9866-4c8e-95be-c40fa81cf826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:14:39.094038 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-07f84db3-615e-4e84-b96f-4d80bff48c0a tempest-GroupSnapshotsV319Test-2055487738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eba349d7-313f-46c3-b05b-8cd8f1548e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:14:39.145805 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-07f84db3-615e-4e84-b96f-4d80bff48c0a tempest-GroupSnapshotsV319Test-2055487738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eba349d7-313f-46c3-b05b-8cd8f1548e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsV319Test-Volume-1460701702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1af5c735-5448-47f7-8794-785faa085a76,host='ncdv-master-1@ceph#ceph',id=a8644e86-8c93-4832-896b-c0a733f3c224,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d3c999387164ee980313aa31b9f46c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:14:39Z,use_quota=True,user_id='b94d59dc7ca144ef8b5726e17e0ef324',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ac1b2b3-7a86-4492-b52a-fc065c4b56a5),volume_type_id=3ac1b2b3-7a86-4492-b52a-fc065c4b56a5)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:14:39.182472 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-07f84db3-615e-4e84-b96f-4d80bff48c0a tempest-GroupSnapshotsV319Test-2055487738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4867fcc1-ce24-4b39-a0d1-5e558ed2a72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:14:39.193639 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-07f84db3-615e-4e84-b96f-4d80bff48c0a tempest-GroupSnapshotsV319Test-2055487738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4867fcc1-ce24-4b39-a0d1-5e558ed2a72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:14:39.232201 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-07f84db3-615e-4e84-b96f-4d80bff48c0a tempest-GroupSnapshotsV319Test-2055487738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97bdef91-3d7c-429c-a9ab-69f170648eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:14:39.255800 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-07f84db3-615e-4e84-b96f-4d80bff48c0a tempest-GroupSnapshotsV319Test-2055487738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97bdef91-3d7c-429c-a9ab-69f170648eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8644e86-8c93-4832-896b-c0a733f3c224', 'volume_name': 'volume-a8644e86-8c93-4832-896b-c0a733f3c224', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:14:39.269864 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-07f84db3-615e-4e84-b96f-4d80bff48c0a tempest-GroupSnapshotsV319Test-2055487738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95aa8d99-48d1-4a40-bdd5-762a95ce670a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:14:39.275872 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-07f84db3-615e-4e84-b96f-4d80bff48c0a tempest-GroupSnapshotsV319Test-2055487738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95aa8d99-48d1-4a40-bdd5-762a95ce670a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:14:39.281584 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-07f84db3-615e-4e84-b96f-4d80bff48c0a tempest-GroupSnapshotsV319Test-2055487738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95201275-19f9-4974-b9c8-d87cc24a03ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:14:39.283595 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-07f84db3-615e-4e84-b96f-4d80bff48c0a tempest-GroupSnapshotsV319Test-2055487738 None] Volume a8644e86-8c93-4832-896b-c0a733f3c224: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8644e86-8c93-4832-896b-c0a733f3c224', 'volume_size': 1} May 07 22:14:39.284503 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-07f84db3-615e-4e84-b96f-4d80bff48c0a tempest-GroupSnapshotsV319Test-2055487738 None] creating volume 'volume-a8644e86-8c93-4832-896b-c0a733f3c224' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:14:39.286449 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-07f84db3-615e-4e84-b96f-4d80bff48c0a tempest-GroupSnapshotsV319Test-2055487738 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:14:39.456350 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-07f84db3-615e-4e84-b96f-4d80bff48c0a tempest-GroupSnapshotsV319Test-2055487738 None] extra_specs: {} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:14:39.458320 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-07f84db3-615e-4e84-b96f-4d80bff48c0a tempest-GroupSnapshotsV319Test-2055487738 None] extra_specs: {} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:14:39.472172 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-07f84db3-615e-4e84-b96f-4d80bff48c0a tempest-GroupSnapshotsV319Test-2055487738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95201275-19f9-4974-b9c8-d87cc24a03ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8644e86-8c93-4832-896b-c0a733f3c224', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:14:39.487153 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-07f84db3-615e-4e84-b96f-4d80bff48c0a tempest-GroupSnapshotsV319Test-2055487738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (081df602-b349-4f12-bdf0-cdc550648b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:14:39.516781 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [req-d2fc1c36-09f5-4575-920c-d44805586def req-b5001ff5-18c5-4908-bb3b-ea62153225c4 tempest-VolumesSnapshotsTestJSON-1598825046 None] Lock "b'cinder-24243580-a0f2-4edd-84d9-cb81af63f8bc-delete_volume'" acquired by "delete_volume" :: waited 0.087s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:14:39.580052 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-07f84db3-615e-4e84-b96f-4d80bff48c0a tempest-GroupSnapshotsV319Test-2055487738 None] Volume volume-a8644e86-8c93-4832-896b-c0a733f3c224 (a8644e86-8c93-4832-896b-c0a733f3c224): created successfully May 07 22:14:39.591636 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-07f84db3-615e-4e84-b96f-4d80bff48c0a tempest-GroupSnapshotsV319Test-2055487738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (081df602-b349-4f12-bdf0-cdc550648b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:14:39.598107 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-07f84db3-615e-4e84-b96f-4d80bff48c0a tempest-GroupSnapshotsV319Test-2055487738 None] Flow 'volume_create_manager' (8b118868-9866-4c8e-95be-c40fa81cf826) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:14:39.630738 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-07f84db3-615e-4e84-b96f-4d80bff48c0a tempest-GroupSnapshotsV319Test-2055487738 None] Created volume successfully. May 07 22:14:39.675521 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-d2fc1c36-09f5-4575-920c-d44805586def req-b5001ff5-18c5-4908-bb3b-ea62153225c4 tempest-VolumesSnapshotsTestJSON-1598825046 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:14:39.792809 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-d2fc1c36-09f5-4575-920c-d44805586def req-b5001ff5-18c5-4908-bb3b-ea62153225c4 tempest-VolumesSnapshotsTestJSON-1598825046 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:14:39.793509 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-d2fc1c36-09f5-4575-920c-d44805586def req-b5001ff5-18c5-4908-bb3b-ea62153225c4 tempest-VolumesSnapshotsTestJSON-1598825046 None] Volume volume-24243580-a0f2-4edd-84d9-cb81af63f8bc is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:14:39.801235 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-d2fc1c36-09f5-4575-920c-d44805586def req-b5001ff5-18c5-4908-bb3b-ea62153225c4 tempest-VolumesSnapshotsTestJSON-1598825046 None] deleting rbd volume volume-24243580-a0f2-4edd-84d9-cb81af63f8bc {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:14:40.372549 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [req-d2fc1c36-09f5-4575-920c-d44805586def req-b5001ff5-18c5-4908-bb3b-ea62153225c4 tempest-VolumesSnapshotsTestJSON-1598825046 None] Created reservations ['5855607b-e836-4748-869a-897c862f7031', 'c7b4fa47-b13d-441f-96b8-2ce868fded41', '885c57ea-8bcc-4206-a2ed-240e29a973eb', '631b0ab7-f50a-497d-af04-c698fa95f533'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:14:40.455848 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-3afb8676-a3b2-462b-af49-fcba6e19fd45 tempest-GroupSnapshotsV319Test-2055487738 None] GroupSnapshot 7f850fa9-0a5e-4a5c-86a2-822a490f1043: creating. May 07 22:14:40.484526 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-3afb8676-a3b2-462b-af49-fcba6e19fd45 tempest-GroupSnapshotsV319Test-2055487738 None] Group snapshot 7f850fa9-0a5e-4a5c-86a2-822a490f1043: creating. {{(pid=129946) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4078}} May 07 22:14:40.492940 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-d2fc1c36-09f5-4575-920c-d44805586def req-b5001ff5-18c5-4908-bb3b-ea62153225c4 tempest-VolumesSnapshotsTestJSON-1598825046 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:14:40.571298 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-d2fc1c36-09f5-4575-920c-d44805586def req-b5001ff5-18c5-4908-bb3b-ea62153225c4 tempest-VolumesSnapshotsTestJSON-1598825046 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:14:40.666749 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [req-d2fc1c36-09f5-4575-920c-d44805586def req-b5001ff5-18c5-4908-bb3b-ea62153225c4 tempest-VolumesSnapshotsTestJSON-1598825046 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:14:40.678531 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-d2fc1c36-09f5-4575-920c-d44805586def req-b5001ff5-18c5-4908-bb3b-ea62153225c4 tempest-VolumesSnapshotsTestJSON-1598825046 None] Deleted volume successfully. May 07 22:14:40.732594 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-3afb8676-a3b2-462b-af49-fcba6e19fd45 tempest-GroupSnapshotsV319Test-2055487738 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:14:40.852118 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [req-d2fc1c36-09f5-4575-920c-d44805586def req-b5001ff5-18c5-4908-bb3b-ea62153225c4 tempest-VolumesSnapshotsTestJSON-1598825046 None] Lock "b'cinder-24243580-a0f2-4edd-84d9-cb81af63f8bc-delete_volume'" released by "delete_volume" :: held 1.338s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:14:41.523066 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-3afb8676-a3b2-462b-af49-fcba6e19fd45 tempest-GroupSnapshotsV319Test-2055487738 None] group_snapshot 7f850fa9-0a5e-4a5c-86a2-822a490f1043: created successfully May 07 22:14:42.305212 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-c0f5c04c-df23-4434-9a17-6a99098482eb tempest-GroupSnapshotsV319Test-2055487738 None] group_snapshot 7f850fa9-0a5e-4a5c-86a2-822a490f1043: deleting May 07 22:14:42.337076 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-c0f5c04c-df23-4434-9a17-6a99098482eb tempest-GroupSnapshotsV319Test-2055487738 None] group_snapshot 7f850fa9-0a5e-4a5c-86a2-822a490f1043: deleting {{(pid=129946) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4253}} May 07 22:14:42.375696 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-c0f5c04c-df23-4434-9a17-6a99098482eb tempest-GroupSnapshotsV319Test-2055487738 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:14:43.675809 ncdv-master-1 cinder-volume[129946]: WARNING cinder.quota [None req-c0f5c04c-df23-4434-9a17-6a99098482eb tempest-GroupSnapshotsV319Test-2055487738 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1726205490 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1726205490, it is now deprecated. Please use the default quota class for default quota. May 07 22:14:43.677722 ncdv-master-1 cinder-volume[129946]: WARNING cinder.quota [None req-c0f5c04c-df23-4434-9a17-6a99098482eb tempest-GroupSnapshotsV319Test-2055487738 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1726205490 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1726205490, it is now deprecated. Please use the default quota class for default quota. May 07 22:14:43.709363 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-c0f5c04c-df23-4434-9a17-6a99098482eb tempest-GroupSnapshotsV319Test-2055487738 None] Created reservations ['8e709900-4a06-4c9b-9050-3b9fb61594ea', '82191ca5-eb3f-4eee-926e-b8f14cd89395', 'f88d7575-5988-480f-b4c5-ee95bcdda2c7', '0321c75b-89ab-4b0a-adc3-d6c2447b5bf9'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:14:43.846868 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-c0f5c04c-df23-4434-9a17-6a99098482eb tempest-GroupSnapshotsV319Test-2055487738 None] group_snapshot 7f850fa9-0a5e-4a5c-86a2-822a490f1043: deleted successfully May 07 22:14:45.220064 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-37f28a0b-661b-4d5a-9896-9678dadc4ba3 tempest-GroupSnapshotsV319Test-2055487738 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:14:45.360652 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-37f28a0b-661b-4d5a-9896-9678dadc4ba3 tempest-GroupSnapshotsV319Test-2055487738 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:14:45.361164 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-37f28a0b-661b-4d5a-9896-9678dadc4ba3 tempest-GroupSnapshotsV319Test-2055487738 None] Volume volume-a8644e86-8c93-4832-896b-c0a733f3c224 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:14:45.399951 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-37f28a0b-661b-4d5a-9896-9678dadc4ba3 tempest-GroupSnapshotsV319Test-2055487738 None] deleting rbd volume volume-a8644e86-8c93-4832-896b-c0a733f3c224 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:14:45.979785 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-37f28a0b-661b-4d5a-9896-9678dadc4ba3 tempest-GroupSnapshotsV319Test-2055487738 None] Created reservations ['a3e9feaf-c027-4a7b-b120-de91eb4eebf2'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:14:46.026912 ncdv-master-1 cinder-volume[129946]: WARNING cinder.quota [None req-37f28a0b-661b-4d5a-9896-9678dadc4ba3 tempest-GroupSnapshotsV319Test-2055487738 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1726205490 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1726205490, it is now deprecated. Please use the default quota class for default quota. May 07 22:14:46.074361 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-37f28a0b-661b-4d5a-9896-9678dadc4ba3 tempest-GroupSnapshotsV319Test-2055487738 None] Created reservations ['46036bf4-df98-4f95-93cc-42ef01784abb', '021366ff-a6c3-4eeb-8faa-2c07a96cac1e', 'c14ad43b-f5ff-4e7a-875a-1175295dfd7b', '910daf91-dcba-4c02-a56f-eae785983a07'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:14:46.267149 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-37f28a0b-661b-4d5a-9896-9678dadc4ba3 tempest-GroupSnapshotsV319Test-2055487738 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:14:46.345367 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-37f28a0b-661b-4d5a-9896-9678dadc4ba3 tempest-GroupSnapshotsV319Test-2055487738 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:14:46.427292 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-37f28a0b-661b-4d5a-9896-9678dadc4ba3 tempest-GroupSnapshotsV319Test-2055487738 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:14:46.439713 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-37f28a0b-661b-4d5a-9896-9678dadc4ba3 tempest-GroupSnapshotsV319Test-2055487738 None] Delete group completed successfully. May 07 22:14:46.501079 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-34b13c07-a3e8-44a0-b367-3f0609e3cb34 tempest-TestVolumeBootPattern-860620187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:14:46.583760 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-34b13c07-a3e8-44a0-b367-3f0609e3cb34 tempest-TestVolumeBootPattern-860620187 None] Flow 'volume_create_manager' (64c87bdb-a211-4170-a973-0bda1867c414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:14:46.615873 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-34b13c07-a3e8-44a0-b367-3f0609e3cb34 tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47165f5c-21b5-4dbd-a050-475b2b9b6dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:14:46.672180 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-34b13c07-a3e8-44a0-b367-3f0609e3cb34 tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47165f5c-21b5-4dbd-a050-475b2b9b6dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:14:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1960454308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d5293072-2a82-483d-ad24-437bd38b3be7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3657e8df46a4252b9eb1eb159306a66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:14:46Z,use_quota=True,user_id='9b4988836610494ab48a138bd43d5b52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:14:46.694881 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-34b13c07-a3e8-44a0-b367-3f0609e3cb34 tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (392807f7-c1d1-4ee7-9d9c-cc323fde561e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:14:46.723195 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-34b13c07-a3e8-44a0-b367-3f0609e3cb34 tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (392807f7-c1d1-4ee7-9d9c-cc323fde561e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:14:46.750740 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-34b13c07-a3e8-44a0-b367-3f0609e3cb34 tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (171a172b-81b8-4725-8995-56ede7ed576f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:14:46.903281 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-34b13c07-a3e8-44a0-b367-3f0609e3cb34 tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (171a172b-81b8-4725-8995-56ede7ed576f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd5293072-2a82-483d-ad24-437bd38b3be7', 'volume_name': 'volume-d5293072-2a82-483d-ad24-437bd38b3be7', 'volume_size': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e2f828af0706465883131e16cb564d05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'created_at': datetime.datetime(2022, 5, 7, 21, 36, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:14:46.924927 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-34b13c07-a3e8-44a0-b367-3f0609e3cb34 tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0956f506-40cc-4218-9936-77f44e68169e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:14:46.944360 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-34b13c07-a3e8-44a0-b367-3f0609e3cb34 tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0956f506-40cc-4218-9936-77f44e68169e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:14:46.967248 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-34b13c07-a3e8-44a0-b367-3f0609e3cb34 tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aa2bf3a-7b4f-4355-90c1-f015f1dc7ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:14:46.974322 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-34b13c07-a3e8-44a0-b367-3f0609e3cb34 tempest-TestVolumeBootPattern-860620187 None] Volume d5293072-2a82-483d-ad24-437bd38b3be7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d5293072-2a82-483d-ad24-437bd38b3be7', 'volume_size': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e2f828af0706465883131e16cb564d05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'created_at': datetime.datetime(2022, 5, 7, 21, 36, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } May 07 22:14:46.981057 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-34b13c07-a3e8-44a0-b367-3f0609e3cb34 tempest-TestVolumeBootPattern-860620187 None] Cloning d5293072-2a82-483d-ad24-437bd38b3be7 from image 3756ae98-5c12-48e7-920e-ef5d1dd5543c at location (None, None). {{(pid=129946) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} May 07 22:14:47.022243 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-34b13c07-a3e8-44a0-b367-3f0609e3cb34 tempest-TestVolumeBootPattern-860620187 None] Lock "b'cinder-3756ae98-5c12-48e7-920e-ef5d1dd5543c'" acquired by "_prepare_image_cache_entry" :: waited 0.040s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:14:47.059251 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-34b13c07-a3e8-44a0-b367-3f0609e3cb34 tempest-TestVolumeBootPattern-860620187 None] Found image-volume cache entry: {'id': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'volume_id': '82279f40-9683-441f-a541-0db8b9177f48', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9), 'last_used': datetime.datetime(2022, 5, 7, 22, 14, 47, 49983)}. {{(pid=129946) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 07 22:14:47.064443 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-34b13c07-a3e8-44a0-b367-3f0609e3cb34 tempest-TestVolumeBootPattern-860620187 None] Image-volume cache entry image_update_at = 2022-05-07 21:37:09+00:00, requested image updated_at = 2022-05-07 21:37:09+00:00. {{(pid=129946) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 07 22:14:47.066643 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-34b13c07-a3e8-44a0-b367-3f0609e3cb34 tempest-TestVolumeBootPattern-860620187 None] Found cache entry for image = 3756ae98-5c12-48e7-920e-ef5d1dd5543c on host ncdv-master-1@ceph#ceph. {{(pid=129946) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} May 07 22:14:47.084180 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-34b13c07-a3e8-44a0-b367-3f0609e3cb34 tempest-TestVolumeBootPattern-860620187 None] Lock "b'cinder-3756ae98-5c12-48e7-920e-ef5d1dd5543c'" released by "_prepare_image_cache_entry" :: held 0.062s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:14:47.086658 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-34b13c07-a3e8-44a0-b367-3f0609e3cb34 tempest-TestVolumeBootPattern-860620187 None] Attempting to retrieve cache entry for image = 3756ae98-5c12-48e7-920e-ef5d1dd5543c on host ncdv-master-1@ceph#ceph. {{(pid=129946) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} May 07 22:14:47.098442 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-34b13c07-a3e8-44a0-b367-3f0609e3cb34 tempest-TestVolumeBootPattern-860620187 None] Found image-volume cache entry: {'id': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'volume_id': '82279f40-9683-441f-a541-0db8b9177f48', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9), 'last_used': datetime.datetime(2022, 5, 7, 22, 14, 47, 95056)}. {{(pid=129946) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 07 22:14:47.099114 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-34b13c07-a3e8-44a0-b367-3f0609e3cb34 tempest-TestVolumeBootPattern-860620187 None] Image-volume cache entry image_update_at = 2022-05-07 21:37:09+00:00, requested image updated_at = 2022-05-07 21:37:09+00:00. {{(pid=129946) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 07 22:14:47.100095 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-34b13c07-a3e8-44a0-b367-3f0609e3cb34 tempest-TestVolumeBootPattern-860620187 None] Creating from source image-volume 82279f40-9683-441f-a541-0db8b9177f48 {{(pid=129946) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} May 07 22:14:47.140275 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-34b13c07-a3e8-44a0-b367-3f0609e3cb34 tempest-TestVolumeBootPattern-860620187 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:14:47.257315 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-34b13c07-a3e8-44a0-b367-3f0609e3cb34 tempest-TestVolumeBootPattern-860620187 None] creating snapshot='volume-d5293072-2a82-483d-ad24-437bd38b3be7.clone_snap' {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} May 07 22:14:48.309172 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-34b13c07-a3e8-44a0-b367-3f0609e3cb34 tempest-TestVolumeBootPattern-860620187 None] cloning 'volume-82279f40-9683-441f-a541-0db8b9177f48@volume-d5293072-2a82-483d-ad24-437bd38b3be7.clone_snap' to 'volume-d5293072-2a82-483d-ad24-437bd38b3be7' {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 07 22:14:48.586740 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-34b13c07-a3e8-44a0-b367-3f0609e3cb34 tempest-TestVolumeBootPattern-860620187 None] Volume volume-3864f924-91b4-4015-ab37-8bdbf8ad652d.deleted is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:14:48.587766 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-34b13c07-a3e8-44a0-b367-3f0609e3cb34 tempest-TestVolumeBootPattern-860620187 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:14:48.588135 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-34b13c07-a3e8-44a0-b367-3f0609e3cb34 tempest-TestVolumeBootPattern-860620187 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:14:48.643018 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-34b13c07-a3e8-44a0-b367-3f0609e3cb34 tempest-TestVolumeBootPattern-860620187 None] clone created successfully {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} May 07 22:14:48.643637 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.volume_utils [None req-34b13c07-a3e8-44a0-b367-3f0609e3cb34 tempest-TestVolumeBootPattern-860620187 None] Marking volume d5293072-2a82-483d-ad24-437bd38b3be7 as bootable. {{(pid=129946) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} May 07 22:14:48.656500 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-34b13c07-a3e8-44a0-b367-3f0609e3cb34 tempest-TestVolumeBootPattern-860620187 None] Copying metadata from image 3756ae98-5c12-48e7-920e-ef5d1dd5543c to d5293072-2a82-483d-ad24-437bd38b3be7. {{(pid=129946) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} May 07 22:14:48.657183 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-34b13c07-a3e8-44a0-b367-3f0609e3cb34 tempest-TestVolumeBootPattern-860620187 None] Creating volume glance metadata for volume d5293072-2a82-483d-ad24-437bd38b3be7 backed by image 3756ae98-5c12-48e7-920e-ef5d1dd5543c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129946) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} May 07 22:14:48.815873 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-34b13c07-a3e8-44a0-b367-3f0609e3cb34 tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aa2bf3a-7b4f-4355-90c1-f015f1dc7ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5293072-2a82-483d-ad24-437bd38b3be7', 'volume_size': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e2f828af0706465883131e16cb564d05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'created_at': datetime.datetime(2022, 5, 7, 21, 36, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:14:48.825757 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-34b13c07-a3e8-44a0-b367-3f0609e3cb34 tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce41b19c-00f6-442b-84e0-96950c12317c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:14:48.855036 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-34b13c07-a3e8-44a0-b367-3f0609e3cb34 tempest-TestVolumeBootPattern-860620187 None] Volume volume-d5293072-2a82-483d-ad24-437bd38b3be7 (d5293072-2a82-483d-ad24-437bd38b3be7): created successfully May 07 22:14:48.859843 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-34b13c07-a3e8-44a0-b367-3f0609e3cb34 tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce41b19c-00f6-442b-84e0-96950c12317c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:14:48.880356 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-34b13c07-a3e8-44a0-b367-3f0609e3cb34 tempest-TestVolumeBootPattern-860620187 None] Flow 'volume_create_manager' (64c87bdb-a211-4170-a973-0bda1867c414) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:14:48.891089 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-34b13c07-a3e8-44a0-b367-3f0609e3cb34 tempest-TestVolumeBootPattern-860620187 None] Created volume successfully. May 07 22:14:55.990138 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-5aaa12c0-1e5f-4ab8-9fce-e56c0d193272 req-0d732d6f-021f-46d1-a184-538c1c4952ec tempest-TestVolumeBootPattern-860620187 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 22:14:57.278572 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-5aaa12c0-1e5f-4ab8-9fce-e56c0d193272 req-0d732d6f-021f-46d1-a184-538c1c4952ec tempest-TestVolumeBootPattern-860620187 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.288s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 22:14:57.279502 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-5aaa12c0-1e5f-4ab8-9fce-e56c0d193272 req-0d732d6f-021f-46d1-a184-538c1c4952ec tempest-TestVolumeBootPattern-860620187 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d5293072-2a82-483d-ad24-437bd38b3be7', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3ca0b836-1cfe-436a-b0fa-deb74d3203d9', 'volume_id': 'd5293072-2a82-483d-ad24-437bd38b3be7', 'discard': True}} {{(pid=129946) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 07 22:14:57.345460 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-5aaa12c0-1e5f-4ab8-9fce-e56c0d193272 req-0d732d6f-021f-46d1-a184-538c1c4952ec tempest-TestVolumeBootPattern-860620187 None] Connection info returned from driver {'name': 'volumes/volume-d5293072-2a82-483d-ad24-437bd38b3be7', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd5293072-2a82-483d-ad24-437bd38b3be7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '20409dac-1cdc-4a9a-ad0c-29e0acf9b619'} {{(pid=129946) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 07 22:14:57.496736 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-5aaa12c0-1e5f-4ab8-9fce-e56c0d193272 req-0d732d6f-021f-46d1-a184-538c1c4952ec tempest-TestVolumeBootPattern-860620187 None] attachment_update completed successfully. May 07 22:14:58.338278 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b4ef2c5-1a61-4caf-8882-f38289fa4692 tempest-SnapshotsActionsTest-487359461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:14:58.417255 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5b4ef2c5-1a61-4caf-8882-f38289fa4692 tempest-SnapshotsActionsTest-487359461 None] Flow 'volume_create_manager' (63517139-3afa-419e-9f10-d57f4e20858d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:14:58.434623 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5b4ef2c5-1a61-4caf-8882-f38289fa4692 tempest-SnapshotsActionsTest-487359461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61c9e724-2f92-4cb8-b7a7-5df1cea9c5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:14:58.494389 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5b4ef2c5-1a61-4caf-8882-f38289fa4692 tempest-SnapshotsActionsTest-487359461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61c9e724-2f92-4cb8-b7a7-5df1cea9c5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2090383321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8404e248-fdc6-48c3-bd3d-31ab290103ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0915e3f568564652bbb67d8df1f997af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:14:58Z,use_quota=True,user_id='b067fb7cbdf4475f90f192e00e32d89e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:14:58.517991 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5b4ef2c5-1a61-4caf-8882-f38289fa4692 tempest-SnapshotsActionsTest-487359461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18dfe342-f2c1-4a41-a42c-e14d385bf5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:14:58.535864 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5b4ef2c5-1a61-4caf-8882-f38289fa4692 tempest-SnapshotsActionsTest-487359461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18dfe342-f2c1-4a41-a42c-e14d385bf5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:14:58.560515 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5b4ef2c5-1a61-4caf-8882-f38289fa4692 tempest-SnapshotsActionsTest-487359461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f853901-bc84-4998-a588-79ab87aea5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:14:58.574857 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5b4ef2c5-1a61-4caf-8882-f38289fa4692 tempest-SnapshotsActionsTest-487359461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f853901-bc84-4998-a588-79ab87aea5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8404e248-fdc6-48c3-bd3d-31ab290103ef', 'volume_name': 'volume-8404e248-fdc6-48c3-bd3d-31ab290103ef', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:14:58.598667 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5b4ef2c5-1a61-4caf-8882-f38289fa4692 tempest-SnapshotsActionsTest-487359461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (632750bb-6fa1-4754-b267-c04963951d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:14:58.604865 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5b4ef2c5-1a61-4caf-8882-f38289fa4692 tempest-SnapshotsActionsTest-487359461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (632750bb-6fa1-4754-b267-c04963951d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:14:58.611742 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5b4ef2c5-1a61-4caf-8882-f38289fa4692 tempest-SnapshotsActionsTest-487359461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71542057-a5f3-41e8-b681-63540d14596f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:14:58.615615 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-5b4ef2c5-1a61-4caf-8882-f38289fa4692 tempest-SnapshotsActionsTest-487359461 None] Volume 8404e248-fdc6-48c3-bd3d-31ab290103ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8404e248-fdc6-48c3-bd3d-31ab290103ef', 'volume_size': 1} May 07 22:14:58.616313 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-5b4ef2c5-1a61-4caf-8882-f38289fa4692 tempest-SnapshotsActionsTest-487359461 None] creating volume 'volume-8404e248-fdc6-48c3-bd3d-31ab290103ef' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:14:58.618062 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-5b4ef2c5-1a61-4caf-8882-f38289fa4692 tempest-SnapshotsActionsTest-487359461 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:14:58.787006 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-5b4ef2c5-1a61-4caf-8882-f38289fa4692 tempest-SnapshotsActionsTest-487359461 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:14:58.787763 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-5b4ef2c5-1a61-4caf-8882-f38289fa4692 tempest-SnapshotsActionsTest-487359461 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:14:58.795195 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5b4ef2c5-1a61-4caf-8882-f38289fa4692 tempest-SnapshotsActionsTest-487359461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71542057-a5f3-41e8-b681-63540d14596f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8404e248-fdc6-48c3-bd3d-31ab290103ef', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:14:58.801380 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5b4ef2c5-1a61-4caf-8882-f38289fa4692 tempest-SnapshotsActionsTest-487359461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5656c2a8-b81c-4a6b-a557-805847f8e4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:14:58.830465 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-5b4ef2c5-1a61-4caf-8882-f38289fa4692 tempest-SnapshotsActionsTest-487359461 None] Volume volume-8404e248-fdc6-48c3-bd3d-31ab290103ef (8404e248-fdc6-48c3-bd3d-31ab290103ef): created successfully May 07 22:14:58.834338 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5b4ef2c5-1a61-4caf-8882-f38289fa4692 tempest-SnapshotsActionsTest-487359461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5656c2a8-b81c-4a6b-a557-805847f8e4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:14:58.849906 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5b4ef2c5-1a61-4caf-8882-f38289fa4692 tempest-SnapshotsActionsTest-487359461 None] Flow 'volume_create_manager' (63517139-3afa-419e-9f10-d57f4e20858d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:14:58.876735 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-5b4ef2c5-1a61-4caf-8882-f38289fa4692 tempest-SnapshotsActionsTest-487359461 None] Created volume successfully. May 07 22:14:59.776967 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-df51f3f6-30ab-41d9-8acd-c693c3097723 tempest-SnapshotsActionsTest-487359461 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:15:00.445589 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-df51f3f6-30ab-41d9-8acd-c693c3097723 tempest-SnapshotsActionsTest-487359461 None] Create snapshot completed successfully May 07 22:15:01.836910 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-fefe140d-5fe3-4805-ac98-f75f05725dfd tempest-SnapshotsActionsTest-487359461 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:15:02.568451 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-fefe140d-5fe3-4805-ac98-f75f05725dfd tempest-SnapshotsActionsTest-487359461 None] Create snapshot completed successfully May 07 22:15:03.023245 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-24331f4e-921f-4eb0-8421-1c9b828d4822 tempest-SnapshotsActionsTest-956790935 None] Lock "b'cinder-cb421231-a5ba-4d58-8bff-b72a6a23000c-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.015s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:15:03.024715 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-24331f4e-921f-4eb0-8421-1c9b828d4822 tempest-SnapshotsActionsTest-956790935 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:15:03.600965 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-24331f4e-921f-4eb0-8421-1c9b828d4822 tempest-SnapshotsActionsTest-956790935 None] Created reservations ['fd56d499-ee74-41c3-b34a-47ef20817ebc', '6a5b29db-a324-46a3-a015-da8a91b80aa1', '200c183c-c8bf-420d-a3eb-cfc337b39fc7', '2372ea73-b374-4dd9-901e-3884f004d24f'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:15:03.691950 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-24331f4e-921f-4eb0-8421-1c9b828d4822 tempest-SnapshotsActionsTest-956790935 None] Delete snapshot completed successfully. May 07 22:15:03.699075 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-24331f4e-921f-4eb0-8421-1c9b828d4822 tempest-SnapshotsActionsTest-956790935 None] Lock "b'cinder-cb421231-a5ba-4d58-8bff-b72a6a23000c-delete_snapshot'" released by "delete_snapshot" :: held 0.676s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:15:04.662420 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-a8547eb2-4b93-488a-a649-b9a6e9253898 tempest-SnapshotsActionsTest-487359461 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:15:05.642283 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-a8547eb2-4b93-488a-a649-b9a6e9253898 tempest-SnapshotsActionsTest-487359461 None] Create snapshot completed successfully May 07 22:15:06.892449 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-4bc9e288-84a7-480f-9c45-5fc3f28f6bc0 tempest-SnapshotsActionsTest-956790935 None] Lock "b'cinder-c8fd87ba-7662-477a-aed8-30755f867091-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.015s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:15:06.896879 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-4bc9e288-84a7-480f-9c45-5fc3f28f6bc0 tempest-SnapshotsActionsTest-956790935 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:15:07.692008 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-4bc9e288-84a7-480f-9c45-5fc3f28f6bc0 tempest-SnapshotsActionsTest-956790935 None] Created reservations ['bc5d375a-902e-4738-8f28-497690a78216', '748f8cc8-7aa9-41f0-8e29-842746a0b7bf', 'ecdcd8eb-7b3f-4447-a4db-703f6414cb55', '724735f7-684a-4080-ab7c-e8510f0ddf66'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:15:07.802861 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-4bc9e288-84a7-480f-9c45-5fc3f28f6bc0 tempest-SnapshotsActionsTest-956790935 None] Delete snapshot completed successfully. May 07 22:15:07.809178 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-4bc9e288-84a7-480f-9c45-5fc3f28f6bc0 tempest-SnapshotsActionsTest-956790935 None] Lock "b'cinder-c8fd87ba-7662-477a-aed8-30755f867091-delete_snapshot'" released by "delete_snapshot" :: held 0.917s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:15:08.725898 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-ad7a1b80-ae3e-4700-8149-6eaaa4f68681 tempest-SnapshotsActionsTest-487359461 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:15:09.740055 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-ad7a1b80-ae3e-4700-8149-6eaaa4f68681 tempest-SnapshotsActionsTest-487359461 None] Create snapshot completed successfully May 07 22:15:10.896715 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-facccdab-a1f3-4fe7-a5ed-a62c3e8afec5 tempest-SnapshotsActionsTest-956790935 None] Lock "b'cinder-ac36c465-6f7d-45c5-aa4c-2f71ecdcd9da-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:15:10.898894 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-facccdab-a1f3-4fe7-a5ed-a62c3e8afec5 tempest-SnapshotsActionsTest-956790935 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:15:11.447242 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-facccdab-a1f3-4fe7-a5ed-a62c3e8afec5 tempest-SnapshotsActionsTest-956790935 None] Created reservations ['078f6139-19e8-4c03-8bd3-4c21326869ff', '8d2c0cdd-82c1-405a-ae36-de6ab34fafac', '899df7a9-4dd4-40fa-bd93-09100af66ea6', 'ee60cd20-9d6a-40db-80ab-41e7b4928645'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:15:11.557730 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-facccdab-a1f3-4fe7-a5ed-a62c3e8afec5 tempest-SnapshotsActionsTest-956790935 None] Delete snapshot completed successfully. May 07 22:15:11.567303 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-facccdab-a1f3-4fe7-a5ed-a62c3e8afec5 tempest-SnapshotsActionsTest-956790935 None] Lock "b'cinder-ac36c465-6f7d-45c5-aa4c-2f71ecdcd9da-delete_snapshot'" released by "delete_snapshot" :: held 0.671s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:15:12.294362 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-1bf46c8b-4a28-4cd6-bb11-240acf04f924 tempest-SnapshotsActionsTest-487359461 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:15:12.732688 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-1bf46c8b-4a28-4cd6-bb11-240acf04f924 tempest-SnapshotsActionsTest-487359461 None] Create snapshot completed successfully May 07 22:15:13.470352 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-ea674fa7-132a-4250-83bf-4ca053eed685 tempest-SnapshotsActionsTest-956790935 None] Lock "b'cinder-7917fa8e-617b-45ff-9b04-e8c91a6a917f-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:15:13.471885 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-ea674fa7-132a-4250-83bf-4ca053eed685 tempest-SnapshotsActionsTest-956790935 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:15:14.732407 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-ea674fa7-132a-4250-83bf-4ca053eed685 tempest-SnapshotsActionsTest-956790935 None] Created reservations ['4b98ca65-1977-4830-b90d-c35d70d072af', '92c97b05-5d40-4761-8888-1bd21729ae1f', '6761e547-ea16-42ba-87c0-02ef0e5a4d60', 'ac9c8021-ffef-4e02-a54a-4f71bad0a19e'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:15:14.784733 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-ea674fa7-132a-4250-83bf-4ca053eed685 tempest-SnapshotsActionsTest-956790935 None] Delete snapshot completed successfully. May 07 22:15:14.793436 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-ea674fa7-132a-4250-83bf-4ca053eed685 tempest-SnapshotsActionsTest-956790935 None] Lock "b'cinder-7917fa8e-617b-45ff-9b04-e8c91a6a917f-delete_snapshot'" released by "delete_snapshot" :: held 1.323s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:15:16.088102 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-42c0fb0e-d808-4f8b-b030-bbfbe3a4a29d tempest-SnapshotsActionsTest-487359461 None] Lock "b'cinder-31670978-d0fe-4b2d-91c9-e1a890c3cca6-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.018s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:15:16.089948 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-42c0fb0e-d808-4f8b-b030-bbfbe3a4a29d tempest-SnapshotsActionsTest-487359461 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:15:17.367403 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-42c0fb0e-d808-4f8b-b030-bbfbe3a4a29d tempest-SnapshotsActionsTest-487359461 None] Created reservations ['eb62a07f-d60b-4b98-99b6-8133f08fda11', 'bf04fd36-9046-4947-b4c2-3dcb7447bff2', '635456b3-8bd2-458c-96ce-5ce02213657f', '7d335b8b-d8a6-49b5-a852-d8d5f24cd5ea'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:15:17.421707 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-42c0fb0e-d808-4f8b-b030-bbfbe3a4a29d tempest-SnapshotsActionsTest-487359461 None] Delete snapshot completed successfully. May 07 22:15:17.428513 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-42c0fb0e-d808-4f8b-b030-bbfbe3a4a29d tempest-SnapshotsActionsTest-487359461 None] Lock "b'cinder-31670978-d0fe-4b2d-91c9-e1a890c3cca6-delete_snapshot'" released by "delete_snapshot" :: held 1.340s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:15:18.254256 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-cb03e9dd-e9a5-43ba-9c06-f243b674107b tempest-SnapshotsActionsTest-487359461 None] Lock "b'cinder-8404e248-fdc6-48c3-bd3d-31ab290103ef-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:15:18.299437 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-cb03e9dd-e9a5-43ba-9c06-f243b674107b tempest-SnapshotsActionsTest-487359461 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:15:18.361199 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-cb03e9dd-e9a5-43ba-9c06-f243b674107b tempest-SnapshotsActionsTest-487359461 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:15:18.361746 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-cb03e9dd-e9a5-43ba-9c06-f243b674107b tempest-SnapshotsActionsTest-487359461 None] Volume volume-8404e248-fdc6-48c3-bd3d-31ab290103ef is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:15:18.372431 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-cb03e9dd-e9a5-43ba-9c06-f243b674107b tempest-SnapshotsActionsTest-487359461 None] deleting rbd volume volume-8404e248-fdc6-48c3-bd3d-31ab290103ef {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:15:18.750694 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-cb03e9dd-e9a5-43ba-9c06-f243b674107b tempest-SnapshotsActionsTest-487359461 None] Created reservations ['43295a7d-abf1-4441-a6f2-8b90f1f6d59d', '595dfd9d-eca6-4450-b346-136b493198e6', 'b8bc5164-bb17-4276-888a-299aa48c533e', '53bec98d-979a-4b23-b3c6-d01bb1385861'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:15:18.831937 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-cb03e9dd-e9a5-43ba-9c06-f243b674107b tempest-SnapshotsActionsTest-487359461 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:15:18.878203 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-cb03e9dd-e9a5-43ba-9c06-f243b674107b tempest-SnapshotsActionsTest-487359461 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:15:18.924419 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-cb03e9dd-e9a5-43ba-9c06-f243b674107b tempest-SnapshotsActionsTest-487359461 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:15:18.940533 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-cb03e9dd-e9a5-43ba-9c06-f243b674107b tempest-SnapshotsActionsTest-487359461 None] Deleted volume successfully. May 07 22:15:18.967761 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-cb03e9dd-e9a5-43ba-9c06-f243b674107b tempest-SnapshotsActionsTest-487359461 None] Lock "b'cinder-8404e248-fdc6-48c3-bd3d-31ab290103ef-delete_volume'" released by "delete_volume" :: held 0.713s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:15:23.347069 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-50c90b83-2ae1-4339-9653-2cf162f86edd tempest-VolumesImageMetadata-688773684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:15:23.392711 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-50c90b83-2ae1-4339-9653-2cf162f86edd tempest-VolumesImageMetadata-688773684 None] Flow 'volume_create_manager' (8bfb08af-98c5-41cf-ae07-324f1b9bae9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:15:23.407620 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-50c90b83-2ae1-4339-9653-2cf162f86edd tempest-VolumesImageMetadata-688773684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2faa8a48-47c1-4949-8f98-6e2926830dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:23.440831 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-50c90b83-2ae1-4339-9653-2cf162f86edd tempest-VolumesImageMetadata-688773684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2faa8a48-47c1-4949-8f98-6e2926830dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1331423627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f39d7bbf-21a0-4de7-ab40-ba87168a9f0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b684b0f2ad42f09a2f5f65ab933a36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:15:23Z,use_quota=True,user_id='7307ff743bd64b3194403cd061d6683e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:23.454466 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-50c90b83-2ae1-4339-9653-2cf162f86edd tempest-VolumesImageMetadata-688773684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52d7d20d-d320-4af6-be0a-775a4cad5bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:23.464182 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-50c90b83-2ae1-4339-9653-2cf162f86edd tempest-VolumesImageMetadata-688773684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52d7d20d-d320-4af6-be0a-775a4cad5bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:23.478208 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-50c90b83-2ae1-4339-9653-2cf162f86edd tempest-VolumesImageMetadata-688773684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (433e8130-a6ed-4fe6-bee7-898df87d5ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:23.613842 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-50c90b83-2ae1-4339-9653-2cf162f86edd tempest-VolumesImageMetadata-688773684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (433e8130-a6ed-4fe6-bee7-898df87d5ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f39d7bbf-21a0-4de7-ab40-ba87168a9f0a', 'volume_name': 'volume-f39d7bbf-21a0-4de7-ab40-ba87168a9f0a', 'volume_size': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e2f828af0706465883131e16cb564d05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'created_at': datetime.datetime(2022, 5, 7, 21, 36, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:23.621804 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-50c90b83-2ae1-4339-9653-2cf162f86edd tempest-VolumesImageMetadata-688773684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23cac221-19c2-4f66-9f57-ef95eb46e88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:23.627711 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-50c90b83-2ae1-4339-9653-2cf162f86edd tempest-VolumesImageMetadata-688773684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23cac221-19c2-4f66-9f57-ef95eb46e88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:23.637938 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-50c90b83-2ae1-4339-9653-2cf162f86edd tempest-VolumesImageMetadata-688773684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1e3e37b-63b2-4052-9ad1-f935c8220a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:23.639922 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-50c90b83-2ae1-4339-9653-2cf162f86edd tempest-VolumesImageMetadata-688773684 None] Volume f39d7bbf-21a0-4de7-ab40-ba87168a9f0a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f39d7bbf-21a0-4de7-ab40-ba87168a9f0a', 'volume_size': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e2f828af0706465883131e16cb564d05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'created_at': datetime.datetime(2022, 5, 7, 21, 36, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } May 07 22:15:23.640973 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-50c90b83-2ae1-4339-9653-2cf162f86edd tempest-VolumesImageMetadata-688773684 None] Cloning f39d7bbf-21a0-4de7-ab40-ba87168a9f0a from image 3756ae98-5c12-48e7-920e-ef5d1dd5543c at location (None, None). {{(pid=129946) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} May 07 22:15:23.657880 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-50c90b83-2ae1-4339-9653-2cf162f86edd tempest-VolumesImageMetadata-688773684 None] Lock "b'cinder-3756ae98-5c12-48e7-920e-ef5d1dd5543c'" acquired by "_prepare_image_cache_entry" :: waited 0.016s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:15:23.690010 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-50c90b83-2ae1-4339-9653-2cf162f86edd tempest-VolumesImageMetadata-688773684 None] Found image-volume cache entry: {'id': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'volume_id': '82279f40-9683-441f-a541-0db8b9177f48', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9), 'last_used': datetime.datetime(2022, 5, 7, 22, 15, 23, 680155)}. {{(pid=129946) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 07 22:15:23.690873 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-50c90b83-2ae1-4339-9653-2cf162f86edd tempest-VolumesImageMetadata-688773684 None] Image-volume cache entry image_update_at = 2022-05-07 21:37:09+00:00, requested image updated_at = 2022-05-07 21:37:09+00:00. {{(pid=129946) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 07 22:15:23.691711 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-50c90b83-2ae1-4339-9653-2cf162f86edd tempest-VolumesImageMetadata-688773684 None] Found cache entry for image = 3756ae98-5c12-48e7-920e-ef5d1dd5543c on host ncdv-master-1@ceph#ceph. {{(pid=129946) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} May 07 22:15:23.700889 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-50c90b83-2ae1-4339-9653-2cf162f86edd tempest-VolumesImageMetadata-688773684 None] Lock "b'cinder-3756ae98-5c12-48e7-920e-ef5d1dd5543c'" released by "_prepare_image_cache_entry" :: held 0.043s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:15:23.703988 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-50c90b83-2ae1-4339-9653-2cf162f86edd tempest-VolumesImageMetadata-688773684 None] Attempting to retrieve cache entry for image = 3756ae98-5c12-48e7-920e-ef5d1dd5543c on host ncdv-master-1@ceph#ceph. {{(pid=129946) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} May 07 22:15:23.721416 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-50c90b83-2ae1-4339-9653-2cf162f86edd tempest-VolumesImageMetadata-688773684 None] Found image-volume cache entry: {'id': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'volume_id': '82279f40-9683-441f-a541-0db8b9177f48', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9), 'last_used': datetime.datetime(2022, 5, 7, 22, 15, 23, 712207)}. {{(pid=129946) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 07 22:15:23.722509 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-50c90b83-2ae1-4339-9653-2cf162f86edd tempest-VolumesImageMetadata-688773684 None] Image-volume cache entry image_update_at = 2022-05-07 21:37:09+00:00, requested image updated_at = 2022-05-07 21:37:09+00:00. {{(pid=129946) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 07 22:15:23.723097 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-50c90b83-2ae1-4339-9653-2cf162f86edd tempest-VolumesImageMetadata-688773684 None] Creating from source image-volume 82279f40-9683-441f-a541-0db8b9177f48 {{(pid=129946) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} May 07 22:15:23.753253 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-50c90b83-2ae1-4339-9653-2cf162f86edd tempest-VolumesImageMetadata-688773684 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:15:23.870742 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-50c90b83-2ae1-4339-9653-2cf162f86edd tempest-VolumesImageMetadata-688773684 None] creating snapshot='volume-f39d7bbf-21a0-4de7-ab40-ba87168a9f0a.clone_snap' {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} May 07 22:15:24.440372 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-50c90b83-2ae1-4339-9653-2cf162f86edd tempest-VolumesImageMetadata-688773684 None] cloning 'volume-82279f40-9683-441f-a541-0db8b9177f48@volume-f39d7bbf-21a0-4de7-ab40-ba87168a9f0a.clone_snap' to 'volume-f39d7bbf-21a0-4de7-ab40-ba87168a9f0a' {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 07 22:15:24.727616 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-50c90b83-2ae1-4339-9653-2cf162f86edd tempest-VolumesImageMetadata-688773684 None] Volume volume-3864f924-91b4-4015-ab37-8bdbf8ad652d.deleted is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:15:24.729024 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-50c90b83-2ae1-4339-9653-2cf162f86edd tempest-VolumesImageMetadata-688773684 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:15:24.730596 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-50c90b83-2ae1-4339-9653-2cf162f86edd tempest-VolumesImageMetadata-688773684 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:15:24.760107 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-50c90b83-2ae1-4339-9653-2cf162f86edd tempest-VolumesImageMetadata-688773684 None] clone created successfully {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} May 07 22:15:24.760724 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.volume_utils [None req-50c90b83-2ae1-4339-9653-2cf162f86edd tempest-VolumesImageMetadata-688773684 None] Marking volume f39d7bbf-21a0-4de7-ab40-ba87168a9f0a as bootable. {{(pid=129946) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} May 07 22:15:24.772818 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-50c90b83-2ae1-4339-9653-2cf162f86edd tempest-VolumesImageMetadata-688773684 None] Copying metadata from image 3756ae98-5c12-48e7-920e-ef5d1dd5543c to f39d7bbf-21a0-4de7-ab40-ba87168a9f0a. {{(pid=129946) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} May 07 22:15:24.773300 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-50c90b83-2ae1-4339-9653-2cf162f86edd tempest-VolumesImageMetadata-688773684 None] Creating volume glance metadata for volume f39d7bbf-21a0-4de7-ab40-ba87168a9f0a backed by image 3756ae98-5c12-48e7-920e-ef5d1dd5543c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129946) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} May 07 22:15:24.869544 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-50c90b83-2ae1-4339-9653-2cf162f86edd tempest-VolumesImageMetadata-688773684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1e3e37b-63b2-4052-9ad1-f935c8220a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f39d7bbf-21a0-4de7-ab40-ba87168a9f0a', 'volume_size': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e2f828af0706465883131e16cb564d05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'created_at': datetime.datetime(2022, 5, 7, 21, 36, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:24.878632 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-50c90b83-2ae1-4339-9653-2cf162f86edd tempest-VolumesImageMetadata-688773684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b867369-4933-4270-a210-330de0b27e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:24.896640 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-50c90b83-2ae1-4339-9653-2cf162f86edd tempest-VolumesImageMetadata-688773684 None] Volume volume-f39d7bbf-21a0-4de7-ab40-ba87168a9f0a (f39d7bbf-21a0-4de7-ab40-ba87168a9f0a): created successfully May 07 22:15:24.905683 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-50c90b83-2ae1-4339-9653-2cf162f86edd tempest-VolumesImageMetadata-688773684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b867369-4933-4270-a210-330de0b27e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:24.919916 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-50c90b83-2ae1-4339-9653-2cf162f86edd tempest-VolumesImageMetadata-688773684 None] Flow 'volume_create_manager' (8bfb08af-98c5-41cf-ae07-324f1b9bae9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:15:24.931719 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-50c90b83-2ae1-4339-9653-2cf162f86edd tempest-VolumesImageMetadata-688773684 None] Created volume successfully. May 07 22:15:25.832408 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-71da2f22-5b6d-43db-9725-cb5eb54fcefd tempest-VolumesImageMetadata-688773684 None] Lock "b'cinder-f39d7bbf-21a0-4de7-ab40-ba87168a9f0a-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:15:25.881410 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-71da2f22-5b6d-43db-9725-cb5eb54fcefd tempest-VolumesImageMetadata-688773684 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:15:25.990453 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-71da2f22-5b6d-43db-9725-cb5eb54fcefd tempest-VolumesImageMetadata-688773684 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:15:26.004851 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-71da2f22-5b6d-43db-9725-cb5eb54fcefd tempest-VolumesImageMetadata-688773684 None] deleting rbd volume volume-f39d7bbf-21a0-4de7-ab40-ba87168a9f0a {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:15:26.369890 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-71da2f22-5b6d-43db-9725-cb5eb54fcefd tempest-VolumesImageMetadata-688773684 None] volume is a clone so cleaning references {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} May 07 22:15:26.422271 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-71da2f22-5b6d-43db-9725-cb5eb54fcefd tempest-VolumesImageMetadata-688773684 None] deleting parent snapshot volume-f39d7bbf-21a0-4de7-ab40-ba87168a9f0a.clone_snap {{(pid=129946) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} May 07 22:15:27.407034 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-71da2f22-5b6d-43db-9725-cb5eb54fcefd tempest-VolumesImageMetadata-688773684 None] Created reservations ['fbd3bf06-6004-4f97-bd44-6211cd1cc2ff', '0639aa73-32a7-43b5-9f8c-44502d44c6da', '0cdbe7de-6b67-4ada-972b-d37cbb3c8d5d', '8fb499c6-ec76-4884-8b44-b6ccb42ee0d3'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:15:27.473713 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-71da2f22-5b6d-43db-9725-cb5eb54fcefd tempest-VolumesImageMetadata-688773684 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:15:27.548611 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-71da2f22-5b6d-43db-9725-cb5eb54fcefd tempest-VolumesImageMetadata-688773684 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:15:27.596228 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-71da2f22-5b6d-43db-9725-cb5eb54fcefd tempest-VolumesImageMetadata-688773684 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:15:27.601055 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-71da2f22-5b6d-43db-9725-cb5eb54fcefd tempest-VolumesImageMetadata-688773684 None] Deleted volume successfully. May 07 22:15:27.619224 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-71da2f22-5b6d-43db-9725-cb5eb54fcefd tempest-VolumesImageMetadata-688773684 None] Lock "b'cinder-f39d7bbf-21a0-4de7-ab40-ba87168a9f0a-delete_volume'" released by "delete_volume" :: held 1.787s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:15:30.376103 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-19df1061-51f4-4a90-aa98-53d410c49c6e tempest-VolumesDeleteCascade-1306773130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:15:30.408120 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-19df1061-51f4-4a90-aa98-53d410c49c6e tempest-VolumesDeleteCascade-1306773130 None] Flow 'volume_create_manager' (e4c3513b-c428-467d-b521-52278d91c0b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:15:30.417135 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-19df1061-51f4-4a90-aa98-53d410c49c6e tempest-VolumesDeleteCascade-1306773130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cafd2a6-1796-4e79-a764-2bafbee5b021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:30.435393 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-19df1061-51f4-4a90-aa98-53d410c49c6e tempest-VolumesDeleteCascade-1306773130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cafd2a6-1796-4e79-a764-2bafbee5b021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1507312463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=374aa476-77b9-498a-b6e4-370b927631ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8cb50bdf4a84c5b86d53ceb0021a81d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:15:30Z,use_quota=True,user_id='3f124f0e42464680adc1e3bc4c4b12ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:30.442392 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-19df1061-51f4-4a90-aa98-53d410c49c6e tempest-VolumesDeleteCascade-1306773130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (713d934a-54d3-4483-8d58-16d69266e801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:30.448118 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-19df1061-51f4-4a90-aa98-53d410c49c6e tempest-VolumesDeleteCascade-1306773130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (713d934a-54d3-4483-8d58-16d69266e801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:30.454986 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-19df1061-51f4-4a90-aa98-53d410c49c6e tempest-VolumesDeleteCascade-1306773130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1330e545-3edf-4b8e-9175-654a73256608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:30.459727 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-19df1061-51f4-4a90-aa98-53d410c49c6e tempest-VolumesDeleteCascade-1306773130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1330e545-3edf-4b8e-9175-654a73256608) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '374aa476-77b9-498a-b6e4-370b927631ac', 'volume_name': 'volume-374aa476-77b9-498a-b6e4-370b927631ac', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:30.465702 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-19df1061-51f4-4a90-aa98-53d410c49c6e tempest-VolumesDeleteCascade-1306773130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e32da30b-7b1a-47a9-be92-311fb5d0476d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:30.471872 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-19df1061-51f4-4a90-aa98-53d410c49c6e tempest-VolumesDeleteCascade-1306773130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e32da30b-7b1a-47a9-be92-311fb5d0476d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:30.477256 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-19df1061-51f4-4a90-aa98-53d410c49c6e tempest-VolumesDeleteCascade-1306773130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44920c74-53e7-4e25-b6f9-a84002e2be99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:30.478598 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-19df1061-51f4-4a90-aa98-53d410c49c6e tempest-VolumesDeleteCascade-1306773130 None] Volume 374aa476-77b9-498a-b6e4-370b927631ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-374aa476-77b9-498a-b6e4-370b927631ac', 'volume_size': 1} May 07 22:15:30.479348 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-19df1061-51f4-4a90-aa98-53d410c49c6e tempest-VolumesDeleteCascade-1306773130 None] creating volume 'volume-374aa476-77b9-498a-b6e4-370b927631ac' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:15:30.480481 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-19df1061-51f4-4a90-aa98-53d410c49c6e tempest-VolumesDeleteCascade-1306773130 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:15:30.634857 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-19df1061-51f4-4a90-aa98-53d410c49c6e tempest-VolumesDeleteCascade-1306773130 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:15:30.635503 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-19df1061-51f4-4a90-aa98-53d410c49c6e tempest-VolumesDeleteCascade-1306773130 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:15:30.641982 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-19df1061-51f4-4a90-aa98-53d410c49c6e tempest-VolumesDeleteCascade-1306773130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44920c74-53e7-4e25-b6f9-a84002e2be99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-374aa476-77b9-498a-b6e4-370b927631ac', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:30.650344 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-19df1061-51f4-4a90-aa98-53d410c49c6e tempest-VolumesDeleteCascade-1306773130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (645b8793-a68e-48f7-95ed-9f5cad38ed1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:30.663865 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-19df1061-51f4-4a90-aa98-53d410c49c6e tempest-VolumesDeleteCascade-1306773130 None] Volume volume-374aa476-77b9-498a-b6e4-370b927631ac (374aa476-77b9-498a-b6e4-370b927631ac): created successfully May 07 22:15:30.672774 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-19df1061-51f4-4a90-aa98-53d410c49c6e tempest-VolumesDeleteCascade-1306773130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (645b8793-a68e-48f7-95ed-9f5cad38ed1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:30.679210 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-19df1061-51f4-4a90-aa98-53d410c49c6e tempest-VolumesDeleteCascade-1306773130 None] Flow 'volume_create_manager' (e4c3513b-c428-467d-b521-52278d91c0b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:15:30.690628 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-19df1061-51f4-4a90-aa98-53d410c49c6e tempest-VolumesDeleteCascade-1306773130 None] Created volume successfully. May 07 22:15:31.197199 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:15:31.198269 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:15:31.255649 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:15:31.288817 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:15:31.578604 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-cc82f9ca-4338-4c11-9b36-d338b7a89cb4 tempest-VolumesDeleteCascade-1306773130 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:15:32.464505 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-cc82f9ca-4338-4c11-9b36-d338b7a89cb4 tempest-VolumesDeleteCascade-1306773130 None] Create snapshot completed successfully May 07 22:15:32.902654 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0b146d7b-6680-4aff-b87e-70f94db23851 tempest-VolumesDeleteCascade-1306773130 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:15:33.545923 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-0b146d7b-6680-4aff-b87e-70f94db23851 tempest-VolumesDeleteCascade-1306773130 None] Create snapshot completed successfully May 07 22:15:33.559420 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-28cfe5e3-1d93-42e4-b438-999853e062ee tempest-BackendsCapabilitiesAdminTestsJSON-1149720297 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:b276a158-7afa-4eaf-b0c1-f56c55c080c6:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=129946) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4733}} May 07 22:15:33.606053 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-cb6e43f1-509f-4346-93f2-dd545e8d7f0a tempest-BackendsCapabilitiesAdminTestsJSON-1149720297 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:b276a158-7afa-4eaf-b0c1-f56c55c080c6:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=129946) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4733}} May 07 22:15:33.892612 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-bce7e56e-3ba3-4d2e-8345-0df8d7438f0f tempest-VolumesDeleteCascade-1306773130 None] Lock "b'cinder-374aa476-77b9-498a-b6e4-370b927631ac-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:15:33.925224 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-bce7e56e-3ba3-4d2e-8345-0df8d7438f0f tempest-VolumesDeleteCascade-1306773130 None] Performing cascade delete. {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/manager.py:964}} May 07 22:15:33.945281 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-bce7e56e-3ba3-4d2e-8345-0df8d7438f0f tempest-VolumesDeleteCascade-1306773130 None] Lock "b'cinder-b80e56e1-e21a-4bec-bfb2-9225b6cdd6a3-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.008s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:15:33.961633 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-bce7e56e-3ba3-4d2e-8345-0df8d7438f0f tempest-VolumesDeleteCascade-1306773130 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:15:34.593059 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-bce7e56e-3ba3-4d2e-8345-0df8d7438f0f tempest-VolumesDeleteCascade-1306773130 None] Created reservations ['b4edcaf2-c958-4ca3-8a90-4749a9e49a96', 'ba2aa81a-a509-4afd-982b-d496e540b469', 'aa004ad6-045c-47be-a0fd-6ffcba0220cb', '752ee076-dece-428f-b68b-dbdde15f8c76'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:15:34.675212 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-bce7e56e-3ba3-4d2e-8345-0df8d7438f0f tempest-VolumesDeleteCascade-1306773130 None] Delete snapshot completed successfully. May 07 22:15:34.681638 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-bce7e56e-3ba3-4d2e-8345-0df8d7438f0f tempest-VolumesDeleteCascade-1306773130 None] Lock "b'cinder-b80e56e1-e21a-4bec-bfb2-9225b6cdd6a3-delete_snapshot'" released by "delete_snapshot" :: held 0.736s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:15:34.700748 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-bce7e56e-3ba3-4d2e-8345-0df8d7438f0f tempest-VolumesDeleteCascade-1306773130 None] Lock "b'cinder-ffd50337-3786-4a2e-ba8d-0012d0495d60-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.018s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:15:34.722675 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-bce7e56e-3ba3-4d2e-8345-0df8d7438f0f tempest-VolumesDeleteCascade-1306773130 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:15:35.579244 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-bce7e56e-3ba3-4d2e-8345-0df8d7438f0f tempest-VolumesDeleteCascade-1306773130 None] Created reservations ['6e1937bf-4e71-44f1-8150-98b6abd72f7b', '8a2643c9-66e3-4eb9-893c-71482d3ddc6a', 'b88705a8-e34e-4512-a3c8-9d2f067edea9', '8f918bde-7950-4fc4-8478-e6669b99d01e'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:15:35.630370 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-bce7e56e-3ba3-4d2e-8345-0df8d7438f0f tempest-VolumesDeleteCascade-1306773130 None] Delete snapshot completed successfully. May 07 22:15:35.635963 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-bce7e56e-3ba3-4d2e-8345-0df8d7438f0f tempest-VolumesDeleteCascade-1306773130 None] Lock "b'cinder-ffd50337-3786-4a2e-ba8d-0012d0495d60-delete_snapshot'" released by "delete_snapshot" :: held 0.936s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:15:35.636887 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-bce7e56e-3ba3-4d2e-8345-0df8d7438f0f tempest-VolumesDeleteCascade-1306773130 None] Snapshots deleted, issuing volume delete {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/manager.py:979}} May 07 22:15:35.637876 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-bce7e56e-3ba3-4d2e-8345-0df8d7438f0f tempest-VolumesDeleteCascade-1306773130 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:15:35.721906 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-bce7e56e-3ba3-4d2e-8345-0df8d7438f0f tempest-VolumesDeleteCascade-1306773130 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:15:35.722439 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-bce7e56e-3ba3-4d2e-8345-0df8d7438f0f tempest-VolumesDeleteCascade-1306773130 None] Volume volume-374aa476-77b9-498a-b6e4-370b927631ac is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:15:35.733319 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-bce7e56e-3ba3-4d2e-8345-0df8d7438f0f tempest-VolumesDeleteCascade-1306773130 None] deleting rbd volume volume-374aa476-77b9-498a-b6e4-370b927631ac {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:15:36.111489 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-bce7e56e-3ba3-4d2e-8345-0df8d7438f0f tempest-VolumesDeleteCascade-1306773130 None] Created reservations ['8c6d735e-49d8-4dca-be9b-8d013aa6185f', '25503550-ff4c-4fe2-a260-a410cb85deef', '7b1ecfad-d609-44a7-a063-96a0df2e8ffa', '91caa759-13d4-4d19-b784-9075da10e563'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:15:36.215254 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-bce7e56e-3ba3-4d2e-8345-0df8d7438f0f tempest-VolumesDeleteCascade-1306773130 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:15:36.320478 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-bce7e56e-3ba3-4d2e-8345-0df8d7438f0f tempest-VolumesDeleteCascade-1306773130 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:15:36.371340 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-bce7e56e-3ba3-4d2e-8345-0df8d7438f0f tempest-VolumesDeleteCascade-1306773130 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:15:36.375880 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-bce7e56e-3ba3-4d2e-8345-0df8d7438f0f tempest-VolumesDeleteCascade-1306773130 None] Deleted volume successfully. May 07 22:15:36.391097 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-bce7e56e-3ba3-4d2e-8345-0df8d7438f0f tempest-VolumesDeleteCascade-1306773130 None] Lock "b'cinder-374aa476-77b9-498a-b6e4-370b927631ac-delete_volume'" released by "delete_volume" :: held 2.498s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:15:42.663143 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-61b672b8-1943-41df-a7ea-5090a3f951b1 tempest-VolumesTransfersTest-546580608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:15:42.694261 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-61b672b8-1943-41df-a7ea-5090a3f951b1 tempest-VolumesTransfersTest-546580608 None] Flow 'volume_create_manager' (b7c625af-62d6-4843-898b-f6a958395f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:15:42.709145 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-61b672b8-1943-41df-a7ea-5090a3f951b1 tempest-VolumesTransfersTest-546580608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aa191e5-cb95-46f9-8403-2011b0f1a78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:42.743853 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-61b672b8-1943-41df-a7ea-5090a3f951b1 tempest-VolumesTransfersTest-546580608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aa191e5-cb95-46f9-8403-2011b0f1a78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:15:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1536602079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=70d5a5f0-bf23-4ba5-b263-9f2caaae50fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ec5e7d0966f4df9bb2eee27fc19cc78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:15:43Z,use_quota=True,user_id='36e57e71413c40e482c1f8969817a528',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:42.756151 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-61b672b8-1943-41df-a7ea-5090a3f951b1 tempest-VolumesTransfersTest-546580608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a55bc9dc-35e7-4dda-a7db-a87d53623e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:42.768206 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-61b672b8-1943-41df-a7ea-5090a3f951b1 tempest-VolumesTransfersTest-546580608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a55bc9dc-35e7-4dda-a7db-a87d53623e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:42.787210 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-61b672b8-1943-41df-a7ea-5090a3f951b1 tempest-VolumesTransfersTest-546580608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b8c79cf-39f3-466c-86c9-332550c1434d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:42.799178 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-61b672b8-1943-41df-a7ea-5090a3f951b1 tempest-VolumesTransfersTest-546580608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b8c79cf-39f3-466c-86c9-332550c1434d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70d5a5f0-bf23-4ba5-b263-9f2caaae50fd', 'volume_name': 'volume-70d5a5f0-bf23-4ba5-b263-9f2caaae50fd', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:42.807887 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-61b672b8-1943-41df-a7ea-5090a3f951b1 tempest-VolumesTransfersTest-546580608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53b9f24d-41e3-462b-9839-ac4dbcf3d4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:42.823372 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-61b672b8-1943-41df-a7ea-5090a3f951b1 tempest-VolumesTransfersTest-546580608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53b9f24d-41e3-462b-9839-ac4dbcf3d4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:42.840013 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-61b672b8-1943-41df-a7ea-5090a3f951b1 tempest-VolumesTransfersTest-546580608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ada20687-2f93-4a54-a278-55ab885fd5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:42.845477 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-61b672b8-1943-41df-a7ea-5090a3f951b1 tempest-VolumesTransfersTest-546580608 None] Volume 70d5a5f0-bf23-4ba5-b263-9f2caaae50fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70d5a5f0-bf23-4ba5-b263-9f2caaae50fd', 'volume_size': 1} May 07 22:15:42.845887 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-61b672b8-1943-41df-a7ea-5090a3f951b1 tempest-VolumesTransfersTest-546580608 None] creating volume 'volume-70d5a5f0-bf23-4ba5-b263-9f2caaae50fd' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:15:42.846750 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-61b672b8-1943-41df-a7ea-5090a3f951b1 tempest-VolumesTransfersTest-546580608 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:15:43.066147 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-61b672b8-1943-41df-a7ea-5090a3f951b1 tempest-VolumesTransfersTest-546580608 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:15:43.066542 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-61b672b8-1943-41df-a7ea-5090a3f951b1 tempest-VolumesTransfersTest-546580608 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:15:43.074266 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-61b672b8-1943-41df-a7ea-5090a3f951b1 tempest-VolumesTransfersTest-546580608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ada20687-2f93-4a54-a278-55ab885fd5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70d5a5f0-bf23-4ba5-b263-9f2caaae50fd', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:43.100297 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-61b672b8-1943-41df-a7ea-5090a3f951b1 tempest-VolumesTransfersTest-546580608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94ccbcef-0471-4370-bcdf-7cede016bacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:43.127156 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-61b672b8-1943-41df-a7ea-5090a3f951b1 tempest-VolumesTransfersTest-546580608 None] Volume volume-70d5a5f0-bf23-4ba5-b263-9f2caaae50fd (70d5a5f0-bf23-4ba5-b263-9f2caaae50fd): created successfully May 07 22:15:43.135340 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-61b672b8-1943-41df-a7ea-5090a3f951b1 tempest-VolumesTransfersTest-546580608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94ccbcef-0471-4370-bcdf-7cede016bacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:43.148634 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-61b672b8-1943-41df-a7ea-5090a3f951b1 tempest-VolumesTransfersTest-546580608 None] Flow 'volume_create_manager' (b7c625af-62d6-4843-898b-f6a958395f2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:15:43.162216 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-61b672b8-1943-41df-a7ea-5090a3f951b1 tempest-VolumesTransfersTest-546580608 None] Created volume successfully. May 07 22:15:44.478835 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-890dccec-2f32-452e-b3ad-9d506576968b tempest-VolumesTransfersTest-29935732 None] Transfer volume completed successfully. May 07 22:15:44.860574 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-93d401ae-7569-4735-8bb2-4a99cd798436 tempest-VolumeTypesAccessTest-1734594944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:15:44.917182 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-93d401ae-7569-4735-8bb2-4a99cd798436 tempest-VolumeTypesAccessTest-1734594944 None] Flow 'volume_create_manager' (3a32842a-4135-4641-ac56-dda6826ff53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:15:44.929035 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-93d401ae-7569-4735-8bb2-4a99cd798436 tempest-VolumeTypesAccessTest-1734594944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65f40bc7-2a16-4828-bf7f-b149abd95e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:44.951345 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-93d401ae-7569-4735-8bb2-4a99cd798436 tempest-VolumeTypesAccessTest-1734594944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65f40bc7-2a16-4828-bf7f-b149abd95e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1179223947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ae586aed-e942-485a-8e86-d7572ededce7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965e6b62b0234b898946b3219a6974bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:15:45Z,use_quota=True,user_id='bddf8ca0755040dbbd106f85311c21c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0492646e-370d-4e6a-8e6a-c9caa0d9eee0),volume_type_id=0492646e-370d-4e6a-8e6a-c9caa0d9eee0)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:44.957341 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-93d401ae-7569-4735-8bb2-4a99cd798436 tempest-VolumeTypesAccessTest-1734594944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fce3903-4256-4774-bc0c-1911b831d0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:44.964298 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-93d401ae-7569-4735-8bb2-4a99cd798436 tempest-VolumeTypesAccessTest-1734594944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fce3903-4256-4774-bc0c-1911b831d0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:44.972743 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-93d401ae-7569-4735-8bb2-4a99cd798436 tempest-VolumeTypesAccessTest-1734594944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e514f93-5928-4407-8dd5-471013fb0dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:44.978858 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-93d401ae-7569-4735-8bb2-4a99cd798436 tempest-VolumeTypesAccessTest-1734594944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e514f93-5928-4407-8dd5-471013fb0dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae586aed-e942-485a-8e86-d7572ededce7', 'volume_name': 'volume-ae586aed-e942-485a-8e86-d7572ededce7', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:44.986408 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-93d401ae-7569-4735-8bb2-4a99cd798436 tempest-VolumeTypesAccessTest-1734594944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c692997-60c4-46fd-8ad3-7468c6222985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:44.992068 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-93d401ae-7569-4735-8bb2-4a99cd798436 tempest-VolumeTypesAccessTest-1734594944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c692997-60c4-46fd-8ad3-7468c6222985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:44.998488 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-93d401ae-7569-4735-8bb2-4a99cd798436 tempest-VolumeTypesAccessTest-1734594944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd7099af-3bd1-48f3-8e6e-b47f1556fa44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:45.000128 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-93d401ae-7569-4735-8bb2-4a99cd798436 tempest-VolumeTypesAccessTest-1734594944 None] Volume ae586aed-e942-485a-8e86-d7572ededce7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae586aed-e942-485a-8e86-d7572ededce7', 'volume_size': 1} May 07 22:15:45.000926 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-93d401ae-7569-4735-8bb2-4a99cd798436 tempest-VolumeTypesAccessTest-1734594944 None] creating volume 'volume-ae586aed-e942-485a-8e86-d7572ededce7' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:15:45.001784 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-93d401ae-7569-4735-8bb2-4a99cd798436 tempest-VolumeTypesAccessTest-1734594944 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:15:45.112754 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-643a551b-1675-4162-b581-bf9f94486d87 tempest-VolumesTransfersTest-829288924 None] Lock "b'cinder-70d5a5f0-bf23-4ba5-b263-9f2caaae50fd-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:15:45.133617 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-93d401ae-7569-4735-8bb2-4a99cd798436 tempest-VolumeTypesAccessTest-1734594944 None] extra_specs: {} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:15:45.134099 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-93d401ae-7569-4735-8bb2-4a99cd798436 tempest-VolumeTypesAccessTest-1734594944 None] extra_specs: {} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:15:45.141642 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-93d401ae-7569-4735-8bb2-4a99cd798436 tempest-VolumeTypesAccessTest-1734594944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd7099af-3bd1-48f3-8e6e-b47f1556fa44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae586aed-e942-485a-8e86-d7572ededce7', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:45.146712 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-93d401ae-7569-4735-8bb2-4a99cd798436 tempest-VolumeTypesAccessTest-1734594944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85d9b96c-62ec-453c-be2d-2b7c51306bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:45.165033 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-643a551b-1675-4162-b581-bf9f94486d87 tempest-VolumesTransfersTest-829288924 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:15:45.238447 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-643a551b-1675-4162-b581-bf9f94486d87 tempest-VolumesTransfersTest-829288924 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:15:45.239068 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-643a551b-1675-4162-b581-bf9f94486d87 tempest-VolumesTransfersTest-829288924 None] Volume volume-70d5a5f0-bf23-4ba5-b263-9f2caaae50fd is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:15:45.253382 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-643a551b-1675-4162-b581-bf9f94486d87 tempest-VolumesTransfersTest-829288924 None] deleting rbd volume volume-70d5a5f0-bf23-4ba5-b263-9f2caaae50fd {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:15:45.255910 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-93d401ae-7569-4735-8bb2-4a99cd798436 tempest-VolumeTypesAccessTest-1734594944 None] Volume volume-ae586aed-e942-485a-8e86-d7572ededce7 (ae586aed-e942-485a-8e86-d7572ededce7): created successfully May 07 22:15:45.260249 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-93d401ae-7569-4735-8bb2-4a99cd798436 tempest-VolumeTypesAccessTest-1734594944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85d9b96c-62ec-453c-be2d-2b7c51306bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:45.267368 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-93d401ae-7569-4735-8bb2-4a99cd798436 tempest-VolumeTypesAccessTest-1734594944 None] Flow 'volume_create_manager' (3a32842a-4135-4641-ac56-dda6826ff53e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:15:45.278439 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-93d401ae-7569-4735-8bb2-4a99cd798436 tempest-VolumeTypesAccessTest-1734594944 None] Created volume successfully. May 07 22:15:45.672974 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-643a551b-1675-4162-b581-bf9f94486d87 tempest-VolumesTransfersTest-829288924 None] Created reservations ['40597ddd-a5cb-498b-bd45-4ff9fb80527f', '0b2a0646-f5ef-4b35-a2f2-f5a6ae7f4719', 'efc41c1c-3837-48ad-9958-edb9e3c48fa0', '979682c8-7c8a-491d-aa70-f97e41b2feb0'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:15:45.730946 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-643a551b-1675-4162-b581-bf9f94486d87 tempest-VolumesTransfersTest-829288924 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:15:45.777862 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-643a551b-1675-4162-b581-bf9f94486d87 tempest-VolumesTransfersTest-829288924 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:15:45.830534 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-643a551b-1675-4162-b581-bf9f94486d87 tempest-VolumesTransfersTest-829288924 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:15:45.838201 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-643a551b-1675-4162-b581-bf9f94486d87 tempest-VolumesTransfersTest-829288924 None] Deleted volume successfully. May 07 22:15:45.860814 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-643a551b-1675-4162-b581-bf9f94486d87 tempest-VolumesTransfersTest-829288924 None] Lock "b'cinder-70d5a5f0-bf23-4ba5-b263-9f2caaae50fd-delete_volume'" released by "delete_volume" :: held 0.748s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:15:46.293428 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-b9c276d7-7fe6-432c-bf61-a855f0dcc5b1 tempest-VolumeTypesAccessTest-1734594944 None] Lock "b'cinder-ae586aed-e942-485a-8e86-d7572ededce7-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:15:46.364137 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b9c276d7-7fe6-432c-bf61-a855f0dcc5b1 tempest-VolumeTypesAccessTest-1734594944 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:15:46.467572 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b9c276d7-7fe6-432c-bf61-a855f0dcc5b1 tempest-VolumeTypesAccessTest-1734594944 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:15:46.468118 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b9c276d7-7fe6-432c-bf61-a855f0dcc5b1 tempest-VolumeTypesAccessTest-1734594944 None] Volume volume-ae586aed-e942-485a-8e86-d7572ededce7 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:15:46.498113 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b9c276d7-7fe6-432c-bf61-a855f0dcc5b1 tempest-VolumeTypesAccessTest-1734594944 None] deleting rbd volume volume-ae586aed-e942-485a-8e86-d7572ededce7 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:15:46.753678 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2cb486a-ceb9-4e45-b419-1333ded7d6ed tempest-VolumesTransfersTest-546580608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:15:46.775715 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f2cb486a-ceb9-4e45-b419-1333ded7d6ed tempest-VolumesTransfersTest-546580608 None] Flow 'volume_create_manager' (c3d54349-1e27-435e-8ea9-5f52f21a1b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:15:46.784385 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f2cb486a-ceb9-4e45-b419-1333ded7d6ed tempest-VolumesTransfersTest-546580608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a93422e8-5cea-45b7-9505-b78e272f0778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:46.817890 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f2cb486a-ceb9-4e45-b419-1333ded7d6ed tempest-VolumesTransfersTest-546580608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a93422e8-5cea-45b7-9505-b78e272f0778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-399221931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4f36d2c3-11cc-4fda-80c1-f16c97cfe8d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ec5e7d0966f4df9bb2eee27fc19cc78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:15:47Z,use_quota=True,user_id='36e57e71413c40e482c1f8969817a528',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:46.823450 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f2cb486a-ceb9-4e45-b419-1333ded7d6ed tempest-VolumesTransfersTest-546580608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff26c393-9d39-4a6a-89cd-00f012ac126b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:46.830526 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f2cb486a-ceb9-4e45-b419-1333ded7d6ed tempest-VolumesTransfersTest-546580608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff26c393-9d39-4a6a-89cd-00f012ac126b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:46.836488 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f2cb486a-ceb9-4e45-b419-1333ded7d6ed tempest-VolumesTransfersTest-546580608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cde35068-d154-413c-ac9d-deb0bbfdc203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:46.851933 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f2cb486a-ceb9-4e45-b419-1333ded7d6ed tempest-VolumesTransfersTest-546580608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cde35068-d154-413c-ac9d-deb0bbfdc203) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f36d2c3-11cc-4fda-80c1-f16c97cfe8d3', 'volume_name': 'volume-4f36d2c3-11cc-4fda-80c1-f16c97cfe8d3', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:46.857977 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f2cb486a-ceb9-4e45-b419-1333ded7d6ed tempest-VolumesTransfersTest-546580608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acd3edd9-4e32-4827-9d90-f7eead1a1e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:46.882459 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f2cb486a-ceb9-4e45-b419-1333ded7d6ed tempest-VolumesTransfersTest-546580608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acd3edd9-4e32-4827-9d90-f7eead1a1e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:46.888564 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f2cb486a-ceb9-4e45-b419-1333ded7d6ed tempest-VolumesTransfersTest-546580608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8496208d-a1c5-4404-8ba5-6df88101f10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:46.891172 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-f2cb486a-ceb9-4e45-b419-1333ded7d6ed tempest-VolumesTransfersTest-546580608 None] Volume 4f36d2c3-11cc-4fda-80c1-f16c97cfe8d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f36d2c3-11cc-4fda-80c1-f16c97cfe8d3', 'volume_size': 1} May 07 22:15:46.891172 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-f2cb486a-ceb9-4e45-b419-1333ded7d6ed tempest-VolumesTransfersTest-546580608 None] creating volume 'volume-4f36d2c3-11cc-4fda-80c1-f16c97cfe8d3' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:15:46.891172 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-f2cb486a-ceb9-4e45-b419-1333ded7d6ed tempest-VolumesTransfersTest-546580608 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:15:46.955572 ncdv-master-1 cinder-volume[129946]: WARNING cinder.quota [None req-b9c276d7-7fe6-432c-bf61-a855f0dcc5b1 tempest-VolumeTypesAccessTest-1734594944 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-769946516 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-769946516, it is now deprecated. Please use the default quota class for default quota. May 07 22:15:46.956343 ncdv-master-1 cinder-volume[129946]: WARNING cinder.quota [None req-b9c276d7-7fe6-432c-bf61-a855f0dcc5b1 tempest-VolumeTypesAccessTest-1734594944 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-769946516 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-769946516, it is now deprecated. Please use the default quota class for default quota. May 07 22:15:46.976117 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-f2cb486a-ceb9-4e45-b419-1333ded7d6ed tempest-VolumesTransfersTest-546580608 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:15:46.976719 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-f2cb486a-ceb9-4e45-b419-1333ded7d6ed tempest-VolumesTransfersTest-546580608 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:15:46.981884 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f2cb486a-ceb9-4e45-b419-1333ded7d6ed tempest-VolumesTransfersTest-546580608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8496208d-a1c5-4404-8ba5-6df88101f10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f36d2c3-11cc-4fda-80c1-f16c97cfe8d3', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:46.987447 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f2cb486a-ceb9-4e45-b419-1333ded7d6ed tempest-VolumesTransfersTest-546580608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef13c5bb-a08b-4aaf-920d-247abc2b1409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:46.995716 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-b9c276d7-7fe6-432c-bf61-a855f0dcc5b1 tempest-VolumeTypesAccessTest-1734594944 None] Created reservations ['95b98b4e-39a9-4345-9775-065ab4bc45c3', 'bac85006-09c2-42b6-8fc5-dc4ac582a2c8', '5b0fef2a-3b4a-4c3b-868f-83ef9bb8d43a', '882baa0a-d494-4424-bdad-9cecca4c5e8b'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:15:47.005671 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-f2cb486a-ceb9-4e45-b419-1333ded7d6ed tempest-VolumesTransfersTest-546580608 None] Volume volume-4f36d2c3-11cc-4fda-80c1-f16c97cfe8d3 (4f36d2c3-11cc-4fda-80c1-f16c97cfe8d3): created successfully May 07 22:15:47.010294 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f2cb486a-ceb9-4e45-b419-1333ded7d6ed tempest-VolumesTransfersTest-546580608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef13c5bb-a08b-4aaf-920d-247abc2b1409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:47.017077 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f2cb486a-ceb9-4e45-b419-1333ded7d6ed tempest-VolumesTransfersTest-546580608 None] Flow 'volume_create_manager' (c3d54349-1e27-435e-8ea9-5f52f21a1b6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:15:47.044193 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-f2cb486a-ceb9-4e45-b419-1333ded7d6ed tempest-VolumesTransfersTest-546580608 None] Created volume successfully. May 07 22:15:47.081149 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b9c276d7-7fe6-432c-bf61-a855f0dcc5b1 tempest-VolumeTypesAccessTest-1734594944 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:15:47.134171 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b9c276d7-7fe6-432c-bf61-a855f0dcc5b1 tempest-VolumeTypesAccessTest-1734594944 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:15:47.168499 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-b9c276d7-7fe6-432c-bf61-a855f0dcc5b1 tempest-VolumeTypesAccessTest-1734594944 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:15:47.180826 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-b9c276d7-7fe6-432c-bf61-a855f0dcc5b1 tempest-VolumeTypesAccessTest-1734594944 None] Deleted volume successfully. May 07 22:15:47.202870 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-b9c276d7-7fe6-432c-bf61-a855f0dcc5b1 tempest-VolumeTypesAccessTest-1734594944 None] Lock "b'cinder-ae586aed-e942-485a-8e86-d7572ededce7-delete_volume'" released by "delete_volume" :: held 0.912s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:15:48.261360 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-e41b9ccf-2d12-489b-8f30-4bbcba7502a4 tempest-VolumesTransfersTest-829288924 None] Lock "b'cinder-4f36d2c3-11cc-4fda-80c1-f16c97cfe8d3-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:15:48.329153 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-e41b9ccf-2d12-489b-8f30-4bbcba7502a4 tempest-VolumesTransfersTest-829288924 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:15:48.403443 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-e41b9ccf-2d12-489b-8f30-4bbcba7502a4 tempest-VolumesTransfersTest-829288924 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:15:48.404623 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-e41b9ccf-2d12-489b-8f30-4bbcba7502a4 tempest-VolumesTransfersTest-829288924 None] Volume volume-4f36d2c3-11cc-4fda-80c1-f16c97cfe8d3 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:15:48.419136 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-e41b9ccf-2d12-489b-8f30-4bbcba7502a4 tempest-VolumesTransfersTest-829288924 None] deleting rbd volume volume-4f36d2c3-11cc-4fda-80c1-f16c97cfe8d3 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:15:48.766576 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-e41b9ccf-2d12-489b-8f30-4bbcba7502a4 tempest-VolumesTransfersTest-829288924 None] Created reservations ['0432fdb7-4a96-4bd5-906d-9c9e48ffbc82', '06682907-15ba-4bbe-ad5d-de5c86041108', 'a30cc689-b6bc-44a7-afe9-c836f0d8cc3d', '8095d5f9-1130-4e3d-8b6a-7df8e245ae36'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:15:48.824870 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-e41b9ccf-2d12-489b-8f30-4bbcba7502a4 tempest-VolumesTransfersTest-829288924 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:15:48.894323 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-e41b9ccf-2d12-489b-8f30-4bbcba7502a4 tempest-VolumesTransfersTest-829288924 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:15:48.942646 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-e41b9ccf-2d12-489b-8f30-4bbcba7502a4 tempest-VolumesTransfersTest-829288924 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:15:48.948647 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-e41b9ccf-2d12-489b-8f30-4bbcba7502a4 tempest-VolumesTransfersTest-829288924 None] Deleted volume successfully. May 07 22:15:48.966064 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-e41b9ccf-2d12-489b-8f30-4bbcba7502a4 tempest-VolumesTransfersTest-829288924 None] Lock "b'cinder-4f36d2c3-11cc-4fda-80c1-f16c97cfe8d3-delete_volume'" released by "delete_volume" :: held 0.704s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:15:54.502564 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-229718ae-f2ad-4b56-aa29-9d6c1a0e0f46 tempest-VolumesActionsTest-497963316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:15:54.541373 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-229718ae-f2ad-4b56-aa29-9d6c1a0e0f46 tempest-VolumesActionsTest-497963316 None] Flow 'volume_create_manager' (60b21c2b-18e0-4815-b3f8-532d8569869e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:15:54.550013 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-229718ae-f2ad-4b56-aa29-9d6c1a0e0f46 tempest-VolumesActionsTest-497963316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1144042-da6e-4ff0-ae86-59632698a36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:54.584008 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-229718ae-f2ad-4b56-aa29-9d6c1a0e0f46 tempest-VolumesActionsTest-497963316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1144042-da6e-4ff0-ae86-59632698a36f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:15:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-186315785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d52eb92e-dfc0-4ab4-8639-1d9fc281fd13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c82534ba00c049e6bfa7421398228fff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:15:54Z,use_quota=True,user_id='af105dbc34cb4e4191e14314d88df4c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:54.591107 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-229718ae-f2ad-4b56-aa29-9d6c1a0e0f46 tempest-VolumesActionsTest-497963316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60d16d42-c550-4013-9e18-0b4d315bd78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:54.595680 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-229718ae-f2ad-4b56-aa29-9d6c1a0e0f46 tempest-VolumesActionsTest-497963316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60d16d42-c550-4013-9e18-0b4d315bd78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:54.601158 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-229718ae-f2ad-4b56-aa29-9d6c1a0e0f46 tempest-VolumesActionsTest-497963316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3483974-c1b8-443a-8a49-1cd839734de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:54.606674 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-229718ae-f2ad-4b56-aa29-9d6c1a0e0f46 tempest-VolumesActionsTest-497963316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3483974-c1b8-443a-8a49-1cd839734de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd52eb92e-dfc0-4ab4-8639-1d9fc281fd13', 'volume_name': 'volume-d52eb92e-dfc0-4ab4-8639-1d9fc281fd13', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:54.613273 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-229718ae-f2ad-4b56-aa29-9d6c1a0e0f46 tempest-VolumesActionsTest-497963316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42e3d3ab-b41d-4190-a9c3-fa7d66b0bc8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:54.617619 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-229718ae-f2ad-4b56-aa29-9d6c1a0e0f46 tempest-VolumesActionsTest-497963316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42e3d3ab-b41d-4190-a9c3-fa7d66b0bc8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:54.623354 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-229718ae-f2ad-4b56-aa29-9d6c1a0e0f46 tempest-VolumesActionsTest-497963316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83417a12-2224-489f-a914-4cb7bd5d1a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:54.624470 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-229718ae-f2ad-4b56-aa29-9d6c1a0e0f46 tempest-VolumesActionsTest-497963316 None] Volume d52eb92e-dfc0-4ab4-8639-1d9fc281fd13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d52eb92e-dfc0-4ab4-8639-1d9fc281fd13', 'volume_size': 1} May 07 22:15:54.624859 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-229718ae-f2ad-4b56-aa29-9d6c1a0e0f46 tempest-VolumesActionsTest-497963316 None] creating volume 'volume-d52eb92e-dfc0-4ab4-8639-1d9fc281fd13' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:15:54.625655 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-229718ae-f2ad-4b56-aa29-9d6c1a0e0f46 tempest-VolumesActionsTest-497963316 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:15:54.662911 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3bd795d-bb48-48d0-8f44-4926dc1f1d64 tempest-VolumesCloneTest-1619515879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:15:54.684794 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-e3bd795d-bb48-48d0-8f44-4926dc1f1d64 tempest-VolumesCloneTest-1619515879 None] Flow 'volume_create_manager' (01a7ed7a-65a2-4363-8180-5807cde633f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:15:54.692003 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-e3bd795d-bb48-48d0-8f44-4926dc1f1d64 tempest-VolumesCloneTest-1619515879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e18a46c-fd7d-4ac7-a6cd-b92faba1bce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:54.701764 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-229718ae-f2ad-4b56-aa29-9d6c1a0e0f46 tempest-VolumesActionsTest-497963316 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:15:54.701764 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-229718ae-f2ad-4b56-aa29-9d6c1a0e0f46 tempest-VolumesActionsTest-497963316 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:15:54.704792 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-229718ae-f2ad-4b56-aa29-9d6c1a0e0f46 tempest-VolumesActionsTest-497963316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83417a12-2224-489f-a914-4cb7bd5d1a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d52eb92e-dfc0-4ab4-8639-1d9fc281fd13', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:54.709758 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-229718ae-f2ad-4b56-aa29-9d6c1a0e0f46 tempest-VolumesActionsTest-497963316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8af2c6f0-89ec-4f74-8be7-142438db9687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:54.728507 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-e3bd795d-bb48-48d0-8f44-4926dc1f1d64 tempest-VolumesCloneTest-1619515879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e18a46c-fd7d-4ac7-a6cd-b92faba1bce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:15:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1319972342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0c57ce0f-5ce7-4331-87f3-52763f4f5201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='646717cca3f1470693a47f4d8d56dd1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:15:55Z,use_quota=True,user_id='3743c0c0605b45d0bc8946a5f6f5d2b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:54.734442 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-e3bd795d-bb48-48d0-8f44-4926dc1f1d64 tempest-VolumesCloneTest-1619515879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9a984e2-bb49-4d69-bbda-6e493cf3a9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:54.739049 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-e3bd795d-bb48-48d0-8f44-4926dc1f1d64 tempest-VolumesCloneTest-1619515879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9a984e2-bb49-4d69-bbda-6e493cf3a9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:54.744437 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-e3bd795d-bb48-48d0-8f44-4926dc1f1d64 tempest-VolumesCloneTest-1619515879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed902657-66a6-4216-85cb-0ec65172517e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:54.750950 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-229718ae-f2ad-4b56-aa29-9d6c1a0e0f46 tempest-VolumesActionsTest-497963316 None] Volume volume-d52eb92e-dfc0-4ab4-8639-1d9fc281fd13 (d52eb92e-dfc0-4ab4-8639-1d9fc281fd13): created successfully May 07 22:15:54.753973 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-229718ae-f2ad-4b56-aa29-9d6c1a0e0f46 tempest-VolumesActionsTest-497963316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8af2c6f0-89ec-4f74-8be7-142438db9687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:54.759740 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-229718ae-f2ad-4b56-aa29-9d6c1a0e0f46 tempest-VolumesActionsTest-497963316 None] Flow 'volume_create_manager' (60b21c2b-18e0-4815-b3f8-532d8569869e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:15:54.769026 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-229718ae-f2ad-4b56-aa29-9d6c1a0e0f46 tempest-VolumesActionsTest-497963316 None] Created volume successfully. May 07 22:15:54.850572 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-e3bd795d-bb48-48d0-8f44-4926dc1f1d64 tempest-VolumesCloneTest-1619515879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed902657-66a6-4216-85cb-0ec65172517e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0c57ce0f-5ce7-4331-87f3-52763f4f5201', 'volume_name': 'volume-0c57ce0f-5ce7-4331-87f3-52763f4f5201', 'volume_size': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e2f828af0706465883131e16cb564d05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'created_at': datetime.datetime(2022, 5, 7, 21, 36, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:54.857422 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-e3bd795d-bb48-48d0-8f44-4926dc1f1d64 tempest-VolumesCloneTest-1619515879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (262ef3a7-2b5c-475f-9670-8885cdcb8a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:54.861691 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-e3bd795d-bb48-48d0-8f44-4926dc1f1d64 tempest-VolumesCloneTest-1619515879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (262ef3a7-2b5c-475f-9670-8885cdcb8a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:54.868860 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-e3bd795d-bb48-48d0-8f44-4926dc1f1d64 tempest-VolumesCloneTest-1619515879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40898827-4b15-4283-8117-0dbc35afcd0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:54.874146 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-e3bd795d-bb48-48d0-8f44-4926dc1f1d64 tempest-VolumesCloneTest-1619515879 None] Volume 0c57ce0f-5ce7-4331-87f3-52763f4f5201: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0c57ce0f-5ce7-4331-87f3-52763f4f5201', 'volume_size': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e2f828af0706465883131e16cb564d05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'created_at': datetime.datetime(2022, 5, 7, 21, 36, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } May 07 22:15:54.875070 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3bd795d-bb48-48d0-8f44-4926dc1f1d64 tempest-VolumesCloneTest-1619515879 None] Cloning 0c57ce0f-5ce7-4331-87f3-52763f4f5201 from image 3756ae98-5c12-48e7-920e-ef5d1dd5543c at location (None, None). {{(pid=129946) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} May 07 22:15:54.885684 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-e3bd795d-bb48-48d0-8f44-4926dc1f1d64 tempest-VolumesCloneTest-1619515879 None] Lock "b'cinder-3756ae98-5c12-48e7-920e-ef5d1dd5543c'" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:15:54.894497 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-e3bd795d-bb48-48d0-8f44-4926dc1f1d64 tempest-VolumesCloneTest-1619515879 None] Found image-volume cache entry: {'id': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'volume_id': '82279f40-9683-441f-a541-0db8b9177f48', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9), 'last_used': datetime.datetime(2022, 5, 7, 22, 15, 54, 889643)}. {{(pid=129946) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 07 22:15:54.894985 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-e3bd795d-bb48-48d0-8f44-4926dc1f1d64 tempest-VolumesCloneTest-1619515879 None] Image-volume cache entry image_update_at = 2022-05-07 21:37:09+00:00, requested image updated_at = 2022-05-07 21:37:09+00:00. {{(pid=129946) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 07 22:15:54.895364 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3bd795d-bb48-48d0-8f44-4926dc1f1d64 tempest-VolumesCloneTest-1619515879 None] Found cache entry for image = 3756ae98-5c12-48e7-920e-ef5d1dd5543c on host ncdv-master-1@ceph#ceph. {{(pid=129946) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} May 07 22:15:54.903392 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-e3bd795d-bb48-48d0-8f44-4926dc1f1d64 tempest-VolumesCloneTest-1619515879 None] Lock "b'cinder-3756ae98-5c12-48e7-920e-ef5d1dd5543c'" released by "_prepare_image_cache_entry" :: held 0.017s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:15:54.904228 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3bd795d-bb48-48d0-8f44-4926dc1f1d64 tempest-VolumesCloneTest-1619515879 None] Attempting to retrieve cache entry for image = 3756ae98-5c12-48e7-920e-ef5d1dd5543c on host ncdv-master-1@ceph#ceph. {{(pid=129946) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} May 07 22:15:54.910183 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-e3bd795d-bb48-48d0-8f44-4926dc1f1d64 tempest-VolumesCloneTest-1619515879 None] Found image-volume cache entry: {'id': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'volume_id': '82279f40-9683-441f-a541-0db8b9177f48', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9), 'last_used': datetime.datetime(2022, 5, 7, 22, 15, 54, 907809)}. {{(pid=129946) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 07 22:15:54.910679 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-e3bd795d-bb48-48d0-8f44-4926dc1f1d64 tempest-VolumesCloneTest-1619515879 None] Image-volume cache entry image_update_at = 2022-05-07 21:37:09+00:00, requested image updated_at = 2022-05-07 21:37:09+00:00. {{(pid=129946) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 07 22:15:54.911542 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3bd795d-bb48-48d0-8f44-4926dc1f1d64 tempest-VolumesCloneTest-1619515879 None] Creating from source image-volume 82279f40-9683-441f-a541-0db8b9177f48 {{(pid=129946) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} May 07 22:15:54.926488 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-e3bd795d-bb48-48d0-8f44-4926dc1f1d64 tempest-VolumesCloneTest-1619515879 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:15:54.985226 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-e3bd795d-bb48-48d0-8f44-4926dc1f1d64 tempest-VolumesCloneTest-1619515879 None] creating snapshot='volume-0c57ce0f-5ce7-4331-87f3-52763f4f5201.clone_snap' {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} May 07 22:15:55.864353 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-e3bd795d-bb48-48d0-8f44-4926dc1f1d64 tempest-VolumesCloneTest-1619515879 None] cloning 'volume-82279f40-9683-441f-a541-0db8b9177f48@volume-0c57ce0f-5ce7-4331-87f3-52763f4f5201.clone_snap' to 'volume-0c57ce0f-5ce7-4331-87f3-52763f4f5201' {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 07 22:15:56.114296 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-e3bd795d-bb48-48d0-8f44-4926dc1f1d64 tempest-VolumesCloneTest-1619515879 None] Volume volume-3864f924-91b4-4015-ab37-8bdbf8ad652d.deleted is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:15:56.115893 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-e3bd795d-bb48-48d0-8f44-4926dc1f1d64 tempest-VolumesCloneTest-1619515879 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:15:56.116243 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-e3bd795d-bb48-48d0-8f44-4926dc1f1d64 tempest-VolumesCloneTest-1619515879 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:15:56.164907 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-e3bd795d-bb48-48d0-8f44-4926dc1f1d64 tempest-VolumesCloneTest-1619515879 None] clone created successfully {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} May 07 22:15:56.166652 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.volume_utils [None req-e3bd795d-bb48-48d0-8f44-4926dc1f1d64 tempest-VolumesCloneTest-1619515879 None] Marking volume 0c57ce0f-5ce7-4331-87f3-52763f4f5201 as bootable. {{(pid=129946) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} May 07 22:15:56.181160 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3bd795d-bb48-48d0-8f44-4926dc1f1d64 tempest-VolumesCloneTest-1619515879 None] Copying metadata from image 3756ae98-5c12-48e7-920e-ef5d1dd5543c to 0c57ce0f-5ce7-4331-87f3-52763f4f5201. {{(pid=129946) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} May 07 22:15:56.181782 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3bd795d-bb48-48d0-8f44-4926dc1f1d64 tempest-VolumesCloneTest-1619515879 None] Creating volume glance metadata for volume 0c57ce0f-5ce7-4331-87f3-52763f4f5201 backed by image 3756ae98-5c12-48e7-920e-ef5d1dd5543c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129946) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} May 07 22:15:56.252373 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-e3bd795d-bb48-48d0-8f44-4926dc1f1d64 tempest-VolumesCloneTest-1619515879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40898827-4b15-4283-8117-0dbc35afcd0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c57ce0f-5ce7-4331-87f3-52763f4f5201', 'volume_size': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e2f828af0706465883131e16cb564d05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'created_at': datetime.datetime(2022, 5, 7, 21, 36, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:56.259361 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-e3bd795d-bb48-48d0-8f44-4926dc1f1d64 tempest-VolumesCloneTest-1619515879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6a06596-afa9-47e1-a453-a17cd8c66a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:56.271669 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-e3bd795d-bb48-48d0-8f44-4926dc1f1d64 tempest-VolumesCloneTest-1619515879 None] Volume volume-0c57ce0f-5ce7-4331-87f3-52763f4f5201 (0c57ce0f-5ce7-4331-87f3-52763f4f5201): created successfully May 07 22:15:56.276283 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-e3bd795d-bb48-48d0-8f44-4926dc1f1d64 tempest-VolumesCloneTest-1619515879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6a06596-afa9-47e1-a453-a17cd8c66a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:56.283356 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-e3bd795d-bb48-48d0-8f44-4926dc1f1d64 tempest-VolumesCloneTest-1619515879 None] Flow 'volume_create_manager' (01a7ed7a-65a2-4363-8180-5807cde633f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:15:56.295731 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-e3bd795d-bb48-48d0-8f44-4926dc1f1d64 tempest-VolumesCloneTest-1619515879 None] Created volume successfully. May 07 22:15:57.231341 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d17409d-0ea5-4566-acc1-947653527922 tempest-VolumesCloneTest-1619515879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:15:57.271179 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7d17409d-0ea5-4566-acc1-947653527922 tempest-VolumesCloneTest-1619515879 None] Flow 'volume_create_manager' (e4a5e3ef-ccda-445b-89d6-16ec2132262f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:15:57.277967 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7d17409d-0ea5-4566-acc1-947653527922 tempest-VolumesCloneTest-1619515879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f0a817b-1e03-44d5-9600-9cb1f21fd0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:57.295986 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7d17409d-0ea5-4566-acc1-947653527922 tempest-VolumesCloneTest-1619515879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f0a817b-1e03-44d5-9600-9cb1f21fd0c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-420849243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2a190b82-eec4-46c2-abfe-fc392b001a83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='646717cca3f1470693a47f4d8d56dd1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=0c57ce0f-5ce7-4331-87f3-52763f4f5201,status='creating',terminated_at=None,updated_at=2022-05-07T22:15:57Z,use_quota=True,user_id='3743c0c0605b45d0bc8946a5f6f5d2b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:57.302183 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7d17409d-0ea5-4566-acc1-947653527922 tempest-VolumesCloneTest-1619515879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e1e9352-e0ee-4637-8b82-a6ed783f8dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:57.306874 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7d17409d-0ea5-4566-acc1-947653527922 tempest-VolumesCloneTest-1619515879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e1e9352-e0ee-4637-8b82-a6ed783f8dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:57.312736 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7d17409d-0ea5-4566-acc1-947653527922 tempest-VolumesCloneTest-1619515879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc0b791e-48f9-4dcb-9c9c-ca8ddd9f31d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:57.332674 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7d17409d-0ea5-4566-acc1-947653527922 tempest-VolumesCloneTest-1619515879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc0b791e-48f9-4dcb-9c9c-ca8ddd9f31d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2a190b82-eec4-46c2-abfe-fc392b001a83', 'volume_name': 'volume-2a190b82-eec4-46c2-abfe-fc392b001a83', 'volume_size': 1, 'source_volid': '0c57ce0f-5ce7-4331-87f3-52763f4f5201', 'source_volstatus': 'available'}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:57.337774 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7d17409d-0ea5-4566-acc1-947653527922 tempest-VolumesCloneTest-1619515879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ff0dea9-4b49-4c5d-8961-5054082f37d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:57.342938 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7d17409d-0ea5-4566-acc1-947653527922 tempest-VolumesCloneTest-1619515879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ff0dea9-4b49-4c5d-8961-5054082f37d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:57.347887 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7d17409d-0ea5-4566-acc1-947653527922 tempest-VolumesCloneTest-1619515879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a883614-2f12-409c-afd7-974e8b559314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:57.349002 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-7d17409d-0ea5-4566-acc1-947653527922 tempest-VolumesCloneTest-1619515879 None] Volume 2a190b82-eec4-46c2-abfe-fc392b001a83: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2a190b82-eec4-46c2-abfe-fc392b001a83', 'volume_size': 1, 'source_volid': '0c57ce0f-5ce7-4331-87f3-52763f4f5201', 'source_volstatus': 'available'} May 07 22:15:57.367238 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-7d17409d-0ea5-4566-acc1-947653527922 tempest-VolumesCloneTest-1619515879 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:15:57.479012 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-7d17409d-0ea5-4566-acc1-947653527922 tempest-VolumesCloneTest-1619515879 None] creating snapshot='volume-2a190b82-eec4-46c2-abfe-fc392b001a83.clone_snap' {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} May 07 22:15:58.329452 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-7d17409d-0ea5-4566-acc1-947653527922 tempest-VolumesCloneTest-1619515879 None] cloning 'volume-0c57ce0f-5ce7-4331-87f3-52763f4f5201@volume-2a190b82-eec4-46c2-abfe-fc392b001a83.clone_snap' to 'volume-2a190b82-eec4-46c2-abfe-fc392b001a83' {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 07 22:15:58.637922 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-7d17409d-0ea5-4566-acc1-947653527922 tempest-VolumesCloneTest-1619515879 None] Volume volume-3864f924-91b4-4015-ab37-8bdbf8ad652d.deleted is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:15:58.639510 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-7d17409d-0ea5-4566-acc1-947653527922 tempest-VolumesCloneTest-1619515879 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:15:58.640054 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-7d17409d-0ea5-4566-acc1-947653527922 tempest-VolumesCloneTest-1619515879 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:15:58.673712 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-7d17409d-0ea5-4566-acc1-947653527922 tempest-VolumesCloneTest-1619515879 None] clone created successfully {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} May 07 22:15:58.674323 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.volume_utils [None req-7d17409d-0ea5-4566-acc1-947653527922 tempest-VolumesCloneTest-1619515879 None] Marking volume 2a190b82-eec4-46c2-abfe-fc392b001a83 as bootable. {{(pid=129946) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} May 07 22:15:58.693453 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d17409d-0ea5-4566-acc1-947653527922 tempest-VolumesCloneTest-1619515879 None] Copying metadata from source volume 0c57ce0f-5ce7-4331-87f3-52763f4f5201 to 2a190b82-eec4-46c2-abfe-fc392b001a83. {{(pid=129946) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:436}} May 07 22:15:58.747306 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7d17409d-0ea5-4566-acc1-947653527922 tempest-VolumesCloneTest-1619515879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a883614-2f12-409c-afd7-974e8b559314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a190b82-eec4-46c2-abfe-fc392b001a83', 'volume_size': 1, 'source_volid': '0c57ce0f-5ce7-4331-87f3-52763f4f5201', 'source_volstatus': 'available'}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:58.753325 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7d17409d-0ea5-4566-acc1-947653527922 tempest-VolumesCloneTest-1619515879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4328b39-da3f-4b94-bd5b-fdc4abd55674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:58.763829 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-7d17409d-0ea5-4566-acc1-947653527922 tempest-VolumesCloneTest-1619515879 None] Volume volume-2a190b82-eec4-46c2-abfe-fc392b001a83 (2a190b82-eec4-46c2-abfe-fc392b001a83): created successfully May 07 22:15:58.768841 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7d17409d-0ea5-4566-acc1-947653527922 tempest-VolumesCloneTest-1619515879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4328b39-da3f-4b94-bd5b-fdc4abd55674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:58.776071 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7d17409d-0ea5-4566-acc1-947653527922 tempest-VolumesCloneTest-1619515879 None] Flow 'volume_create_manager' (e4a5e3ef-ccda-445b-89d6-16ec2132262f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:15:58.794739 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-7d17409d-0ea5-4566-acc1-947653527922 tempest-VolumesCloneTest-1619515879 None] Created volume successfully. May 07 22:15:59.752304 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7fbc023-2f5e-4bd0-8156-c7bd82fdd681 tempest-VolumesCloneTest-1619515879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:15:59.774164 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a7fbc023-2f5e-4bd0-8156-c7bd82fdd681 tempest-VolumesCloneTest-1619515879 None] Flow 'volume_create_manager' (3a11e35b-b231-4b2a-bbd8-fad5c5caff41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:15:59.783631 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a7fbc023-2f5e-4bd0-8156-c7bd82fdd681 tempest-VolumesCloneTest-1619515879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89a0a507-f328-4e96-b7fc-53f3c8266413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:59.802291 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a7fbc023-2f5e-4bd0-8156-c7bd82fdd681 tempest-VolumesCloneTest-1619515879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89a0a507-f328-4e96-b7fc-53f3c8266413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-563213690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=22c08512-8de7-4d32-a542-805a34f1b722,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='646717cca3f1470693a47f4d8d56dd1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:16:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:16:00Z,use_quota=True,user_id='3743c0c0605b45d0bc8946a5f6f5d2b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:59.810878 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a7fbc023-2f5e-4bd0-8156-c7bd82fdd681 tempest-VolumesCloneTest-1619515879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (597183b4-936a-43ec-945f-981f4f732977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:59.816529 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a7fbc023-2f5e-4bd0-8156-c7bd82fdd681 tempest-VolumesCloneTest-1619515879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (597183b4-936a-43ec-945f-981f4f732977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:59.822028 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a7fbc023-2f5e-4bd0-8156-c7bd82fdd681 tempest-VolumesCloneTest-1619515879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1d49302-c171-49ef-abf2-c2150469927f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:59.826445 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a7fbc023-2f5e-4bd0-8156-c7bd82fdd681 tempest-VolumesCloneTest-1619515879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1d49302-c171-49ef-abf2-c2150469927f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22c08512-8de7-4d32-a542-805a34f1b722', 'volume_name': 'volume-22c08512-8de7-4d32-a542-805a34f1b722', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:59.831991 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a7fbc023-2f5e-4bd0-8156-c7bd82fdd681 tempest-VolumesCloneTest-1619515879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a5cf30e-e098-41fa-8e6d-c2246a9a7de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:59.836034 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a7fbc023-2f5e-4bd0-8156-c7bd82fdd681 tempest-VolumesCloneTest-1619515879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a5cf30e-e098-41fa-8e6d-c2246a9a7de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:59.840978 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a7fbc023-2f5e-4bd0-8156-c7bd82fdd681 tempest-VolumesCloneTest-1619515879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (762f1925-c62c-4b7e-8231-7319b6cc6789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:59.842165 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-a7fbc023-2f5e-4bd0-8156-c7bd82fdd681 tempest-VolumesCloneTest-1619515879 None] Volume 22c08512-8de7-4d32-a542-805a34f1b722: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22c08512-8de7-4d32-a542-805a34f1b722', 'volume_size': 1} May 07 22:15:59.842560 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-a7fbc023-2f5e-4bd0-8156-c7bd82fdd681 tempest-VolumesCloneTest-1619515879 None] creating volume 'volume-22c08512-8de7-4d32-a542-805a34f1b722' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:15:59.843269 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-a7fbc023-2f5e-4bd0-8156-c7bd82fdd681 tempest-VolumesCloneTest-1619515879 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:15:59.925176 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-a7fbc023-2f5e-4bd0-8156-c7bd82fdd681 tempest-VolumesCloneTest-1619515879 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:15:59.925797 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-a7fbc023-2f5e-4bd0-8156-c7bd82fdd681 tempest-VolumesCloneTest-1619515879 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:15:59.930366 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a7fbc023-2f5e-4bd0-8156-c7bd82fdd681 tempest-VolumesCloneTest-1619515879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (762f1925-c62c-4b7e-8231-7319b6cc6789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22c08512-8de7-4d32-a542-805a34f1b722', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:59.937155 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a7fbc023-2f5e-4bd0-8156-c7bd82fdd681 tempest-VolumesCloneTest-1619515879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9ca3aff-e07c-4353-965f-35a1dfa4f589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:15:59.948555 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-a7fbc023-2f5e-4bd0-8156-c7bd82fdd681 tempest-VolumesCloneTest-1619515879 None] Volume volume-22c08512-8de7-4d32-a542-805a34f1b722 (22c08512-8de7-4d32-a542-805a34f1b722): created successfully May 07 22:15:59.952757 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a7fbc023-2f5e-4bd0-8156-c7bd82fdd681 tempest-VolumesCloneTest-1619515879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9ca3aff-e07c-4353-965f-35a1dfa4f589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:15:59.958983 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-a7fbc023-2f5e-4bd0-8156-c7bd82fdd681 tempest-VolumesCloneTest-1619515879 None] Flow 'volume_create_manager' (3a11e35b-b231-4b2a-bbd8-fad5c5caff41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:15:59.971572 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-a7fbc023-2f5e-4bd0-8156-c7bd82fdd681 tempest-VolumesCloneTest-1619515879 None] Created volume successfully. May 07 22:16:01.142957 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-00a51d8e-4744-4d74-8358-24c0871dbad2 tempest-VolumesCloneTest-1619515879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:16:01.182733 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-00a51d8e-4744-4d74-8358-24c0871dbad2 tempest-VolumesCloneTest-1619515879 None] Flow 'volume_create_manager' (78ccfefb-af59-467b-bd0c-addbea176cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:16:01.189904 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-00a51d8e-4744-4d74-8358-24c0871dbad2 tempest-VolumesCloneTest-1619515879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e4dd7aa-2928-4ad8-99d6-afe5c56159a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:01.209844 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-00a51d8e-4744-4d74-8358-24c0871dbad2 tempest-VolumesCloneTest-1619515879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e4dd7aa-2928-4ad8-99d6-afe5c56159a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:16:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1589243470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4268c7ea-ba1c-4fce-a16d-55d82f970f8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='646717cca3f1470693a47f4d8d56dd1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:16:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=22c08512-8de7-4d32-a542-805a34f1b722,status='creating',terminated_at=None,updated_at=2022-05-07T22:16:01Z,use_quota=True,user_id='3743c0c0605b45d0bc8946a5f6f5d2b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:01.216167 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-00a51d8e-4744-4d74-8358-24c0871dbad2 tempest-VolumesCloneTest-1619515879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3447723b-d005-4e37-afa7-70b2283090a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:01.221327 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-00a51d8e-4744-4d74-8358-24c0871dbad2 tempest-VolumesCloneTest-1619515879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3447723b-d005-4e37-afa7-70b2283090a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:01.227464 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-00a51d8e-4744-4d74-8358-24c0871dbad2 tempest-VolumesCloneTest-1619515879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d26d7e00-fc42-44cf-92e5-d6fab90099d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:01.247255 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-00a51d8e-4744-4d74-8358-24c0871dbad2 tempest-VolumesCloneTest-1619515879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d26d7e00-fc42-44cf-92e5-d6fab90099d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4268c7ea-ba1c-4fce-a16d-55d82f970f8e', 'volume_name': 'volume-4268c7ea-ba1c-4fce-a16d-55d82f970f8e', 'volume_size': 2, 'source_volid': '22c08512-8de7-4d32-a542-805a34f1b722', 'source_volstatus': 'available'}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:01.254197 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-00a51d8e-4744-4d74-8358-24c0871dbad2 tempest-VolumesCloneTest-1619515879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06fe60fa-7e06-4e36-9c39-643c0922f524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:01.258300 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-00a51d8e-4744-4d74-8358-24c0871dbad2 tempest-VolumesCloneTest-1619515879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06fe60fa-7e06-4e36-9c39-643c0922f524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:01.264549 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-00a51d8e-4744-4d74-8358-24c0871dbad2 tempest-VolumesCloneTest-1619515879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68f1f9f4-6500-4796-9e81-06ec3fa4242a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:01.265658 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-00a51d8e-4744-4d74-8358-24c0871dbad2 tempest-VolumesCloneTest-1619515879 None] Volume 4268c7ea-ba1c-4fce-a16d-55d82f970f8e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4268c7ea-ba1c-4fce-a16d-55d82f970f8e', 'volume_size': 2, 'source_volid': '22c08512-8de7-4d32-a542-805a34f1b722', 'source_volstatus': 'available'} May 07 22:16:01.281626 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-00a51d8e-4744-4d74-8358-24c0871dbad2 tempest-VolumesCloneTest-1619515879 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:01.334518 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-00a51d8e-4744-4d74-8358-24c0871dbad2 tempest-VolumesCloneTest-1619515879 None] creating snapshot='volume-4268c7ea-ba1c-4fce-a16d-55d82f970f8e.clone_snap' {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} May 07 22:16:02.302349 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-00a51d8e-4744-4d74-8358-24c0871dbad2 tempest-VolumesCloneTest-1619515879 None] cloning 'volume-22c08512-8de7-4d32-a542-805a34f1b722@volume-4268c7ea-ba1c-4fce-a16d-55d82f970f8e.clone_snap' to 'volume-4268c7ea-ba1c-4fce-a16d-55d82f970f8e' {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 07 22:16:02.405720 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-00a51d8e-4744-4d74-8358-24c0871dbad2 tempest-VolumesCloneTest-1619515879 None] Volume volume-22c08512-8de7-4d32-a542-805a34f1b722 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:16:02.407022 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-00a51d8e-4744-4d74-8358-24c0871dbad2 tempest-VolumesCloneTest-1619515879 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:16:02.407518 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-00a51d8e-4744-4d74-8358-24c0871dbad2 tempest-VolumesCloneTest-1619515879 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:16:02.421871 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-00a51d8e-4744-4d74-8358-24c0871dbad2 tempest-VolumesCloneTest-1619515879 None] resize volume 'volume-4268c7ea-ba1c-4fce-a16d-55d82f970f8e' from 1 to 2 {{(pid=129946) _extend_if_required /opt/stack/cinder/cinder/volume/drivers/rbd.py:743}} May 07 22:16:02.422569 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-00a51d8e-4744-4d74-8358-24c0871dbad2 tempest-VolumesCloneTest-1619515879 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:02.525818 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-00a51d8e-4744-4d74-8358-24c0871dbad2 tempest-VolumesCloneTest-1619515879 None] clone created successfully {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} May 07 22:16:02.530302 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-00a51d8e-4744-4d74-8358-24c0871dbad2 tempest-VolumesCloneTest-1619515879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68f1f9f4-6500-4796-9e81-06ec3fa4242a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4268c7ea-ba1c-4fce-a16d-55d82f970f8e', 'volume_size': 2, 'source_volid': '22c08512-8de7-4d32-a542-805a34f1b722', 'source_volstatus': 'available'}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:02.535364 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-00a51d8e-4744-4d74-8358-24c0871dbad2 tempest-VolumesCloneTest-1619515879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8746093-7f74-4573-97bd-a7303b6d8b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:02.543988 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-00a51d8e-4744-4d74-8358-24c0871dbad2 tempest-VolumesCloneTest-1619515879 None] Volume volume-4268c7ea-ba1c-4fce-a16d-55d82f970f8e (4268c7ea-ba1c-4fce-a16d-55d82f970f8e): created successfully May 07 22:16:02.547879 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-00a51d8e-4744-4d74-8358-24c0871dbad2 tempest-VolumesCloneTest-1619515879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8746093-7f74-4573-97bd-a7303b6d8b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:02.554558 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-00a51d8e-4744-4d74-8358-24c0871dbad2 tempest-VolumesCloneTest-1619515879 None] Flow 'volume_create_manager' (78ccfefb-af59-467b-bd0c-addbea176cb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:16:02.567123 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-00a51d8e-4744-4d74-8358-24c0871dbad2 tempest-VolumesCloneTest-1619515879 None] Created volume successfully. May 07 22:16:03.313819 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-d0963e31-24a3-4447-93c8-8007fd2ca33f tempest-VolumesCloneTest-1619515879 None] Lock "b'cinder-4268c7ea-ba1c-4fce-a16d-55d82f970f8e-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:16:03.348566 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d0963e31-24a3-4447-93c8-8007fd2ca33f tempest-VolumesCloneTest-1619515879 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:03.405530 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d0963e31-24a3-4447-93c8-8007fd2ca33f tempest-VolumesCloneTest-1619515879 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:16:03.412327 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d0963e31-24a3-4447-93c8-8007fd2ca33f tempest-VolumesCloneTest-1619515879 None] deleting rbd volume volume-4268c7ea-ba1c-4fce-a16d-55d82f970f8e {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:16:03.601049 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d0963e31-24a3-4447-93c8-8007fd2ca33f tempest-VolumesCloneTest-1619515879 None] volume is a clone so cleaning references {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} May 07 22:16:03.619973 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d0963e31-24a3-4447-93c8-8007fd2ca33f tempest-VolumesCloneTest-1619515879 None] Volume volume-22c08512-8de7-4d32-a542-805a34f1b722 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:16:03.620461 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d0963e31-24a3-4447-93c8-8007fd2ca33f tempest-VolumesCloneTest-1619515879 None] deleting parent snapshot volume-4268c7ea-ba1c-4fce-a16d-55d82f970f8e.clone_snap {{(pid=129946) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} May 07 22:16:04.384023 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-d0963e31-24a3-4447-93c8-8007fd2ca33f tempest-VolumesCloneTest-1619515879 None] Created reservations ['93c95560-0480-48ae-b607-c142855d2d10', 'a2f0dd54-72d8-48bb-913c-5cad8026ec4b', 'ee50ff71-579f-4116-9ef9-2960ef55a5ca', '8155bfc3-ab2e-4a54-b7d3-87c66461e75a'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:16:04.440649 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d0963e31-24a3-4447-93c8-8007fd2ca33f tempest-VolumesCloneTest-1619515879 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:04.465073 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d0963e31-24a3-4447-93c8-8007fd2ca33f tempest-VolumesCloneTest-1619515879 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:04.493279 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-d0963e31-24a3-4447-93c8-8007fd2ca33f tempest-VolumesCloneTest-1619515879 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:16:04.499320 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-d0963e31-24a3-4447-93c8-8007fd2ca33f tempest-VolumesCloneTest-1619515879 None] Deleted volume successfully. May 07 22:16:04.511695 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-d0963e31-24a3-4447-93c8-8007fd2ca33f tempest-VolumesCloneTest-1619515879 None] Lock "b'cinder-4268c7ea-ba1c-4fce-a16d-55d82f970f8e-delete_volume'" released by "delete_volume" :: held 1.198s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:16:05.494191 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-49dbe8e0-3888-463f-a811-f84010c76e74 tempest-VolumesCloneTest-1619515879 None] Lock "b'cinder-22c08512-8de7-4d32-a542-805a34f1b722-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:16:05.531428 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-49dbe8e0-3888-463f-a811-f84010c76e74 tempest-VolumesCloneTest-1619515879 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:05.577826 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-49dbe8e0-3888-463f-a811-f84010c76e74 tempest-VolumesCloneTest-1619515879 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:16:05.578262 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-49dbe8e0-3888-463f-a811-f84010c76e74 tempest-VolumesCloneTest-1619515879 None] Volume volume-22c08512-8de7-4d32-a542-805a34f1b722 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:16:05.587025 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-49dbe8e0-3888-463f-a811-f84010c76e74 tempest-VolumesCloneTest-1619515879 None] deleting rbd volume volume-22c08512-8de7-4d32-a542-805a34f1b722 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:16:05.841443 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-49dbe8e0-3888-463f-a811-f84010c76e74 tempest-VolumesCloneTest-1619515879 None] Created reservations ['c6faec76-069b-4c60-8aa9-7768caffaef3', '1e496290-aafb-4fdb-b1ef-0092b0fd5a54', 'ed83a8a5-7e61-4f5e-b4ac-080e36c82b1a', '474b4c80-a3ac-4b36-96b8-6909cc1d04e0'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:16:05.897584 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-49dbe8e0-3888-463f-a811-f84010c76e74 tempest-VolumesCloneTest-1619515879 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:05.955313 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-49dbe8e0-3888-463f-a811-f84010c76e74 tempest-VolumesCloneTest-1619515879 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:05.989182 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-49dbe8e0-3888-463f-a811-f84010c76e74 tempest-VolumesCloneTest-1619515879 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:16:05.995405 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-49dbe8e0-3888-463f-a811-f84010c76e74 tempest-VolumesCloneTest-1619515879 None] Deleted volume successfully. May 07 22:16:06.027688 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-49dbe8e0-3888-463f-a811-f84010c76e74 tempest-VolumesCloneTest-1619515879 None] Lock "b'cinder-22c08512-8de7-4d32-a542-805a34f1b722-delete_volume'" released by "delete_volume" :: held 0.533s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:16:06.051416 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-19e0824e-dbee-480a-bf2e-a432fdd62079 tempest-GroupsV314Test-2120829142 None] Group tempest-GroupsV314Test-Group-205910092: creating May 07 22:16:06.073351 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-19e0824e-dbee-480a-bf2e-a432fdd62079 tempest-GroupsV314Test-2120829142 None] Group tempest-GroupsV314Test-Group-205910092: created successfully May 07 22:16:06.082490 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-19e0824e-dbee-480a-bf2e-a432fdd62079 tempest-GroupsV314Test-2120829142 None] Create group completed successfully. May 07 22:16:06.631175 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-13b8351a-793c-4073-aaef-5f70768261fb tempest-VolumesCloneTest-1619515879 None] Lock "b'cinder-2a190b82-eec4-46c2-abfe-fc392b001a83-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:16:06.666492 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-13b8351a-793c-4073-aaef-5f70768261fb tempest-VolumesCloneTest-1619515879 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:06.743806 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-13b8351a-793c-4073-aaef-5f70768261fb tempest-VolumesCloneTest-1619515879 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:16:06.751637 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-13b8351a-793c-4073-aaef-5f70768261fb tempest-VolumesCloneTest-1619515879 None] deleting rbd volume volume-2a190b82-eec4-46c2-abfe-fc392b001a83 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:16:06.967440 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-13b8351a-793c-4073-aaef-5f70768261fb tempest-VolumesCloneTest-1619515879 None] volume is a clone so cleaning references {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} May 07 22:16:07.017597 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-13b8351a-793c-4073-aaef-5f70768261fb tempest-VolumesCloneTest-1619515879 None] deleting parent snapshot volume-2a190b82-eec4-46c2-abfe-fc392b001a83.clone_snap {{(pid=129946) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} May 07 22:16:07.453867 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-13b8351a-793c-4073-aaef-5f70768261fb tempest-VolumesCloneTest-1619515879 None] Created reservations ['70321bdc-333b-4a0d-bd95-961a7fe32d0c', '4d932493-f020-4365-bbbb-23debc6f52e1', '0951706e-507e-4578-8acc-e5f7224195cc', 'd0333c74-d09e-4074-bf13-15c75a245c61'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:16:07.492581 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-396124c3-445e-4bfb-abf3-05647d3b82c4 tempest-GroupsV314Test-2120829142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:16:07.513936 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-396124c3-445e-4bfb-abf3-05647d3b82c4 tempest-GroupsV314Test-2120829142 None] Flow 'volume_create_manager' (1d28a77e-0155-42d8-be27-7b7d5b91ffc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:16:07.520909 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-396124c3-445e-4bfb-abf3-05647d3b82c4 tempest-GroupsV314Test-2120829142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1803534d-2f6d-462f-9df9-8e9fc8d7298b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:07.539110 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-396124c3-445e-4bfb-abf3-05647d3b82c4 tempest-GroupsV314Test-2120829142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1803534d-2f6d-462f-9df9-8e9fc8d7298b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:16:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsV314Test-Volume-353227949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d1d658ee-ecf3-4288-bbd7-2b2c491c04a0,host='ncdv-master-1@ceph#ceph',id=30ddaa9c-f03b-4167-9ade-02a645bb192a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c97c10be6f04abe88bae3fed114e3eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:16:07Z,use_quota=True,user_id='8d7d1e4d45af4c66adbfd4ce9fb95457',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b775b282-d84d-49e0-8129-5815dda157bd),volume_type_id=b775b282-d84d-49e0-8129-5815dda157bd)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:07.545698 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-396124c3-445e-4bfb-abf3-05647d3b82c4 tempest-GroupsV314Test-2120829142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (920b9ec0-dc0a-4d01-a3dc-ec8e7ca510c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:07.550527 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-396124c3-445e-4bfb-abf3-05647d3b82c4 tempest-GroupsV314Test-2120829142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (920b9ec0-dc0a-4d01-a3dc-ec8e7ca510c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:07.556278 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-396124c3-445e-4bfb-abf3-05647d3b82c4 tempest-GroupsV314Test-2120829142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f0b714-d0b9-414b-a303-83b13abed1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:07.561191 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-396124c3-445e-4bfb-abf3-05647d3b82c4 tempest-GroupsV314Test-2120829142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f0b714-d0b9-414b-a303-83b13abed1ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30ddaa9c-f03b-4167-9ade-02a645bb192a', 'volume_name': 'volume-30ddaa9c-f03b-4167-9ade-02a645bb192a', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:07.566400 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-396124c3-445e-4bfb-abf3-05647d3b82c4 tempest-GroupsV314Test-2120829142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2cba5a8-8007-402f-b124-9c3df77cea79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:07.570856 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-396124c3-445e-4bfb-abf3-05647d3b82c4 tempest-GroupsV314Test-2120829142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2cba5a8-8007-402f-b124-9c3df77cea79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:07.575974 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-396124c3-445e-4bfb-abf3-05647d3b82c4 tempest-GroupsV314Test-2120829142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83af46ab-238a-42c5-8e5c-96a09bcd603a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:07.577172 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-396124c3-445e-4bfb-abf3-05647d3b82c4 tempest-GroupsV314Test-2120829142 None] Volume 30ddaa9c-f03b-4167-9ade-02a645bb192a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30ddaa9c-f03b-4167-9ade-02a645bb192a', 'volume_size': 1} May 07 22:16:07.577818 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-396124c3-445e-4bfb-abf3-05647d3b82c4 tempest-GroupsV314Test-2120829142 None] creating volume 'volume-30ddaa9c-f03b-4167-9ade-02a645bb192a' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:16:07.579015 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-396124c3-445e-4bfb-abf3-05647d3b82c4 tempest-GroupsV314Test-2120829142 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:07.633459 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-13b8351a-793c-4073-aaef-5f70768261fb tempest-VolumesCloneTest-1619515879 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:07.662222 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-13b8351a-793c-4073-aaef-5f70768261fb tempest-VolumesCloneTest-1619515879 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:07.707726 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-13b8351a-793c-4073-aaef-5f70768261fb tempest-VolumesCloneTest-1619515879 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:16:07.718759 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-396124c3-445e-4bfb-abf3-05647d3b82c4 tempest-GroupsV314Test-2120829142 None] extra_specs: {} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:16:07.719175 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-396124c3-445e-4bfb-abf3-05647d3b82c4 tempest-GroupsV314Test-2120829142 None] extra_specs: {} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:16:07.724242 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-396124c3-445e-4bfb-abf3-05647d3b82c4 tempest-GroupsV314Test-2120829142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83af46ab-238a-42c5-8e5c-96a09bcd603a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30ddaa9c-f03b-4167-9ade-02a645bb192a', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:07.734061 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-396124c3-445e-4bfb-abf3-05647d3b82c4 tempest-GroupsV314Test-2120829142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (024f9e4c-6d12-4057-99f5-05fcccd5a353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:07.746797 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-13b8351a-793c-4073-aaef-5f70768261fb tempest-VolumesCloneTest-1619515879 None] Deleted volume successfully. May 07 22:16:07.751625 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-396124c3-445e-4bfb-abf3-05647d3b82c4 tempest-GroupsV314Test-2120829142 None] Volume volume-30ddaa9c-f03b-4167-9ade-02a645bb192a (30ddaa9c-f03b-4167-9ade-02a645bb192a): created successfully May 07 22:16:07.756223 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-396124c3-445e-4bfb-abf3-05647d3b82c4 tempest-GroupsV314Test-2120829142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (024f9e4c-6d12-4057-99f5-05fcccd5a353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:07.763143 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-396124c3-445e-4bfb-abf3-05647d3b82c4 tempest-GroupsV314Test-2120829142 None] Flow 'volume_create_manager' (1d28a77e-0155-42d8-be27-7b7d5b91ffc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:16:07.786059 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-396124c3-445e-4bfb-abf3-05647d3b82c4 tempest-GroupsV314Test-2120829142 None] Created volume successfully. May 07 22:16:07.800958 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-13b8351a-793c-4073-aaef-5f70768261fb tempest-VolumesCloneTest-1619515879 None] Lock "b'cinder-2a190b82-eec4-46c2-abfe-fc392b001a83-delete_volume'" released by "delete_volume" :: held 1.170s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:16:07.806829 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-8b30739f-ab3f-49d1-9b9f-1e180102d6b0 tempest-VolumesActionsTest-497963316 None] Lock "b'cinder-d52eb92e-dfc0-4ab4-8639-1d9fc281fd13'" acquired by "attach_volume" :: waited 0.029s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:16:07.810932 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-ce5f0aab-1e1c-49cd-8829-c0a9dcc840b1 tempest-VolumesCloneTest-1619515879 None] Lock "b'cinder-0c57ce0f-5ce7-4331-87f3-52763f4f5201-delete_volume'" acquired by "delete_volume" :: waited 0.030s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:16:07.863918 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-ce5f0aab-1e1c-49cd-8829-c0a9dcc840b1 tempest-VolumesCloneTest-1619515879 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:07.929587 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-ce5f0aab-1e1c-49cd-8829-c0a9dcc840b1 tempest-VolumesCloneTest-1619515879 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:16:07.936284 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-ce5f0aab-1e1c-49cd-8829-c0a9dcc840b1 tempest-VolumesCloneTest-1619515879 None] deleting rbd volume volume-0c57ce0f-5ce7-4331-87f3-52763f4f5201 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:16:07.949118 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-8b30739f-ab3f-49d1-9b9f-1e180102d6b0 tempest-VolumesActionsTest-497963316 None] Attaching volume d52eb92e-dfc0-4ab4-8639-1d9fc281fd13 to instance ee2464fc-0c20-429b-9b5b-a23a01ad87f2 at mountpoint /dev/sdb on host None. May 07 22:16:07.972915 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-8b30739f-ab3f-49d1-9b9f-1e180102d6b0 tempest-VolumesActionsTest-497963316 None] Attach volume completed successfully. May 07 22:16:07.977869 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-8b30739f-ab3f-49d1-9b9f-1e180102d6b0 tempest-VolumesActionsTest-497963316 None] Lock "b'cinder-d52eb92e-dfc0-4ab4-8639-1d9fc281fd13'" released by "attach_volume" :: held 0.171s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:16:08.095841 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-dc456567-8932-45d5-90b2-ccaf315107f2 tempest-VolumesActionsTest-497963316 None] Lock "b'cinder-d52eb92e-dfc0-4ab4-8639-1d9fc281fd13-detach_volume'" acquired by "detach_volume" :: waited 0.010s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:16:08.096476 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-dc456567-8932-45d5-90b2-ccaf315107f2 tempest-VolumesActionsTest-497963316 None] Detaching volume d52eb92e-dfc0-4ab4-8639-1d9fc281fd13 from instance ee2464fc-0c20-429b-9b5b-a23a01ad87f2. May 07 22:16:08.143048 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-dc456567-8932-45d5-90b2-ccaf315107f2 tempest-VolumesActionsTest-497963316 None] Detach volume completed successfully. May 07 22:16:08.149066 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-dc456567-8932-45d5-90b2-ccaf315107f2 tempest-VolumesActionsTest-497963316 None] Lock "b'cinder-d52eb92e-dfc0-4ab4-8639-1d9fc281fd13-detach_volume'" released by "detach_volume" :: held 0.053s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:16:08.172510 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-ce5f0aab-1e1c-49cd-8829-c0a9dcc840b1 tempest-VolumesCloneTest-1619515879 None] volume is a clone so cleaning references {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} May 07 22:16:08.208884 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-ce5f0aab-1e1c-49cd-8829-c0a9dcc840b1 tempest-VolumesCloneTest-1619515879 None] deleting parent snapshot volume-0c57ce0f-5ce7-4331-87f3-52763f4f5201.clone_snap {{(pid=129946) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} May 07 22:16:08.427505 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-ce5f0aab-1e1c-49cd-8829-c0a9dcc840b1 tempest-VolumesCloneTest-1619515879 None] Created reservations ['08d672a0-7aa3-403c-bf25-0f25fee98018', '229f73ac-6420-41e6-a622-771320fa7a5a', 'e1099c74-bef1-4e95-a6dd-6b36f987dd56', '839ba564-6ef3-4f71-8ce1-1c4c3a58c4b7'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:16:08.479760 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-ce5f0aab-1e1c-49cd-8829-c0a9dcc840b1 tempest-VolumesCloneTest-1619515879 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:08.511153 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-ce5f0aab-1e1c-49cd-8829-c0a9dcc840b1 tempest-VolumesCloneTest-1619515879 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:08.545619 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-ce5f0aab-1e1c-49cd-8829-c0a9dcc840b1 tempest-VolumesCloneTest-1619515879 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:16:08.549813 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-ce5f0aab-1e1c-49cd-8829-c0a9dcc840b1 tempest-VolumesCloneTest-1619515879 None] Deleted volume successfully. May 07 22:16:08.563281 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-ce5f0aab-1e1c-49cd-8829-c0a9dcc840b1 tempest-VolumesCloneTest-1619515879 None] Lock "b'cinder-0c57ce0f-5ce7-4331-87f3-52763f4f5201-delete_volume'" released by "delete_volume" :: held 0.752s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:16:08.940777 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-24b40938-4229-47ab-b2f1-c927d1ddeb32 tempest-GroupsV314Test-2120829142 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:09.020533 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-24b40938-4229-47ab-b2f1-c927d1ddeb32 tempest-GroupsV314Test-2120829142 None] creating snapshot='volume-e07686a6-3fba-4167-90b7-8e650068cfd3.clone_snap' {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} May 07 22:16:09.405552 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-24b40938-4229-47ab-b2f1-c927d1ddeb32 tempest-GroupsV314Test-2120829142 None] cloning 'volume-30ddaa9c-f03b-4167-9ade-02a645bb192a@volume-e07686a6-3fba-4167-90b7-8e650068cfd3.clone_snap' to 'volume-e07686a6-3fba-4167-90b7-8e650068cfd3' {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 07 22:16:09.532385 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-24b40938-4229-47ab-b2f1-c927d1ddeb32 tempest-GroupsV314Test-2120829142 None] Volume volume-30ddaa9c-f03b-4167-9ade-02a645bb192a is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:16:09.537824 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-24b40938-4229-47ab-b2f1-c927d1ddeb32 tempest-GroupsV314Test-2120829142 None] extra_specs: {} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:16:09.538030 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-24b40938-4229-47ab-b2f1-c927d1ddeb32 tempest-GroupsV314Test-2120829142 None] extra_specs: {} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:16:09.582685 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-24b40938-4229-47ab-b2f1-c927d1ddeb32 tempest-GroupsV314Test-2120829142 None] clone created successfully {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} May 07 22:16:09.643759 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-24b40938-4229-47ab-b2f1-c927d1ddeb32 tempest-GroupsV314Test-2120829142 None] Create group from source-group-d1d658ee-ecf3-4288-bbd7-2b2c491c04a0 completed successfully. May 07 22:16:10.509501 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-fe66f5ad-a0a0-4a5d-aff8-14aeb2eaf0b6 tempest-GroupsV314Test-2120829142 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:10.601819 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-fe66f5ad-a0a0-4a5d-aff8-14aeb2eaf0b6 tempest-GroupsV314Test-2120829142 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:16:10.615526 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-fe66f5ad-a0a0-4a5d-aff8-14aeb2eaf0b6 tempest-GroupsV314Test-2120829142 None] deleting rbd volume volume-e07686a6-3fba-4167-90b7-8e650068cfd3 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:16:10.943104 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-fe66f5ad-a0a0-4a5d-aff8-14aeb2eaf0b6 tempest-GroupsV314Test-2120829142 None] volume is a clone so cleaning references {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} May 07 22:16:10.966233 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-fe66f5ad-a0a0-4a5d-aff8-14aeb2eaf0b6 tempest-GroupsV314Test-2120829142 None] Volume volume-30ddaa9c-f03b-4167-9ade-02a645bb192a is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:16:10.966901 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-fe66f5ad-a0a0-4a5d-aff8-14aeb2eaf0b6 tempest-GroupsV314Test-2120829142 None] deleting parent snapshot volume-e07686a6-3fba-4167-90b7-8e650068cfd3.clone_snap {{(pid=129946) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} May 07 22:16:11.409024 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-fe66f5ad-a0a0-4a5d-aff8-14aeb2eaf0b6 tempest-GroupsV314Test-2120829142 None] Created reservations ['fc0859e4-021a-4d2e-9146-2f6cc803c0ef'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:16:11.432413 ncdv-master-1 cinder-volume[129946]: WARNING cinder.quota [None req-fe66f5ad-a0a0-4a5d-aff8-14aeb2eaf0b6 tempest-GroupsV314Test-2120829142 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1408757421 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1408757421, it is now deprecated. Please use the default quota class for default quota. May 07 22:16:11.433850 ncdv-master-1 cinder-volume[129946]: WARNING cinder.quota [None req-fe66f5ad-a0a0-4a5d-aff8-14aeb2eaf0b6 tempest-GroupsV314Test-2120829142 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1408757421 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1408757421, it is now deprecated. Please use the default quota class for default quota. May 07 22:16:11.450822 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-fe66f5ad-a0a0-4a5d-aff8-14aeb2eaf0b6 tempest-GroupsV314Test-2120829142 None] Created reservations ['0b174424-51ae-4a5e-99f3-278d1ea1f622', '32a7eb58-84c5-4949-aef3-4a9b22b24b3d', '207547da-17e8-4c47-b857-98a166101760', '893c0262-d5eb-497c-9ef3-7aa8d204f586'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:16:11.549909 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-fe66f5ad-a0a0-4a5d-aff8-14aeb2eaf0b6 tempest-GroupsV314Test-2120829142 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:11.592963 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-fe66f5ad-a0a0-4a5d-aff8-14aeb2eaf0b6 tempest-GroupsV314Test-2120829142 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:11.672065 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-fe66f5ad-a0a0-4a5d-aff8-14aeb2eaf0b6 tempest-GroupsV314Test-2120829142 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:16:11.678039 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-fe66f5ad-a0a0-4a5d-aff8-14aeb2eaf0b6 tempest-GroupsV314Test-2120829142 None] Delete group completed successfully. May 07 22:16:11.947425 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-cd6da851-c4fd-447f-9681-85995be63131 tempest-GroupsV314Test-2120829142 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:12.028575 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-cd6da851-c4fd-447f-9681-85995be63131 tempest-GroupsV314Test-2120829142 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:16:12.029006 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-cd6da851-c4fd-447f-9681-85995be63131 tempest-GroupsV314Test-2120829142 None] Volume volume-30ddaa9c-f03b-4167-9ade-02a645bb192a is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:16:12.038687 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-cd6da851-c4fd-447f-9681-85995be63131 tempest-GroupsV314Test-2120829142 None] deleting rbd volume volume-30ddaa9c-f03b-4167-9ade-02a645bb192a {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:16:12.411519 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-cd6da851-c4fd-447f-9681-85995be63131 tempest-GroupsV314Test-2120829142 None] Created reservations ['481a6f0e-2671-4de7-85f8-505ec9342388'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:16:12.448662 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-cd6da851-c4fd-447f-9681-85995be63131 tempest-GroupsV314Test-2120829142 None] Created reservations ['41d3750c-058f-423e-b58d-a5fef49d442f', '8f2717b4-7a4e-4843-8420-7b6ccf36fa69', '3ce54a5b-9b7f-44ef-97cd-1bbac5076385', '44d622c4-dad4-4361-bf32-1220a17a1cdb'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:16:12.575279 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-cd6da851-c4fd-447f-9681-85995be63131 tempest-GroupsV314Test-2120829142 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:12.608556 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-cd6da851-c4fd-447f-9681-85995be63131 tempest-GroupsV314Test-2120829142 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:12.650133 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-cd6da851-c4fd-447f-9681-85995be63131 tempest-GroupsV314Test-2120829142 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:16:12.657829 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-cd6da851-c4fd-447f-9681-85995be63131 tempest-GroupsV314Test-2120829142 None] Delete group completed successfully. May 07 22:16:24.160695 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-69b347da-6437-4c04-9ef9-3e28e1006c69 tempest-VolumesActionsTest-497963316 None] Lock "b'cinder-d52eb92e-dfc0-4ab4-8639-1d9fc281fd13'" acquired by "attach_volume" :: waited 0.052s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:16:24.175711 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6c6d032-8c9c-4e7e-aeaa-294ae6c08767 tempest-VolumeQuotasAdminTestJSON-1648254432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:16:24.205745 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-c6c6d032-8c9c-4e7e-aeaa-294ae6c08767 tempest-VolumeQuotasAdminTestJSON-1648254432 None] Flow 'volume_create_manager' (b519e6f2-03cf-47a4-8b96-0e70ef006317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:16:24.214911 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-c6c6d032-8c9c-4e7e-aeaa-294ae6c08767 tempest-VolumeQuotasAdminTestJSON-1648254432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc803fe5-fe59-4401-91a0-3174528239af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:24.250699 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-c6c6d032-8c9c-4e7e-aeaa-294ae6c08767 tempest-VolumeQuotasAdminTestJSON-1648254432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc803fe5-fe59-4401-91a0-3174528239af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:16:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1289790981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1eadae7a-e536-48ec-93f3-95bcabb45751,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1b40dcfd2984f6e970681073445c904',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:16:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:16:24Z,use_quota=True,user_id='bd164563a7524038aac7dd703d2e5b99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:24.257419 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-c6c6d032-8c9c-4e7e-aeaa-294ae6c08767 tempest-VolumeQuotasAdminTestJSON-1648254432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fefbdf4-8590-4009-96b2-14ff840971c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:24.262942 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-c6c6d032-8c9c-4e7e-aeaa-294ae6c08767 tempest-VolumeQuotasAdminTestJSON-1648254432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fefbdf4-8590-4009-96b2-14ff840971c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:24.269324 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-c6c6d032-8c9c-4e7e-aeaa-294ae6c08767 tempest-VolumeQuotasAdminTestJSON-1648254432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfa93d2d-becd-46b2-9f01-e1a9a6189ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:24.273858 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-c6c6d032-8c9c-4e7e-aeaa-294ae6c08767 tempest-VolumeQuotasAdminTestJSON-1648254432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfa93d2d-becd-46b2-9f01-e1a9a6189ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1eadae7a-e536-48ec-93f3-95bcabb45751', 'volume_name': 'volume-1eadae7a-e536-48ec-93f3-95bcabb45751', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:24.285849 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-c6c6d032-8c9c-4e7e-aeaa-294ae6c08767 tempest-VolumeQuotasAdminTestJSON-1648254432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7e7a22e-3725-4c39-8d34-0f2150ecb742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:24.293700 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-c6c6d032-8c9c-4e7e-aeaa-294ae6c08767 tempest-VolumeQuotasAdminTestJSON-1648254432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7e7a22e-3725-4c39-8d34-0f2150ecb742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:24.301265 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-c6c6d032-8c9c-4e7e-aeaa-294ae6c08767 tempest-VolumeQuotasAdminTestJSON-1648254432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea8bafd8-a909-46c5-bd60-f22caf78f041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:24.303248 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-c6c6d032-8c9c-4e7e-aeaa-294ae6c08767 tempest-VolumeQuotasAdminTestJSON-1648254432 None] Volume 1eadae7a-e536-48ec-93f3-95bcabb45751: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1eadae7a-e536-48ec-93f3-95bcabb45751', 'volume_size': 1} May 07 22:16:24.304026 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-c6c6d032-8c9c-4e7e-aeaa-294ae6c08767 tempest-VolumeQuotasAdminTestJSON-1648254432 None] creating volume 'volume-1eadae7a-e536-48ec-93f3-95bcabb45751' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:16:24.305411 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-c6c6d032-8c9c-4e7e-aeaa-294ae6c08767 tempest-VolumeQuotasAdminTestJSON-1648254432 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:24.384783 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-69b347da-6437-4c04-9ef9-3e28e1006c69 tempest-VolumesActionsTest-497963316 None] Attaching volume d52eb92e-dfc0-4ab4-8639-1d9fc281fd13 to instance fa6abbec-a7a3-431b-a106-38de1fc2e254 at mountpoint /dev/sdb on host None. May 07 22:16:24.400252 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-c6c6d032-8c9c-4e7e-aeaa-294ae6c08767 tempest-VolumeQuotasAdminTestJSON-1648254432 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:16:24.400810 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-c6c6d032-8c9c-4e7e-aeaa-294ae6c08767 tempest-VolumeQuotasAdminTestJSON-1648254432 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:16:24.406795 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-c6c6d032-8c9c-4e7e-aeaa-294ae6c08767 tempest-VolumeQuotasAdminTestJSON-1648254432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea8bafd8-a909-46c5-bd60-f22caf78f041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1eadae7a-e536-48ec-93f3-95bcabb45751', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:24.411966 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-c6c6d032-8c9c-4e7e-aeaa-294ae6c08767 tempest-VolumeQuotasAdminTestJSON-1648254432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77666c6a-724b-41ea-8fcb-5c86b5bb8f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:24.428382 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-c6c6d032-8c9c-4e7e-aeaa-294ae6c08767 tempest-VolumeQuotasAdminTestJSON-1648254432 None] Volume volume-1eadae7a-e536-48ec-93f3-95bcabb45751 (1eadae7a-e536-48ec-93f3-95bcabb45751): created successfully May 07 22:16:24.432122 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-c6c6d032-8c9c-4e7e-aeaa-294ae6c08767 tempest-VolumeQuotasAdminTestJSON-1648254432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77666c6a-724b-41ea-8fcb-5c86b5bb8f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:24.437811 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-c6c6d032-8c9c-4e7e-aeaa-294ae6c08767 tempest-VolumeQuotasAdminTestJSON-1648254432 None] Flow 'volume_create_manager' (b519e6f2-03cf-47a4-8b96-0e70ef006317) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:16:24.443518 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-69b347da-6437-4c04-9ef9-3e28e1006c69 tempest-VolumesActionsTest-497963316 None] Attach volume completed successfully. May 07 22:16:24.446821 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-c6c6d032-8c9c-4e7e-aeaa-294ae6c08767 tempest-VolumeQuotasAdminTestJSON-1648254432 None] Created volume successfully. May 07 22:16:24.451128 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-69b347da-6437-4c04-9ef9-3e28e1006c69 tempest-VolumesActionsTest-497963316 None] Lock "b'cinder-d52eb92e-dfc0-4ab4-8639-1d9fc281fd13'" released by "attach_volume" :: held 0.291s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:16:24.632610 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-c7586085-f67e-4ac9-8f1d-0f4ad42531ad tempest-VolumesActionsTest-497963316 None] Lock "b'cinder-d52eb92e-dfc0-4ab4-8639-1d9fc281fd13-detach_volume'" acquired by "detach_volume" :: waited 0.008s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:16:24.633084 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-c7586085-f67e-4ac9-8f1d-0f4ad42531ad tempest-VolumesActionsTest-497963316 None] Detaching volume d52eb92e-dfc0-4ab4-8639-1d9fc281fd13 from instance fa6abbec-a7a3-431b-a106-38de1fc2e254. May 07 22:16:24.670450 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-c7586085-f67e-4ac9-8f1d-0f4ad42531ad tempest-VolumesActionsTest-497963316 None] Detach volume completed successfully. May 07 22:16:24.675521 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-c7586085-f67e-4ac9-8f1d-0f4ad42531ad tempest-VolumesActionsTest-497963316 None] Lock "b'cinder-d52eb92e-dfc0-4ab4-8639-1d9fc281fd13-detach_volume'" released by "detach_volume" :: held 0.043s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:16:25.274498 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-3dba3d7d-eb12-4b6e-8496-5cf01caa5eee tempest-VolumeQuotasAdminTestJSON-1648254432 None] Lock "b'cinder-1eadae7a-e536-48ec-93f3-95bcabb45751-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:16:25.321573 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-3dba3d7d-eb12-4b6e-8496-5cf01caa5eee tempest-VolumeQuotasAdminTestJSON-1648254432 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:25.364090 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-3dba3d7d-eb12-4b6e-8496-5cf01caa5eee tempest-VolumeQuotasAdminTestJSON-1648254432 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:16:25.364636 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-3dba3d7d-eb12-4b6e-8496-5cf01caa5eee tempest-VolumeQuotasAdminTestJSON-1648254432 None] Volume volume-1eadae7a-e536-48ec-93f3-95bcabb45751 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:16:25.370111 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-3dba3d7d-eb12-4b6e-8496-5cf01caa5eee tempest-VolumeQuotasAdminTestJSON-1648254432 None] deleting rbd volume volume-1eadae7a-e536-48ec-93f3-95bcabb45751 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:16:25.621819 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-3dba3d7d-eb12-4b6e-8496-5cf01caa5eee tempest-VolumeQuotasAdminTestJSON-1648254432 None] Created reservations ['59b77d4c-a751-4394-af81-2b2301ff294c', '95b2ce35-61af-4789-8efc-cf93ad44a045', 'b8c63d06-5585-46ad-95ac-d646e8b2a191', '2793602d-dd77-4c95-a7f6-7efc55d54b73'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:16:25.665854 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-3dba3d7d-eb12-4b6e-8496-5cf01caa5eee tempest-VolumeQuotasAdminTestJSON-1648254432 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:25.693781 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-3dba3d7d-eb12-4b6e-8496-5cf01caa5eee tempest-VolumeQuotasAdminTestJSON-1648254432 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:25.717666 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-3dba3d7d-eb12-4b6e-8496-5cf01caa5eee tempest-VolumeQuotasAdminTestJSON-1648254432 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:16:25.721948 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-3dba3d7d-eb12-4b6e-8496-5cf01caa5eee tempest-VolumeQuotasAdminTestJSON-1648254432 None] Deleted volume successfully. May 07 22:16:25.734493 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-3dba3d7d-eb12-4b6e-8496-5cf01caa5eee tempest-VolumeQuotasAdminTestJSON-1648254432 None] Lock "b'cinder-1eadae7a-e536-48ec-93f3-95bcabb45751-delete_volume'" released by "delete_volume" :: held 0.460s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:16:26.794736 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-27422b72-b1d2-4161-b97a-0c4cd8f6346b tempest-VolumeQuotasAdminTestJSON-1648254432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:16:26.823021 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-27422b72-b1d2-4161-b97a-0c4cd8f6346b tempest-VolumeQuotasAdminTestJSON-1648254432 None] Flow 'volume_create_manager' (1341c10e-edcf-407e-af0b-e8b09ba35c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:16:26.830615 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-27422b72-b1d2-4161-b97a-0c4cd8f6346b tempest-VolumeQuotasAdminTestJSON-1648254432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b07e15b2-deba-4eff-8aab-f2cefa096323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:26.846314 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-27422b72-b1d2-4161-b97a-0c4cd8f6346b tempest-VolumeQuotasAdminTestJSON-1648254432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b07e15b2-deba-4eff-8aab-f2cefa096323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1854413547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c1d7dfb8-6d22-4c1d-a38e-fca2c00d9e25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1b40dcfd2984f6e970681073445c904',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:16:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:16:27Z,use_quota=True,user_id='bd164563a7524038aac7dd703d2e5b99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:26.851953 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-27422b72-b1d2-4161-b97a-0c4cd8f6346b tempest-VolumeQuotasAdminTestJSON-1648254432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59558f20-8bbc-431d-ab82-3fa35f80af8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:26.856762 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-27422b72-b1d2-4161-b97a-0c4cd8f6346b tempest-VolumeQuotasAdminTestJSON-1648254432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59558f20-8bbc-431d-ab82-3fa35f80af8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:26.862091 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-27422b72-b1d2-4161-b97a-0c4cd8f6346b tempest-VolumeQuotasAdminTestJSON-1648254432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4bd916c-e7e1-488a-9ae8-02469cea091b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:26.866224 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-27422b72-b1d2-4161-b97a-0c4cd8f6346b tempest-VolumeQuotasAdminTestJSON-1648254432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4bd916c-e7e1-488a-9ae8-02469cea091b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1d7dfb8-6d22-4c1d-a38e-fca2c00d9e25', 'volume_name': 'volume-c1d7dfb8-6d22-4c1d-a38e-fca2c00d9e25', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:26.871889 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-27422b72-b1d2-4161-b97a-0c4cd8f6346b tempest-VolumeQuotasAdminTestJSON-1648254432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56625a92-7568-454a-bcd6-af8afb0b69a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:26.875892 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-27422b72-b1d2-4161-b97a-0c4cd8f6346b tempest-VolumeQuotasAdminTestJSON-1648254432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56625a92-7568-454a-bcd6-af8afb0b69a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:26.880734 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-27422b72-b1d2-4161-b97a-0c4cd8f6346b tempest-VolumeQuotasAdminTestJSON-1648254432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f9727b2-eb36-4ece-8425-b00f12815cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:26.881832 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-27422b72-b1d2-4161-b97a-0c4cd8f6346b tempest-VolumeQuotasAdminTestJSON-1648254432 None] Volume c1d7dfb8-6d22-4c1d-a38e-fca2c00d9e25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1d7dfb8-6d22-4c1d-a38e-fca2c00d9e25', 'volume_size': 1} May 07 22:16:26.882219 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-27422b72-b1d2-4161-b97a-0c4cd8f6346b tempest-VolumeQuotasAdminTestJSON-1648254432 None] creating volume 'volume-c1d7dfb8-6d22-4c1d-a38e-fca2c00d9e25' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:16:26.883029 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-27422b72-b1d2-4161-b97a-0c4cd8f6346b tempest-VolumeQuotasAdminTestJSON-1648254432 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:26.942191 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-27422b72-b1d2-4161-b97a-0c4cd8f6346b tempest-VolumeQuotasAdminTestJSON-1648254432 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:16:26.942598 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-27422b72-b1d2-4161-b97a-0c4cd8f6346b tempest-VolumeQuotasAdminTestJSON-1648254432 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:16:26.946420 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-27422b72-b1d2-4161-b97a-0c4cd8f6346b tempest-VolumeQuotasAdminTestJSON-1648254432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f9727b2-eb36-4ece-8425-b00f12815cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1d7dfb8-6d22-4c1d-a38e-fca2c00d9e25', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:26.951251 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-27422b72-b1d2-4161-b97a-0c4cd8f6346b tempest-VolumeQuotasAdminTestJSON-1648254432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (511a5ca4-e347-4b14-a2c1-affb380717aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:26.960130 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-27422b72-b1d2-4161-b97a-0c4cd8f6346b tempest-VolumeQuotasAdminTestJSON-1648254432 None] Volume volume-c1d7dfb8-6d22-4c1d-a38e-fca2c00d9e25 (c1d7dfb8-6d22-4c1d-a38e-fca2c00d9e25): created successfully May 07 22:16:26.963904 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-27422b72-b1d2-4161-b97a-0c4cd8f6346b tempest-VolumeQuotasAdminTestJSON-1648254432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (511a5ca4-e347-4b14-a2c1-affb380717aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:26.969684 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-27422b72-b1d2-4161-b97a-0c4cd8f6346b tempest-VolumeQuotasAdminTestJSON-1648254432 None] Flow 'volume_create_manager' (1341c10e-edcf-407e-af0b-e8b09ba35c9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:16:26.976946 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-27422b72-b1d2-4161-b97a-0c4cd8f6346b tempest-VolumeQuotasAdminTestJSON-1648254432 None] Created volume successfully. May 07 22:16:28.103018 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [None req-b0ac375c-1e48-446a-9017-2b7c4adecb10 tempest-VolumesActionsTest-497963316 None] Running cmd (subprocess): rbd export --pool volumes volume-d52eb92e-dfc0-4ab4-8639-1d9fc281fd13 /opt/stack/data/cinder/conversion/volume-d52eb92e-dfc0-4ab4-8639-1d9fc281fd13-0f15ad59-e8a6-4a0d-816b-5be8d7ba82ac --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 22:16:28.424919 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-55e61c35-7124-4bcb-88ca-f25d3aecabaa tempest-VolumeQuotasAdminTestJSON-63021359 None] Transfer volume completed successfully. May 07 22:16:28.693618 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [None req-b0ac375c-1e48-446a-9017-2b7c4adecb10 tempest-VolumesActionsTest-497963316 None] CMD "rbd export --pool volumes volume-d52eb92e-dfc0-4ab4-8639-1d9fc281fd13 /opt/stack/data/cinder/conversion/volume-d52eb92e-dfc0-4ab4-8639-1d9fc281fd13-0f15ad59-e8a6-4a0d-816b-5be8d7ba82ac --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.591s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 22:16:28.701758 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.image_utils [None req-b0ac375c-1e48-446a-9017-2b7c4adecb10 tempest-VolumesActionsTest-497963316 None] 0f15ad59-e8a6-4a0d-816b-5be8d7ba82ac was raw, no need to convert to raw {{(pid=129946) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:815}} May 07 22:16:28.844170 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-9bcd4481-4d6a-4017-8d8b-eb528898885f tempest-VolumeQuotasAdminTestJSON-830826833 None] Lock "b'cinder-c1d7dfb8-6d22-4c1d-a38e-fca2c00d9e25-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:16:28.876306 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-9bcd4481-4d6a-4017-8d8b-eb528898885f tempest-VolumeQuotasAdminTestJSON-830826833 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:28.921191 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-9bcd4481-4d6a-4017-8d8b-eb528898885f tempest-VolumeQuotasAdminTestJSON-830826833 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:16:28.921688 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-9bcd4481-4d6a-4017-8d8b-eb528898885f tempest-VolumeQuotasAdminTestJSON-830826833 None] Volume volume-c1d7dfb8-6d22-4c1d-a38e-fca2c00d9e25 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:16:28.927968 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-9bcd4481-4d6a-4017-8d8b-eb528898885f tempest-VolumeQuotasAdminTestJSON-830826833 None] deleting rbd volume volume-c1d7dfb8-6d22-4c1d-a38e-fca2c00d9e25 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:16:29.316088 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-9bcd4481-4d6a-4017-8d8b-eb528898885f tempest-VolumeQuotasAdminTestJSON-830826833 None] Created reservations ['5ae5da3c-1e04-4e80-a10f-d1c9404697b9', 'eab4d609-0199-44f1-a5c8-ad31d91e2625', '564d7daf-67f0-4830-8249-b55b179c6e26', 'f940f5cb-1978-437f-8afc-da8d22586660'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:16:29.378757 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-9bcd4481-4d6a-4017-8d8b-eb528898885f tempest-VolumeQuotasAdminTestJSON-830826833 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:29.429868 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-9bcd4481-4d6a-4017-8d8b-eb528898885f tempest-VolumeQuotasAdminTestJSON-830826833 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:29.457546 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-9bcd4481-4d6a-4017-8d8b-eb528898885f tempest-VolumeQuotasAdminTestJSON-830826833 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:16:29.463624 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-9bcd4481-4d6a-4017-8d8b-eb528898885f tempest-VolumeQuotasAdminTestJSON-830826833 None] Deleted volume successfully. May 07 22:16:29.483244 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-9bcd4481-4d6a-4017-8d8b-eb528898885f tempest-VolumeQuotasAdminTestJSON-830826833 None] Lock "b'cinder-c1d7dfb8-6d22-4c1d-a38e-fca2c00d9e25-delete_volume'" released by "delete_volume" :: held 0.639s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:16:31.201572 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:16:31.206150 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:31.281305 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:31.333226 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:16:43.489068 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-d68f82fb-be57-4bbf-bb98-8fca3f1d1c1a tempest-SnapshotMetadataTestJSON-929793752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:16:43.513725 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d68f82fb-be57-4bbf-bb98-8fca3f1d1c1a tempest-SnapshotMetadataTestJSON-929793752 None] Flow 'volume_create_manager' (e0871a00-3b64-4dfc-83ea-43b6407aed0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:16:43.526884 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d68f82fb-be57-4bbf-bb98-8fca3f1d1c1a tempest-SnapshotMetadataTestJSON-929793752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8699d11e-7958-4fd6-96f1-551a60f1931d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:43.539540 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d68f82fb-be57-4bbf-bb98-8fca3f1d1c1a tempest-SnapshotMetadataTestJSON-929793752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8699d11e-7958-4fd6-96f1-551a60f1931d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2112579618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8d02d931-a340-495e-97f6-90bd5846c1a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da2cd9f873674463a0d54570586512c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:16:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:16:43Z,use_quota=True,user_id='5b004d5e8c6743dda2f9983b1679ee9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:43.545442 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d68f82fb-be57-4bbf-bb98-8fca3f1d1c1a tempest-SnapshotMetadataTestJSON-929793752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b271a6e9-720c-456f-aadb-16d09f9b3149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:43.550249 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d68f82fb-be57-4bbf-bb98-8fca3f1d1c1a tempest-SnapshotMetadataTestJSON-929793752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b271a6e9-720c-456f-aadb-16d09f9b3149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:43.555612 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d68f82fb-be57-4bbf-bb98-8fca3f1d1c1a tempest-SnapshotMetadataTestJSON-929793752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3b914e1-73fc-446d-9cad-66d054bd9b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:43.560168 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d68f82fb-be57-4bbf-bb98-8fca3f1d1c1a tempest-SnapshotMetadataTestJSON-929793752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3b914e1-73fc-446d-9cad-66d054bd9b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d02d931-a340-495e-97f6-90bd5846c1a1', 'volume_name': 'volume-8d02d931-a340-495e-97f6-90bd5846c1a1', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:43.565212 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d68f82fb-be57-4bbf-bb98-8fca3f1d1c1a tempest-SnapshotMetadataTestJSON-929793752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ffc92e6-033e-426f-95e9-79db990fb19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:43.569532 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d68f82fb-be57-4bbf-bb98-8fca3f1d1c1a tempest-SnapshotMetadataTestJSON-929793752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ffc92e6-033e-426f-95e9-79db990fb19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:43.574980 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d68f82fb-be57-4bbf-bb98-8fca3f1d1c1a tempest-SnapshotMetadataTestJSON-929793752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (948a4114-1080-4ada-a5b1-417a48c940b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:43.576122 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-d68f82fb-be57-4bbf-bb98-8fca3f1d1c1a tempest-SnapshotMetadataTestJSON-929793752 None] Volume 8d02d931-a340-495e-97f6-90bd5846c1a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d02d931-a340-495e-97f6-90bd5846c1a1', 'volume_size': 1} May 07 22:16:43.576583 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d68f82fb-be57-4bbf-bb98-8fca3f1d1c1a tempest-SnapshotMetadataTestJSON-929793752 None] creating volume 'volume-8d02d931-a340-495e-97f6-90bd5846c1a1' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:16:43.577403 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d68f82fb-be57-4bbf-bb98-8fca3f1d1c1a tempest-SnapshotMetadataTestJSON-929793752 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:43.774058 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d68f82fb-be57-4bbf-bb98-8fca3f1d1c1a tempest-SnapshotMetadataTestJSON-929793752 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:16:43.774444 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d68f82fb-be57-4bbf-bb98-8fca3f1d1c1a tempest-SnapshotMetadataTestJSON-929793752 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:16:43.778241 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d68f82fb-be57-4bbf-bb98-8fca3f1d1c1a tempest-SnapshotMetadataTestJSON-929793752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (948a4114-1080-4ada-a5b1-417a48c940b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d02d931-a340-495e-97f6-90bd5846c1a1', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:43.783169 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d68f82fb-be57-4bbf-bb98-8fca3f1d1c1a tempest-SnapshotMetadataTestJSON-929793752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6514b01-7210-40ec-aa18-094f457665d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:43.794155 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-d68f82fb-be57-4bbf-bb98-8fca3f1d1c1a tempest-SnapshotMetadataTestJSON-929793752 None] Volume volume-8d02d931-a340-495e-97f6-90bd5846c1a1 (8d02d931-a340-495e-97f6-90bd5846c1a1): created successfully May 07 22:16:43.798068 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d68f82fb-be57-4bbf-bb98-8fca3f1d1c1a tempest-SnapshotMetadataTestJSON-929793752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6514b01-7210-40ec-aa18-094f457665d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:43.804648 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-d68f82fb-be57-4bbf-bb98-8fca3f1d1c1a tempest-SnapshotMetadataTestJSON-929793752 None] Flow 'volume_create_manager' (e0871a00-3b64-4dfc-83ea-43b6407aed0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:16:43.821062 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-d68f82fb-be57-4bbf-bb98-8fca3f1d1c1a tempest-SnapshotMetadataTestJSON-929793752 None] Created volume successfully. May 07 22:16:44.773621 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-5fb24f1f-78b8-4f6e-b6c4-e754521ce922 tempest-SnapshotMetadataTestJSON-929793752 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:45.810076 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-5fb24f1f-78b8-4f6e-b6c4-e754521ce922 tempest-SnapshotMetadataTestJSON-929793752 None] Create snapshot completed successfully May 07 22:16:47.336673 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-b0ac375c-1e48-446a-9017-2b7c4adecb10 tempest-VolumesActionsTest-497963316 None] Uploaded volume to glance image-id: 0f15ad59-e8a6-4a0d-816b-5be8d7ba82ac. {{(pid=129946) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1747}} May 07 22:16:47.352665 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-b0ac375c-1e48-446a-9017-2b7c4adecb10 tempest-VolumesActionsTest-497963316 None] Copy volume to image completed successfully. May 07 22:16:47.442002 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-992db359-ec10-43f3-b30c-3a6845469929 tempest-SnapshotMetadataTestJSON-929793752 None] Lock "b'cinder-48497bc5-a750-4136-8595-1d86bcf1f6e9-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.008s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:16:47.443521 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-992db359-ec10-43f3-b30c-3a6845469929 tempest-SnapshotMetadataTestJSON-929793752 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:47.830029 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-992db359-ec10-43f3-b30c-3a6845469929 tempest-SnapshotMetadataTestJSON-929793752 None] Created reservations ['5a22fe19-7550-40df-9620-8b996aea74af', 'cbed7e9d-0853-46b0-a191-dce9c4cc7884', 'dba4a321-0b22-4b14-8ab4-7874974d7a18', '2ffcf2b8-3ed3-470e-9586-e14ff60dd820'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:16:47.864317 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-992db359-ec10-43f3-b30c-3a6845469929 tempest-SnapshotMetadataTestJSON-929793752 None] Delete snapshot completed successfully. May 07 22:16:47.869205 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-992db359-ec10-43f3-b30c-3a6845469929 tempest-SnapshotMetadataTestJSON-929793752 None] Lock "b'cinder-48497bc5-a750-4136-8595-1d86bcf1f6e9-delete_snapshot'" released by "delete_snapshot" :: held 0.427s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:16:48.346100 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-d5cd7a3a-b2b7-4149-b8f1-b48a4fd4cc48 tempest-VolumesActionsTest-497963316 None] Lock "b'cinder-d52eb92e-dfc0-4ab4-8639-1d9fc281fd13-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:16:48.376297 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d5cd7a3a-b2b7-4149-b8f1-b48a4fd4cc48 tempest-VolumesActionsTest-497963316 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:48.418601 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d5cd7a3a-b2b7-4149-b8f1-b48a4fd4cc48 tempest-VolumesActionsTest-497963316 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:16:48.419313 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d5cd7a3a-b2b7-4149-b8f1-b48a4fd4cc48 tempest-VolumesActionsTest-497963316 None] Volume volume-d52eb92e-dfc0-4ab4-8639-1d9fc281fd13 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:16:48.425153 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d5cd7a3a-b2b7-4149-b8f1-b48a4fd4cc48 tempest-VolumesActionsTest-497963316 None] deleting rbd volume volume-d52eb92e-dfc0-4ab4-8639-1d9fc281fd13 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:16:48.544007 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-0a3e316c-3e89-4a5a-ac59-f318c1085333 tempest-SnapshotMetadataTestJSON-929793752 None] Lock "b'cinder-8d02d931-a340-495e-97f6-90bd5846c1a1-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:16:48.580458 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0a3e316c-3e89-4a5a-ac59-f318c1085333 tempest-SnapshotMetadataTestJSON-929793752 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:48.631277 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0a3e316c-3e89-4a5a-ac59-f318c1085333 tempest-SnapshotMetadataTestJSON-929793752 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:16:48.631753 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0a3e316c-3e89-4a5a-ac59-f318c1085333 tempest-SnapshotMetadataTestJSON-929793752 None] Volume volume-8d02d931-a340-495e-97f6-90bd5846c1a1 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:16:48.637222 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0a3e316c-3e89-4a5a-ac59-f318c1085333 tempest-SnapshotMetadataTestJSON-929793752 None] deleting rbd volume volume-8d02d931-a340-495e-97f6-90bd5846c1a1 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:16:48.679826 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-d5cd7a3a-b2b7-4149-b8f1-b48a4fd4cc48 tempest-VolumesActionsTest-497963316 None] Created reservations ['23ad6d4e-e1d9-4f5a-a681-a5ed240047a1', 'd909047c-d5f4-45a8-b14e-e60e8b2bcd36', '0cbb8902-1ec8-433b-9399-d2759416e969', '23c737e9-4b39-4861-bdac-0a4bef8e0144'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:16:48.726193 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d5cd7a3a-b2b7-4149-b8f1-b48a4fd4cc48 tempest-VolumesActionsTest-497963316 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:48.757759 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d5cd7a3a-b2b7-4149-b8f1-b48a4fd4cc48 tempest-VolumesActionsTest-497963316 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:48.784580 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-d5cd7a3a-b2b7-4149-b8f1-b48a4fd4cc48 tempest-VolumesActionsTest-497963316 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:16:48.789558 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-d5cd7a3a-b2b7-4149-b8f1-b48a4fd4cc48 tempest-VolumesActionsTest-497963316 None] Deleted volume successfully. May 07 22:16:48.804269 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-d5cd7a3a-b2b7-4149-b8f1-b48a4fd4cc48 tempest-VolumesActionsTest-497963316 None] Lock "b'cinder-d52eb92e-dfc0-4ab4-8639-1d9fc281fd13-delete_volume'" released by "delete_volume" :: held 0.458s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:16:48.872857 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-0a3e316c-3e89-4a5a-ac59-f318c1085333 tempest-SnapshotMetadataTestJSON-929793752 None] Created reservations ['34c251fa-9b21-44c0-bd8e-1ec973654d88', '5240dcd7-58f1-4d5d-9c4a-51764c90fc69', '5cfabe49-3e17-4a22-bc32-1c6ee884142c', '43409ad4-2e54-481c-9bfa-e81cd29cce34'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:16:48.919568 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0a3e316c-3e89-4a5a-ac59-f318c1085333 tempest-SnapshotMetadataTestJSON-929793752 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:48.942197 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0a3e316c-3e89-4a5a-ac59-f318c1085333 tempest-SnapshotMetadataTestJSON-929793752 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:48.964196 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-0a3e316c-3e89-4a5a-ac59-f318c1085333 tempest-SnapshotMetadataTestJSON-929793752 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:16:48.968613 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-0a3e316c-3e89-4a5a-ac59-f318c1085333 tempest-SnapshotMetadataTestJSON-929793752 None] Deleted volume successfully. May 07 22:16:48.980142 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-0a3e316c-3e89-4a5a-ac59-f318c1085333 tempest-SnapshotMetadataTestJSON-929793752 None] Lock "b'cinder-8d02d931-a340-495e-97f6-90bd5846c1a1-delete_volume'" released by "delete_volume" :: held 0.436s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:16:51.754225 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-8456e90b-4e34-4358-815b-6f3bf124e51a tempest-VolumesMetadataTest-2136788933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:16:51.776150 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-8456e90b-4e34-4358-815b-6f3bf124e51a tempest-VolumesMetadataTest-2136788933 None] Flow 'volume_create_manager' (1e8304e0-e5c1-4425-a798-792e949b5f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:16:51.783408 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-8456e90b-4e34-4358-815b-6f3bf124e51a tempest-VolumesMetadataTest-2136788933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a77930a-af8a-4a22-ac04-a76bb66224ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:51.798949 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-8456e90b-4e34-4358-815b-6f3bf124e51a tempest-VolumesMetadataTest-2136788933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a77930a-af8a-4a22-ac04-a76bb66224ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-767847963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=375cd014-1927-45f6-9e43-24734c9bdbab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a3f46c126714930aca88fe9624bfe80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:16:52Z,use_quota=True,user_id='9eb6ede5766f4a6cad923de222ac01ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:51.804707 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-8456e90b-4e34-4358-815b-6f3bf124e51a tempest-VolumesMetadataTest-2136788933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51e0a022-45e4-4a32-a023-8410a8d8dc3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:51.809005 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-8456e90b-4e34-4358-815b-6f3bf124e51a tempest-VolumesMetadataTest-2136788933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51e0a022-45e4-4a32-a023-8410a8d8dc3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:51.814472 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-8456e90b-4e34-4358-815b-6f3bf124e51a tempest-VolumesMetadataTest-2136788933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64867332-0e4a-4aea-a798-8753436688ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:51.818795 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-8456e90b-4e34-4358-815b-6f3bf124e51a tempest-VolumesMetadataTest-2136788933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64867332-0e4a-4aea-a798-8753436688ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '375cd014-1927-45f6-9e43-24734c9bdbab', 'volume_name': 'volume-375cd014-1927-45f6-9e43-24734c9bdbab', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:51.825241 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-8456e90b-4e34-4358-815b-6f3bf124e51a tempest-VolumesMetadataTest-2136788933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baeaec1c-aeda-4282-ba55-2b213ba30b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:51.829684 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-8456e90b-4e34-4358-815b-6f3bf124e51a tempest-VolumesMetadataTest-2136788933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baeaec1c-aeda-4282-ba55-2b213ba30b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:51.834572 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-8456e90b-4e34-4358-815b-6f3bf124e51a tempest-VolumesMetadataTest-2136788933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96694319-0bd0-4bb2-b152-dfb684318afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:51.835677 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-8456e90b-4e34-4358-815b-6f3bf124e51a tempest-VolumesMetadataTest-2136788933 None] Volume 375cd014-1927-45f6-9e43-24734c9bdbab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-375cd014-1927-45f6-9e43-24734c9bdbab', 'volume_size': 1} May 07 22:16:51.836074 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-8456e90b-4e34-4358-815b-6f3bf124e51a tempest-VolumesMetadataTest-2136788933 None] creating volume 'volume-375cd014-1927-45f6-9e43-24734c9bdbab' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:16:51.836993 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-8456e90b-4e34-4358-815b-6f3bf124e51a tempest-VolumesMetadataTest-2136788933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:51.902361 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-8456e90b-4e34-4358-815b-6f3bf124e51a tempest-VolumesMetadataTest-2136788933 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:16:51.902844 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-8456e90b-4e34-4358-815b-6f3bf124e51a tempest-VolumesMetadataTest-2136788933 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:16:51.906682 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-8456e90b-4e34-4358-815b-6f3bf124e51a tempest-VolumesMetadataTest-2136788933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96694319-0bd0-4bb2-b152-dfb684318afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-375cd014-1927-45f6-9e43-24734c9bdbab', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:51.911639 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-8456e90b-4e34-4358-815b-6f3bf124e51a tempest-VolumesMetadataTest-2136788933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57f9afc3-2203-4222-a898-e12fa11d9e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:51.929012 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-8456e90b-4e34-4358-815b-6f3bf124e51a tempest-VolumesMetadataTest-2136788933 None] Volume volume-375cd014-1927-45f6-9e43-24734c9bdbab (375cd014-1927-45f6-9e43-24734c9bdbab): created successfully May 07 22:16:51.932698 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-8456e90b-4e34-4358-815b-6f3bf124e51a tempest-VolumesMetadataTest-2136788933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57f9afc3-2203-4222-a898-e12fa11d9e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:51.938911 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-8456e90b-4e34-4358-815b-6f3bf124e51a tempest-VolumesMetadataTest-2136788933 None] Flow 'volume_create_manager' (1e8304e0-e5c1-4425-a798-792e949b5f2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:16:51.951828 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-8456e90b-4e34-4358-815b-6f3bf124e51a tempest-VolumesMetadataTest-2136788933 None] Created volume successfully. May 07 22:16:51.956927 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-f53b4afb-8ea9-4879-8d42-dcee1eec9bd4 tempest-VolumesExtendTest-1349521331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:16:51.975771 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f53b4afb-8ea9-4879-8d42-dcee1eec9bd4 tempest-VolumesExtendTest-1349521331 None] Flow 'volume_create_manager' (bcbe2f61-6972-4817-a63e-343ae17a2469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:16:51.982829 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f53b4afb-8ea9-4879-8d42-dcee1eec9bd4 tempest-VolumesExtendTest-1349521331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b04c2a16-6a46-4732-bcf0-1e050edca375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:51.998865 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f53b4afb-8ea9-4879-8d42-dcee1eec9bd4 tempest-VolumesExtendTest-1349521331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b04c2a16-6a46-4732-bcf0-1e050edca375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-728868454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=40eb2681-c8fa-47fa-9d8c-c027652390b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='117ff6231e96434ab97d7e6405af2765',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:16:52Z,use_quota=True,user_id='1e52fc614b774d13a38bbcbbe94a419d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:52.004352 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f53b4afb-8ea9-4879-8d42-dcee1eec9bd4 tempest-VolumesExtendTest-1349521331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ff96fbb-ae6a-44e6-8da3-d57a1dee1869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:52.008567 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f53b4afb-8ea9-4879-8d42-dcee1eec9bd4 tempest-VolumesExtendTest-1349521331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ff96fbb-ae6a-44e6-8da3-d57a1dee1869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:52.014536 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f53b4afb-8ea9-4879-8d42-dcee1eec9bd4 tempest-VolumesExtendTest-1349521331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b3af79d-d120-4b8a-b7a1-ab8bd8a3785a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:52.092833 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f53b4afb-8ea9-4879-8d42-dcee1eec9bd4 tempest-VolumesExtendTest-1349521331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b3af79d-d120-4b8a-b7a1-ab8bd8a3785a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '40eb2681-c8fa-47fa-9d8c-c027652390b1', 'volume_name': 'volume-40eb2681-c8fa-47fa-9d8c-c027652390b1', 'volume_size': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e2f828af0706465883131e16cb564d05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'created_at': datetime.datetime(2022, 5, 7, 21, 36, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:52.098033 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f53b4afb-8ea9-4879-8d42-dcee1eec9bd4 tempest-VolumesExtendTest-1349521331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d06435ef-3ac7-4626-9063-5e85946e468e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:52.102131 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f53b4afb-8ea9-4879-8d42-dcee1eec9bd4 tempest-VolumesExtendTest-1349521331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d06435ef-3ac7-4626-9063-5e85946e468e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:52.107012 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f53b4afb-8ea9-4879-8d42-dcee1eec9bd4 tempest-VolumesExtendTest-1349521331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32b9682f-4910-457d-872e-9b9f1aa1b0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:52.108075 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-f53b4afb-8ea9-4879-8d42-dcee1eec9bd4 tempest-VolumesExtendTest-1349521331 None] Volume 40eb2681-c8fa-47fa-9d8c-c027652390b1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-40eb2681-c8fa-47fa-9d8c-c027652390b1', 'volume_size': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e2f828af0706465883131e16cb564d05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'created_at': datetime.datetime(2022, 5, 7, 21, 36, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } May 07 22:16:52.108651 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-f53b4afb-8ea9-4879-8d42-dcee1eec9bd4 tempest-VolumesExtendTest-1349521331 None] Cloning 40eb2681-c8fa-47fa-9d8c-c027652390b1 from image 3756ae98-5c12-48e7-920e-ef5d1dd5543c at location (None, None). {{(pid=129946) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} May 07 22:16:52.117953 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-f53b4afb-8ea9-4879-8d42-dcee1eec9bd4 tempest-VolumesExtendTest-1349521331 None] Lock "b'cinder-3756ae98-5c12-48e7-920e-ef5d1dd5543c'" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:16:52.127881 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-f53b4afb-8ea9-4879-8d42-dcee1eec9bd4 tempest-VolumesExtendTest-1349521331 None] Found image-volume cache entry: {'id': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'volume_id': '82279f40-9683-441f-a541-0db8b9177f48', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9), 'last_used': datetime.datetime(2022, 5, 7, 22, 16, 52, 122888)}. {{(pid=129946) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 07 22:16:52.128460 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-f53b4afb-8ea9-4879-8d42-dcee1eec9bd4 tempest-VolumesExtendTest-1349521331 None] Image-volume cache entry image_update_at = 2022-05-07 21:37:09+00:00, requested image updated_at = 2022-05-07 21:37:09+00:00. {{(pid=129946) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 07 22:16:52.129005 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-f53b4afb-8ea9-4879-8d42-dcee1eec9bd4 tempest-VolumesExtendTest-1349521331 None] Found cache entry for image = 3756ae98-5c12-48e7-920e-ef5d1dd5543c on host ncdv-master-1@ceph#ceph. {{(pid=129946) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} May 07 22:16:52.132954 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-f53b4afb-8ea9-4879-8d42-dcee1eec9bd4 tempest-VolumesExtendTest-1349521331 None] Lock "b'cinder-3756ae98-5c12-48e7-920e-ef5d1dd5543c'" released by "_prepare_image_cache_entry" :: held 0.015s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:16:52.133827 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-f53b4afb-8ea9-4879-8d42-dcee1eec9bd4 tempest-VolumesExtendTest-1349521331 None] Attempting to retrieve cache entry for image = 3756ae98-5c12-48e7-920e-ef5d1dd5543c on host ncdv-master-1@ceph#ceph. {{(pid=129946) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} May 07 22:16:52.139672 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-f53b4afb-8ea9-4879-8d42-dcee1eec9bd4 tempest-VolumesExtendTest-1349521331 None] Found image-volume cache entry: {'id': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'volume_id': '82279f40-9683-441f-a541-0db8b9177f48', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9), 'last_used': datetime.datetime(2022, 5, 7, 22, 16, 52, 137522)}. {{(pid=129946) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 07 22:16:52.140088 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-f53b4afb-8ea9-4879-8d42-dcee1eec9bd4 tempest-VolumesExtendTest-1349521331 None] Image-volume cache entry image_update_at = 2022-05-07 21:37:09+00:00, requested image updated_at = 2022-05-07 21:37:09+00:00. {{(pid=129946) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 07 22:16:52.140475 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-f53b4afb-8ea9-4879-8d42-dcee1eec9bd4 tempest-VolumesExtendTest-1349521331 None] Creating from source image-volume 82279f40-9683-441f-a541-0db8b9177f48 {{(pid=129946) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} May 07 22:16:52.151491 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-f53b4afb-8ea9-4879-8d42-dcee1eec9bd4 tempest-VolumesExtendTest-1349521331 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:52.203151 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-f53b4afb-8ea9-4879-8d42-dcee1eec9bd4 tempest-VolumesExtendTest-1349521331 None] creating snapshot='volume-40eb2681-c8fa-47fa-9d8c-c027652390b1.clone_snap' {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} May 07 22:16:52.822247 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-f53b4afb-8ea9-4879-8d42-dcee1eec9bd4 tempest-VolumesExtendTest-1349521331 None] cloning 'volume-82279f40-9683-441f-a541-0db8b9177f48@volume-40eb2681-c8fa-47fa-9d8c-c027652390b1.clone_snap' to 'volume-40eb2681-c8fa-47fa-9d8c-c027652390b1' {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 07 22:16:52.973210 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-f53b4afb-8ea9-4879-8d42-dcee1eec9bd4 tempest-VolumesExtendTest-1349521331 None] Volume volume-3864f924-91b4-4015-ab37-8bdbf8ad652d.deleted is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:16:52.974882 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-f53b4afb-8ea9-4879-8d42-dcee1eec9bd4 tempest-VolumesExtendTest-1349521331 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:16:52.975261 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-f53b4afb-8ea9-4879-8d42-dcee1eec9bd4 tempest-VolumesExtendTest-1349521331 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:16:52.998258 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-f53b4afb-8ea9-4879-8d42-dcee1eec9bd4 tempest-VolumesExtendTest-1349521331 None] clone created successfully {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} May 07 22:16:52.999091 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.volume_utils [None req-f53b4afb-8ea9-4879-8d42-dcee1eec9bd4 tempest-VolumesExtendTest-1349521331 None] Marking volume 40eb2681-c8fa-47fa-9d8c-c027652390b1 as bootable. {{(pid=129946) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} May 07 22:16:53.008509 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-f53b4afb-8ea9-4879-8d42-dcee1eec9bd4 tempest-VolumesExtendTest-1349521331 None] Copying metadata from image 3756ae98-5c12-48e7-920e-ef5d1dd5543c to 40eb2681-c8fa-47fa-9d8c-c027652390b1. {{(pid=129946) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} May 07 22:16:53.008926 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-f53b4afb-8ea9-4879-8d42-dcee1eec9bd4 tempest-VolumesExtendTest-1349521331 None] Creating volume glance metadata for volume 40eb2681-c8fa-47fa-9d8c-c027652390b1 backed by image 3756ae98-5c12-48e7-920e-ef5d1dd5543c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129946) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} May 07 22:16:53.076637 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f53b4afb-8ea9-4879-8d42-dcee1eec9bd4 tempest-VolumesExtendTest-1349521331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32b9682f-4910-457d-872e-9b9f1aa1b0b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40eb2681-c8fa-47fa-9d8c-c027652390b1', 'volume_size': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e2f828af0706465883131e16cb564d05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'created_at': datetime.datetime(2022, 5, 7, 21, 36, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:53.084775 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f53b4afb-8ea9-4879-8d42-dcee1eec9bd4 tempest-VolumesExtendTest-1349521331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a84b86e0-3358-4c5f-a920-cf788a92395a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:53.096488 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-f53b4afb-8ea9-4879-8d42-dcee1eec9bd4 tempest-VolumesExtendTest-1349521331 None] Volume volume-40eb2681-c8fa-47fa-9d8c-c027652390b1 (40eb2681-c8fa-47fa-9d8c-c027652390b1): created successfully May 07 22:16:53.101139 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f53b4afb-8ea9-4879-8d42-dcee1eec9bd4 tempest-VolumesExtendTest-1349521331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a84b86e0-3358-4c5f-a920-cf788a92395a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:53.108357 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-f53b4afb-8ea9-4879-8d42-dcee1eec9bd4 tempest-VolumesExtendTest-1349521331 None] Flow 'volume_create_manager' (bcbe2f61-6972-4817-a63e-343ae17a2469) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:16:53.118273 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-f53b4afb-8ea9-4879-8d42-dcee1eec9bd4 tempest-VolumesExtendTest-1349521331 None] Created volume successfully. May 07 22:16:53.366980 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-9ff803d4-3b62-4a7a-9992-77f1f200471a tempest-VolumesMetadataTest-2136788933 None] Lock "b'cinder-375cd014-1927-45f6-9e43-24734c9bdbab-delete_volume'" acquired by "delete_volume" :: waited 0.008s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:16:53.407550 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-9ff803d4-3b62-4a7a-9992-77f1f200471a tempest-VolumesMetadataTest-2136788933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:53.439403 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-9ff803d4-3b62-4a7a-9992-77f1f200471a tempest-VolumesMetadataTest-2136788933 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:16:53.439852 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-9ff803d4-3b62-4a7a-9992-77f1f200471a tempest-VolumesMetadataTest-2136788933 None] Volume volume-375cd014-1927-45f6-9e43-24734c9bdbab is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:16:53.444560 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-9ff803d4-3b62-4a7a-9992-77f1f200471a tempest-VolumesMetadataTest-2136788933 None] deleting rbd volume volume-375cd014-1927-45f6-9e43-24734c9bdbab {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:16:53.650035 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-9ff803d4-3b62-4a7a-9992-77f1f200471a tempest-VolumesMetadataTest-2136788933 None] Created reservations ['bfb3e067-a78e-4d10-866c-ed3ef5181fde', '1ae76b9e-3a1d-41ea-aacc-be099aaa9a4a', 'd76b1220-dd3e-4f8f-a306-9ce382cf65cc', '9d26b44b-c6dd-41ef-9c52-fef7ba00320d'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:16:53.692936 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-9ff803d4-3b62-4a7a-9992-77f1f200471a tempest-VolumesMetadataTest-2136788933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:53.716003 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-9ff803d4-3b62-4a7a-9992-77f1f200471a tempest-VolumesMetadataTest-2136788933 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:53.738462 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-9ff803d4-3b62-4a7a-9992-77f1f200471a tempest-VolumesMetadataTest-2136788933 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:16:53.742569 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-9ff803d4-3b62-4a7a-9992-77f1f200471a tempest-VolumesMetadataTest-2136788933 None] Deleted volume successfully. May 07 22:16:53.754168 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-9ff803d4-3b62-4a7a-9992-77f1f200471a tempest-VolumesMetadataTest-2136788933 None] Lock "b'cinder-375cd014-1927-45f6-9e43-24734c9bdbab-delete_volume'" released by "delete_volume" :: held 0.387s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:16:54.115155 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-91027f10-ba07-44a7-9550-38618673c3ab tempest-VolumesExtendTest-1349521331 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:54.234484 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-91027f10-ba07-44a7-9550-38618673c3ab tempest-VolumesExtendTest-1349521331 None] Extend volume from 1 GB to 2 GB. {{(pid=129946) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1875}} May 07 22:16:54.259884 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-91027f10-ba07-44a7-9550-38618673c3ab tempest-VolumesExtendTest-1349521331 None] Extend volume completed successfully. May 07 22:16:55.577120 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-db1eac1c-6574-4b1a-b031-70548e11b562 tempest-VolumesExtendTest-1349521331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:16:55.599894 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-db1eac1c-6574-4b1a-b031-70548e11b562 tempest-VolumesExtendTest-1349521331 None] Flow 'volume_create_manager' (38bc6c06-36ea-49a2-a230-43e7e6cac668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:16:55.607267 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-db1eac1c-6574-4b1a-b031-70548e11b562 tempest-VolumesExtendTest-1349521331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4188ea7f-7b20-4253-8ddd-cb00184ab231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:55.624520 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-db1eac1c-6574-4b1a-b031-70548e11b562 tempest-VolumesExtendTest-1349521331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4188ea7f-7b20-4253-8ddd-cb00184ab231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-907158290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=affef0a0-400e-47d4-a183-271864e88443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='117ff6231e96434ab97d7e6405af2765',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:16:56Z,use_quota=True,user_id='1e52fc614b774d13a38bbcbbe94a419d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:55.630392 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-db1eac1c-6574-4b1a-b031-70548e11b562 tempest-VolumesExtendTest-1349521331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (226db9d5-ff55-4f0d-8f33-9c6184ed8377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:55.634721 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-db1eac1c-6574-4b1a-b031-70548e11b562 tempest-VolumesExtendTest-1349521331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (226db9d5-ff55-4f0d-8f33-9c6184ed8377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:55.640511 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-db1eac1c-6574-4b1a-b031-70548e11b562 tempest-VolumesExtendTest-1349521331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (882c306b-e5b5-467a-9f1d-5c3e9326dfa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:55.644683 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-db1eac1c-6574-4b1a-b031-70548e11b562 tempest-VolumesExtendTest-1349521331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (882c306b-e5b5-467a-9f1d-5c3e9326dfa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'affef0a0-400e-47d4-a183-271864e88443', 'volume_name': 'volume-affef0a0-400e-47d4-a183-271864e88443', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:55.649708 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-db1eac1c-6574-4b1a-b031-70548e11b562 tempest-VolumesExtendTest-1349521331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bce55bc-9374-474d-af4d-046da7445a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:55.654335 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-db1eac1c-6574-4b1a-b031-70548e11b562 tempest-VolumesExtendTest-1349521331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bce55bc-9374-474d-af4d-046da7445a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:55.659405 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-db1eac1c-6574-4b1a-b031-70548e11b562 tempest-VolumesExtendTest-1349521331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe3ccfcf-1377-4989-aa87-79ed366cea17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:55.660494 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-db1eac1c-6574-4b1a-b031-70548e11b562 tempest-VolumesExtendTest-1349521331 None] Volume affef0a0-400e-47d4-a183-271864e88443: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-affef0a0-400e-47d4-a183-271864e88443', 'volume_size': 1} May 07 22:16:55.660888 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-db1eac1c-6574-4b1a-b031-70548e11b562 tempest-VolumesExtendTest-1349521331 None] creating volume 'volume-affef0a0-400e-47d4-a183-271864e88443' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:16:55.661679 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-db1eac1c-6574-4b1a-b031-70548e11b562 tempest-VolumesExtendTest-1349521331 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:55.722523 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-db1eac1c-6574-4b1a-b031-70548e11b562 tempest-VolumesExtendTest-1349521331 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:16:55.723207 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-db1eac1c-6574-4b1a-b031-70548e11b562 tempest-VolumesExtendTest-1349521331 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:16:55.727166 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-db1eac1c-6574-4b1a-b031-70548e11b562 tempest-VolumesExtendTest-1349521331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe3ccfcf-1377-4989-aa87-79ed366cea17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-affef0a0-400e-47d4-a183-271864e88443', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:55.731908 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-db1eac1c-6574-4b1a-b031-70548e11b562 tempest-VolumesExtendTest-1349521331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6141156a-2fab-4fe6-a970-a85dc1fac898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:55.740303 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-db1eac1c-6574-4b1a-b031-70548e11b562 tempest-VolumesExtendTest-1349521331 None] Volume volume-affef0a0-400e-47d4-a183-271864e88443 (affef0a0-400e-47d4-a183-271864e88443): created successfully May 07 22:16:55.743920 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-db1eac1c-6574-4b1a-b031-70548e11b562 tempest-VolumesExtendTest-1349521331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6141156a-2fab-4fe6-a970-a85dc1fac898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:55.749559 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-db1eac1c-6574-4b1a-b031-70548e11b562 tempest-VolumesExtendTest-1349521331 None] Flow 'volume_create_manager' (38bc6c06-36ea-49a2-a230-43e7e6cac668) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:16:55.757096 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-db1eac1c-6574-4b1a-b031-70548e11b562 tempest-VolumesExtendTest-1349521331 None] Created volume successfully. May 07 22:16:56.092891 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c0f988c-8012-43c2-861d-2b73b16d8005 tempest-VolumesGetTest-717577636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:16:56.111663 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5c0f988c-8012-43c2-861d-2b73b16d8005 tempest-VolumesGetTest-717577636 None] Flow 'volume_create_manager' (c76a3c8d-c9b7-48d6-99dd-5525804029f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:16:56.118538 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5c0f988c-8012-43c2-861d-2b73b16d8005 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (405f33b6-5913-4e28-b5d6-e6e4c5ed6559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:56.133806 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5c0f988c-8012-43c2-861d-2b73b16d8005 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (405f33b6-5913-4e28-b5d6-e6e4c5ed6559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1936834419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5d009292-09d2-4c47-98be-09309f389754,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='162642dda04647e3ba9064594cfad423',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:16:56Z,use_quota=True,user_id='8dffc3e4bcad4a6b8ec9b1faf27c8bc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:56.139968 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5c0f988c-8012-43c2-861d-2b73b16d8005 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9ec36e5-5caf-4a62-8530-58855c9c687e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:56.144202 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5c0f988c-8012-43c2-861d-2b73b16d8005 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9ec36e5-5caf-4a62-8530-58855c9c687e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:56.149481 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5c0f988c-8012-43c2-861d-2b73b16d8005 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ba21787-5a66-421d-8089-15bcdc44257f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:56.153695 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5c0f988c-8012-43c2-861d-2b73b16d8005 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ba21787-5a66-421d-8089-15bcdc44257f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d009292-09d2-4c47-98be-09309f389754', 'volume_name': 'volume-5d009292-09d2-4c47-98be-09309f389754', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:56.158730 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5c0f988c-8012-43c2-861d-2b73b16d8005 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (291aa6d5-1ac2-430d-b210-d8f05d6cb027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:56.162747 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5c0f988c-8012-43c2-861d-2b73b16d8005 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (291aa6d5-1ac2-430d-b210-d8f05d6cb027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:56.167607 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5c0f988c-8012-43c2-861d-2b73b16d8005 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab8f8bec-7541-497d-8b62-f71e73c9848e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:56.168678 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-5c0f988c-8012-43c2-861d-2b73b16d8005 tempest-VolumesGetTest-717577636 None] Volume 5d009292-09d2-4c47-98be-09309f389754: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d009292-09d2-4c47-98be-09309f389754', 'volume_size': 1} May 07 22:16:56.169062 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-5c0f988c-8012-43c2-861d-2b73b16d8005 tempest-VolumesGetTest-717577636 None] creating volume 'volume-5d009292-09d2-4c47-98be-09309f389754' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:16:56.169718 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-5c0f988c-8012-43c2-861d-2b73b16d8005 tempest-VolumesGetTest-717577636 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:56.221130 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-5c0f988c-8012-43c2-861d-2b73b16d8005 tempest-VolumesGetTest-717577636 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:16:56.221535 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-5c0f988c-8012-43c2-861d-2b73b16d8005 tempest-VolumesGetTest-717577636 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:16:56.225344 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5c0f988c-8012-43c2-861d-2b73b16d8005 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab8f8bec-7541-497d-8b62-f71e73c9848e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d009292-09d2-4c47-98be-09309f389754', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:56.230060 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5c0f988c-8012-43c2-861d-2b73b16d8005 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56fab0e7-9a7e-41b5-a1f1-28421e5b33d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:56.240365 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-5c0f988c-8012-43c2-861d-2b73b16d8005 tempest-VolumesGetTest-717577636 None] Volume volume-5d009292-09d2-4c47-98be-09309f389754 (5d009292-09d2-4c47-98be-09309f389754): created successfully May 07 22:16:56.243919 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5c0f988c-8012-43c2-861d-2b73b16d8005 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56fab0e7-9a7e-41b5-a1f1-28421e5b33d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:56.250061 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5c0f988c-8012-43c2-861d-2b73b16d8005 tempest-VolumesGetTest-717577636 None] Flow 'volume_create_manager' (c76a3c8d-c9b7-48d6-99dd-5525804029f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:16:56.257114 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-5c0f988c-8012-43c2-861d-2b73b16d8005 tempest-VolumesGetTest-717577636 None] Created volume successfully. May 07 22:16:56.743411 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-cb10069d-aa85-45bb-96d7-d586b29edf54 tempest-VolumesExtendTest-1349521331 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:57.576876 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-1be7b3b1-1fe2-44aa-8e2a-654a64f63848 tempest-VolumesGetTest-717577636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:16:57.595946 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-1be7b3b1-1fe2-44aa-8e2a-654a64f63848 tempest-VolumesGetTest-717577636 None] Flow 'volume_create_manager' (acff1693-b4ee-43a1-b81a-f9aea7b3cd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:16:57.602405 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-1be7b3b1-1fe2-44aa-8e2a-654a64f63848 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a0f0024-3b2f-463d-aacb-cf4c447c0e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:57.618434 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-1be7b3b1-1fe2-44aa-8e2a-654a64f63848 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a0f0024-3b2f-463d-aacb-cf4c447c0e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:16:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-972169819',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4a019a60-6d07-4ef9-b70d-f2acb8434464,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='162642dda04647e3ba9064594cfad423',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:16:58Z,use_quota=True,user_id='8dffc3e4bcad4a6b8ec9b1faf27c8bc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:57.624413 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-1be7b3b1-1fe2-44aa-8e2a-654a64f63848 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75b4e319-2032-47b2-8aaf-817c3c30699c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:57.628547 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-1be7b3b1-1fe2-44aa-8e2a-654a64f63848 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75b4e319-2032-47b2-8aaf-817c3c30699c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:57.633670 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-1be7b3b1-1fe2-44aa-8e2a-654a64f63848 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e2d9415-3540-41e7-ab85-defa75250cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:57.638509 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-1be7b3b1-1fe2-44aa-8e2a-654a64f63848 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e2d9415-3540-41e7-ab85-defa75250cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a019a60-6d07-4ef9-b70d-f2acb8434464', 'volume_name': 'volume-4a019a60-6d07-4ef9-b70d-f2acb8434464', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:57.643592 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-1be7b3b1-1fe2-44aa-8e2a-654a64f63848 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (795a98de-4f0f-437f-8b2c-344bcaf9bd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:57.647557 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-1be7b3b1-1fe2-44aa-8e2a-654a64f63848 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (795a98de-4f0f-437f-8b2c-344bcaf9bd6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:57.652297 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-1be7b3b1-1fe2-44aa-8e2a-654a64f63848 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f298afd7-7403-42a6-aa1b-45640ffa5b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:57.653357 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-1be7b3b1-1fe2-44aa-8e2a-654a64f63848 tempest-VolumesGetTest-717577636 None] Volume 4a019a60-6d07-4ef9-b70d-f2acb8434464: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a019a60-6d07-4ef9-b70d-f2acb8434464', 'volume_size': 1} May 07 22:16:57.653733 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-1be7b3b1-1fe2-44aa-8e2a-654a64f63848 tempest-VolumesGetTest-717577636 None] creating volume 'volume-4a019a60-6d07-4ef9-b70d-f2acb8434464' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:16:57.654379 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-1be7b3b1-1fe2-44aa-8e2a-654a64f63848 tempest-VolumesGetTest-717577636 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:57.703001 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-1be7b3b1-1fe2-44aa-8e2a-654a64f63848 tempest-VolumesGetTest-717577636 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:16:57.703383 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-1be7b3b1-1fe2-44aa-8e2a-654a64f63848 tempest-VolumesGetTest-717577636 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:16:57.707228 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-1be7b3b1-1fe2-44aa-8e2a-654a64f63848 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f298afd7-7403-42a6-aa1b-45640ffa5b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a019a60-6d07-4ef9-b70d-f2acb8434464', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:57.711977 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-1be7b3b1-1fe2-44aa-8e2a-654a64f63848 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcfee579-2c89-4c4e-9ddc-447ee3004fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:16:57.721011 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-1be7b3b1-1fe2-44aa-8e2a-654a64f63848 tempest-VolumesGetTest-717577636 None] Volume volume-4a019a60-6d07-4ef9-b70d-f2acb8434464 (4a019a60-6d07-4ef9-b70d-f2acb8434464): created successfully May 07 22:16:57.726178 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-1be7b3b1-1fe2-44aa-8e2a-654a64f63848 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcfee579-2c89-4c4e-9ddc-447ee3004fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:16:57.732278 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-1be7b3b1-1fe2-44aa-8e2a-654a64f63848 tempest-VolumesGetTest-717577636 None] Flow 'volume_create_manager' (acff1693-b4ee-43a1-b81a-f9aea7b3cd02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:16:57.740826 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-1be7b3b1-1fe2-44aa-8e2a-654a64f63848 tempest-VolumesGetTest-717577636 None] Created volume successfully. May 07 22:16:57.862186 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-cb10069d-aa85-45bb-96d7-d586b29edf54 tempest-VolumesExtendTest-1349521331 None] Create snapshot completed successfully May 07 22:16:58.682424 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-d53b2a28-653b-4239-8958-c6639af391b0 tempest-VolumesGetTest-717577636 None] Lock "b'cinder-4a019a60-6d07-4ef9-b70d-f2acb8434464-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:16:58.712975 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d53b2a28-653b-4239-8958-c6639af391b0 tempest-VolumesGetTest-717577636 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:58.750673 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d53b2a28-653b-4239-8958-c6639af391b0 tempest-VolumesGetTest-717577636 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:16:58.751138 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d53b2a28-653b-4239-8958-c6639af391b0 tempest-VolumesGetTest-717577636 None] Volume volume-4a019a60-6d07-4ef9-b70d-f2acb8434464 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:16:58.759935 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d53b2a28-653b-4239-8958-c6639af391b0 tempest-VolumesGetTest-717577636 None] deleting rbd volume volume-4a019a60-6d07-4ef9-b70d-f2acb8434464 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:16:58.909511 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-ab877632-5fa2-49ca-a0f5-ffdd9ee9d33b tempest-VolumesExtendTest-1349521331 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:59.013167 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-ab877632-5fa2-49ca-a0f5-ffdd9ee9d33b tempest-VolumesExtendTest-1349521331 None] Extend volume from 1 GB to 2 GB. {{(pid=129946) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1875}} May 07 22:16:59.016417 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-d53b2a28-653b-4239-8958-c6639af391b0 tempest-VolumesGetTest-717577636 None] Created reservations ['e8d14c05-7d1d-4ba9-bd85-4be07a2efa12', 'c72e3772-2f6b-4e7c-b031-79738982010c', '7a8172aa-bdab-4b4f-84e3-e2a1baaabcd8', 'fe21d8a4-aa2e-4098-9b40-0bf6cb085a51'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:16:59.054186 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-ab877632-5fa2-49ca-a0f5-ffdd9ee9d33b tempest-VolumesExtendTest-1349521331 None] Extend volume completed successfully. May 07 22:16:59.070995 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d53b2a28-653b-4239-8958-c6639af391b0 tempest-VolumesGetTest-717577636 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:59.094728 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-d53b2a28-653b-4239-8958-c6639af391b0 tempest-VolumesGetTest-717577636 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:59.117619 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-d53b2a28-653b-4239-8958-c6639af391b0 tempest-VolumesGetTest-717577636 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:16:59.122147 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-d53b2a28-653b-4239-8958-c6639af391b0 tempest-VolumesGetTest-717577636 None] Deleted volume successfully. May 07 22:16:59.132920 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-d53b2a28-653b-4239-8958-c6639af391b0 tempest-VolumesGetTest-717577636 None] Lock "b'cinder-4a019a60-6d07-4ef9-b70d-f2acb8434464-delete_volume'" released by "delete_volume" :: held 0.451s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:16:59.809997 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-b40f1d73-cf60-4b8a-ac61-4f9c60b05198 tempest-VolumesGetTest-717577636 None] Lock "b'cinder-5d009292-09d2-4c47-98be-09309f389754-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:16:59.843702 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b40f1d73-cf60-4b8a-ac61-4f9c60b05198 tempest-VolumesGetTest-717577636 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:16:59.883792 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b40f1d73-cf60-4b8a-ac61-4f9c60b05198 tempest-VolumesGetTest-717577636 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:16:59.884213 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b40f1d73-cf60-4b8a-ac61-4f9c60b05198 tempest-VolumesGetTest-717577636 None] Volume volume-5d009292-09d2-4c47-98be-09309f389754 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:16:59.889444 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b40f1d73-cf60-4b8a-ac61-4f9c60b05198 tempest-VolumesGetTest-717577636 None] deleting rbd volume volume-5d009292-09d2-4c47-98be-09309f389754 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:17:00.106510 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-7ffc55bc-1a87-4105-bd4e-5755d144f99d tempest-VolumesExtendTest-1349521331 None] Lock "b'cinder-8204af29-0968-49c9-9f35-6411f4602da8-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.015s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:17:00.108424 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-7ffc55bc-1a87-4105-bd4e-5755d144f99d tempest-VolumesExtendTest-1349521331 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:17:00.156769 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-b40f1d73-cf60-4b8a-ac61-4f9c60b05198 tempest-VolumesGetTest-717577636 None] Created reservations ['e993cf59-e01e-4771-883b-01af29e7a6fd', 'e5b82a58-a479-4717-b297-d6628d3be367', 'b7e726f4-a2c2-4ba2-a12a-e648bb5a94ee', '56b3b121-9acf-495c-99d2-2173cfa02327'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:17:00.203397 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b40f1d73-cf60-4b8a-ac61-4f9c60b05198 tempest-VolumesGetTest-717577636 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:17:00.228645 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b40f1d73-cf60-4b8a-ac61-4f9c60b05198 tempest-VolumesGetTest-717577636 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:17:00.250296 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-b40f1d73-cf60-4b8a-ac61-4f9c60b05198 tempest-VolumesGetTest-717577636 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:17:00.254097 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-b40f1d73-cf60-4b8a-ac61-4f9c60b05198 tempest-VolumesGetTest-717577636 None] Deleted volume successfully. May 07 22:17:00.266320 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-b40f1d73-cf60-4b8a-ac61-4f9c60b05198 tempest-VolumesGetTest-717577636 None] Lock "b'cinder-5d009292-09d2-4c47-98be-09309f389754-delete_volume'" released by "delete_volume" :: held 0.456s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:17:00.922678 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-7ffc55bc-1a87-4105-bd4e-5755d144f99d tempest-VolumesExtendTest-1349521331 None] Created reservations ['a52ece3d-abf2-4a7a-a69b-85195cb55fbb', 'f50f0c3b-148f-400a-a691-2a96e30f0827', '5bc871f7-c71f-49bc-93af-9f3705a9bc7c', '0b2f5841-698b-44bb-a1a5-679b4edf2b50'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:17:00.959237 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-7ffc55bc-1a87-4105-bd4e-5755d144f99d tempest-VolumesExtendTest-1349521331 None] Delete snapshot completed successfully. May 07 22:17:00.963838 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-7ffc55bc-1a87-4105-bd4e-5755d144f99d tempest-VolumesExtendTest-1349521331 None] Lock "b'cinder-8204af29-0968-49c9-9f35-6411f4602da8-delete_snapshot'" released by "delete_snapshot" :: held 0.858s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:17:01.191133 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cf34bb2-5608-466b-8fe9-ff421c865ef2 tempest-VolumesGetTest-717577636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:17:01.212910 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-9cf34bb2-5608-466b-8fe9-ff421c865ef2 tempest-VolumesGetTest-717577636 None] Flow 'volume_create_manager' (90116b5f-cff8-4630-accb-e76d6150cd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:17:01.224884 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-9cf34bb2-5608-466b-8fe9-ff421c865ef2 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55bf48a9-add7-4218-a3fa-1e3b4a689305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:17:01.245242 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-9cf34bb2-5608-466b-8fe9-ff421c865ef2 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55bf48a9-add7-4218-a3fa-1e3b4a689305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1544785401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=733724e6-4834-48e8-98d2-608394e479c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='162642dda04647e3ba9064594cfad423',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:17:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:17:01Z,use_quota=True,user_id='8dffc3e4bcad4a6b8ec9b1faf27c8bc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:17:01.251710 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-9cf34bb2-5608-466b-8fe9-ff421c865ef2 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (162d4ca7-5b5f-4bd1-9825-a0c2fdb4007c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:17:01.255938 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-9cf34bb2-5608-466b-8fe9-ff421c865ef2 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (162d4ca7-5b5f-4bd1-9825-a0c2fdb4007c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:17:01.261238 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-9cf34bb2-5608-466b-8fe9-ff421c865ef2 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41ad1003-06c1-4d83-a70f-a3eaafe2db3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:17:01.265506 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-9cf34bb2-5608-466b-8fe9-ff421c865ef2 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41ad1003-06c1-4d83-a70f-a3eaafe2db3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '733724e6-4834-48e8-98d2-608394e479c6', 'volume_name': 'volume-733724e6-4834-48e8-98d2-608394e479c6', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:17:01.270586 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-9cf34bb2-5608-466b-8fe9-ff421c865ef2 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e68eb085-141c-41a3-9953-76a11793ebeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:17:01.274638 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-9cf34bb2-5608-466b-8fe9-ff421c865ef2 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e68eb085-141c-41a3-9953-76a11793ebeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:17:01.280082 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-9cf34bb2-5608-466b-8fe9-ff421c865ef2 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa2dae24-412b-467b-a154-869b42d6eb21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:17:01.281161 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-9cf34bb2-5608-466b-8fe9-ff421c865ef2 tempest-VolumesGetTest-717577636 None] Volume 733724e6-4834-48e8-98d2-608394e479c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-733724e6-4834-48e8-98d2-608394e479c6', 'volume_size': 1} May 07 22:17:01.281550 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-9cf34bb2-5608-466b-8fe9-ff421c865ef2 tempest-VolumesGetTest-717577636 None] creating volume 'volume-733724e6-4834-48e8-98d2-608394e479c6' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:17:01.282512 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-9cf34bb2-5608-466b-8fe9-ff421c865ef2 tempest-VolumesGetTest-717577636 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:17:01.308752 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-90fbf5d8-28e7-4eb1-ace6-b7d222bc2864 tempest-VolumesExtendTest-1349521331 None] Lock "b'cinder-affef0a0-400e-47d4-a183-271864e88443-delete_volume'" acquired by "delete_volume" :: waited 0.076s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:17:01.341702 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-9cf34bb2-5608-466b-8fe9-ff421c865ef2 tempest-VolumesGetTest-717577636 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:17:01.342074 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-9cf34bb2-5608-466b-8fe9-ff421c865ef2 tempest-VolumesGetTest-717577636 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:17:01.345875 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-9cf34bb2-5608-466b-8fe9-ff421c865ef2 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa2dae24-412b-467b-a154-869b42d6eb21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-733724e6-4834-48e8-98d2-608394e479c6', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:17:01.350894 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-9cf34bb2-5608-466b-8fe9-ff421c865ef2 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb4df5ec-06d0-4ab5-8a88-c2a6e0ae9edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:17:01.359880 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-90fbf5d8-28e7-4eb1-ace6-b7d222bc2864 tempest-VolumesExtendTest-1349521331 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:17:01.399065 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-90fbf5d8-28e7-4eb1-ace6-b7d222bc2864 tempest-VolumesExtendTest-1349521331 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:17:01.399496 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-90fbf5d8-28e7-4eb1-ace6-b7d222bc2864 tempest-VolumesExtendTest-1349521331 None] Volume volume-affef0a0-400e-47d4-a183-271864e88443 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:17:01.405144 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-90fbf5d8-28e7-4eb1-ace6-b7d222bc2864 tempest-VolumesExtendTest-1349521331 None] deleting rbd volume volume-affef0a0-400e-47d4-a183-271864e88443 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:17:01.408952 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-9cf34bb2-5608-466b-8fe9-ff421c865ef2 tempest-VolumesGetTest-717577636 None] Volume volume-733724e6-4834-48e8-98d2-608394e479c6 (733724e6-4834-48e8-98d2-608394e479c6): created successfully May 07 22:17:01.412709 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-9cf34bb2-5608-466b-8fe9-ff421c865ef2 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb4df5ec-06d0-4ab5-8a88-c2a6e0ae9edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:17:01.419071 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-9cf34bb2-5608-466b-8fe9-ff421c865ef2 tempest-VolumesGetTest-717577636 None] Flow 'volume_create_manager' (90116b5f-cff8-4630-accb-e76d6150cd44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:17:01.432431 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-9cf34bb2-5608-466b-8fe9-ff421c865ef2 tempest-VolumesGetTest-717577636 None] Created volume successfully. May 07 22:17:01.612034 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-90fbf5d8-28e7-4eb1-ace6-b7d222bc2864 tempest-VolumesExtendTest-1349521331 None] Created reservations ['3f3fb02e-6bce-4245-a5be-2139f6b181db', '428bef8b-486e-412d-b137-454e7c3795da', '981297a1-c9a5-4a16-ac94-fdab457e427b', '9b634c29-e141-4387-bd2f-caae53a4afb9'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:17:01.653903 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-90fbf5d8-28e7-4eb1-ace6-b7d222bc2864 tempest-VolumesExtendTest-1349521331 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:17:01.676839 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-90fbf5d8-28e7-4eb1-ace6-b7d222bc2864 tempest-VolumesExtendTest-1349521331 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:17:01.698539 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-90fbf5d8-28e7-4eb1-ace6-b7d222bc2864 tempest-VolumesExtendTest-1349521331 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:17:01.703044 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-90fbf5d8-28e7-4eb1-ace6-b7d222bc2864 tempest-VolumesExtendTest-1349521331 None] Deleted volume successfully. May 07 22:17:01.714531 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-90fbf5d8-28e7-4eb1-ace6-b7d222bc2864 tempest-VolumesExtendTest-1349521331 None] Lock "b'cinder-affef0a0-400e-47d4-a183-271864e88443-delete_volume'" released by "delete_volume" :: held 0.406s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:17:02.327073 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-c7f0d33a-3010-418e-897b-2da8b006ae0c tempest-VolumesExtendTest-1349521331 None] Lock "b'cinder-40eb2681-c8fa-47fa-9d8c-c027652390b1-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:17:02.361685 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-c7f0d33a-3010-418e-897b-2da8b006ae0c tempest-VolumesExtendTest-1349521331 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:17:02.431178 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-c7f0d33a-3010-418e-897b-2da8b006ae0c tempest-VolumesExtendTest-1349521331 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:17:02.445399 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-c7f0d33a-3010-418e-897b-2da8b006ae0c tempest-VolumesExtendTest-1349521331 None] deleting rbd volume volume-40eb2681-c8fa-47fa-9d8c-c027652390b1 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:17:02.552548 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b383621-1c66-4da3-b02c-29363f3e7b6c tempest-VolumesGetTest-717577636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:17:02.587140 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7b383621-1c66-4da3-b02c-29363f3e7b6c tempest-VolumesGetTest-717577636 None] Flow 'volume_create_manager' (402976bd-e701-4f4f-ae8c-2d840309f22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:17:02.598208 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7b383621-1c66-4da3-b02c-29363f3e7b6c tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (177a2633-0e63-4b49-aac8-943624df7d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:17:02.625662 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7b383621-1c66-4da3-b02c-29363f3e7b6c tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (177a2633-0e63-4b49-aac8-943624df7d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:17:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1674138179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4ba910b0-b825-4e63-b1a8-85a4c43d8350,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='162642dda04647e3ba9064594cfad423',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:17:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=733724e6-4834-48e8-98d2-608394e479c6,status='creating',terminated_at=None,updated_at=2022-05-07T22:17:03Z,use_quota=True,user_id='8dffc3e4bcad4a6b8ec9b1faf27c8bc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:17:02.631946 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7b383621-1c66-4da3-b02c-29363f3e7b6c tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75cd9cef-e41a-4175-bc21-9ccf983f3e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:17:02.636189 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7b383621-1c66-4da3-b02c-29363f3e7b6c tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75cd9cef-e41a-4175-bc21-9ccf983f3e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:17:02.641482 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7b383621-1c66-4da3-b02c-29363f3e7b6c tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba4279f4-0c42-4986-b120-7f8288f85acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:17:02.663976 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7b383621-1c66-4da3-b02c-29363f3e7b6c tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba4279f4-0c42-4986-b120-7f8288f85acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4ba910b0-b825-4e63-b1a8-85a4c43d8350', 'volume_name': 'volume-4ba910b0-b825-4e63-b1a8-85a4c43d8350', 'volume_size': 1, 'source_volid': '733724e6-4834-48e8-98d2-608394e479c6', 'source_volstatus': 'available'}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:17:02.669691 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7b383621-1c66-4da3-b02c-29363f3e7b6c tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f391c72c-4570-44f3-b821-a6f70c5f0ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:17:02.674014 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7b383621-1c66-4da3-b02c-29363f3e7b6c tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f391c72c-4570-44f3-b821-a6f70c5f0ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:17:02.678982 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7b383621-1c66-4da3-b02c-29363f3e7b6c tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d55bb3f-44a2-4d16-b6be-0e2764000fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:17:02.680076 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-7b383621-1c66-4da3-b02c-29363f3e7b6c tempest-VolumesGetTest-717577636 None] Volume 4ba910b0-b825-4e63-b1a8-85a4c43d8350: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4ba910b0-b825-4e63-b1a8-85a4c43d8350', 'volume_size': 1, 'source_volid': '733724e6-4834-48e8-98d2-608394e479c6', 'source_volstatus': 'available'} May 07 22:17:02.682472 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-c7f0d33a-3010-418e-897b-2da8b006ae0c tempest-VolumesExtendTest-1349521331 None] volume is a clone so cleaning references {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} May 07 22:17:02.714743 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-c7f0d33a-3010-418e-897b-2da8b006ae0c tempest-VolumesExtendTest-1349521331 None] deleting parent snapshot volume-40eb2681-c8fa-47fa-9d8c-c027652390b1.clone_snap {{(pid=129946) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} May 07 22:17:02.901984 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-7b383621-1c66-4da3-b02c-29363f3e7b6c tempest-VolumesGetTest-717577636 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:17:02.944226 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-7b383621-1c66-4da3-b02c-29363f3e7b6c tempest-VolumesGetTest-717577636 None] creating snapshot='volume-4ba910b0-b825-4e63-b1a8-85a4c43d8350.clone_snap' {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} May 07 22:17:03.886725 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-7b383621-1c66-4da3-b02c-29363f3e7b6c tempest-VolumesGetTest-717577636 None] cloning 'volume-733724e6-4834-48e8-98d2-608394e479c6@volume-4ba910b0-b825-4e63-b1a8-85a4c43d8350.clone_snap' to 'volume-4ba910b0-b825-4e63-b1a8-85a4c43d8350' {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 07 22:17:03.917034 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-c7f0d33a-3010-418e-897b-2da8b006ae0c tempest-VolumesExtendTest-1349521331 None] Created reservations ['c6970964-945b-4ca8-b920-329c96b685d9', '42276fc1-c3d8-43c5-9925-89e365741976', 'd8566331-8944-4527-821e-a3018891d7f6', 'aec7f64b-e0ee-48f9-b682-a47b4134abe6'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:17:03.972274 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-c7f0d33a-3010-418e-897b-2da8b006ae0c tempest-VolumesExtendTest-1349521331 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:17:03.994188 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-c7f0d33a-3010-418e-897b-2da8b006ae0c tempest-VolumesExtendTest-1349521331 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:17:04.016095 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-c7f0d33a-3010-418e-897b-2da8b006ae0c tempest-VolumesExtendTest-1349521331 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:17:04.032268 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-7b383621-1c66-4da3-b02c-29363f3e7b6c tempest-VolumesGetTest-717577636 None] Volume volume-733724e6-4834-48e8-98d2-608394e479c6 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:17:04.033560 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-7b383621-1c66-4da3-b02c-29363f3e7b6c tempest-VolumesGetTest-717577636 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:17:04.033935 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-7b383621-1c66-4da3-b02c-29363f3e7b6c tempest-VolumesGetTest-717577636 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:17:04.049375 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-7b383621-1c66-4da3-b02c-29363f3e7b6c tempest-VolumesGetTest-717577636 None] clone created successfully {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} May 07 22:17:04.053364 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7b383621-1c66-4da3-b02c-29363f3e7b6c tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d55bb3f-44a2-4d16-b6be-0e2764000fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ba910b0-b825-4e63-b1a8-85a4c43d8350', 'volume_size': 1, 'source_volid': '733724e6-4834-48e8-98d2-608394e479c6', 'source_volstatus': 'available'}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:17:04.058125 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7b383621-1c66-4da3-b02c-29363f3e7b6c tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28538520-1f57-428e-8dec-5cb7e30e6b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:17:04.064729 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-c7f0d33a-3010-418e-897b-2da8b006ae0c tempest-VolumesExtendTest-1349521331 None] Deleted volume successfully. May 07 22:17:04.071102 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-7b383621-1c66-4da3-b02c-29363f3e7b6c tempest-VolumesGetTest-717577636 None] Volume volume-4ba910b0-b825-4e63-b1a8-85a4c43d8350 (4ba910b0-b825-4e63-b1a8-85a4c43d8350): created successfully May 07 22:17:04.075954 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7b383621-1c66-4da3-b02c-29363f3e7b6c tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28538520-1f57-428e-8dec-5cb7e30e6b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:17:04.081506 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7b383621-1c66-4da3-b02c-29363f3e7b6c tempest-VolumesGetTest-717577636 None] Flow 'volume_create_manager' (402976bd-e701-4f4f-ae8c-2d840309f22f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:17:04.089816 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-c7f0d33a-3010-418e-897b-2da8b006ae0c tempest-VolumesExtendTest-1349521331 None] Lock "b'cinder-40eb2681-c8fa-47fa-9d8c-c027652390b1-delete_volume'" released by "delete_volume" :: held 1.763s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:17:04.096340 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-7b383621-1c66-4da3-b02c-29363f3e7b6c tempest-VolumesGetTest-717577636 None] Created volume successfully. May 07 22:17:05.129548 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-de009ac7-46a1-4674-9fb8-e08f0d0d3db8 tempest-VolumesGetTest-717577636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:17:05.149487 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-de009ac7-46a1-4674-9fb8-e08f0d0d3db8 tempest-VolumesGetTest-717577636 None] Flow 'volume_create_manager' (6e2b292e-4ec2-4e67-b87c-5200d3820696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:17:05.157520 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-de009ac7-46a1-4674-9fb8-e08f0d0d3db8 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a3d7996-dede-4257-b0a9-7dae05847a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:17:05.173940 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-de009ac7-46a1-4674-9fb8-e08f0d0d3db8 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a3d7996-dede-4257-b0a9-7dae05847a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:17:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-402601141',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=242d3e09-bdfe-429b-800f-a9981818fc97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='162642dda04647e3ba9064594cfad423',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:17:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:17:05Z,use_quota=True,user_id='8dffc3e4bcad4a6b8ec9b1faf27c8bc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:17:05.179614 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-de009ac7-46a1-4674-9fb8-e08f0d0d3db8 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96c07f7a-cd67-4f2b-b5ce-7172baf525f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:17:05.183908 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-de009ac7-46a1-4674-9fb8-e08f0d0d3db8 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96c07f7a-cd67-4f2b-b5ce-7172baf525f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:17:05.189288 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-de009ac7-46a1-4674-9fb8-e08f0d0d3db8 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (802af974-0fbc-400d-bc0d-6e8963288c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:17:05.193507 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-de009ac7-46a1-4674-9fb8-e08f0d0d3db8 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (802af974-0fbc-400d-bc0d-6e8963288c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '242d3e09-bdfe-429b-800f-a9981818fc97', 'volume_name': 'volume-242d3e09-bdfe-429b-800f-a9981818fc97', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:17:05.198656 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-de009ac7-46a1-4674-9fb8-e08f0d0d3db8 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (365e824b-ac04-43b5-954e-be15c47f4e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:17:05.202978 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-de009ac7-46a1-4674-9fb8-e08f0d0d3db8 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (365e824b-ac04-43b5-954e-be15c47f4e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:17:05.207870 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-de009ac7-46a1-4674-9fb8-e08f0d0d3db8 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d9d37f1-5e00-4b56-a6af-0301d4dedbeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:17:05.208981 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-de009ac7-46a1-4674-9fb8-e08f0d0d3db8 tempest-VolumesGetTest-717577636 None] Volume 242d3e09-bdfe-429b-800f-a9981818fc97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-242d3e09-bdfe-429b-800f-a9981818fc97', 'volume_size': 1} May 07 22:17:05.209379 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-de009ac7-46a1-4674-9fb8-e08f0d0d3db8 tempest-VolumesGetTest-717577636 None] creating volume 'volume-242d3e09-bdfe-429b-800f-a9981818fc97' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:17:05.210186 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-de009ac7-46a1-4674-9fb8-e08f0d0d3db8 tempest-VolumesGetTest-717577636 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:17:05.266045 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-de009ac7-46a1-4674-9fb8-e08f0d0d3db8 tempest-VolumesGetTest-717577636 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:17:05.266342 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-de009ac7-46a1-4674-9fb8-e08f0d0d3db8 tempest-VolumesGetTest-717577636 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:17:05.270103 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-de009ac7-46a1-4674-9fb8-e08f0d0d3db8 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d9d37f1-5e00-4b56-a6af-0301d4dedbeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-242d3e09-bdfe-429b-800f-a9981818fc97', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:17:05.274880 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-de009ac7-46a1-4674-9fb8-e08f0d0d3db8 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54249100-b068-4374-9df2-988f66d16f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:17:05.285667 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-de009ac7-46a1-4674-9fb8-e08f0d0d3db8 tempest-VolumesGetTest-717577636 None] Volume volume-242d3e09-bdfe-429b-800f-a9981818fc97 (242d3e09-bdfe-429b-800f-a9981818fc97): created successfully May 07 22:17:05.291608 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-de009ac7-46a1-4674-9fb8-e08f0d0d3db8 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54249100-b068-4374-9df2-988f66d16f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:17:05.304706 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-de009ac7-46a1-4674-9fb8-e08f0d0d3db8 tempest-VolumesGetTest-717577636 None] Flow 'volume_create_manager' (6e2b292e-4ec2-4e67-b87c-5200d3820696) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:17:05.317192 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-de009ac7-46a1-4674-9fb8-e08f0d0d3db8 tempest-VolumesGetTest-717577636 None] Created volume successfully. May 07 22:17:06.254550 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-042d3009-a778-49d2-a843-2144ee0df9e2 tempest-VolumesGetTest-717577636 None] Lock "b'cinder-242d3e09-bdfe-429b-800f-a9981818fc97-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:17:06.298744 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-042d3009-a778-49d2-a843-2144ee0df9e2 tempest-VolumesGetTest-717577636 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:17:06.368642 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-042d3009-a778-49d2-a843-2144ee0df9e2 tempest-VolumesGetTest-717577636 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:17:06.369135 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-042d3009-a778-49d2-a843-2144ee0df9e2 tempest-VolumesGetTest-717577636 None] Volume volume-242d3e09-bdfe-429b-800f-a9981818fc97 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:17:06.375672 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-042d3009-a778-49d2-a843-2144ee0df9e2 tempest-VolumesGetTest-717577636 None] deleting rbd volume volume-242d3e09-bdfe-429b-800f-a9981818fc97 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:17:06.648314 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-042d3009-a778-49d2-a843-2144ee0df9e2 tempest-VolumesGetTest-717577636 None] Created reservations ['12b11a90-4640-4bed-be6f-4b20b9e443a4', 'a9a4a0f0-6181-44d1-bebb-d767283bbc5d', '1316fdf7-c197-4e07-8479-1307f903a0d4', 'c6508ab9-d5c0-43e0-9373-7b38cdcc514d'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:17:06.694386 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-042d3009-a778-49d2-a843-2144ee0df9e2 tempest-VolumesGetTest-717577636 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:17:06.734708 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-042d3009-a778-49d2-a843-2144ee0df9e2 tempest-VolumesGetTest-717577636 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:17:06.782187 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-042d3009-a778-49d2-a843-2144ee0df9e2 tempest-VolumesGetTest-717577636 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:17:06.789223 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-042d3009-a778-49d2-a843-2144ee0df9e2 tempest-VolumesGetTest-717577636 None] Deleted volume successfully. May 07 22:17:06.806610 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-042d3009-a778-49d2-a843-2144ee0df9e2 tempest-VolumesGetTest-717577636 None] Lock "b'cinder-242d3e09-bdfe-429b-800f-a9981818fc97-delete_volume'" released by "delete_volume" :: held 0.552s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:17:07.395382 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-0c94ddeb-b4d7-439f-891b-290f3ddc0c11 tempest-VolumesGetTest-717577636 None] Lock "b'cinder-4ba910b0-b825-4e63-b1a8-85a4c43d8350-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:17:07.444441 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0c94ddeb-b4d7-439f-891b-290f3ddc0c11 tempest-VolumesGetTest-717577636 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:17:07.513397 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0c94ddeb-b4d7-439f-891b-290f3ddc0c11 tempest-VolumesGetTest-717577636 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:17:07.522926 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0c94ddeb-b4d7-439f-891b-290f3ddc0c11 tempest-VolumesGetTest-717577636 None] deleting rbd volume volume-4ba910b0-b825-4e63-b1a8-85a4c43d8350 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:17:07.773911 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0c94ddeb-b4d7-439f-891b-290f3ddc0c11 tempest-VolumesGetTest-717577636 None] volume is a clone so cleaning references {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} May 07 22:17:07.799626 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0c94ddeb-b4d7-439f-891b-290f3ddc0c11 tempest-VolumesGetTest-717577636 None] Volume volume-733724e6-4834-48e8-98d2-608394e479c6 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:17:07.800192 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0c94ddeb-b4d7-439f-891b-290f3ddc0c11 tempest-VolumesGetTest-717577636 None] deleting parent snapshot volume-4ba910b0-b825-4e63-b1a8-85a4c43d8350.clone_snap {{(pid=129946) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} May 07 22:17:08.409985 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-49114cfe-68b2-4d9b-b4f1-62cb54a6e958 tempest-VolumesSnapshotListTestJSON-1624502190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:17:08.429588 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-49114cfe-68b2-4d9b-b4f1-62cb54a6e958 tempest-VolumesSnapshotListTestJSON-1624502190 None] Flow 'volume_create_manager' (77364e1e-e4e8-4432-8467-b38fe7cca9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:17:08.436096 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-49114cfe-68b2-4d9b-b4f1-62cb54a6e958 tempest-VolumesSnapshotListTestJSON-1624502190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91bba7a2-3f60-4a61-94fe-8f1fc79f5e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:17:08.452886 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-49114cfe-68b2-4d9b-b4f1-62cb54a6e958 tempest-VolumesSnapshotListTestJSON-1624502190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91bba7a2-3f60-4a61-94fe-8f1fc79f5e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:17:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1271420658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5c79abe8-4a8a-4947-bc32-abc63656ddf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bac0f87a16b47fd834d24945cc0ca92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:17:08Z,use_quota=True,user_id='be2a0c581a934ebd9d694a3b7a411c4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:17:08.458420 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-49114cfe-68b2-4d9b-b4f1-62cb54a6e958 tempest-VolumesSnapshotListTestJSON-1624502190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd06d8ae-607e-4f2a-b9ef-44340c2c1e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:17:08.462720 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-49114cfe-68b2-4d9b-b4f1-62cb54a6e958 tempest-VolumesSnapshotListTestJSON-1624502190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd06d8ae-607e-4f2a-b9ef-44340c2c1e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:17:08.468510 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-49114cfe-68b2-4d9b-b4f1-62cb54a6e958 tempest-VolumesSnapshotListTestJSON-1624502190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddd8355a-ec3b-4f01-8f85-41a0315bc5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:17:08.472656 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-49114cfe-68b2-4d9b-b4f1-62cb54a6e958 tempest-VolumesSnapshotListTestJSON-1624502190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddd8355a-ec3b-4f01-8f85-41a0315bc5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c79abe8-4a8a-4947-bc32-abc63656ddf9', 'volume_name': 'volume-5c79abe8-4a8a-4947-bc32-abc63656ddf9', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:17:08.477751 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-49114cfe-68b2-4d9b-b4f1-62cb54a6e958 tempest-VolumesSnapshotListTestJSON-1624502190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44cfa79e-962e-4359-9bb2-4aaeec3e6489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:17:08.481784 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-49114cfe-68b2-4d9b-b4f1-62cb54a6e958 tempest-VolumesSnapshotListTestJSON-1624502190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44cfa79e-962e-4359-9bb2-4aaeec3e6489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:17:08.486604 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-49114cfe-68b2-4d9b-b4f1-62cb54a6e958 tempest-VolumesSnapshotListTestJSON-1624502190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37f53dc9-ddb1-4e00-af93-01947c01c378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:17:08.487768 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-49114cfe-68b2-4d9b-b4f1-62cb54a6e958 tempest-VolumesSnapshotListTestJSON-1624502190 None] Volume 5c79abe8-4a8a-4947-bc32-abc63656ddf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c79abe8-4a8a-4947-bc32-abc63656ddf9', 'volume_size': 1} May 07 22:17:08.488146 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-49114cfe-68b2-4d9b-b4f1-62cb54a6e958 tempest-VolumesSnapshotListTestJSON-1624502190 None] creating volume 'volume-5c79abe8-4a8a-4947-bc32-abc63656ddf9' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:17:08.488929 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-49114cfe-68b2-4d9b-b4f1-62cb54a6e958 tempest-VolumesSnapshotListTestJSON-1624502190 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:17:08.530425 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-0c94ddeb-b4d7-439f-891b-290f3ddc0c11 tempest-VolumesGetTest-717577636 None] Created reservations ['7e38d2be-feb2-4aee-9c92-7961ed2c3dae', '71423969-0175-4a80-bc5e-69cd2eaea898', '6712b222-4e5f-44f8-a85b-2d0fa480c62d', 'b30af325-05d0-4266-b876-37f6c6fd279b'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:17:08.553573 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-49114cfe-68b2-4d9b-b4f1-62cb54a6e958 tempest-VolumesSnapshotListTestJSON-1624502190 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:17:08.553977 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-49114cfe-68b2-4d9b-b4f1-62cb54a6e958 tempest-VolumesSnapshotListTestJSON-1624502190 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:17:08.557980 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-49114cfe-68b2-4d9b-b4f1-62cb54a6e958 tempest-VolumesSnapshotListTestJSON-1624502190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37f53dc9-ddb1-4e00-af93-01947c01c378) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c79abe8-4a8a-4947-bc32-abc63656ddf9', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:17:08.562796 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-49114cfe-68b2-4d9b-b4f1-62cb54a6e958 tempest-VolumesSnapshotListTestJSON-1624502190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51706dc0-52d0-4ac5-8471-0e6cab86f3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:17:08.573402 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-49114cfe-68b2-4d9b-b4f1-62cb54a6e958 tempest-VolumesSnapshotListTestJSON-1624502190 None] Volume volume-5c79abe8-4a8a-4947-bc32-abc63656ddf9 (5c79abe8-4a8a-4947-bc32-abc63656ddf9): created successfully May 07 22:17:08.577683 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-49114cfe-68b2-4d9b-b4f1-62cb54a6e958 tempest-VolumesSnapshotListTestJSON-1624502190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51706dc0-52d0-4ac5-8471-0e6cab86f3d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:17:08.583402 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-49114cfe-68b2-4d9b-b4f1-62cb54a6e958 tempest-VolumesSnapshotListTestJSON-1624502190 None] Flow 'volume_create_manager' (77364e1e-e4e8-4432-8467-b38fe7cca9c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:17:08.595950 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-49114cfe-68b2-4d9b-b4f1-62cb54a6e958 tempest-VolumesSnapshotListTestJSON-1624502190 None] Created volume successfully. May 07 22:17:08.611847 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0c94ddeb-b4d7-439f-891b-290f3ddc0c11 tempest-VolumesGetTest-717577636 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:17:08.637160 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0c94ddeb-b4d7-439f-891b-290f3ddc0c11 tempest-VolumesGetTest-717577636 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:17:08.669333 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-0c94ddeb-b4d7-439f-891b-290f3ddc0c11 tempest-VolumesGetTest-717577636 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:17:08.677470 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-0c94ddeb-b4d7-439f-891b-290f3ddc0c11 tempest-VolumesGetTest-717577636 None] Deleted volume successfully. May 07 22:17:08.692485 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-0c94ddeb-b4d7-439f-891b-290f3ddc0c11 tempest-VolumesGetTest-717577636 None] Lock "b'cinder-4ba910b0-b825-4e63-b1a8-85a4c43d8350-delete_volume'" released by "delete_volume" :: held 1.297s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:17:09.008290 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-f35379f9-3382-470e-a7f5-86524b9313d3 tempest-VolumesSnapshotListTestJSON-1624502190 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:17:09.420831 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-f35379f9-3382-470e-a7f5-86524b9313d3 tempest-VolumesSnapshotListTestJSON-1624502190 None] Create snapshot completed successfully May 07 22:17:09.955094 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-98a7fdb0-b6af-4c3d-bc08-56c0cca96a9b tempest-VolumesGetTest-717577636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:17:09.974563 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-98a7fdb0-b6af-4c3d-bc08-56c0cca96a9b tempest-VolumesGetTest-717577636 None] Flow 'volume_create_manager' (815e0a81-ee63-4597-9a78-0723b53f468d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:17:09.981094 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-98a7fdb0-b6af-4c3d-bc08-56c0cca96a9b tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1f2f8c5-8035-4ec4-9871-deeb6c8eff4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:17:09.996428 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-98a7fdb0-b6af-4c3d-bc08-56c0cca96a9b tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1f2f8c5-8035-4ec4-9871-deeb6c8eff4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1283681774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1730763a-1607-4e4e-8d72-a6ec08b2d6b5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='162642dda04647e3ba9064594cfad423',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:17:10Z,use_quota=True,user_id='8dffc3e4bcad4a6b8ec9b1faf27c8bc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:17:10.002109 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-98a7fdb0-b6af-4c3d-bc08-56c0cca96a9b tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23889340-f1ad-4c0b-a3d5-72b62e3b5fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:17:10.006325 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-98a7fdb0-b6af-4c3d-bc08-56c0cca96a9b tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23889340-f1ad-4c0b-a3d5-72b62e3b5fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:17:10.011556 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-98a7fdb0-b6af-4c3d-bc08-56c0cca96a9b tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73c13d6d-c22c-4229-a1c2-fa4530ca62c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:17:10.098130 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-98a7fdb0-b6af-4c3d-bc08-56c0cca96a9b tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73c13d6d-c22c-4229-a1c2-fa4530ca62c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1730763a-1607-4e4e-8d72-a6ec08b2d6b5', 'volume_name': 'volume-1730763a-1607-4e4e-8d72-a6ec08b2d6b5', 'volume_size': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e2f828af0706465883131e16cb564d05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'created_at': datetime.datetime(2022, 5, 7, 21, 36, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:17:10.104376 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-98a7fdb0-b6af-4c3d-bc08-56c0cca96a9b tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c835395d-7f9d-40ca-8303-1d12cb8ea84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:17:10.114426 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-98a7fdb0-b6af-4c3d-bc08-56c0cca96a9b tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c835395d-7f9d-40ca-8303-1d12cb8ea84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:17:10.114703 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-98a7fdb0-b6af-4c3d-bc08-56c0cca96a9b tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d2ebeb2-dd4d-4ae5-839b-f039a473525e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:17:10.115886 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-98a7fdb0-b6af-4c3d-bc08-56c0cca96a9b tempest-VolumesGetTest-717577636 None] Volume 1730763a-1607-4e4e-8d72-a6ec08b2d6b5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1730763a-1607-4e4e-8d72-a6ec08b2d6b5', 'volume_size': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e2f828af0706465883131e16cb564d05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'created_at': datetime.datetime(2022, 5, 7, 21, 36, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } May 07 22:17:10.116446 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-98a7fdb0-b6af-4c3d-bc08-56c0cca96a9b tempest-VolumesGetTest-717577636 None] Cloning 1730763a-1607-4e4e-8d72-a6ec08b2d6b5 from image 3756ae98-5c12-48e7-920e-ef5d1dd5543c at location (None, None). {{(pid=129946) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} May 07 22:17:10.127678 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-98a7fdb0-b6af-4c3d-bc08-56c0cca96a9b tempest-VolumesGetTest-717577636 None] Lock "b'cinder-3756ae98-5c12-48e7-920e-ef5d1dd5543c'" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:17:10.144336 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-98a7fdb0-b6af-4c3d-bc08-56c0cca96a9b tempest-VolumesGetTest-717577636 None] Found image-volume cache entry: {'id': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'volume_id': '82279f40-9683-441f-a541-0db8b9177f48', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9), 'last_used': datetime.datetime(2022, 5, 7, 22, 17, 10, 132182)}. {{(pid=129946) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 07 22:17:10.144754 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-98a7fdb0-b6af-4c3d-bc08-56c0cca96a9b tempest-VolumesGetTest-717577636 None] Image-volume cache entry image_update_at = 2022-05-07 21:37:09+00:00, requested image updated_at = 2022-05-07 21:37:09+00:00. {{(pid=129946) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 07 22:17:10.145154 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-98a7fdb0-b6af-4c3d-bc08-56c0cca96a9b tempest-VolumesGetTest-717577636 None] Found cache entry for image = 3756ae98-5c12-48e7-920e-ef5d1dd5543c on host ncdv-master-1@ceph#ceph. {{(pid=129946) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} May 07 22:17:10.153763 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-98a7fdb0-b6af-4c3d-bc08-56c0cca96a9b tempest-VolumesGetTest-717577636 None] Lock "b'cinder-3756ae98-5c12-48e7-920e-ef5d1dd5543c'" released by "_prepare_image_cache_entry" :: held 0.026s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:17:10.154611 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-98a7fdb0-b6af-4c3d-bc08-56c0cca96a9b tempest-VolumesGetTest-717577636 None] Attempting to retrieve cache entry for image = 3756ae98-5c12-48e7-920e-ef5d1dd5543c on host ncdv-master-1@ceph#ceph. {{(pid=129946) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} May 07 22:17:10.161153 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-98a7fdb0-b6af-4c3d-bc08-56c0cca96a9b tempest-VolumesGetTest-717577636 None] Found image-volume cache entry: {'id': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'volume_id': '82279f40-9683-441f-a541-0db8b9177f48', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9), 'last_used': datetime.datetime(2022, 5, 7, 22, 17, 10, 158225)}. {{(pid=129946) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 07 22:17:10.161622 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-98a7fdb0-b6af-4c3d-bc08-56c0cca96a9b tempest-VolumesGetTest-717577636 None] Image-volume cache entry image_update_at = 2022-05-07 21:37:09+00:00, requested image updated_at = 2022-05-07 21:37:09+00:00. {{(pid=129946) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 07 22:17:10.162007 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-98a7fdb0-b6af-4c3d-bc08-56c0cca96a9b tempest-VolumesGetTest-717577636 None] Creating from source image-volume 82279f40-9683-441f-a541-0db8b9177f48 {{(pid=129946) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} May 07 22:17:10.182053 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-98a7fdb0-b6af-4c3d-bc08-56c0cca96a9b tempest-VolumesGetTest-717577636 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:17:10.239615 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-98a7fdb0-b6af-4c3d-bc08-56c0cca96a9b tempest-VolumesGetTest-717577636 None] creating snapshot='volume-1730763a-1607-4e4e-8d72-a6ec08b2d6b5.clone_snap' {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} May 07 22:17:10.423831 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-98a7fdb0-b6af-4c3d-bc08-56c0cca96a9b tempest-VolumesGetTest-717577636 None] cloning 'volume-82279f40-9683-441f-a541-0db8b9177f48@volume-1730763a-1607-4e4e-8d72-a6ec08b2d6b5.clone_snap' to 'volume-1730763a-1607-4e4e-8d72-a6ec08b2d6b5' {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 07 22:17:10.426160 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-629d7621-506c-438d-a3b8-e42c573b61bf tempest-VolumesSnapshotListTestJSON-1624502190 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:17:10.585535 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-98a7fdb0-b6af-4c3d-bc08-56c0cca96a9b tempest-VolumesGetTest-717577636 None] Volume volume-3864f924-91b4-4015-ab37-8bdbf8ad652d.deleted is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:17:10.586701 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-98a7fdb0-b6af-4c3d-bc08-56c0cca96a9b tempest-VolumesGetTest-717577636 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:17:10.587113 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-98a7fdb0-b6af-4c3d-bc08-56c0cca96a9b tempest-VolumesGetTest-717577636 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:17:10.603927 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-98a7fdb0-b6af-4c3d-bc08-56c0cca96a9b tempest-VolumesGetTest-717577636 None] clone created successfully {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} May 07 22:17:10.604522 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.volume_utils [None req-98a7fdb0-b6af-4c3d-bc08-56c0cca96a9b tempest-VolumesGetTest-717577636 None] Marking volume 1730763a-1607-4e4e-8d72-a6ec08b2d6b5 as bootable. {{(pid=129946) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} May 07 22:17:10.612759 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-98a7fdb0-b6af-4c3d-bc08-56c0cca96a9b tempest-VolumesGetTest-717577636 None] Copying metadata from image 3756ae98-5c12-48e7-920e-ef5d1dd5543c to 1730763a-1607-4e4e-8d72-a6ec08b2d6b5. {{(pid=129946) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} May 07 22:17:10.613199 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-98a7fdb0-b6af-4c3d-bc08-56c0cca96a9b tempest-VolumesGetTest-717577636 None] Creating volume glance metadata for volume 1730763a-1607-4e4e-8d72-a6ec08b2d6b5 backed by image 3756ae98-5c12-48e7-920e-ef5d1dd5543c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129946) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} May 07 22:17:10.660866 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-98a7fdb0-b6af-4c3d-bc08-56c0cca96a9b tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d2ebeb2-dd4d-4ae5-839b-f039a473525e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1730763a-1607-4e4e-8d72-a6ec08b2d6b5', 'volume_size': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e2f828af0706465883131e16cb564d05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'created_at': datetime.datetime(2022, 5, 7, 21, 36, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:17:10.665521 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-98a7fdb0-b6af-4c3d-bc08-56c0cca96a9b tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26cc6836-0796-4d87-a5fd-83837111f90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:17:10.673895 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-98a7fdb0-b6af-4c3d-bc08-56c0cca96a9b tempest-VolumesGetTest-717577636 None] Volume volume-1730763a-1607-4e4e-8d72-a6ec08b2d6b5 (1730763a-1607-4e4e-8d72-a6ec08b2d6b5): created successfully May 07 22:17:10.677608 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-98a7fdb0-b6af-4c3d-bc08-56c0cca96a9b tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26cc6836-0796-4d87-a5fd-83837111f90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:17:10.683200 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-98a7fdb0-b6af-4c3d-bc08-56c0cca96a9b tempest-VolumesGetTest-717577636 None] Flow 'volume_create_manager' (815e0a81-ee63-4597-9a78-0723b53f468d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:17:10.691116 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-98a7fdb0-b6af-4c3d-bc08-56c0cca96a9b tempest-VolumesGetTest-717577636 None] Created volume successfully. May 07 22:17:11.436460 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-629d7621-506c-438d-a3b8-e42c573b61bf tempest-VolumesSnapshotListTestJSON-1624502190 None] Create snapshot completed successfully May 07 22:17:11.463810 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb1406d3-550e-475d-a612-92c4ccad2701 tempest-VolumesGetTest-717577636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:17:11.483865 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-fb1406d3-550e-475d-a612-92c4ccad2701 tempest-VolumesGetTest-717577636 None] Flow 'volume_create_manager' (cc54a938-541a-4f7f-b273-321cf6f9649c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:17:11.490422 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-fb1406d3-550e-475d-a612-92c4ccad2701 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (139cabcb-36ad-4132-a9ce-093aad8de50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:17:11.504959 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-fb1406d3-550e-475d-a612-92c4ccad2701 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (139cabcb-36ad-4132-a9ce-093aad8de50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:17:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-391559855',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0de1293a-1a5b-469c-89fb-1c865d9be242,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='162642dda04647e3ba9064594cfad423',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:17:11Z,use_quota=True,user_id='8dffc3e4bcad4a6b8ec9b1faf27c8bc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:17:11.510419 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-fb1406d3-550e-475d-a612-92c4ccad2701 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ff771ab-8ea1-4fd2-bc31-dfe0b1b890cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:17:11.515162 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-fb1406d3-550e-475d-a612-92c4ccad2701 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ff771ab-8ea1-4fd2-bc31-dfe0b1b890cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:17:11.520360 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-fb1406d3-550e-475d-a612-92c4ccad2701 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c44b307-b891-45aa-944e-6cb934dc3c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:17:11.524564 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-fb1406d3-550e-475d-a612-92c4ccad2701 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c44b307-b891-45aa-944e-6cb934dc3c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0de1293a-1a5b-469c-89fb-1c865d9be242', 'volume_name': 'volume-0de1293a-1a5b-469c-89fb-1c865d9be242', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:17:11.530164 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-fb1406d3-550e-475d-a612-92c4ccad2701 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfe66bde-0091-4af9-8575-4cb96481825e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:17:11.534105 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-fb1406d3-550e-475d-a612-92c4ccad2701 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfe66bde-0091-4af9-8575-4cb96481825e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:17:11.538930 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-fb1406d3-550e-475d-a612-92c4ccad2701 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08c52d43-f1c5-4678-b2dc-a2ca6b8ab4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:17:11.540000 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-fb1406d3-550e-475d-a612-92c4ccad2701 tempest-VolumesGetTest-717577636 None] Volume 0de1293a-1a5b-469c-89fb-1c865d9be242: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0de1293a-1a5b-469c-89fb-1c865d9be242', 'volume_size': 1} May 07 22:17:11.540386 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-fb1406d3-550e-475d-a612-92c4ccad2701 tempest-VolumesGetTest-717577636 None] creating volume 'volume-0de1293a-1a5b-469c-89fb-1c865d9be242' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:17:11.541153 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-fb1406d3-550e-475d-a612-92c4ccad2701 tempest-VolumesGetTest-717577636 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:17:11.596569 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-fb1406d3-550e-475d-a612-92c4ccad2701 tempest-VolumesGetTest-717577636 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:17:11.596950 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-fb1406d3-550e-475d-a612-92c4ccad2701 tempest-VolumesGetTest-717577636 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:17:11.600855 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-fb1406d3-550e-475d-a612-92c4ccad2701 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08c52d43-f1c5-4678-b2dc-a2ca6b8ab4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0de1293a-1a5b-469c-89fb-1c865d9be242', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:17:11.605664 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-fb1406d3-550e-475d-a612-92c4ccad2701 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ce0906e-ab6b-49a4-8d74-007ba4382835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:17:11.614835 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-fb1406d3-550e-475d-a612-92c4ccad2701 tempest-VolumesGetTest-717577636 None] Volume volume-0de1293a-1a5b-469c-89fb-1c865d9be242 (0de1293a-1a5b-469c-89fb-1c865d9be242): created successfully May 07 22:17:11.618450 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-fb1406d3-550e-475d-a612-92c4ccad2701 tempest-VolumesGetTest-717577636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ce0906e-ab6b-49a4-8d74-007ba4382835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:17:11.624104 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-fb1406d3-550e-475d-a612-92c4ccad2701 tempest-VolumesGetTest-717577636 None] Flow 'volume_create_manager' (cc54a938-541a-4f7f-b273-321cf6f9649c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:17:11.632198 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-fb1406d3-550e-475d-a612-92c4ccad2701 tempest-VolumesGetTest-717577636 None] Created volume successfully. May 07 22:17:12.364474 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-502fa6ff-1590-4db2-a944-80b9658234c5 tempest-VolumesSnapshotListTestJSON-1624502190 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:17:12.567198 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-fcf713df-c683-429f-a1f9-41905c9479a2 tempest-VolumesGetTest-717577636 None] Lock "b'cinder-0de1293a-1a5b-469c-89fb-1c865d9be242-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:17:12.597554 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-fcf713df-c683-429f-a1f9-41905c9479a2 tempest-VolumesGetTest-717577636 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:17:12.633126 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-fcf713df-c683-429f-a1f9-41905c9479a2 tempest-VolumesGetTest-717577636 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:17:12.633556 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-fcf713df-c683-429f-a1f9-41905c9479a2 tempest-VolumesGetTest-717577636 None] Volume volume-0de1293a-1a5b-469c-89fb-1c865d9be242 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:17:12.637858 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-fcf713df-c683-429f-a1f9-41905c9479a2 tempest-VolumesGetTest-717577636 None] deleting rbd volume volume-0de1293a-1a5b-469c-89fb-1c865d9be242 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:17:12.854359 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-fcf713df-c683-429f-a1f9-41905c9479a2 tempest-VolumesGetTest-717577636 None] Created reservations ['39f2ecd9-8fe1-470a-9f4d-a977f091140b', '58b275d8-9dd7-4999-b71d-7e5fcb124d9e', '83f6b2fc-6190-42be-8b81-b958f53f3f43', '35443e5d-7e49-493b-8e63-e34b403fbe32'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:17:12.898106 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-fcf713df-c683-429f-a1f9-41905c9479a2 tempest-VolumesGetTest-717577636 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:17:12.919110 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-fcf713df-c683-429f-a1f9-41905c9479a2 tempest-VolumesGetTest-717577636 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:17:12.944416 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-fcf713df-c683-429f-a1f9-41905c9479a2 tempest-VolumesGetTest-717577636 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:17:12.948433 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-fcf713df-c683-429f-a1f9-41905c9479a2 tempest-VolumesGetTest-717577636 None] Deleted volume successfully. May 07 22:17:12.959978 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-fcf713df-c683-429f-a1f9-41905c9479a2 tempest-VolumesGetTest-717577636 None] Lock "b'cinder-0de1293a-1a5b-469c-89fb-1c865d9be242-delete_volume'" released by "delete_volume" :: held 0.393s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:17:13.483984 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-502fa6ff-1590-4db2-a944-80b9658234c5 tempest-VolumesSnapshotListTestJSON-1624502190 None] Create snapshot completed successfully May 07 22:17:13.701509 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-be738c88-65e7-4e14-8e1b-17fbdd0d1724 tempest-VolumesGetTest-717577636 None] Lock "b'cinder-1730763a-1607-4e4e-8d72-a6ec08b2d6b5-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:17:13.733707 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-be738c88-65e7-4e14-8e1b-17fbdd0d1724 tempest-VolumesGetTest-717577636 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:17:13.806411 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-be738c88-65e7-4e14-8e1b-17fbdd0d1724 tempest-VolumesGetTest-717577636 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:17:13.816130 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-be738c88-65e7-4e14-8e1b-17fbdd0d1724 tempest-VolumesGetTest-717577636 None] deleting rbd volume volume-1730763a-1607-4e4e-8d72-a6ec08b2d6b5 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:17:14.086706 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-be738c88-65e7-4e14-8e1b-17fbdd0d1724 tempest-VolumesGetTest-717577636 None] volume is a clone so cleaning references {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} May 07 22:17:14.119872 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-be738c88-65e7-4e14-8e1b-17fbdd0d1724 tempest-VolumesGetTest-717577636 None] deleting parent snapshot volume-1730763a-1607-4e4e-8d72-a6ec08b2d6b5.clone_snap {{(pid=129946) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} May 07 22:17:14.527237 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-be738c88-65e7-4e14-8e1b-17fbdd0d1724 tempest-VolumesGetTest-717577636 None] Created reservations ['d7d76d0f-b127-4510-9e71-c8d1e60b7f2b', '6115966d-a3c5-46d8-95d8-46b4b00b3b34', '45bc79df-3a25-4205-9a89-19829a0d35a8', '83186180-9607-41da-9176-02e6763c7a2c'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:17:14.576093 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-be738c88-65e7-4e14-8e1b-17fbdd0d1724 tempest-VolumesGetTest-717577636 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:17:14.602368 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-be738c88-65e7-4e14-8e1b-17fbdd0d1724 tempest-VolumesGetTest-717577636 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:17:14.626861 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-be738c88-65e7-4e14-8e1b-17fbdd0d1724 tempest-VolumesGetTest-717577636 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:17:14.632469 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-be738c88-65e7-4e14-8e1b-17fbdd0d1724 tempest-VolumesGetTest-717577636 None] Deleted volume successfully. May 07 22:17:14.645234 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-be738c88-65e7-4e14-8e1b-17fbdd0d1724 tempest-VolumesGetTest-717577636 None] Lock "b'cinder-1730763a-1607-4e4e-8d72-a6ec08b2d6b5-delete_volume'" released by "delete_volume" :: held 0.944s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:17:14.849951 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-03af37f9-1dd0-4559-8419-14e756b77d3c tempest-VolumesGetTest-717577636 None] Lock "b'cinder-733724e6-4834-48e8-98d2-608394e479c6-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:17:14.879078 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-03af37f9-1dd0-4559-8419-14e756b77d3c tempest-VolumesGetTest-717577636 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:17:14.923970 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-03af37f9-1dd0-4559-8419-14e756b77d3c tempest-VolumesGetTest-717577636 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:17:14.924399 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-03af37f9-1dd0-4559-8419-14e756b77d3c tempest-VolumesGetTest-717577636 None] Volume volume-733724e6-4834-48e8-98d2-608394e479c6 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:17:14.930155 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-03af37f9-1dd0-4559-8419-14e756b77d3c tempest-VolumesGetTest-717577636 None] deleting rbd volume volume-733724e6-4834-48e8-98d2-608394e479c6 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:17:15.168161 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-2bc255c4-bf41-4ecd-a0c7-9b4ab38e0995 tempest-VolumesSnapshotListTestJSON-1624502190 None] Lock "b'cinder-ca0e7ad1-7bca-4952-a2c0-cee522b3f9cb-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:17:15.169780 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-2bc255c4-bf41-4ecd-a0c7-9b4ab38e0995 tempest-VolumesSnapshotListTestJSON-1624502190 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:17:15.259470 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-03af37f9-1dd0-4559-8419-14e756b77d3c tempest-VolumesGetTest-717577636 None] Created reservations ['a0103c2b-a315-497f-b6f0-34e23908d88a', 'ac8d3bea-018f-4551-b688-3076bb7704d5', '3b57f9f5-1714-4d33-a11a-78f5c54cf321', '6a64f130-8822-4928-b8ee-e56887459d2b'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:17:15.305637 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-03af37f9-1dd0-4559-8419-14e756b77d3c tempest-VolumesGetTest-717577636 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:17:15.329180 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-03af37f9-1dd0-4559-8419-14e756b77d3c tempest-VolumesGetTest-717577636 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:17:15.353041 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-03af37f9-1dd0-4559-8419-14e756b77d3c tempest-VolumesGetTest-717577636 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:17:15.357538 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-03af37f9-1dd0-4559-8419-14e756b77d3c tempest-VolumesGetTest-717577636 None] Deleted volume successfully. May 07 22:17:15.369237 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-03af37f9-1dd0-4559-8419-14e756b77d3c tempest-VolumesGetTest-717577636 None] Lock "b'cinder-733724e6-4834-48e8-98d2-608394e479c6-delete_volume'" released by "delete_volume" :: held 0.525s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:17:15.532101 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-2bc255c4-bf41-4ecd-a0c7-9b4ab38e0995 tempest-VolumesSnapshotListTestJSON-1624502190 None] Created reservations ['eea73d12-aa30-4731-a62b-93661a547b07', 'eac0b758-d5e3-4d27-a8e7-1ab91fb0309c', '73b396b5-8aa4-43c8-a917-ab8ef2e76d67', 'dba95e07-fa95-419b-84a7-9695bc663974'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:17:15.567498 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-2bc255c4-bf41-4ecd-a0c7-9b4ab38e0995 tempest-VolumesSnapshotListTestJSON-1624502190 None] Delete snapshot completed successfully. May 07 22:17:15.572106 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-2bc255c4-bf41-4ecd-a0c7-9b4ab38e0995 tempest-VolumesSnapshotListTestJSON-1624502190 None] Lock "b'cinder-ca0e7ad1-7bca-4952-a2c0-cee522b3f9cb-delete_snapshot'" released by "delete_snapshot" :: held 0.404s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:17:16.290590 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-0e979f38-cb56-4e11-8ec0-8a70b15eb638 tempest-VolumesSnapshotListTestJSON-1624502190 None] Lock "b'cinder-8ee03374-6a09-4d13-bbaa-f5406fb8d9de-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.013s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:17:16.293237 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-0e979f38-cb56-4e11-8ec0-8a70b15eb638 tempest-VolumesSnapshotListTestJSON-1624502190 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:17:17.550046 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-0e979f38-cb56-4e11-8ec0-8a70b15eb638 tempest-VolumesSnapshotListTestJSON-1624502190 None] Created reservations ['ed2f52db-6c69-46bb-b807-8a2f19ae0cbd', '7eb40823-6daa-4fca-b029-69ecac5ef9ba', '1ef0de5c-6ad3-4bc9-bc34-5e493fb05f78', '176df919-05e4-4ec8-9497-8a4cae41f09e'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:17:17.589049 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-0e979f38-cb56-4e11-8ec0-8a70b15eb638 tempest-VolumesSnapshotListTestJSON-1624502190 None] Delete snapshot completed successfully. May 07 22:17:17.596522 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-0e979f38-cb56-4e11-8ec0-8a70b15eb638 tempest-VolumesSnapshotListTestJSON-1624502190 None] Lock "b'cinder-8ee03374-6a09-4d13-bbaa-f5406fb8d9de-delete_snapshot'" released by "delete_snapshot" :: held 1.306s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:17:18.442373 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-901c14f0-05c7-40fc-9fc9-828ca7853ae5 tempest-VolumesSnapshotListTestJSON-1624502190 None] Lock "b'cinder-2e025244-fb4f-43e2-b9ab-108b492a3661-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.019s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:17:18.444684 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-901c14f0-05c7-40fc-9fc9-828ca7853ae5 tempest-VolumesSnapshotListTestJSON-1624502190 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:17:19.595817 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-901c14f0-05c7-40fc-9fc9-828ca7853ae5 tempest-VolumesSnapshotListTestJSON-1624502190 None] Created reservations ['c871d5bb-0c36-4d8e-bc2e-bbfa67c7c5f4', '71caf5a2-bb1c-4661-909e-0c864006b7bb', '51bd648c-7fab-47ca-85cb-164642c6c2ae', '9080bd89-f754-4b19-ab77-3711de1f1769'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:17:19.636547 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-901c14f0-05c7-40fc-9fc9-828ca7853ae5 tempest-VolumesSnapshotListTestJSON-1624502190 None] Delete snapshot completed successfully. May 07 22:17:19.641981 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-901c14f0-05c7-40fc-9fc9-828ca7853ae5 tempest-VolumesSnapshotListTestJSON-1624502190 None] Lock "b'cinder-2e025244-fb4f-43e2-b9ab-108b492a3661-delete_snapshot'" released by "delete_snapshot" :: held 1.200s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:17:20.567367 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-7ac8ba4a-8ded-48cb-bf25-69e4a1571a0a tempest-VolumesSnapshotListTestJSON-1624502190 None] Lock "b'cinder-5c79abe8-4a8a-4947-bc32-abc63656ddf9-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:17:20.603722 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-7ac8ba4a-8ded-48cb-bf25-69e4a1571a0a tempest-VolumesSnapshotListTestJSON-1624502190 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:17:20.641587 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-7ac8ba4a-8ded-48cb-bf25-69e4a1571a0a tempest-VolumesSnapshotListTestJSON-1624502190 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:17:20.642204 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-7ac8ba4a-8ded-48cb-bf25-69e4a1571a0a tempest-VolumesSnapshotListTestJSON-1624502190 None] Volume volume-5c79abe8-4a8a-4947-bc32-abc63656ddf9 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:17:20.646923 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-7ac8ba4a-8ded-48cb-bf25-69e4a1571a0a tempest-VolumesSnapshotListTestJSON-1624502190 None] deleting rbd volume volume-5c79abe8-4a8a-4947-bc32-abc63656ddf9 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:17:20.833888 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-7ac8ba4a-8ded-48cb-bf25-69e4a1571a0a tempest-VolumesSnapshotListTestJSON-1624502190 None] Created reservations ['05f6fcf6-6e65-41df-afd6-f3ef4bfc0dc5', 'd23a52e5-6db6-49aa-b8c8-59d7ebbbb9cd', '6dc6c0ed-0e9a-4414-a435-3ec2ed1f24a8', 'fb957cfc-9300-4a99-bf64-1a98984c0c60'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:17:20.877451 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-7ac8ba4a-8ded-48cb-bf25-69e4a1571a0a tempest-VolumesSnapshotListTestJSON-1624502190 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:17:20.900006 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-7ac8ba4a-8ded-48cb-bf25-69e4a1571a0a tempest-VolumesSnapshotListTestJSON-1624502190 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:17:20.927460 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-7ac8ba4a-8ded-48cb-bf25-69e4a1571a0a tempest-VolumesSnapshotListTestJSON-1624502190 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:17:20.931302 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-7ac8ba4a-8ded-48cb-bf25-69e4a1571a0a tempest-VolumesSnapshotListTestJSON-1624502190 None] Deleted volume successfully. May 07 22:17:20.942561 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-7ac8ba4a-8ded-48cb-bf25-69e4a1571a0a tempest-VolumesSnapshotListTestJSON-1624502190 None] Lock "b'cinder-5c79abe8-4a8a-4947-bc32-abc63656ddf9-delete_volume'" released by "delete_volume" :: held 0.375s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:17:31.200248 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:17:31.201536 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:17:31.233667 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:17:31.257291 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:17:36.382175 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-6c3d1ff7-7d50-4640-bab8-7899aa1283ce req-913519c2-ddac-432b-8f34-bf6ed55bc773 tempest-TestVolumeBootPattern-860620187 None] Terminate volume connection completed successfully. May 07 22:17:36.382754 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-6c3d1ff7-7d50-4640-bab8-7899aa1283ce req-913519c2-ddac-432b-8f34-bf6ed55bc773 tempest-TestVolumeBootPattern-860620187 None] Deleting attachment 20409dac-1cdc-4a9a-ad0c-29e0acf9b619. {{(pid=129946) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 07 22:17:39.582752 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-f1baf4c3-ab50-492c-a4d5-744ef30c44d4 req-2381cec1-55b5-404d-8fc0-db3af5882d9c tempest-TestVolumeBootPattern-860620187 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 22:17:40.357024 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-f1baf4c3-ab50-492c-a4d5-744ef30c44d4 req-2381cec1-55b5-404d-8fc0-db3af5882d9c tempest-TestVolumeBootPattern-860620187 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.775s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 22:17:40.357853 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-f1baf4c3-ab50-492c-a4d5-744ef30c44d4 req-2381cec1-55b5-404d-8fc0-db3af5882d9c tempest-TestVolumeBootPattern-860620187 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d5293072-2a82-483d-ad24-437bd38b3be7', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3ca0b836-1cfe-436a-b0fa-deb74d3203d9', 'volume_id': 'd5293072-2a82-483d-ad24-437bd38b3be7', 'discard': True}} {{(pid=129946) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 07 22:17:40.381337 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-f1baf4c3-ab50-492c-a4d5-744ef30c44d4 req-2381cec1-55b5-404d-8fc0-db3af5882d9c tempest-TestVolumeBootPattern-860620187 None] Connection info returned from driver {'name': 'volumes/volume-d5293072-2a82-483d-ad24-437bd38b3be7', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd5293072-2a82-483d-ad24-437bd38b3be7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '7ef995bd-4d99-4771-900e-91be4b36804a'} {{(pid=129946) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 07 22:17:40.427909 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-f1baf4c3-ab50-492c-a4d5-744ef30c44d4 req-2381cec1-55b5-404d-8fc0-db3af5882d9c tempest-TestVolumeBootPattern-860620187 None] attachment_update completed successfully. May 07 22:18:31.202938 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:18:31.203917 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:18:31.231287 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:18:31.253609 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:19:31.199146 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:19:31.199853 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:19:31.225079 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:19:31.247062 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:19:41.454367 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-c72e67b5-0cc2-480d-8104-2abaa6a04f64 tempest-TestVolumeBootPattern-860620187 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:19:42.548797 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-c72e67b5-0cc2-480d-8104-2abaa6a04f64 tempest-TestVolumeBootPattern-860620187 None] Create snapshot completed successfully May 07 22:19:43.868479 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d8efeec-9688-43ac-b2b7-933b3f878dbc tempest-TestVolumeBootPattern-860620187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:19:43.897075 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5d8efeec-9688-43ac-b2b7-933b3f878dbc tempest-TestVolumeBootPattern-860620187 None] Flow 'volume_create_manager' (369297ef-52c3-44ba-938b-322dd3a59491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:19:43.903767 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5d8efeec-9688-43ac-b2b7-933b3f878dbc tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (510b7a18-6da8-4eb8-865f-86ddd106d8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:19:43.920884 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5d8efeec-9688-43ac-b2b7-933b3f878dbc tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (510b7a18-6da8-4eb8-865f-86ddd106d8e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-1291788329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f9f101f0-0189-4520-a073-6074f76ea4db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3657e8df46a4252b9eb1eb159306a66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=64d057e8-c270-4c8c-80a9-b074ffaba6ea,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:19:44Z,use_quota=True,user_id='9b4988836610494ab48a138bd43d5b52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:19:43.926995 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5d8efeec-9688-43ac-b2b7-933b3f878dbc tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3003d647-8a2c-4e55-be86-5858982f09d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:19:43.931184 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5d8efeec-9688-43ac-b2b7-933b3f878dbc tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3003d647-8a2c-4e55-be86-5858982f09d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:19:43.936389 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5d8efeec-9688-43ac-b2b7-933b3f878dbc tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b90d93ee-06a0-4b8b-b0bc-21e1cfa764f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:19:43.940563 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5d8efeec-9688-43ac-b2b7-933b3f878dbc tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b90d93ee-06a0-4b8b-b0bc-21e1cfa764f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f9f101f0-0189-4520-a073-6074f76ea4db', 'volume_name': 'volume-f9f101f0-0189-4520-a073-6074f76ea4db', 'volume_size': 1, 'snapshot_id': '64d057e8-c270-4c8c-80a9-b074ffaba6ea'}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:19:43.945561 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5d8efeec-9688-43ac-b2b7-933b3f878dbc tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27a399f6-ee8b-4960-9be6-b928c54b06b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:19:43.949537 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5d8efeec-9688-43ac-b2b7-933b3f878dbc tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27a399f6-ee8b-4960-9be6-b928c54b06b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:19:43.954325 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5d8efeec-9688-43ac-b2b7-933b3f878dbc tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e81648af-b7be-4a66-b50d-fa5926abc0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:19:43.955460 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-5d8efeec-9688-43ac-b2b7-933b3f878dbc tempest-TestVolumeBootPattern-860620187 None] Volume f9f101f0-0189-4520-a073-6074f76ea4db: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f9f101f0-0189-4520-a073-6074f76ea4db', 'volume_size': 1, 'snapshot_id': '64d057e8-c270-4c8c-80a9-b074ffaba6ea'} May 07 22:19:43.978427 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-5d8efeec-9688-43ac-b2b7-933b3f878dbc tempest-TestVolumeBootPattern-860620187 None] cloning volumes/volume-d5293072-2a82-483d-ad24-437bd38b3be7@snapshot-64d057e8-c270-4c8c-80a9-b074ffaba6ea to volume-f9f101f0-0189-4520-a073-6074f76ea4db {{(pid=129946) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1091}} May 07 22:19:43.979154 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-5d8efeec-9688-43ac-b2b7-933b3f878dbc tempest-TestVolumeBootPattern-860620187 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:19:44.042156 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-5d8efeec-9688-43ac-b2b7-933b3f878dbc tempest-TestVolumeBootPattern-860620187 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:19:44.170666 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-5d8efeec-9688-43ac-b2b7-933b3f878dbc tempest-TestVolumeBootPattern-860620187 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:19:44.171078 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-5d8efeec-9688-43ac-b2b7-933b3f878dbc tempest-TestVolumeBootPattern-860620187 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:19:44.191618 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.volume_utils [None req-5d8efeec-9688-43ac-b2b7-933b3f878dbc tempest-TestVolumeBootPattern-860620187 None] Marking volume f9f101f0-0189-4520-a073-6074f76ea4db as bootable. {{(pid=129946) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} May 07 22:19:44.196098 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d8efeec-9688-43ac-b2b7-933b3f878dbc tempest-TestVolumeBootPattern-860620187 None] Copying metadata from snapshot 64d057e8-c270-4c8c-80a9-b074ffaba6ea to f9f101f0-0189-4520-a073-6074f76ea4db. {{(pid=129946) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:427}} May 07 22:19:44.227281 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5d8efeec-9688-43ac-b2b7-933b3f878dbc tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e81648af-b7be-4a66-b50d-fa5926abc0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9f101f0-0189-4520-a073-6074f76ea4db', 'volume_size': 1, 'snapshot_id': '64d057e8-c270-4c8c-80a9-b074ffaba6ea'}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:19:44.232044 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5d8efeec-9688-43ac-b2b7-933b3f878dbc tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7b645e1-b2fc-43c3-a81a-e0c79e102543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:19:44.239987 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-5d8efeec-9688-43ac-b2b7-933b3f878dbc tempest-TestVolumeBootPattern-860620187 None] Volume volume-f9f101f0-0189-4520-a073-6074f76ea4db (f9f101f0-0189-4520-a073-6074f76ea4db): created successfully May 07 22:19:44.243562 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5d8efeec-9688-43ac-b2b7-933b3f878dbc tempest-TestVolumeBootPattern-860620187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7b645e1-b2fc-43c3-a81a-e0c79e102543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:19:44.249120 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-5d8efeec-9688-43ac-b2b7-933b3f878dbc tempest-TestVolumeBootPattern-860620187 None] Flow 'volume_create_manager' (369297ef-52c3-44ba-938b-322dd3a59491) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:19:44.260211 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-5d8efeec-9688-43ac-b2b7-933b3f878dbc tempest-TestVolumeBootPattern-860620187 None] Created volume successfully. May 07 22:19:46.688558 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-a640ddb3-50df-4787-b7f7-f91137da2784 req-e22869b3-d80e-4195-8d0b-f0f541958a9c tempest-TestVolumeBootPattern-860620187 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 22:19:47.332291 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-a640ddb3-50df-4787-b7f7-f91137da2784 req-e22869b3-d80e-4195-8d0b-f0f541958a9c tempest-TestVolumeBootPattern-860620187 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.643s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 22:19:47.333255 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-a640ddb3-50df-4787-b7f7-f91137da2784 req-e22869b3-d80e-4195-8d0b-f0f541958a9c tempest-TestVolumeBootPattern-860620187 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f9f101f0-0189-4520-a073-6074f76ea4db', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3ca0b836-1cfe-436a-b0fa-deb74d3203d9', 'volume_id': 'f9f101f0-0189-4520-a073-6074f76ea4db', 'discard': True}} {{(pid=129946) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 07 22:19:47.362523 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-a640ddb3-50df-4787-b7f7-f91137da2784 req-e22869b3-d80e-4195-8d0b-f0f541958a9c tempest-TestVolumeBootPattern-860620187 None] Connection info returned from driver {'name': 'volumes/volume-f9f101f0-0189-4520-a073-6074f76ea4db', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f9f101f0-0189-4520-a073-6074f76ea4db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'fbd5b60f-04a4-415f-896d-f545702aa0a0'} {{(pid=129946) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 07 22:19:47.412138 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-a640ddb3-50df-4787-b7f7-f91137da2784 req-e22869b3-d80e-4195-8d0b-f0f541958a9c tempest-TestVolumeBootPattern-860620187 None] attachment_update completed successfully. May 07 22:20:31.201942 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:20:31.203021 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:20:31.225929 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:20:31.248055 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:21:31.203352 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:21:31.204056 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:21:31.225691 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:21:31.248197 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:21:37.714638 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-7c7d0659-87d7-4d0f-b730-997bc7043f7f req-81957e40-7214-4c90-9359-18a7c8d838ac tempest-TestVolumeBootPattern-860620187 None] Terminate volume connection completed successfully. May 07 22:21:37.715276 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-7c7d0659-87d7-4d0f-b730-997bc7043f7f req-81957e40-7214-4c90-9359-18a7c8d838ac tempest-TestVolumeBootPattern-860620187 None] Deleting attachment fbd5b60f-04a4-415f-896d-f545702aa0a0. {{(pid=129946) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 07 22:21:39.307476 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-fd106a9a-7794-4277-930e-0a563f949c02 tempest-TestVolumeBootPattern-860620187 None] Lock "b'cinder-f9f101f0-0189-4520-a073-6074f76ea4db-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:21:39.339631 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-fd106a9a-7794-4277-930e-0a563f949c02 tempest-TestVolumeBootPattern-860620187 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:21:39.415287 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-fd106a9a-7794-4277-930e-0a563f949c02 tempest-TestVolumeBootPattern-860620187 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:21:39.424498 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-fd106a9a-7794-4277-930e-0a563f949c02 tempest-TestVolumeBootPattern-860620187 None] deleting rbd volume volume-f9f101f0-0189-4520-a073-6074f76ea4db {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:21:39.657023 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-fd106a9a-7794-4277-930e-0a563f949c02 tempest-TestVolumeBootPattern-860620187 None] Created reservations ['ae8f2285-cf03-461e-b73f-84cdca849972', '83e0d25a-0ebf-4e06-89f7-08fb5e05efb3', '9bc2e5a5-07d6-4011-970b-778cfe371380', '02d5c8fd-643d-406f-8e54-e320c0dcd409'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:21:39.700330 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-fd106a9a-7794-4277-930e-0a563f949c02 tempest-TestVolumeBootPattern-860620187 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:21:39.721621 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-fd106a9a-7794-4277-930e-0a563f949c02 tempest-TestVolumeBootPattern-860620187 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:21:39.745413 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-fd106a9a-7794-4277-930e-0a563f949c02 tempest-TestVolumeBootPattern-860620187 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:21:39.750231 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-fd106a9a-7794-4277-930e-0a563f949c02 tempest-TestVolumeBootPattern-860620187 None] Deleted volume successfully. May 07 22:21:39.761710 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-fd106a9a-7794-4277-930e-0a563f949c02 tempest-TestVolumeBootPattern-860620187 None] Lock "b'cinder-f9f101f0-0189-4520-a073-6074f76ea4db-delete_volume'" released by "delete_volume" :: held 0.454s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:21:40.432746 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-e28c6ea7-1ebe-43eb-a987-581a10a355a3 tempest-TestVolumeBootPattern-860620187 None] Lock "b'cinder-64d057e8-c270-4c8c-80a9-b074ffaba6ea-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:21:40.434551 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-e28c6ea7-1ebe-43eb-a987-581a10a355a3 tempest-TestVolumeBootPattern-860620187 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:22:10.600172 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-e28c6ea7-1ebe-43eb-a987-581a10a355a3 tempest-TestVolumeBootPattern-860620187 None] Created reservations ['50a64cb1-dd34-4525-871a-7b2341503da3', '75894832-7aea-4fea-9977-f4cba7ba6aee', 'ea69291c-14bd-466b-8300-86e6e4be9933', '4f4f2823-e199-43d2-af72-2b428c12c6a9'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:22:10.639858 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-e28c6ea7-1ebe-43eb-a987-581a10a355a3 tempest-TestVolumeBootPattern-860620187 None] Delete snapshot completed successfully. May 07 22:22:10.644518 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-e28c6ea7-1ebe-43eb-a987-581a10a355a3 tempest-TestVolumeBootPattern-860620187 None] Lock "b'cinder-64d057e8-c270-4c8c-80a9-b074ffaba6ea-delete_snapshot'" released by "delete_snapshot" :: held 30.212s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:22:14.380657 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-a9c364b8-292d-4b10-985b-c7b27810591d req-2eb3e497-2a03-4740-b13b-b992d0cd11b6 tempest-TestVolumeBootPattern-860620187 None] Terminate volume connection completed successfully. May 07 22:22:14.381320 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-a9c364b8-292d-4b10-985b-c7b27810591d req-2eb3e497-2a03-4740-b13b-b992d0cd11b6 tempest-TestVolumeBootPattern-860620187 None] Deleting attachment 7ef995bd-4d99-4771-900e-91be4b36804a. {{(pid=129946) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 07 22:22:16.468734 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-5db6ed14-c110-44df-a0c1-18b143656591 tempest-TestVolumeBootPattern-860620187 None] Lock "b'cinder-d5293072-2a82-483d-ad24-437bd38b3be7-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:22:16.500693 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-5db6ed14-c110-44df-a0c1-18b143656591 tempest-TestVolumeBootPattern-860620187 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:22:16.563239 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-5db6ed14-c110-44df-a0c1-18b143656591 tempest-TestVolumeBootPattern-860620187 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:22:16.570254 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-5db6ed14-c110-44df-a0c1-18b143656591 tempest-TestVolumeBootPattern-860620187 None] deleting rbd volume volume-d5293072-2a82-483d-ad24-437bd38b3be7 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:22:16.805921 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-5db6ed14-c110-44df-a0c1-18b143656591 tempest-TestVolumeBootPattern-860620187 None] volume is a clone so cleaning references {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} May 07 22:22:16.835487 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-5db6ed14-c110-44df-a0c1-18b143656591 tempest-TestVolumeBootPattern-860620187 None] deleting parent snapshot volume-d5293072-2a82-483d-ad24-437bd38b3be7.clone_snap {{(pid=129946) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} May 07 22:22:17.788471 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-5db6ed14-c110-44df-a0c1-18b143656591 tempest-TestVolumeBootPattern-860620187 None] Created reservations ['64ea0764-d5d1-4974-a71d-0ea4157a188c', 'a6d28018-e10f-4385-b502-71337b750a54', '751677da-42f4-4e27-91d6-c14154c38120', 'd1a6e1c4-e624-4cf6-a1ab-16878a27ae32'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:22:17.831697 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-5db6ed14-c110-44df-a0c1-18b143656591 tempest-TestVolumeBootPattern-860620187 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:22:17.853431 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-5db6ed14-c110-44df-a0c1-18b143656591 tempest-TestVolumeBootPattern-860620187 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:22:17.877197 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-5db6ed14-c110-44df-a0c1-18b143656591 tempest-TestVolumeBootPattern-860620187 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:22:17.882327 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-5db6ed14-c110-44df-a0c1-18b143656591 tempest-TestVolumeBootPattern-860620187 None] Deleted volume successfully. May 07 22:22:17.893843 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-5db6ed14-c110-44df-a0c1-18b143656591 tempest-TestVolumeBootPattern-860620187 None] Lock "b'cinder-d5293072-2a82-483d-ad24-437bd38b3be7-delete_volume'" released by "delete_volume" :: held 1.425s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:22:31.203541 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:22:31.204222 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:22:31.226476 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:22:31.252236 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:23:31.208026 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:23:31.209619 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:23:31.237071 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:23:31.274340 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:24:31.209958 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:24:31.210693 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:24:31.231527 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:24:31.253502 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:25:31.208459 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:25:31.209783 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:25:31.230661 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:25:31.252014 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:26:31.207489 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:26:31.208201 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:26:31.230166 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:26:31.251920 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:27:31.207569 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:27:31.208255 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:27:31.239701 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:27:31.263886 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:28:31.209480 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:28:31.210171 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:28:31.232569 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:28:31.254473 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:28:42.941774 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-c39c0109-16e7-401c-991e-db2f3173e873 tempest-ServerActionsTestJSON-114634088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:28:42.964266 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-c39c0109-16e7-401c-991e-db2f3173e873 tempest-ServerActionsTestJSON-114634088 None] Flow 'volume_create_manager' (dede39cd-2f4d-44d8-a26e-bc58136d9b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:28:42.972173 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-c39c0109-16e7-401c-991e-db2f3173e873 tempest-ServerActionsTestJSON-114634088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28b6fbf1-6e4d-4d49-b58e-03c3fb501f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:28:42.988066 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-c39c0109-16e7-401c-991e-db2f3173e873 tempest-ServerActionsTestJSON-114634088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28b6fbf1-6e4d-4d49-b58e-03c3fb501f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-285576853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8803baac-833f-42a6-9477-276c4f54bf2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='697345bef14f49b0a7ffff78f8f90913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:28:43Z,use_quota=True,user_id='29f04b492fa34ec79228aeb116b422e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:28:42.993576 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-c39c0109-16e7-401c-991e-db2f3173e873 tempest-ServerActionsTestJSON-114634088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25d6e7fd-5b9b-4d76-9990-d3803e98246d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:28:42.997706 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-c39c0109-16e7-401c-991e-db2f3173e873 tempest-ServerActionsTestJSON-114634088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25d6e7fd-5b9b-4d76-9990-d3803e98246d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:28:43.002925 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-c39c0109-16e7-401c-991e-db2f3173e873 tempest-ServerActionsTestJSON-114634088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80ba2e3d-ae18-4d42-b7ae-cffb64d0ce44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:28:43.007256 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-c39c0109-16e7-401c-991e-db2f3173e873 tempest-ServerActionsTestJSON-114634088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80ba2e3d-ae18-4d42-b7ae-cffb64d0ce44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8803baac-833f-42a6-9477-276c4f54bf2c', 'volume_name': 'volume-8803baac-833f-42a6-9477-276c4f54bf2c', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:28:43.012219 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-c39c0109-16e7-401c-991e-db2f3173e873 tempest-ServerActionsTestJSON-114634088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03c2c9e1-7d00-49b4-b5e8-aa018bf6ea42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:28:43.016705 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-c39c0109-16e7-401c-991e-db2f3173e873 tempest-ServerActionsTestJSON-114634088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03c2c9e1-7d00-49b4-b5e8-aa018bf6ea42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:28:43.021641 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-c39c0109-16e7-401c-991e-db2f3173e873 tempest-ServerActionsTestJSON-114634088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceb683c2-1af8-4a95-b14a-6c4caecea837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:28:43.022714 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-c39c0109-16e7-401c-991e-db2f3173e873 tempest-ServerActionsTestJSON-114634088 None] Volume 8803baac-833f-42a6-9477-276c4f54bf2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8803baac-833f-42a6-9477-276c4f54bf2c', 'volume_size': 1} May 07 22:28:43.023123 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-c39c0109-16e7-401c-991e-db2f3173e873 tempest-ServerActionsTestJSON-114634088 None] creating volume 'volume-8803baac-833f-42a6-9477-276c4f54bf2c' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:28:43.023924 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-c39c0109-16e7-401c-991e-db2f3173e873 tempest-ServerActionsTestJSON-114634088 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:28:43.089089 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-c39c0109-16e7-401c-991e-db2f3173e873 tempest-ServerActionsTestJSON-114634088 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:28:43.089568 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-c39c0109-16e7-401c-991e-db2f3173e873 tempest-ServerActionsTestJSON-114634088 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:28:43.094248 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-c39c0109-16e7-401c-991e-db2f3173e873 tempest-ServerActionsTestJSON-114634088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceb683c2-1af8-4a95-b14a-6c4caecea837) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8803baac-833f-42a6-9477-276c4f54bf2c', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:28:43.099716 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-c39c0109-16e7-401c-991e-db2f3173e873 tempest-ServerActionsTestJSON-114634088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ea2b864-b688-43f1-8400-f65c7683106c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:28:43.111318 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-c39c0109-16e7-401c-991e-db2f3173e873 tempest-ServerActionsTestJSON-114634088 None] Volume volume-8803baac-833f-42a6-9477-276c4f54bf2c (8803baac-833f-42a6-9477-276c4f54bf2c): created successfully May 07 22:28:43.115258 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-c39c0109-16e7-401c-991e-db2f3173e873 tempest-ServerActionsTestJSON-114634088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ea2b864-b688-43f1-8400-f65c7683106c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:28:43.121670 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-c39c0109-16e7-401c-991e-db2f3173e873 tempest-ServerActionsTestJSON-114634088 None] Flow 'volume_create_manager' (dede39cd-2f4d-44d8-a26e-bc58136d9b1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:28:43.130328 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-c39c0109-16e7-401c-991e-db2f3173e873 tempest-ServerActionsTestJSON-114634088 None] Created volume successfully. May 07 22:28:44.488551 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-18d7bae4-309f-46fd-9f6a-e1dae538ec71 req-1a91569b-7462-4be8-8428-011db9bfb3f6 tempest-ServerActionsTestJSON-114634088 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 22:28:45.111916 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-18d7bae4-309f-46fd-9f6a-e1dae538ec71 req-1a91569b-7462-4be8-8428-011db9bfb3f6 tempest-ServerActionsTestJSON-114634088 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.623s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 22:28:45.112750 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-18d7bae4-309f-46fd-9f6a-e1dae538ec71 req-1a91569b-7462-4be8-8428-011db9bfb3f6 tempest-ServerActionsTestJSON-114634088 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-8803baac-833f-42a6-9477-276c4f54bf2c', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3ca0b836-1cfe-436a-b0fa-deb74d3203d9', 'volume_id': '8803baac-833f-42a6-9477-276c4f54bf2c', 'discard': True}} {{(pid=129946) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 07 22:28:45.135391 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-18d7bae4-309f-46fd-9f6a-e1dae538ec71 req-1a91569b-7462-4be8-8428-011db9bfb3f6 tempest-ServerActionsTestJSON-114634088 None] Connection info returned from driver {'name': 'volumes/volume-8803baac-833f-42a6-9477-276c4f54bf2c', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '8803baac-833f-42a6-9477-276c4f54bf2c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '6e72c0d7-5253-4c98-8a46-773149f35e11'} {{(pid=129946) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 07 22:28:45.180084 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-18d7bae4-309f-46fd-9f6a-e1dae538ec71 req-1a91569b-7462-4be8-8428-011db9bfb3f6 tempest-ServerActionsTestJSON-114634088 None] attachment_update completed successfully. May 07 22:29:11.153255 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-17d13939-b2d0-4983-91cf-5b9fd0f0b2d2 req-f40cbea3-ba35-41f4-9650-4c51e2b18146 tempest-ServerActionsTestJSON-114634088 None] Terminate volume connection completed successfully. May 07 22:29:11.153999 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-17d13939-b2d0-4983-91cf-5b9fd0f0b2d2 req-f40cbea3-ba35-41f4-9650-4c51e2b18146 tempest-ServerActionsTestJSON-114634088 None] Deleting attachment 6e72c0d7-5253-4c98-8a46-773149f35e11. {{(pid=129946) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 07 22:29:12.952597 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-17d13939-b2d0-4983-91cf-5b9fd0f0b2d2 req-b0027652-b6eb-421c-ba6d-fe785a4a9e63 tempest-ServerActionsTestJSON-114634088 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 22:29:13.573570 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-17d13939-b2d0-4983-91cf-5b9fd0f0b2d2 req-b0027652-b6eb-421c-ba6d-fe785a4a9e63 tempest-ServerActionsTestJSON-114634088 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.621s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 22:29:13.574796 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-17d13939-b2d0-4983-91cf-5b9fd0f0b2d2 req-b0027652-b6eb-421c-ba6d-fe785a4a9e63 tempest-ServerActionsTestJSON-114634088 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-8803baac-833f-42a6-9477-276c4f54bf2c', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3ca0b836-1cfe-436a-b0fa-deb74d3203d9', 'volume_id': '8803baac-833f-42a6-9477-276c4f54bf2c', 'discard': True}} {{(pid=129946) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 07 22:29:13.597454 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-17d13939-b2d0-4983-91cf-5b9fd0f0b2d2 req-b0027652-b6eb-421c-ba6d-fe785a4a9e63 tempest-ServerActionsTestJSON-114634088 None] Connection info returned from driver {'name': 'volumes/volume-8803baac-833f-42a6-9477-276c4f54bf2c', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '8803baac-833f-42a6-9477-276c4f54bf2c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '39b9d097-65e7-4bce-a327-87ab81c29f98'} {{(pid=129946) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 07 22:29:13.644519 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-17d13939-b2d0-4983-91cf-5b9fd0f0b2d2 req-b0027652-b6eb-421c-ba6d-fe785a4a9e63 tempest-ServerActionsTestJSON-114634088 None] attachment_update completed successfully. May 07 22:29:20.108200 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-e0e205cc-d7e4-46d3-809e-221960f0af07 req-6e7deb2e-cdf1-4d1d-be33-fc96f03754b2 tempest-ServerActionsTestJSON-114634088 None] Terminate volume connection completed successfully. May 07 22:29:20.108833 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-e0e205cc-d7e4-46d3-809e-221960f0af07 req-6e7deb2e-cdf1-4d1d-be33-fc96f03754b2 tempest-ServerActionsTestJSON-114634088 None] Deleting attachment 39b9d097-65e7-4bce-a327-87ab81c29f98. {{(pid=129946) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 07 22:29:22.568716 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-e0e205cc-d7e4-46d3-809e-221960f0af07 req-57f7c880-6d1c-45fb-a999-7eaa48064296 tempest-ServerActionsTestJSON-114634088 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 22:29:23.198408 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-e0e205cc-d7e4-46d3-809e-221960f0af07 req-57f7c880-6d1c-45fb-a999-7eaa48064296 tempest-ServerActionsTestJSON-114634088 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.629s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 22:29:23.199379 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-e0e205cc-d7e4-46d3-809e-221960f0af07 req-57f7c880-6d1c-45fb-a999-7eaa48064296 tempest-ServerActionsTestJSON-114634088 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-8803baac-833f-42a6-9477-276c4f54bf2c', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3ca0b836-1cfe-436a-b0fa-deb74d3203d9', 'volume_id': '8803baac-833f-42a6-9477-276c4f54bf2c', 'discard': True}} {{(pid=129946) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 07 22:29:23.223114 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-e0e205cc-d7e4-46d3-809e-221960f0af07 req-57f7c880-6d1c-45fb-a999-7eaa48064296 tempest-ServerActionsTestJSON-114634088 None] Connection info returned from driver {'name': 'volumes/volume-8803baac-833f-42a6-9477-276c4f54bf2c', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '8803baac-833f-42a6-9477-276c4f54bf2c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '759faacd-3bd8-4556-a7ec-aab641681fe7'} {{(pid=129946) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 07 22:29:23.267612 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-e0e205cc-d7e4-46d3-809e-221960f0af07 req-57f7c880-6d1c-45fb-a999-7eaa48064296 tempest-ServerActionsTestJSON-114634088 None] attachment_update completed successfully. May 07 22:29:29.267189 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-b249a866-98d9-42af-9f8a-3e1596d69987 req-ef14534b-8304-47cf-a263-6f6bfc730b83 tempest-ServerActionsTestJSON-114634088 None] Terminate volume connection completed successfully. May 07 22:29:29.267824 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-b249a866-98d9-42af-9f8a-3e1596d69987 req-ef14534b-8304-47cf-a263-6f6bfc730b83 tempest-ServerActionsTestJSON-114634088 None] Deleting attachment 759faacd-3bd8-4556-a7ec-aab641681fe7. {{(pid=129946) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 07 22:29:30.375015 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-e3580a8b-5a53-4d4f-abc4-7d3f168f0085 tempest-ServerActionsTestJSON-114634088 None] Lock "b'cinder-8803baac-833f-42a6-9477-276c4f54bf2c-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:29:30.411826 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-e3580a8b-5a53-4d4f-abc4-7d3f168f0085 tempest-ServerActionsTestJSON-114634088 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:29:30.445588 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-e3580a8b-5a53-4d4f-abc4-7d3f168f0085 tempest-ServerActionsTestJSON-114634088 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:29:30.446042 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-e3580a8b-5a53-4d4f-abc4-7d3f168f0085 tempest-ServerActionsTestJSON-114634088 None] Volume volume-8803baac-833f-42a6-9477-276c4f54bf2c is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:29:30.450715 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-e3580a8b-5a53-4d4f-abc4-7d3f168f0085 tempest-ServerActionsTestJSON-114634088 None] deleting rbd volume volume-8803baac-833f-42a6-9477-276c4f54bf2c {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:29:30.642218 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-e3580a8b-5a53-4d4f-abc4-7d3f168f0085 tempest-ServerActionsTestJSON-114634088 None] Created reservations ['260b8848-30ea-45c3-b924-7238215aea9e', 'a9ceb115-fbf5-45fa-af13-7ea79b006a4f', 'e58783c1-629b-4ee1-80b6-1ad2a5efa0e8', 'abae569d-e04b-4089-9570-68c763ca59a0'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:29:30.684141 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-e3580a8b-5a53-4d4f-abc4-7d3f168f0085 tempest-ServerActionsTestJSON-114634088 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:29:30.705809 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-e3580a8b-5a53-4d4f-abc4-7d3f168f0085 tempest-ServerActionsTestJSON-114634088 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:29:30.729002 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-e3580a8b-5a53-4d4f-abc4-7d3f168f0085 tempest-ServerActionsTestJSON-114634088 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:29:30.733248 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-e3580a8b-5a53-4d4f-abc4-7d3f168f0085 tempest-ServerActionsTestJSON-114634088 None] Deleted volume successfully. May 07 22:29:30.744764 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-e3580a8b-5a53-4d4f-abc4-7d3f168f0085 tempest-ServerActionsTestJSON-114634088 None] Lock "b'cinder-8803baac-833f-42a6-9477-276c4f54bf2c-delete_volume'" released by "delete_volume" :: held 0.370s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:29:31.209789 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:29:31.210475 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:29:31.234274 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:29:31.256141 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:30:31.216800 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:30:31.219649 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:30:31.274704 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:30:31.320620 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:30:58.392446 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-106403a8-a607-46d7-be4f-e3136a3bcbdc tempest-TestMinimumBasicScenario-472552688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:30:58.412142 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-106403a8-a607-46d7-be4f-e3136a3bcbdc tempest-TestMinimumBasicScenario-472552688 None] Flow 'volume_create_manager' (75cf81ad-ea43-47e0-bc55-c3012cd1f82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:30:58.419489 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-106403a8-a607-46d7-be4f-e3136a3bcbdc tempest-TestMinimumBasicScenario-472552688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (775269ee-69fc-4d9a-a914-bb5257e4463d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:30:58.434240 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-106403a8-a607-46d7-be4f-e3136a3bcbdc tempest-TestMinimumBasicScenario-472552688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (775269ee-69fc-4d9a-a914-bb5257e4463d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:30:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1169005952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=81f278a7-4744-462b-9dcf-b548d1819434,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42b928f3be814de2bf73bded06b23fd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:30:58Z,use_quota=True,user_id='96de17f60f6047f2a1886aa8e80354c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:30:58.440465 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-106403a8-a607-46d7-be4f-e3136a3bcbdc tempest-TestMinimumBasicScenario-472552688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (159138ce-1a00-498f-b556-79ece14731cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:30:58.444709 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-106403a8-a607-46d7-be4f-e3136a3bcbdc tempest-TestMinimumBasicScenario-472552688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (159138ce-1a00-498f-b556-79ece14731cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:30:58.449962 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-106403a8-a607-46d7-be4f-e3136a3bcbdc tempest-TestMinimumBasicScenario-472552688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96bd22fe-ced0-47ba-b353-427f5eff7f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:30:58.454851 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-106403a8-a607-46d7-be4f-e3136a3bcbdc tempest-TestMinimumBasicScenario-472552688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96bd22fe-ced0-47ba-b353-427f5eff7f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81f278a7-4744-462b-9dcf-b548d1819434', 'volume_name': 'volume-81f278a7-4744-462b-9dcf-b548d1819434', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:30:58.459907 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-106403a8-a607-46d7-be4f-e3136a3bcbdc tempest-TestMinimumBasicScenario-472552688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62fb9408-3ab1-4ee4-bbf7-75ca95674589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:30:58.463927 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-106403a8-a607-46d7-be4f-e3136a3bcbdc tempest-TestMinimumBasicScenario-472552688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62fb9408-3ab1-4ee4-bbf7-75ca95674589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:30:58.468853 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-106403a8-a607-46d7-be4f-e3136a3bcbdc tempest-TestMinimumBasicScenario-472552688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (009a36d4-75f5-44a0-b57c-63dbb80e798f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:30:58.469954 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-106403a8-a607-46d7-be4f-e3136a3bcbdc tempest-TestMinimumBasicScenario-472552688 None] Volume 81f278a7-4744-462b-9dcf-b548d1819434: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81f278a7-4744-462b-9dcf-b548d1819434', 'volume_size': 1} May 07 22:30:58.470350 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-106403a8-a607-46d7-be4f-e3136a3bcbdc tempest-TestMinimumBasicScenario-472552688 None] creating volume 'volume-81f278a7-4744-462b-9dcf-b548d1819434' {{(pid=129946) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1037}} May 07 22:30:58.471227 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-106403a8-a607-46d7-be4f-e3136a3bcbdc tempest-TestMinimumBasicScenario-472552688 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:30:58.590573 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-106403a8-a607-46d7-be4f-e3136a3bcbdc tempest-TestMinimumBasicScenario-472552688 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:30:58.591240 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-106403a8-a607-46d7-be4f-e3136a3bcbdc tempest-TestMinimumBasicScenario-472552688 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:30:58.595033 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-106403a8-a607-46d7-be4f-e3136a3bcbdc tempest-TestMinimumBasicScenario-472552688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (009a36d4-75f5-44a0-b57c-63dbb80e798f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81f278a7-4744-462b-9dcf-b548d1819434', 'volume_size': 1}' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:30:58.599897 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-106403a8-a607-46d7-be4f-e3136a3bcbdc tempest-TestMinimumBasicScenario-472552688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ed4a56f-3cf1-4b92-965a-db37100f9b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:30:58.609630 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-106403a8-a607-46d7-be4f-e3136a3bcbdc tempest-TestMinimumBasicScenario-472552688 None] Volume volume-81f278a7-4744-462b-9dcf-b548d1819434 (81f278a7-4744-462b-9dcf-b548d1819434): created successfully May 07 22:30:58.613503 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-106403a8-a607-46d7-be4f-e3136a3bcbdc tempest-TestMinimumBasicScenario-472552688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ed4a56f-3cf1-4b92-965a-db37100f9b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:30:58.619255 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-106403a8-a607-46d7-be4f-e3136a3bcbdc tempest-TestMinimumBasicScenario-472552688 None] Flow 'volume_create_manager' (75cf81ad-ea43-47e0-bc55-c3012cd1f82b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:30:58.627195 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-106403a8-a607-46d7-be4f-e3136a3bcbdc tempest-TestMinimumBasicScenario-472552688 None] Created volume successfully. May 07 22:31:00.113961 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-43639d21-1669-49ed-8d5b-7894aa0ba955 req-67f9b43b-5ce5-4cd2-8054-cfb9c0f02c9e tempest-TestMinimumBasicScenario-472552688 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 22:31:00.874905 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-43639d21-1669-49ed-8d5b-7894aa0ba955 req-67f9b43b-5ce5-4cd2-8054-cfb9c0f02c9e tempest-TestMinimumBasicScenario-472552688 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.760s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 22:31:00.875736 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-43639d21-1669-49ed-8d5b-7894aa0ba955 req-67f9b43b-5ce5-4cd2-8054-cfb9c0f02c9e tempest-TestMinimumBasicScenario-472552688 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-81f278a7-4744-462b-9dcf-b548d1819434', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3ca0b836-1cfe-436a-b0fa-deb74d3203d9', 'volume_id': '81f278a7-4744-462b-9dcf-b548d1819434', 'discard': True}} {{(pid=129946) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 07 22:31:00.898857 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-43639d21-1669-49ed-8d5b-7894aa0ba955 req-67f9b43b-5ce5-4cd2-8054-cfb9c0f02c9e tempest-TestMinimumBasicScenario-472552688 None] Connection info returned from driver {'name': 'volumes/volume-81f278a7-4744-462b-9dcf-b548d1819434', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '81f278a7-4744-462b-9dcf-b548d1819434', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '7c471855-ed0d-4b25-b43e-65ec1227e123'} {{(pid=129946) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 07 22:31:00.943020 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-43639d21-1669-49ed-8d5b-7894aa0ba955 req-67f9b43b-5ce5-4cd2-8054-cfb9c0f02c9e tempest-TestMinimumBasicScenario-472552688 None] attachment_update completed successfully. May 07 22:31:31.220315 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:31:31.221324 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:31:31.261135 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:31:31.301300 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:32:21.865195 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-d39f973e-006b-4ddd-bd0d-f9f89898ea56 req-c1718575-5b44-48ad-a563-0436488d539a tempest-TestMinimumBasicScenario-472552688 None] Terminate volume connection completed successfully. May 07 22:32:21.865954 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-d39f973e-006b-4ddd-bd0d-f9f89898ea56 req-c1718575-5b44-48ad-a563-0436488d539a tempest-TestMinimumBasicScenario-472552688 None] Deleting attachment 7c471855-ed0d-4b25-b43e-65ec1227e123. {{(pid=129946) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 07 22:32:22.510397 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-b4cb3d68-85f5-41b0-8048-078f3f1a1511 tempest-TestMinimumBasicScenario-472552688 None] Lock "b'cinder-81f278a7-4744-462b-9dcf-b548d1819434-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:32:22.542616 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b4cb3d68-85f5-41b0-8048-078f3f1a1511 tempest-TestMinimumBasicScenario-472552688 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:32:22.582169 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b4cb3d68-85f5-41b0-8048-078f3f1a1511 tempest-TestMinimumBasicScenario-472552688 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:32:22.582631 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b4cb3d68-85f5-41b0-8048-078f3f1a1511 tempest-TestMinimumBasicScenario-472552688 None] Volume volume-81f278a7-4744-462b-9dcf-b548d1819434 is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:32:22.587433 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b4cb3d68-85f5-41b0-8048-078f3f1a1511 tempest-TestMinimumBasicScenario-472552688 None] deleting rbd volume volume-81f278a7-4744-462b-9dcf-b548d1819434 {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:32:22.790141 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [None req-b4cb3d68-85f5-41b0-8048-078f3f1a1511 tempest-TestMinimumBasicScenario-472552688 None] Created reservations ['690f87ad-eb40-430d-abfc-3a8fa183e59e', 'c05e17e4-1278-4e2a-b869-50bbf2d580be', '56a39501-6be3-49ac-b68f-b12dac0e6690', '17b0335d-ae13-44e1-9bb8-69fdf5c89016'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:32:22.832155 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b4cb3d68-85f5-41b0-8048-078f3f1a1511 tempest-TestMinimumBasicScenario-472552688 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:32:22.858726 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-b4cb3d68-85f5-41b0-8048-078f3f1a1511 tempest-TestMinimumBasicScenario-472552688 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:32:22.882317 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-b4cb3d68-85f5-41b0-8048-078f3f1a1511 tempest-TestMinimumBasicScenario-472552688 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:32:22.886621 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-b4cb3d68-85f5-41b0-8048-078f3f1a1511 tempest-TestMinimumBasicScenario-472552688 None] Deleted volume successfully. May 07 22:32:22.898303 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-b4cb3d68-85f5-41b0-8048-078f3f1a1511 tempest-TestMinimumBasicScenario-472552688 None] Lock "b'cinder-81f278a7-4744-462b-9dcf-b548d1819434-delete_volume'" released by "delete_volume" :: held 0.388s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:33:31.221676 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:33:31.222365 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:33:31.265063 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:33:31.287787 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:34:31.223027 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:34:31.223740 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:34:31.245908 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:34:31.267129 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:35:31.227816 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:35:31.231866 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:35:31.281216 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:35:31.323086 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:36:31.224355 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:36:31.225035 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:36:31.249334 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:36:31.270901 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:37:31.226259 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:37:31.226990 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:37:31.266279 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:37:31.307022 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:38:31.223364 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:38:31.224119 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:38:31.249242 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:38:31.273498 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:39:31.228285 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:39:31.229590 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:39:31.253640 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:39:31.281630 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:40:31.227370 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:40:31.228050 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:40:31.249173 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:40:31.270200 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:41:31.225832 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:41:31.226678 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:41:31.252245 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:41:31.278848 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:42:31.223515 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:42:31.224247 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:42:31.246084 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:42:31.268707 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:43:31.223977 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:43:31.224664 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:43:31.246054 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:43:31.267844 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:44:31.222564 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:44:31.223273 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:44:31.249677 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:44:31.279625 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:44:36.916131 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cfcb388-d769-463a-8ad5-b460db93582b tempest-TestShelveInstance-1932052715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129946) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} May 07 22:44:36.940681 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7cfcb388-d769-463a-8ad5-b460db93582b tempest-TestShelveInstance-1932052715 None] Flow 'volume_create_manager' (2d8ceb0f-5d6d-4e5c-9dda-26180426166f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:44:36.947872 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7cfcb388-d769-463a-8ad5-b460db93582b tempest-TestShelveInstance-1932052715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (959439df-f4e7-4a06-9f67-d2e9f791485d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:44:36.963099 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7cfcb388-d769-463a-8ad5-b460db93582b tempest-TestShelveInstance-1932052715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (959439df-f4e7-4a06-9f67-d2e9f791485d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-05-07T22:44:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-225561933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7f57b01f-2fa5-46dc-b0ca-e3dece07128b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a375b5dd32e4b6eb61e9a9877c9a04c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-05-07T22:44:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-05-07T22:44:37Z,use_quota=True,user_id='6a81d6104e634bd7a6ae26dc51124c2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e),volume_type_id=1a78be55-4b68-4ed9-a75b-aa4d5fb30d5e)' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:44:36.968667 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7cfcb388-d769-463a-8ad5-b460db93582b tempest-TestShelveInstance-1932052715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec65b644-a6f0-47a7-bb57-43f0373334d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:44:36.972961 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7cfcb388-d769-463a-8ad5-b460db93582b tempest-TestShelveInstance-1932052715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec65b644-a6f0-47a7-bb57-43f0373334d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:44:36.978209 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7cfcb388-d769-463a-8ad5-b460db93582b tempest-TestShelveInstance-1932052715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38a366ec-bf3e-4fcc-ab98-f71ccbdae854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:44:37.062847 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7cfcb388-d769-463a-8ad5-b460db93582b tempest-TestShelveInstance-1932052715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38a366ec-bf3e-4fcc-ab98-f71ccbdae854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7f57b01f-2fa5-46dc-b0ca-e3dece07128b', 'volume_name': 'volume-7f57b01f-2fa5-46dc-b0ca-e3dece07128b', 'volume_size': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e2f828af0706465883131e16cb564d05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'created_at': datetime.datetime(2022, 5, 7, 21, 36, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:44:37.068645 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7cfcb388-d769-463a-8ad5-b460db93582b tempest-TestShelveInstance-1932052715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6c4896c-093b-4c65-ad7d-8b766b6f12fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:44:37.072680 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7cfcb388-d769-463a-8ad5-b460db93582b tempest-TestShelveInstance-1932052715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6c4896c-093b-4c65-ad7d-8b766b6f12fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:44:37.077589 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7cfcb388-d769-463a-8ad5-b460db93582b tempest-TestShelveInstance-1932052715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9da43d3b-0fc1-49dd-be7a-b1da54505dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:44:37.078743 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-7cfcb388-d769-463a-8ad5-b460db93582b tempest-TestShelveInstance-1932052715 None] Volume 7f57b01f-2fa5-46dc-b0ca-e3dece07128b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7f57b01f-2fa5-46dc-b0ca-e3dece07128b', 'volume_size': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e2f828af0706465883131e16cb564d05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'created_at': datetime.datetime(2022, 5, 7, 21, 36, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } May 07 22:44:37.079377 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cfcb388-d769-463a-8ad5-b460db93582b tempest-TestShelveInstance-1932052715 None] Cloning 7f57b01f-2fa5-46dc-b0ca-e3dece07128b from image 3756ae98-5c12-48e7-920e-ef5d1dd5543c at location (None, None). {{(pid=129946) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}} May 07 22:44:37.087907 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-7cfcb388-d769-463a-8ad5-b460db93582b tempest-TestShelveInstance-1932052715 None] Lock "b'cinder-3756ae98-5c12-48e7-920e-ef5d1dd5543c'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:44:37.097251 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-7cfcb388-d769-463a-8ad5-b460db93582b tempest-TestShelveInstance-1932052715 None] Found image-volume cache entry: {'id': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'volume_id': '82279f40-9683-441f-a541-0db8b9177f48', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9), 'last_used': datetime.datetime(2022, 5, 7, 22, 44, 37, 92284)}. {{(pid=129946) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 07 22:44:37.097832 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-7cfcb388-d769-463a-8ad5-b460db93582b tempest-TestShelveInstance-1932052715 None] Image-volume cache entry image_update_at = 2022-05-07 21:37:09+00:00, requested image updated_at = 2022-05-07 21:37:09+00:00. {{(pid=129946) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 07 22:44:37.098359 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cfcb388-d769-463a-8ad5-b460db93582b tempest-TestShelveInstance-1932052715 None] Found cache entry for image = 3756ae98-5c12-48e7-920e-ef5d1dd5543c on host ncdv-master-1@ceph#ceph. {{(pid=129946) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}} May 07 22:44:37.102279 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [None req-7cfcb388-d769-463a-8ad5-b460db93582b tempest-TestShelveInstance-1932052715 None] Lock "b'cinder-3756ae98-5c12-48e7-920e-ef5d1dd5543c'" released by "_prepare_image_cache_entry" :: held 0.014s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:44:37.103204 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cfcb388-d769-463a-8ad5-b460db93582b tempest-TestShelveInstance-1932052715 None] Attempting to retrieve cache entry for image = 3756ae98-5c12-48e7-920e-ef5d1dd5543c on host ncdv-master-1@ceph#ceph. {{(pid=129946) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}} May 07 22:44:37.108537 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-7cfcb388-d769-463a-8ad5-b460db93582b tempest-TestShelveInstance-1932052715 None] Found image-volume cache entry: {'id': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'volume_id': '82279f40-9683-441f-a541-0db8b9177f48', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9), 'last_used': datetime.datetime(2022, 5, 7, 22, 44, 37, 106338)}. {{(pid=129946) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} May 07 22:44:37.108948 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.image.cache [None req-7cfcb388-d769-463a-8ad5-b460db93582b tempest-TestShelveInstance-1932052715 None] Image-volume cache entry image_update_at = 2022-05-07 21:37:09+00:00, requested image updated_at = 2022-05-07 21:37:09+00:00. {{(pid=129946) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} May 07 22:44:37.109367 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cfcb388-d769-463a-8ad5-b460db93582b tempest-TestShelveInstance-1932052715 None] Creating from source image-volume 82279f40-9683-441f-a541-0db8b9177f48 {{(pid=129946) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}} May 07 22:44:37.120764 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-7cfcb388-d769-463a-8ad5-b460db93582b tempest-TestShelveInstance-1932052715 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:44:37.170718 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-7cfcb388-d769-463a-8ad5-b460db93582b tempest-TestShelveInstance-1932052715 None] creating snapshot='volume-7f57b01f-2fa5-46dc-b0ca-e3dece07128b.clone_snap' {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:777}} May 07 22:44:37.818296 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-7cfcb388-d769-463a-8ad5-b460db93582b tempest-TestShelveInstance-1932052715 None] cloning 'volume-82279f40-9683-441f-a541-0db8b9177f48@volume-7f57b01f-2fa5-46dc-b0ca-e3dece07128b.clone_snap' to 'volume-7f57b01f-2fa5-46dc-b0ca-e3dece07128b' {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:783}} May 07 22:44:37.946586 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-7cfcb388-d769-463a-8ad5-b460db93582b tempest-TestShelveInstance-1932052715 None] Volume volume-3864f924-91b4-4015-ab37-8bdbf8ad652d.deleted is not a clone. {{(pid=129946) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1196}} May 07 22:44:37.948053 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-7cfcb388-d769-463a-8ad5-b460db93582b tempest-TestShelveInstance-1932052715 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:912}} May 07 22:44:37.948420 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-7cfcb388-d769-463a-8ad5-b460db93582b tempest-TestShelveInstance-1932052715 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129946) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:921}} May 07 22:44:37.967616 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-7cfcb388-d769-463a-8ad5-b460db93582b tempest-TestShelveInstance-1932052715 None] clone created successfully {{(pid=129946) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:855}} May 07 22:44:37.968227 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.volume_utils [None req-7cfcb388-d769-463a-8ad5-b460db93582b tempest-TestShelveInstance-1932052715 None] Marking volume 7f57b01f-2fa5-46dc-b0ca-e3dece07128b as bootable. {{(pid=129946) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}} May 07 22:44:37.975774 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cfcb388-d769-463a-8ad5-b460db93582b tempest-TestShelveInstance-1932052715 None] Copying metadata from image 3756ae98-5c12-48e7-920e-ef5d1dd5543c to 7f57b01f-2fa5-46dc-b0ca-e3dece07128b. {{(pid=129946) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}} May 07 22:44:37.976202 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cfcb388-d769-463a-8ad5-b460db93582b tempest-TestShelveInstance-1932052715 None] Creating volume glance metadata for volume 7f57b01f-2fa5-46dc-b0ca-e3dece07128b backed by image 3756ae98-5c12-48e7-920e-ef5d1dd5543c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129946) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}} May 07 22:44:38.025863 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7cfcb388-d769-463a-8ad5-b460db93582b tempest-TestShelveInstance-1932052715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9da43d3b-0fc1-49dd-be7a-b1da54505dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f57b01f-2fa5-46dc-b0ca-e3dece07128b', 'volume_size': 1, 'image_id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e2f828af0706465883131e16cb564d05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3756ae98-5c12-48e7-920e-ef5d1dd5543c', 'created_at': datetime.datetime(2022, 5, 7, 21, 36, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 5, 7, 21, 37, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:44:38.030549 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7cfcb388-d769-463a-8ad5-b460db93582b tempest-TestShelveInstance-1932052715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5019915-efc0-495b-abed-b52a810b0514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} May 07 22:44:38.038715 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.flows.manager.create_volume [None req-7cfcb388-d769-463a-8ad5-b460db93582b tempest-TestShelveInstance-1932052715 None] Volume volume-7f57b01f-2fa5-46dc-b0ca-e3dece07128b (7f57b01f-2fa5-46dc-b0ca-e3dece07128b): created successfully May 07 22:44:38.042281 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7cfcb388-d769-463a-8ad5-b460db93582b tempest-TestShelveInstance-1932052715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5019915-efc0-495b-abed-b52a810b0514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129946) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} May 07 22:44:38.047927 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [None req-7cfcb388-d769-463a-8ad5-b460db93582b tempest-TestShelveInstance-1932052715 None] Flow 'volume_create_manager' (2d8ceb0f-5d6d-4e5c-9dda-26180426166f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129946) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} May 07 22:44:38.055195 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [None req-7cfcb388-d769-463a-8ad5-b460db93582b tempest-TestShelveInstance-1932052715 None] Created volume successfully. May 07 22:44:45.905324 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-05b70258-3742-429f-b84b-1c54cd488edb req-10d2d0eb-7110-4b75-8c35-405e28dbb4c4 tempest-TestShelveInstance-1932052715 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 22:44:46.615906 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-05b70258-3742-429f-b84b-1c54cd488edb req-10d2d0eb-7110-4b75-8c35-405e28dbb4c4 tempest-TestShelveInstance-1932052715 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.710s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 22:44:46.616792 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-05b70258-3742-429f-b84b-1c54cd488edb req-10d2d0eb-7110-4b75-8c35-405e28dbb4c4 tempest-TestShelveInstance-1932052715 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7f57b01f-2fa5-46dc-b0ca-e3dece07128b', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3ca0b836-1cfe-436a-b0fa-deb74d3203d9', 'volume_id': '7f57b01f-2fa5-46dc-b0ca-e3dece07128b', 'discard': True}} {{(pid=129946) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 07 22:44:46.640520 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-05b70258-3742-429f-b84b-1c54cd488edb req-10d2d0eb-7110-4b75-8c35-405e28dbb4c4 tempest-TestShelveInstance-1932052715 None] Connection info returned from driver {'name': 'volumes/volume-7f57b01f-2fa5-46dc-b0ca-e3dece07128b', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '7f57b01f-2fa5-46dc-b0ca-e3dece07128b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'e4cc3a60-f883-4dc8-908b-43696136c96a'} {{(pid=129946) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 07 22:44:46.690969 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-05b70258-3742-429f-b84b-1c54cd488edb req-10d2d0eb-7110-4b75-8c35-405e28dbb4c4 tempest-TestShelveInstance-1932052715 None] attachment_update completed successfully. May 07 22:45:31.228449 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:45:31.229984 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:45:31.256054 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:45:31.280477 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:46:31.226660 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:46:31.227378 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:46:31.248585 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:46:31.270902 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:47:16.976674 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-e5a71db3-c77b-4d6b-ae6d-c5155f0b8088 req-f241109f-5137-45b9-a6ce-cbf2be308da8 tempest-TestShelveInstance-1932052715 None] Terminate volume connection completed successfully. May 07 22:47:16.977454 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-e5a71db3-c77b-4d6b-ae6d-c5155f0b8088 req-f241109f-5137-45b9-a6ce-cbf2be308da8 tempest-TestShelveInstance-1932052715 None] Deleting attachment e4cc3a60-f883-4dc8-908b-43696136c96a. {{(pid=129946) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 07 22:47:18.722022 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-247109f0-7dae-4f08-95db-60fdbdf21557 req-a37b54ad-5b1d-437e-8972-178120f26486 tempest-TestShelveInstance-1932052715 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 22:47:19.342221 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_concurrency.processutils [req-247109f0-7dae-4f08-95db-60fdbdf21557 req-a37b54ad-5b1d-437e-8972-178120f26486 tempest-TestShelveInstance-1932052715 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.620s {{(pid=129946) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 22:47:19.343096 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-247109f0-7dae-4f08-95db-60fdbdf21557 req-a37b54ad-5b1d-437e-8972-178120f26486 tempest-TestShelveInstance-1932052715 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7f57b01f-2fa5-46dc-b0ca-e3dece07128b', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '3ca0b836-1cfe-436a-b0fa-deb74d3203d9', 'volume_id': '7f57b01f-2fa5-46dc-b0ca-e3dece07128b', 'discard': True}} {{(pid=129946) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1647}} May 07 22:47:19.365925 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-247109f0-7dae-4f08-95db-60fdbdf21557 req-a37b54ad-5b1d-437e-8972-178120f26486 tempest-TestShelveInstance-1932052715 None] Connection info returned from driver {'name': 'volumes/volume-7f57b01f-2fa5-46dc-b0ca-e3dece07128b', 'hosts': ['10.222.0.32'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '7f57b01f-2fa5-46dc-b0ca-e3dece07128b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '17e0cbf2-6bab-4060-921b-9c8b95792528'} {{(pid=129946) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4824}} May 07 22:47:19.411148 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-247109f0-7dae-4f08-95db-60fdbdf21557 req-a37b54ad-5b1d-437e-8972-178120f26486 tempest-TestShelveInstance-1932052715 None] attachment_update completed successfully. May 07 22:47:31.227023 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:47:31.227978 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:47:31.251069 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:47:31.272637 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:48:31.227499 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:48:31.228189 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:48:31.249816 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:48:31.271833 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:48:53.783494 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-cff63389-cc24-4e32-9cc8-4f7995abb4f2 req-46fafd94-8de2-42f4-b651-d37f7ce0b3e9 tempest-TestShelveInstance-1932052715 None] Terminate volume connection completed successfully. May 07 22:48:53.784110 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.manager [req-cff63389-cc24-4e32-9cc8-4f7995abb4f2 req-46fafd94-8de2-42f4-b651-d37f7ce0b3e9 tempest-TestShelveInstance-1932052715 None] Deleting attachment 17e0cbf2-6bab-4060-921b-9c8b95792528. {{(pid=129946) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4955}} May 07 22:48:53.899895 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [req-cff63389-cc24-4e32-9cc8-4f7995abb4f2 req-5cbb5b2e-febe-43bb-85e1-ff8a55769c7c tempest-TestShelveInstance-1932052715 None] Lock "b'cinder-7f57b01f-2fa5-46dc-b0ca-e3dece07128b-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} May 07 22:48:53.933119 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-cff63389-cc24-4e32-9cc8-4f7995abb4f2 req-5cbb5b2e-febe-43bb-85e1-ff8a55769c7c tempest-TestShelveInstance-1932052715 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:48:54.010820 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-cff63389-cc24-4e32-9cc8-4f7995abb4f2 req-5cbb5b2e-febe-43bb-85e1-ff8a55769c7c tempest-TestShelveInstance-1932052715 None] volume has no backup snaps {{(pid=129946) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1168}} May 07 22:48:54.017226 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-cff63389-cc24-4e32-9cc8-4f7995abb4f2 req-5cbb5b2e-febe-43bb-85e1-ff8a55769c7c tempest-TestShelveInstance-1932052715 None] deleting rbd volume volume-7f57b01f-2fa5-46dc-b0ca-e3dece07128b {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1322}} May 07 22:48:54.260471 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-cff63389-cc24-4e32-9cc8-4f7995abb4f2 req-5cbb5b2e-febe-43bb-85e1-ff8a55769c7c tempest-TestShelveInstance-1932052715 None] volume is a clone so cleaning references {{(pid=129946) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1343}} May 07 22:48:54.292982 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-cff63389-cc24-4e32-9cc8-4f7995abb4f2 req-5cbb5b2e-febe-43bb-85e1-ff8a55769c7c tempest-TestShelveInstance-1932052715 None] deleting parent snapshot volume-7f57b01f-2fa5-46dc-b0ca-e3dece07128b.clone_snap {{(pid=129946) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1234}} May 07 22:48:55.103415 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.quota [req-cff63389-cc24-4e32-9cc8-4f7995abb4f2 req-5cbb5b2e-febe-43bb-85e1-ff8a55769c7c tempest-TestShelveInstance-1932052715 None] Created reservations ['b7575e15-9505-40cf-a37c-7d8c706e9832', '30cd1773-3eef-4255-b17d-e504ed99483d', '64dd506a-ce22-48c0-a1da-2407993d1ff3', 'c4287b73-3625-46d6-bf61-b4683804cbc2'] {{(pid=129946) reserve /opt/stack/cinder/cinder/quota.py:755}} May 07 22:48:55.145584 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-cff63389-cc24-4e32-9cc8-4f7995abb4f2 req-5cbb5b2e-febe-43bb-85e1-ff8a55769c7c tempest-TestShelveInstance-1932052715 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:48:55.167822 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [req-cff63389-cc24-4e32-9cc8-4f7995abb4f2 req-5cbb5b2e-febe-43bb-85e1-ff8a55769c7c tempest-TestShelveInstance-1932052715 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:48:55.190367 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [req-cff63389-cc24-4e32-9cc8-4f7995abb4f2 req-5cbb5b2e-febe-43bb-85e1-ff8a55769c7c tempest-TestShelveInstance-1932052715 None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:48:55.195630 ncdv-master-1 cinder-volume[129946]: INFO cinder.volume.manager [req-cff63389-cc24-4e32-9cc8-4f7995abb4f2 req-5cbb5b2e-febe-43bb-85e1-ff8a55769c7c tempest-TestShelveInstance-1932052715 None] Deleted volume successfully. May 07 22:48:55.208023 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.coordination [req-cff63389-cc24-4e32-9cc8-4f7995abb4f2 req-5cbb5b2e-febe-43bb-85e1-ff8a55769c7c tempest-TestShelveInstance-1932052715 None] Lock "b'cinder-7f57b01f-2fa5-46dc-b0ca-e3dece07128b-delete_volume'" released by "delete_volume" :: held 1.308s {{(pid=129946) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} May 07 22:49:31.229060 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:49:31.229060 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:49:31.248813 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:49:31.270325 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:50:31.229999 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:50:31.230679 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:50:31.253578 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:50:31.281879 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:51:31.228484 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:51:31.229594 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:51:31.265235 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:51:31.302692 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:52:31.230659 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:52:31.231730 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:52:31.252836 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:52:31.274858 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:53:31.231431 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:53:31.232120 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:53:31.270538 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:53:31.311665 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:54:31.237068 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:54:31.237755 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:54:31.281268 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:54:31.303609 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:55:31.239228 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:55:31.239952 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:55:31.261336 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:55:31.285796 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:56:31.240824 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:56:31.241503 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:56:31.262752 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:56:31.284216 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:57:31.239780 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:57:31.240465 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:57:31.263121 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:57:31.285063 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:58:31.240064 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:58:31.240756 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:58:31.261588 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:58:31.285774 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 22:59:31.241078 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 22:59:31.241771 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:59:31.263598 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 22:59:31.285258 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 23:00:31.240254 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 23:00:31.240978 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 23:00:31.263944 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 23:00:31.287677 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} May 07 23:01:31.244145 ncdv-master-1 cinder-volume[129946]: DEBUG oslo_service.periodic_task [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129946) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} May 07 23:01:31.244842 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 23:01:31.267690 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.volume.drivers.rbd [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129946) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:522}} May 07 23:01:31.289476 ncdv-master-1 cinder-volume[129946]: DEBUG cinder.manager [None req-80c4808d-019b-4bdb-9614-e4fb5c77948e None None] Notifying Schedulers of capabilities ... {{(pid=129946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}