-- Logs begin at Sat 2022-06-25 20:01:14 UTC, end at Sat 2022-06-25 22:30:16 UTC. -- Jun 25 20:42:17.151592 ncdv-master-1 systemd[1]: Started Devstack devstack@c-vol.service. Jun 25 20:42:20.574182 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=130495) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 25 20:42:20.575841 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=130495) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 25 20:42:21.004881 ncdv-master-1 cinder-volume[130495]: INFO dbcounter [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] Registered counter for database cinder Jun 25 20:42:21.025252 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_db.sqlalchemy.engines [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130495) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 25 20:42:21.033368 ncdv-master-1 cinder-volume[130495]: DEBUG dbcounter [-] [130495] Writer thread running {{(pid=130495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 25 20:42:21.339923 ncdv-master-1 cinder-volume[130495]: INFO cinder.rpc [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 25 20:42:21.345113 ncdv-master-1 cinder-volume[130495]: INFO cinder.rpc [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 25 20:42:21.353802 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_db.sqlalchemy.engines [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130495) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 25 20:42:21.423105 ncdv-master-1 cinder-volume[130495]: INFO cinder.volume.manager [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] Determined volume DB was empty at startup. Jun 25 20:42:21.423754 ncdv-master-1 cinder-volume[130495]: DEBUG cinder.volume.manager [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=130495) __init__ /opt/stack/cinder/cinder/volume/manager.py:290}} Jun 25 20:42:21.433013 ncdv-master-1 cinder-volume[130495]: INFO cinder.volume.manager [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 25 20:42:21.433858 ncdv-master-1 cinder-volume[130495]: WARNING stevedore.named [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 25 20:42:21.434294 ncdv-master-1 cinder-volume[130495]: WARNING castellan.key_manager [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 25 20:42:21.435473 ncdv-master-1 cinder-volume[130495]: WARNING cinder.keymgr.conf_key_mgr [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 25 20:42:21.454761 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_db.sqlalchemy.engines [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130495) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 25 20:42:21.459456 ncdv-master-1 cinder-volume[130495]: INFO cinder.rpc [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jun 25 20:42:21.463847 ncdv-master-1 cinder-volume[130495]: INFO cinder.rpc [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] Automatically selected cinder-volume RPC version 3.18 as minimum service version. Jun 25 20:42:21.464553 ncdv-master-1 cinder-volume[130495]: WARNING stevedore.named [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 25 20:42:21.464959 ncdv-master-1 cinder-volume[130495]: WARNING castellan.key_manager [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 25 20:42:21.466691 ncdv-master-1 cinder-volume[130495]: INFO cinder.volume.manager [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] Image-volume cache enabled for host ncdv-master-1@ceph. Jun 25 20:42:21.472973 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_db.sqlalchemy.engines [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130495) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 25 20:42:21.495281 ncdv-master-1 cinder-volume[130495]: INFO oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] Starting 1 workers Jun 25 20:42:21.501593 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] Started child 130674 {{(pid=130495) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Jun 25 20:42:21.503098 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] Full set of CONF: {{(pid=130495) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Jun 25 20:42:21.504065 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ******************************************************************************** {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 25 20:42:21.504728 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] Configuration options gathered from: {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 25 20:42:21.505277 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 25 20:42:21.506190 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 25 20:42:21.506659 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ================================================================================ {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 25 20:42:21.507682 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] allow_availability_zone_fallback = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.508237 ncdv-master-1 cinder-volume[130674]: INFO cinder.service [-] Starting cinder-volume node (version 20.1.0) Jun 25 20:42:21.508919 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] allow_compression_on_image_upload = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.509599 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] allowed_direct_url_schemes = [] {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.510172 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] api_rate_limit = True {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.510948 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] auth_strategy = keystone {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.511634 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] az_cache_duration = 3600 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.512228 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_availability_zone = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.512829 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_host = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.513623 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_name = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.514111 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_stats_polling_interval = 60 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.514638 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backup_api_class = cinder.backup.api.API {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.515022 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.515497 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backup_name_template = backup-%s {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.515980 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backup_use_same_host = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.516414 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backup_use_temp_snapshot = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.516886 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] chap_password = **** {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.517451 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] chap_username = {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.517906 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.518371 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] cinder_internal_tenant_project_id = a6e42207f22245d5b512d5a5e7be5fa7 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.518815 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] cinder_internal_tenant_user_id = 083565d7e7e3423486d9bfd51efaf318 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.519248 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] cloned_volume_same_az = True {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.519676 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] cluster = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.520112 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] compression_format = gzip {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.520601 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] compute_api_class = cinder.compute.nova.API {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.521122 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] config_dir = [] {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.521485 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.521977 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] config_source = [] {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.522431 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.522907 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] control_exchange = openstack {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.524214 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] debug = True {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.524214 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] default_availability_zone = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.524214 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] default_group_type = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.524950 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.526343 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] default_volume_type = ceph {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.526343 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] driver_client_cert = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.526343 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] driver_client_cert_key = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.526751 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] driver_data_namespace = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.527109 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] driver_ssl_cert_path = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.527645 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] driver_ssl_cert_verify = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.528051 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] driver_use_ssl = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.533844 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] enable_force_upload = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.533844 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] enable_new_services = True {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.533844 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] enable_unsupported_driver = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.533844 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] enabled_backends = ['ceph'] {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.533844 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] enforce_multipath_for_image_xfer = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.533844 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] filter_function = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.533844 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] glance_api_insecure = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.536028 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] glance_api_servers = ['http://10.222.0.39/image'] {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.536028 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] glance_api_ssl_compression = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.536028 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] glance_ca_certificates_file = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.536028 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] glance_catalog_info = image:glance:publicURL {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.536028 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] glance_certfile = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.536028 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.536561 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] glance_keyfile = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.536561 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] glance_num_retries = 3 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.536957 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] glance_request_timeout = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.537353 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-e875c594-b6be-4c8b-ace2-86a1bcedae7d None None] Starting volume driver RBDDriver (1.2.0) Jun 25 20:42:21.537647 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] goodness_function = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.538118 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] graceful_shutdown_timeout = 5 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.538593 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] group_api_class = cinder.group.api.API {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.538984 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] host = ncdv-master-1 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.539085 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e875c594-b6be-4c8b-ace2-86a1bcedae7d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:42:21.539535 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] iet_conf = /etc/iet/ietd.conf {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.540015 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] image_compress_on_upload = True {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.540494 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] image_conversion_address_space_limit = 1 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.540959 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] image_conversion_cpu_limit = 60 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.541601 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.542078 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] image_conversion_disable = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.542624 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] image_upload_use_cinder_backend = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.543185 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] image_upload_use_internal_tenant = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.543871 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] image_volume_cache_enabled = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.544449 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] image_volume_cache_max_count = 0 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.545037 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] image_volume_cache_max_size_gb = 0 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.545605 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] init_host_max_objects_retrieval = 0 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.546208 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] instance_format = [instance: %(uuid)s] {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.546780 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.547403 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] iscsi_iotype = fileio {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.548093 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] iscsi_secondary_ip_addresses = [] {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.548710 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] iscsi_target_flags = {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.549318 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] iscsi_write_cache = on {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.549909 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] iser_helper = tgtadm {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.550709 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] iser_ip_address = 10.222.0.39 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.551363 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] iser_port = 3260 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.551928 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.552563 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] log_config_append = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.553151 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.553799 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] log_dir = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.554393 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] log_file = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.554933 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] log_options = True {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.555430 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] log_rotate_interval = 1 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.555914 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] log_rotate_interval_type = days {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.556387 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] log_rotation_type = none {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.556805 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.557201 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.557671 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.558216 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.558606 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.559095 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] max_age = 0 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.559535 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] max_logfile_count = 30 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.560010 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] max_logfile_size_mb = 200 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.560601 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] max_over_subscription_ratio = 20.0 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.561083 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] message_reap_interval = 86400 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.561544 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] message_ttl = 2592000 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.562026 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] migration_create_volume_timeout_secs = 300 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.562475 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] monkey_patch = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.562948 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] monkey_patch_modules = [] {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.563474 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] my_ip = 10.222.0.39 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.564015 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] no_snapshot_gb_quota = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.564589 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] num_iser_scan_tries = 3 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.565170 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] num_shell_tries = 3 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.565697 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] num_volume_device_scan_tries = 3 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.566253 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] nvmet_ns_id = 10 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.566663 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] nvmet_port_id = 1 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.567277 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] osapi_max_limit = 1000 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.567700 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] osapi_volume_ext_list = [] {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.568260 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.568730 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] osapi_volume_listen = 0.0.0.0 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.569155 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] osapi_volume_listen_port = 8776 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.569562 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] osapi_volume_use_ssl = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.570020 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] osapi_volume_workers = 2 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.570501 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] per_volume_size_limit = -1 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.570909 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] periodic_fuzzy_delay = 60 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.571358 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] periodic_interval = 60 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.571844 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] project_id_regex = [0-9a-f\-]+ {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.572238 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] public_endpoint = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.572681 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] publish_errors = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.573095 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] quota_backup_gigabytes = 1000 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.573720 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] quota_backups = 10 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.574245 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] quota_consistencygroups = 10 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.574807 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.575092 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] quota_gigabytes = 1000 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.575500 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] quota_groups = 10 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.575921 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] quota_snapshots = 10 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.576528 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] quota_volumes = 10 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.577071 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] rate_limit_burst = 0 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.577586 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] rate_limit_except_level = CRITICAL {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.578495 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] rate_limit_interval = 0 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.579012 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] reinit_driver_count = 3 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.579721 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] replication_device = **** {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.580256 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] report_discard_supported = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.580782 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] report_interval = 10 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.581413 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] reservation_clean_interval = 86400 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.581899 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] reservation_expire = 86400 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.582431 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] reserved_percentage = 0 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.582820 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.583197 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.583584 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] rpc_response_timeout = 120 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.584162 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] run_external_periodic_tasks = True {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.584584 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.584960 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] scst_target_driver = iscsi {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.585557 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] scst_target_iqn_name = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.585809 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] service_down_time = 60 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.586477 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] snapshot_name_template = snapshot-%s {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.586863 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] snapshot_same_host = True {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.587270 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] split_loggers = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.587655 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] state_path = /opt/stack/data/cinder {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.588622 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] storage_availability_zone = nova {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.589524 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] storage_protocol = iSCSI {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.590079 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] syslog_log_facility = LOG_USER {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.590601 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] target_helper = lioadm {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.591217 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] target_ip_address = 10.222.0.39 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.591710 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e875c594-b6be-4c8b-ace2-86a1bcedae7d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:42:21.591853 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] target_port = 3260 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.592358 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.592926 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] target_protocol = iscsi {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.593433 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] trace_flags = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.593942 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] transfer_api_class = cinder.transfer.api.API {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.594460 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] transport_url = **** {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.594949 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] until_refresh = 0 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.595452 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] use_chap_auth = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.595957 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] use_default_quota_class = True {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.596476 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] use_eventlog = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.597354 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] use_journal = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.597680 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] use_json = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.598037 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] use_multipath_for_image_xfer = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.598510 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] use_stderr = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.598862 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] use_syslog = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.599255 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] verify_glance_signatures = enabled {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.599609 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] volume_api_class = cinder.volume.api.API {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.599950 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] volume_backend_name = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.600344 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] volume_clear = zero {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.600760 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] volume_clear_ionice = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.601114 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] volume_clear_size = 0 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.601489 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.601839 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] volume_copy_bps_limit = 0 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.602202 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] volume_dd_blocksize = 1M {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.602572 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.602924 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] volume_name_template = volume-%s {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.603271 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] volume_service_inithost_offload = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.603643 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] volume_usage_audit_period = month {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.604237 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.604757 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] watch_log_file = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.605332 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] zoning_mode = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:42:21.605945 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.606467 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.607026 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_concurrency.disable_process_locking = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.607419 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.607825 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.608185 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.608594 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.608955 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.609306 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.609801 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] keystone_authtoken.admin_password = **** {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.610124 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.610467 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] keystone_authtoken.admin_token = **** {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.610834 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] keystone_authtoken.admin_user = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.611216 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] keystone_authtoken.auth_admin_prefix = {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.611576 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.611935 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] keystone_authtoken.auth_port = 35357 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.612328 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] keystone_authtoken.auth_protocol = https {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.612750 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] keystone_authtoken.auth_section = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.613194 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] keystone_authtoken.auth_type = password {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.613807 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] keystone_authtoken.auth_uri = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.614191 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] keystone_authtoken.auth_version = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.614577 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] keystone_authtoken.cache = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.614980 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.615342 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] keystone_authtoken.certfile = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.615689 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] keystone_authtoken.delay_auth_decision = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.616073 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.616410 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] keystone_authtoken.http_connect_timeout = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.616813 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.617160 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] keystone_authtoken.identity_uri = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.617539 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] keystone_authtoken.include_service_catalog = True {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.617901 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] keystone_authtoken.insecure = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.618269 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] keystone_authtoken.interface = public {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.618610 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] keystone_authtoken.keyfile = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.618981 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.619345 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.619698 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.620043 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.620455 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.620798 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.621173 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.621519 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.621916 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.622252 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] keystone_authtoken.region_name = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.622646 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.622980 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] keystone_authtoken.service_token_roles_required = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.623323 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] keystone_authtoken.service_type = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.623676 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] keystone_authtoken.token_cache_time = 300 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.624059 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.624557 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] cache.backend = dogpile.cache.null {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.625071 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] cache.backend_argument = **** {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.625612 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] cache.config_prefix = cache.oslo {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.626035 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] cache.dead_timeout = 60.0 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.626470 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] cache.debug_cache_backend = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.626822 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] cache.enable_retry_client = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.627169 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] cache.enable_socket_keepalive = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.627535 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] cache.enabled = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.627884 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] cache.expiration_time = 600 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.628235 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] cache.hashclient_retry_attempts = 2 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.628615 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] cache.hashclient_retry_delay = 1.0 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.629005 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] cache.memcache_dead_retry = 300 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.632552 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.632552 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.632552 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] cache.memcache_pool_maxsize = 10 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.632552 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.632552 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.632552 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] cache.memcache_socket_timeout = 1.0 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.632552 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] cache.proxies = [] {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.633070 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] cache.retry_attempts = 2 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.633070 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] cache.retry_delay = 0.0 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.633070 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] cache.socket_keepalive_count = 1 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.633070 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] cache.socket_keepalive_idle = 1 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.633329 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] cache.socket_keepalive_interval = 1 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.633492 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] cache.tls_allowed_ciphers = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.633827 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] cache.tls_cafile = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.634191 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] cache.tls_certfile = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.635012 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] cache.tls_enabled = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.635362 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] cache.tls_keyfile = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.635860 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] coordination.backend_url = etcd3+http://10.222.0.39:2379 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.636397 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] database.backend = sqlalchemy {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.636725 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] database.connection = **** {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.637223 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] database.connection_debug = 0 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.637605 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] database.connection_parameters = {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.637970 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] database.connection_recycle_time = 3600 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.638336 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] database.connection_trace = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.638688 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] database.db_inc_retry_interval = True {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.639239 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] database.db_max_retries = 20 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.639505 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e875c594-b6be-4c8b-ace2-86a1bcedae7d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:42:21.639603 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] database.db_max_retry_interval = 10 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.639935 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] database.db_retry_interval = 1 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.640304 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] database.max_overflow = 50 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.640701 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] database.max_pool_size = 5 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.641076 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] database.max_retries = 10 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.641428 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] database.mysql_enable_ndb = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.641783 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.642281 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] database.pool_timeout = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.643002 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] database.retry_interval = 10 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.643513 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] database.slave_connection = **** {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.644018 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] database.sqlite_synchronous = True {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.644524 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] database.use_db_reconnect = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.645056 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_policy.enforce_new_defaults = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.645568 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_policy.enforce_scope = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.646096 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_policy.policy_default_rule = default {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.646720 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.647053 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_policy.policy_file = policy.yaml {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.647598 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.648100 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.648633 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.649123 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.649598 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.650163 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] profiler.connection_string = messaging:// {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.650604 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] profiler.enabled = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.651143 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] profiler.es_doc_type = notification {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.651513 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] profiler.es_scroll_size = 10000 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.651930 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] profiler.es_scroll_time = 2m {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.652263 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] profiler.filter_error_trace = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.652670 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] profiler.hmac_keys = SECRET_KEY {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.653037 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] profiler.sentinel_service_name = mymaster {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.653400 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] profiler.socket_timeout = 0.1 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.653752 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] profiler.trace_sqlalchemy = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.654175 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] privsep_osbrick.capabilities = [21] {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.654546 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] privsep_osbrick.group = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.654901 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] privsep_osbrick.helper_command = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.655271 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] privsep_osbrick.logger_name = oslo_privsep.daemon {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.655621 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.655979 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] privsep_osbrick.user = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.656373 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.656746 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] cinder_sys_admin.group = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.657084 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] cinder_sys_admin.helper_command = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.657433 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.657784 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.658143 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] cinder_sys_admin.user = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.658524 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] service_user.auth_section = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.658885 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] service_user.auth_type = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.659238 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] service_user.cafile = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.659574 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] service_user.certfile = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.659946 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] service_user.collect_timing = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.660287 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] service_user.insecure = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.660757 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] service_user.keyfile = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.661122 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] service_user.send_service_user_token = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.661480 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] service_user.split_loggers = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.661975 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] service_user.timeout = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.662520 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.backend_availability_zone = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.663011 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.663516 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.663905 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.chap_password = **** {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.664318 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.chap_username = {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.664724 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.665227 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.deferred_deletion_delay = 0 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.665617 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.deferred_deletion_purge_interval = 60 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.666139 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.driver_client_cert = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.666496 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.driver_client_cert_key = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.666850 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.driver_data_namespace = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.667201 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.667635 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.667988 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.driver_use_ssl = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.668341 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.enable_deferred_deletion = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.668730 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.enable_unsupported_driver = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.669082 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.669445 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.extra_capabilities = {} {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.669808 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.filter_function = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.670154 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.goodness_function = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.670519 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.iet_conf = /etc/iet/ietd.conf {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.670864 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.671367 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.671870 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.672263 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.672645 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.673008 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.iscsi_iotype = fileio {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.673503 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.iscsi_secondary_ip_addresses = [] {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.674052 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.iscsi_target_flags = {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.674586 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.iscsi_write_cache = on {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.675112 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.iser_helper = tgtadm {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.675650 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.iser_ip_address = 10.222.0.39 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.676009 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.iser_port = 3260 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.676623 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.677075 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.677422 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.677774 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.num_shell_tries = 3 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.678126 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.678479 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.678831 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.nvmet_port_id = 1 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.679196 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.rados_connect_timeout = -1 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.679559 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.rados_connection_interval = 5 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.679915 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.rados_connection_retries = 3 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.680281 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.rbd_ceph_conf = {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.680680 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.rbd_cluster_name = ceph {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.681214 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.rbd_exclusive_cinder_pool = True {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.681748 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.rbd_flatten_volume_from_snapshot = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.682106 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.rbd_max_clone_depth = 5 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.682475 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.rbd_pool = rbd {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.682832 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.rbd_secret_uuid = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.683235 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.rbd_store_chunk_size = 4 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.683585 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.rbd_user = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.683935 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.replication_connect_timeout = 5 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.684292 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.replication_device = **** {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.684667 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.report_discard_supported = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.685029 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.report_dynamic_total_capacity = True {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.685389 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.reserved_percentage = 0 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.685758 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.scst_target_driver = iscsi {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.686103 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.scst_target_iqn_name = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.686471 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.storage_protocol = iSCSI {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.686825 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.687189 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.target_helper = tgtadm {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.687659 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.target_ip_address = 10.222.0.39 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.688010 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.target_port = 3260 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.688372 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.688767 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.target_protocol = iscsi {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.689120 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.trace_flags = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.689472 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.unique_fqdn_network = True {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.689839 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.use_chap_auth = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.690188 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.690538 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.volume_backend_name = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.690902 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.volume_clear = zero {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.691261 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.volume_clear_ionice = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.691600 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.volume_clear_size = 0 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.691971 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.692335 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.692738 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.693100 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.693549 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.693969 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_reports.file_event_handler = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.694370 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.694755 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_reports.log_dir = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.695165 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.backend_availability_zone = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.695531 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.backend_host = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.695896 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.backend_native_threads_pool_size = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.696266 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.backup_use_temp_snapshot = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.696644 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.chap_password = **** {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.696981 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.chap_username = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.697368 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.chiscsi_conf = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.697735 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.deferred_deletion_delay = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.698111 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.deferred_deletion_purge_interval = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.698476 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.driver_client_cert = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.698902 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.driver_client_cert_key = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.699292 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.driver_data_namespace = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.699657 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.driver_ssl_cert_path = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.700009 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.driver_ssl_cert_verify = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.700360 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.driver_use_ssl = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.700732 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.enable_deferred_deletion = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.701104 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.enable_unsupported_driver = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.701442 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.enforce_multipath_for_image_xfer = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.701798 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.extra_capabilities = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.702134 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.filter_function = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.702482 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.goodness_function = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.702840 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.iet_conf = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.703179 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.image_upload_use_cinder_backend = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.703613 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.image_upload_use_internal_tenant = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.703994 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.image_volume_cache_enabled = True {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.704337 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.image_volume_cache_max_count = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.704745 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.image_volume_cache_max_size_gb = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.705134 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.iscsi_iotype = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.705441 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.iscsi_secondary_ip_addresses = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.705952 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.iscsi_target_flags = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.706270 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.iscsi_write_cache = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.706609 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.iser_helper = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.707193 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.iser_ip_address = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.707545 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.iser_port = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.707973 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.iser_target_prefix = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.708326 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.max_over_subscription_ratio = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.708697 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.num_iser_scan_tries = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.709041 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.num_shell_tries = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.709413 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.num_volume_device_scan_tries = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.709757 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.nvmet_ns_id = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.710100 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.nvmet_port_id = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.710477 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.rados_connect_timeout = -1 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.710823 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.rados_connection_interval = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.711168 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.rados_connection_retries = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.711530 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.rbd_ceph_conf = /etc/ceph/ceph.conf {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.711872 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.rbd_cluster_name = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.712223 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.rbd_exclusive_cinder_pool = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.712647 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.rbd_flatten_volume_from_snapshot = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.713009 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.rbd_max_clone_depth = 5 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.713369 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.rbd_pool = volumes {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.713729 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.rbd_secret_uuid = b1fae50d-3f02-47a8-90c2-b7e0c0e1be59 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.714062 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.driver [None req-e875c594-b6be-4c8b-ace2-86a1bcedae7d None None] Driver hasn't implemented _init_vendor_properties() Jun 25 20:42:21.714189 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.rbd_store_chunk_size = 4 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.714470 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.rbd_user = cinder {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.714826 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.replication_connect_timeout = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.715174 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.replication_device = **** {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.715425 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.driver [None req-e875c594-b6be-4c8b-ace2-86a1bcedae7d None None] Initialized capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:b8435c3c-9c73-4367-b32e-070fd9e26614:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=130674) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:812}} Jun 25 20:42:21.715553 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.report_discard_supported = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.715849 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.report_dynamic_total_capacity = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.716192 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.reserved_percentage = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.716564 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.scst_target_driver = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.716909 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.scst_target_iqn_name = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.717254 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.storage_protocol = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.717600 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.suppress_requests_ssl_warnings = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.717969 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.target_helper = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.718312 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.target_ip_address = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.718674 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.target_port = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.719038 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.target_prefix = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.719546 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.target_protocol = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.720062 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.trace_flags = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.720598 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.unique_fqdn_network = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.721109 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.use_chap_auth = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.721604 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.use_multipath_for_image_xfer = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.722426 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.volume_backend_name = ceph {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.722929 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.volume_clear = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.723436 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.volume_clear_ionice = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.723930 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.volume_clear_size = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.724444 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.volume_copy_blkio_cgroup_name = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.724965 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.volume_copy_bps_limit = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.725467 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.volume_dd_blocksize = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.725999 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.volume_driver = cinder.volume.drivers.rbd.RBDDriver {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.726492 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ceph.volumes_dir = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.727124 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.727638 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.728142 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.728723 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.729238 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.729769 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.730359 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.730878 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.731399 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.731901 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.732468 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.732978 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.733516 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.734012 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.734531 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.735177 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.735666 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.736147 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.736703 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.737167 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_db.sqlalchemy.engines [None req-e875c594-b6be-4c8b-ace2-86a1bcedae7d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130674) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 25 20:42:21.737372 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.737881 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.738379 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.738935 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_messaging_rabbit.ssl = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.739456 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.739919 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writer thread running {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 25 20:42:21.740147 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.740695 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.741223 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.741759 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_messaging_rabbit.ssl_version = {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.742237 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_messaging_notifications.driver = [] {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.742768 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_messaging_notifications.retry = -1 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.743314 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.743817 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.744307 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.744792 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] key_manager.fixed_key = **** {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.745391 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.745940 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] barbican.barbican_api_version = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.746453 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] barbican.barbican_endpoint = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.747003 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] barbican.barbican_endpoint_type = public {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.747531 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] barbican.barbican_region_name = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.748021 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] barbican.cafile = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.748552 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] barbican.certfile = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.749073 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] barbican.collect_timing = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.749578 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] barbican.insecure = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.750085 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] barbican.keyfile = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.750617 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] barbican.number_of_retries = 60 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.751110 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] barbican.retry_delay = 1 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.751612 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] barbican.send_service_user_token = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.752113 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] barbican.split_loggers = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.752636 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] barbican.timeout = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.753153 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] barbican.verify_ssl = True {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.753634 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] barbican.verify_ssl_path = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.754157 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] barbican_service_user.auth_section = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.754678 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] barbican_service_user.auth_type = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.755173 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] barbican_service_user.cafile = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.755675 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] barbican_service_user.certfile = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.756167 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] barbican_service_user.collect_timing = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.756697 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] barbican_service_user.insecure = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.757181 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] barbican_service_user.keyfile = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.757690 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] barbican_service_user.split_loggers = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.758309 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] barbican_service_user.timeout = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.758840 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] vault.approle_role_id = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.759326 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] vault.approle_secret_id = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.759808 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] vault.cafile = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.760297 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] vault.certfile = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.760827 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] vault.collect_timing = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.761369 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] vault.insecure = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.761862 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] vault.keyfile = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.762382 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] vault.kv_mountpoint = secret {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.762874 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] vault.kv_version = 2 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.763369 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] vault.namespace = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.763941 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] vault.root_token_id = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.764562 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] vault.split_loggers = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.765138 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] vault.ssl_ca_crt_file = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.765619 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] vault.timeout = None {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.766118 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] vault.use_ssl = False {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.766631 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:42:21.767064 ncdv-master-1 cinder-volume[130495]: DEBUG oslo_service.service [None req-0866ef57-3d8f-4b3a-8196-7ebb6545eca9 None None] ******************************************************************************** {{(pid=130495) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 25 20:42:21.779945 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.db.sqlalchemy.api [None req-e875c594-b6be-4c8b-ace2-86a1bcedae7d None None] Building query based on filter {{(pid=130674) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3878}} Jun 25 20:42:21.800061 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.image_utils [None req-e875c594-b6be-4c8b-ace2-86a1bcedae7d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=130674) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:991}} Jun 25 20:42:21.809808 ncdv-master-1 cinder-volume[130674]: INFO cinder.keymgr.migration [None req-09cb0529-d59b-4986-b369-59861b418271 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 25 20:42:21.813842 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e875c594-b6be-4c8b-ace2-86a1bcedae7d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:42:21.851587 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e875c594-b6be-4c8b-ace2-86a1bcedae7d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:42:21.900609 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-e875c594-b6be-4c8b-ace2-86a1bcedae7d None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 20:42:21.933992 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-e875c594-b6be-4c8b-ace2-86a1bcedae7d None None] Driver initialization completed successfully. Jun 25 20:42:21.934741 ncdv-master-1 cinder-volume[130674]: INFO cinder.manager [None req-e875c594-b6be-4c8b-ace2-86a1bcedae7d None None] Initiating service 3 cleanup Jun 25 20:42:21.944872 ncdv-master-1 cinder-volume[130674]: INFO cinder.manager [None req-e875c594-b6be-4c8b-ace2-86a1bcedae7d None None] Service 3 cleanup completed. Jun 25 20:42:21.945363 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.service [None req-e875c594-b6be-4c8b-ace2-86a1bcedae7d None None] Creating RPC server for service cinder-volume {{(pid=130674) start /opt/stack/cinder/cinder/service.py:231}} Jun 25 20:42:21.952974 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.service [None req-e875c594-b6be-4c8b-ace2-86a1bcedae7d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=130674) start /opt/stack/cinder/cinder/service.py:237}} Jun 25 20:42:21.995644 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-e875c594-b6be-4c8b-ace2-86a1bcedae7d None None] Initializing RPC dependent components of volume driver RBDDriver (1.2.0) Jun 25 20:42:21.997114 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e875c594-b6be-4c8b-ace2-86a1bcedae7d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:42:22.031624 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e875c594-b6be-4c8b-ace2-86a1bcedae7d None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:42:22.090244 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-e875c594-b6be-4c8b-ace2-86a1bcedae7d None None] Driver post RPC initialization completed successfully. Jun 25 20:42:31.486758 ncdv-master-1 cinder-volume[130495]: DEBUG dbcounter [-] [130495] Writing DB stats cinder:SELECT=16,cinder:INSERT=1 {{(pid=130495) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:42:32.073552 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=21,cinder:INSERT=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:42:32.085693 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:42:42.105728 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:42:52.103072 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:43:22.098059 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:43:32.104449 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:43:52.098458 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 20:43:52.099313 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:43:52.122616 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:43:52.147295 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 20:43:52.150835 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:43:52.151961 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:44:22.154275 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:44:22.157965 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:44:42.149315 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:44:52.098500 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 20:44:52.099130 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:44:52.127579 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:44:52.152410 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 20:45:02.155742 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:UPDATE=3,cinder:SELECT=5 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:45:12.159562 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:45:32.170838 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:45:42.175594 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:45:52.099273 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 20:45:52.099849 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:45:52.124363 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:45:52.149348 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 20:46:12.169543 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=7 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:46:12.171888 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:46:32.179515 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:46:42.178931 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:46:52.104942 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 20:46:52.105694 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:46:52.134851 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:46:52.157375 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 20:47:02.188379 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:47:12.198113 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:47:32.193432 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:47:42.197601 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:UPDATE=2,cinder:SELECT=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:47:52.102916 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 20:47:52.103931 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:47:52.137193 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:47:52.159890 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 20:48:02.197902 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:48:02.198884 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:48:22.204906 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:48:32.211495 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:48:52.104987 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 20:48:52.106031 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:48:52.137838 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:48:52.160483 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 20:48:52.219632 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:49:12.214125 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:49:12.215109 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:49:32.213515 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:49:52.105683 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 20:49:52.106362 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:49:52.132060 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:49:52.155110 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 20:49:52.213451 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:49:52.214067 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:50:12.214996 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:50:32.216906 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:50:42.222390 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:50:52.110649 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 20:50:52.111403 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:50:52.148000 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:50:52.184330 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 20:51:12.215905 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:22.210229 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:42.216746 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:52.111045 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 20:51:52.111867 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:51:52.194226 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:51:52.273232 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 20:51:52.289820 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:22.281302 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:22.293810 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:42.293994 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:52.115117 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 20:52:52.115787 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:52:52.201922 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:52:52.300161 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 20:53:12.359532 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:12.361936 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:52.112397 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 20:53:52.113280 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:53:52.177018 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:53:52.255520 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 20:53:52.317238 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=7 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:52.318200 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:02.330656 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:32.322081 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:42.325997 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:52.109888 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 20:54:52.111978 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:54:52.225580 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:54:52.318032 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 20:54:52.341046 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:55:22.329157 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=4 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:55:22.330425 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:55:42.340467 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:55:52.113498 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 20:55:52.114280 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:55:52.147317 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:55:52.228203 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 20:56:02.340142 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:02.343329 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:03.008225 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7963797-5f31-4914-9c3d-f16cfee9accd tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 20:56:03.050312 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e7963797-5f31-4914-9c3d-f16cfee9accd tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Flow 'volume_create_manager' (4652798b-a15b-422d-9308-0bd44cec5415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 20:56:03.056158 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e7963797-5f31-4914-9c3d-f16cfee9accd tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f3511b9-1484-45e2-888f-5d4b0f4d7c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 20:56:03.106161 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e7963797-5f31-4914-9c3d-f16cfee9accd tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f3511b9-1484-45e2-888f-5d4b0f4d7c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T20:56:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveAutoBlockMigrationV225Test-volume-271316906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ea776117-2993-45a1-9ace-9a0e96e6fb96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a2d8b5c82f44807b9d01252ea17cff9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T20:56:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T20:56:03Z,use_quota=True,user_id='39e82edaa30d418d96ea37f942d62755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 20:56:03.110888 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e7963797-5f31-4914-9c3d-f16cfee9accd tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39d3dee4-4d3e-4c32-b0a0-a469129d26ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 20:56:03.114618 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e7963797-5f31-4914-9c3d-f16cfee9accd tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39d3dee4-4d3e-4c32-b0a0-a469129d26ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 20:56:03.128762 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e7963797-5f31-4914-9c3d-f16cfee9accd tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6660b1f4-08d0-4b93-aae6-b4fc8a9536b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 20:56:03.133334 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e7963797-5f31-4914-9c3d-f16cfee9accd tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6660b1f4-08d0-4b93-aae6-b4fc8a9536b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea776117-2993-45a1-9ace-9a0e96e6fb96', 'volume_name': 'volume-ea776117-2993-45a1-9ace-9a0e96e6fb96', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 20:56:03.153111 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e7963797-5f31-4914-9c3d-f16cfee9accd tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19223f2f-4d7c-4ea7-bff3-5706a50da757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 20:56:03.158447 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e7963797-5f31-4914-9c3d-f16cfee9accd tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19223f2f-4d7c-4ea7-bff3-5706a50da757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 20:56:03.164725 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e7963797-5f31-4914-9c3d-f16cfee9accd tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f10272c-4248-4801-8921-9dad91e7c6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 20:56:03.166265 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-e7963797-5f31-4914-9c3d-f16cfee9accd tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Volume ea776117-2993-45a1-9ace-9a0e96e6fb96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea776117-2993-45a1-9ace-9a0e96e6fb96', 'volume_size': 1} Jun 25 20:56:03.167471 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e7963797-5f31-4914-9c3d-f16cfee9accd tempest-LiveAutoBlockMigrationV225Test-1642564932 None] creating volume 'volume-ea776117-2993-45a1-9ace-9a0e96e6fb96' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 20:56:03.169340 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e7963797-5f31-4914-9c3d-f16cfee9accd tempest-LiveAutoBlockMigrationV225Test-1642564932 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:56:03.475947 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e7963797-5f31-4914-9c3d-f16cfee9accd tempest-LiveAutoBlockMigrationV225Test-1642564932 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 20:56:03.477556 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e7963797-5f31-4914-9c3d-f16cfee9accd tempest-LiveAutoBlockMigrationV225Test-1642564932 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 20:56:03.484540 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e7963797-5f31-4914-9c3d-f16cfee9accd tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f10272c-4248-4801-8921-9dad91e7c6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea776117-2993-45a1-9ace-9a0e96e6fb96', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 20:56:03.501689 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e7963797-5f31-4914-9c3d-f16cfee9accd tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (831ae4a6-b623-47e5-a9b8-812b68a6c709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 20:56:03.545683 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-e7963797-5f31-4914-9c3d-f16cfee9accd tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Volume volume-ea776117-2993-45a1-9ace-9a0e96e6fb96 (ea776117-2993-45a1-9ace-9a0e96e6fb96): created successfully Jun 25 20:56:03.550273 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e7963797-5f31-4914-9c3d-f16cfee9accd tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (831ae4a6-b623-47e5-a9b8-812b68a6c709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 20:56:03.558161 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e7963797-5f31-4914-9c3d-f16cfee9accd tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Flow 'volume_create_manager' (4652798b-a15b-422d-9308-0bd44cec5415) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 20:56:03.578279 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-e7963797-5f31-4914-9c3d-f16cfee9accd tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Created volume successfully. Jun 25 20:56:04.907206 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-32404ed4-607d-4dfc-8228-71a25cefd9a1 req-3e99ef92-f5d0-469c-ac8b-22a796e48f7a tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 20:56:06.316998 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-32404ed4-607d-4dfc-8228-71a25cefd9a1 req-3e99ef92-f5d0-469c-ac8b-22a796e48f7a tempest-LiveAutoBlockMigrationV225Test-1642564932 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.407s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 20:56:06.319348 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-32404ed4-607d-4dfc-8228-71a25cefd9a1 req-3e99ef92-f5d0-469c-ac8b-22a796e48f7a tempest-LiveAutoBlockMigrationV225Test-1642564932 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ea776117-2993-45a1-9ace-9a0e96e6fb96', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': 'ea776117-2993-45a1-9ace-9a0e96e6fb96', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 20:56:06.412111 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-32404ed4-607d-4dfc-8228-71a25cefd9a1 req-3e99ef92-f5d0-469c-ac8b-22a796e48f7a tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Connection info returned from driver {'name': 'volumes/volume-ea776117-2993-45a1-9ace-9a0e96e6fb96', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ea776117-2993-45a1-9ace-9a0e96e6fb96', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '553b1ee7-1bfc-4a29-8bc5-b2a6ae770a84'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 25 20:56:06.537756 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-32404ed4-607d-4dfc-8228-71a25cefd9a1 req-3e99ef92-f5d0-469c-ac8b-22a796e48f7a tempest-LiveAutoBlockMigrationV225Test-1642564932 None] attachment_update completed successfully. Jun 25 20:56:16.309444 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-fa3e413a-6b88-4bac-81af-84a61b054826 req-96fbcb2b-8c7d-4a32-bd9c-0cdf730287d9 tempest-LiveAutoBlockMigrationV225Test-1157528900 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 20:56:17.461841 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-fa3e413a-6b88-4bac-81af-84a61b054826 req-96fbcb2b-8c7d-4a32-bd9c-0cdf730287d9 tempest-LiveAutoBlockMigrationV225Test-1157528900 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.152s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 20:56:17.462650 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-fa3e413a-6b88-4bac-81af-84a61b054826 req-96fbcb2b-8c7d-4a32-bd9c-0cdf730287d9 tempest-LiveAutoBlockMigrationV225Test-1157528900 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ea776117-2993-45a1-9ace-9a0e96e6fb96', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': 'ea776117-2993-45a1-9ace-9a0e96e6fb96', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 20:56:17.508372 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-fa3e413a-6b88-4bac-81af-84a61b054826 req-96fbcb2b-8c7d-4a32-bd9c-0cdf730287d9 tempest-LiveAutoBlockMigrationV225Test-1157528900 None] Connection info returned from driver {'name': 'volumes/volume-ea776117-2993-45a1-9ace-9a0e96e6fb96', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ea776117-2993-45a1-9ace-9a0e96e6fb96', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '1fc74a5d-e64d-4348-9864-6df93ce023b6'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 25 20:56:17.607590 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-fa3e413a-6b88-4bac-81af-84a61b054826 req-96fbcb2b-8c7d-4a32-bd9c-0cdf730287d9 tempest-LiveAutoBlockMigrationV225Test-1157528900 None] attachment_update completed successfully. Jun 25 20:56:32.352677 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=38,cinder:UPDATE=5 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:38.291634 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=26,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:38.302527 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-fa3e413a-6b88-4bac-81af-84a61b054826 req-ef13478b-07bc-4975-81bb-38627b7bc689 tempest-LiveAutoBlockMigrationV225Test-1157528900 None] Terminate volume connection completed successfully. Jun 25 20:56:38.302934 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-fa3e413a-6b88-4bac-81af-84a61b054826 req-ef13478b-07bc-4975-81bb-38627b7bc689 tempest-LiveAutoBlockMigrationV225Test-1157528900 None] Deleting attachment 553b1ee7-1bfc-4a29-8bc5-b2a6ae770a84. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 25 20:56:49.652580 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-ee399a9b-6a98-4da1-b3c5-7db9916dad5b req-621883e8-863c-4405-b3f8-964c91784cd4 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Terminate volume connection completed successfully. Jun 25 20:56:49.653772 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-ee399a9b-6a98-4da1-b3c5-7db9916dad5b req-621883e8-863c-4405-b3f8-964c91784cd4 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Deleting attachment 1fc74a5d-e64d-4348-9864-6df93ce023b6. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 25 20:56:51.367486 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 20:56:51.455545 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Flow 'volume_create_manager' (13344dac-e6f9-41b7-a331-b5429e56c346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 20:56:51.482462 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22d62a4a-0e57-42ed-bcf6-b914c7018715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 20:56:51.522491 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22d62a4a-0e57-42ed-bcf6-b914c7018715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T20:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1569336645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=74f093be-e96a-4a80-ad38-abd3f5585611,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a2d8b5c82f44807b9d01252ea17cff9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T20:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T20:56:51Z,use_quota=True,user_id='39e82edaa30d418d96ea37f942d62755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 20:56:51.527783 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42152da7-cf23-443f-b25a-21d15bef5536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 20:56:51.531863 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42152da7-cf23-443f-b25a-21d15bef5536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 20:56:51.559502 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f151ecd-ca97-457a-b06b-bf4fee221d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 20:56:51.775287 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f151ecd-ca97-457a-b06b-bf4fee221d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '74f093be-e96a-4a80-ad38-abd3f5585611', 'volume_name': 'volume-74f093be-e96a-4a80-ad38-abd3f5585611', 'volume_size': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d98522b7634403f83ff66fd72edfd9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'created_at': datetime.datetime(2022, 6, 25, 20, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5741eca-b932-4865-b29a-bd2a12a73795/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 20:56:51.780871 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36c040bb-2c00-43c4-96d3-50014c16d06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 20:56:51.785046 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36c040bb-2c00-43c4-96d3-50014c16d06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 20:56:51.802079 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (841bac0b-4c2c-49fe-87ce-ffa87c484270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 20:56:51.803799 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Volume 74f093be-e96a-4a80-ad38-abd3f5585611: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-74f093be-e96a-4a80-ad38-abd3f5585611', 'volume_size': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d98522b7634403f83ff66fd72edfd9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'created_at': datetime.datetime(2022, 6, 25, 20, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5741eca-b932-4865-b29a-bd2a12a73795/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 25 20:56:51.805687 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Cloning 74f093be-e96a-4a80-ad38-abd3f5585611 from image c5741eca-b932-4865-b29a-bd2a12a73795 at location (None, None). {{(pid=130674) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1062}} Jun 25 20:56:51.822381 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Lock "b'cinder-c5741eca-b932-4865-b29a-bd2a12a73795'" acquired by "_prepare_image_cache_entry" :: waited 0.015s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 20:56:51.844066 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Preparing cache entry for image = c5741eca-b932-4865-b29a-bd2a12a73795 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:882}} Jun 25 20:56:51.845508 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Attempting to retrieve cache entry for image = c5741eca-b932-4865-b29a-bd2a12a73795 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:818}} Jun 25 20:56:52.115983 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 20:56:52.117098 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:56:52.164682 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:56:52.239056 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 20:57:02.358535 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=12,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:12.361231 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=14,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:12.411822 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.image_utils [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c5741eca-b932-4865-b29a-bd2a12a73795_n1btzh6fncdv-master-1@ceph, size 616.00 MB, duration 20.55 sec {{(pid=130674) fetch /opt/stack/cinder/cinder/image/image_utils.py:587}} Jun 25 20:57:12.416690 ncdv-master-1 cinder-volume[130674]: INFO cinder.image.image_utils [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Image download 616.00 MB at 29.98 MB/s Jun 25 20:57:12.501184 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_c5741eca-b932-4865-b29a-bd2a12a73795_n1btzh6fncdv-master-1@ceph {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 20:57:12.779501 ncdv-master-1 sudo[145656]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_c5741eca-b932-4865-b29a-bd2a12a73795_n1btzh6fncdv-master-1@ceph Jun 25 20:57:12.780354 ncdv-master-1 sudo[145656]: pam_unix(sudo:session): session opened for user root by (uid=0) Jun 25 20:57:15.156911 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-883cb25c-0b35-4da7-b074-7405faddb5ec tempest-LiveMigrationTest-185531048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 20:57:15.252775 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-883cb25c-0b35-4da7-b074-7405faddb5ec tempest-LiveMigrationTest-185531048 None] Flow 'volume_create_manager' (89b0a605-a8fd-47f9-af60-6cd2377ad1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 20:57:15.265284 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-883cb25c-0b35-4da7-b074-7405faddb5ec tempest-LiveMigrationTest-185531048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c97ee14-9dcf-4966-9c0b-2ef1c77a7b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 20:57:15.366593 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-883cb25c-0b35-4da7-b074-7405faddb5ec tempest-LiveMigrationTest-185531048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c97ee14-9dcf-4966-9c0b-2ef1c77a7b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T20:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveMigrationTest-volume-179873861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=dfb3f3d7-81ce-4d96-93a2-b60490b5cf87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8850e182ca148cb99d4eb414eb7c08d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T20:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T20:57:15Z,use_quota=True,user_id='e9c6e12528ea4760bed65f994df57783',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 20:57:15.386161 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-883cb25c-0b35-4da7-b074-7405faddb5ec tempest-LiveMigrationTest-185531048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d06d2227-1516-4f58-b669-072b4700baf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 20:57:15.404771 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-883cb25c-0b35-4da7-b074-7405faddb5ec tempest-LiveMigrationTest-185531048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d06d2227-1516-4f58-b669-072b4700baf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 20:57:15.410195 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-883cb25c-0b35-4da7-b074-7405faddb5ec tempest-LiveMigrationTest-185531048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26fcd532-6a3c-4911-985c-1cc653e06fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 20:57:15.469799 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-883cb25c-0b35-4da7-b074-7405faddb5ec tempest-LiveMigrationTest-185531048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26fcd532-6a3c-4911-985c-1cc653e06fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfb3f3d7-81ce-4d96-93a2-b60490b5cf87', 'volume_name': 'volume-dfb3f3d7-81ce-4d96-93a2-b60490b5cf87', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 20:57:15.506025 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-883cb25c-0b35-4da7-b074-7405faddb5ec tempest-LiveMigrationTest-185531048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (868e31b2-56ad-4360-a4e9-1da13cb9c2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 20:57:15.530881 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-883cb25c-0b35-4da7-b074-7405faddb5ec tempest-LiveMigrationTest-185531048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (868e31b2-56ad-4360-a4e9-1da13cb9c2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 20:57:15.555430 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-883cb25c-0b35-4da7-b074-7405faddb5ec tempest-LiveMigrationTest-185531048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (489d63fb-97a0-4e64-96f3-5a606702d247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 20:57:15.556234 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-883cb25c-0b35-4da7-b074-7405faddb5ec tempest-LiveMigrationTest-185531048 None] Volume dfb3f3d7-81ce-4d96-93a2-b60490b5cf87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfb3f3d7-81ce-4d96-93a2-b60490b5cf87', 'volume_size': 1} Jun 25 20:57:15.556689 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-883cb25c-0b35-4da7-b074-7405faddb5ec tempest-LiveMigrationTest-185531048 None] creating volume 'volume-dfb3f3d7-81ce-4d96-93a2-b60490b5cf87' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 20:57:15.572988 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-883cb25c-0b35-4da7-b074-7405faddb5ec tempest-LiveMigrationTest-185531048 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:57:15.770662 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-883cb25c-0b35-4da7-b074-7405faddb5ec tempest-LiveMigrationTest-185531048 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 20:57:15.771037 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-883cb25c-0b35-4da7-b074-7405faddb5ec tempest-LiveMigrationTest-185531048 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 20:57:15.785127 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-883cb25c-0b35-4da7-b074-7405faddb5ec tempest-LiveMigrationTest-185531048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (489d63fb-97a0-4e64-96f3-5a606702d247) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfb3f3d7-81ce-4d96-93a2-b60490b5cf87', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 20:57:15.799049 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-883cb25c-0b35-4da7-b074-7405faddb5ec tempest-LiveMigrationTest-185531048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5ac52c7-e584-4018-b17f-50050e8fa727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 20:57:15.835485 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-883cb25c-0b35-4da7-b074-7405faddb5ec tempest-LiveMigrationTest-185531048 None] Volume volume-dfb3f3d7-81ce-4d96-93a2-b60490b5cf87 (dfb3f3d7-81ce-4d96-93a2-b60490b5cf87): created successfully Jun 25 20:57:15.850009 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-883cb25c-0b35-4da7-b074-7405faddb5ec tempest-LiveMigrationTest-185531048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5ac52c7-e584-4018-b17f-50050e8fa727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 20:57:15.855392 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-883cb25c-0b35-4da7-b074-7405faddb5ec tempest-LiveMigrationTest-185531048 None] Flow 'volume_create_manager' (89b0a605-a8fd-47f9-af60-6cd2377ad1ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 20:57:15.870792 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-883cb25c-0b35-4da7-b074-7405faddb5ec tempest-LiveMigrationTest-185531048 None] Created volume successfully. Jun 25 20:57:16.136173 ncdv-master-1 sudo[145656]: pam_unix(sudo:session): session closed for user root Jun 25 20:57:16.138222 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_c5741eca-b932-4865-b29a-bd2a12a73795_n1btzh6fncdv-master-1@ceph" returned: 0 in 3.637s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 20:57:16.143216 ncdv-master-1 cinder-volume[130674]: WARNING py.warnings [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Jun 25 20:57:16.143216 ncdv-master-1 cinder-volume[130674]: debtcollector.deprecate( Jun 25 20:57:16.143216 ncdv-master-1 cinder-volume[130674]: Jun 25 20:57:16.143971 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.image_utils [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Temporary image c5741eca-b932-4865-b29a-bd2a12a73795 is fetched for user 39e82edaa30d418d96ea37f942d62755. {{(pid=130674) fetch /opt/stack/cinder/cinder/image/image_utils.py:1124}} Jun 25 20:57:16.294324 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_c5741eca-b932-4865-b29a-bd2a12a73795_n1btzh6fncdv-master-1@ceph {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 20:57:16.485638 ncdv-master-1 sudo[145712]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_c5741eca-b932-4865-b29a-bd2a12a73795_n1btzh6fncdv-master-1@ceph Jun 25 20:57:16.491739 ncdv-master-1 sudo[145712]: pam_unix(sudo:session): session opened for user root by (uid=0) Jun 25 20:57:17.324958 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-19d4c056-9bef-4945-bb83-01d898930451 req-166286e2-5602-4d98-ae1b-f1ee5c262efb tempest-LiveMigrationTest-185531048 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 20:57:19.384877 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-19d4c056-9bef-4945-bb83-01d898930451 req-166286e2-5602-4d98-ae1b-f1ee5c262efb tempest-LiveMigrationTest-185531048 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 2.061s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 20:57:19.386930 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-19d4c056-9bef-4945-bb83-01d898930451 req-166286e2-5602-4d98-ae1b-f1ee5c262efb tempest-LiveMigrationTest-185531048 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-dfb3f3d7-81ce-4d96-93a2-b60490b5cf87', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': 'dfb3f3d7-81ce-4d96-93a2-b60490b5cf87', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 20:57:19.445444 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-19d4c056-9bef-4945-bb83-01d898930451 req-166286e2-5602-4d98-ae1b-f1ee5c262efb tempest-LiveMigrationTest-185531048 None] Connection info returned from driver {'name': 'volumes/volume-dfb3f3d7-81ce-4d96-93a2-b60490b5cf87', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'dfb3f3d7-81ce-4d96-93a2-b60490b5cf87', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '2fd9029d-3c2c-4346-bfcf-0cde87d4874d'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 25 20:57:19.577814 ncdv-master-1 sudo[145712]: pam_unix(sudo:session): session closed for user root Jun 25 20:57:19.630546 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_c5741eca-b932-4865-b29a-bd2a12a73795_n1btzh6fncdv-master-1@ceph" returned: 0 in 3.336s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 20:57:19.638043 ncdv-master-1 cinder-volume[130674]: WARNING py.warnings [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Jun 25 20:57:19.638043 ncdv-master-1 cinder-volume[130674]: debtcollector.deprecate( Jun 25 20:57:19.638043 ncdv-master-1 cinder-volume[130674]: Jun 25 20:57:19.639433 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] creating volume 'volume-74f093be-e96a-4a80-ad38-abd3f5585611' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 20:57:19.640874 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:57:19.735375 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-19d4c056-9bef-4945-bb83-01d898930451 req-166286e2-5602-4d98-ae1b-f1ee5c262efb tempest-LiveMigrationTest-185531048 None] attachment_update completed successfully. Jun 25 20:57:19.814781 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 20:57:19.815539 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 20:57:19.851610 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.volume_utils [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Attempting download of c5741eca-b932-4865-b29a-bd2a12a73795 ((None, None)) to volume 74f093be-e96a-4a80-ad38-abd3f5585611. {{(pid=130674) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1181}} Jun 25 20:57:19.900690 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_c5741eca-b932-4865-b29a-bd2a12a73795_vf08iy01 {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 20:57:20.142517 ncdv-master-1 sudo[145776]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_c5741eca-b932-4865-b29a-bd2a12a73795_vf08iy01 Jun 25 20:57:20.143356 ncdv-master-1 sudo[145776]: pam_unix(sudo:session): session opened for user root by (uid=0) Jun 25 20:57:22.740317 ncdv-master-1 sudo[145776]: pam_unix(sudo:session): session closed for user root Jun 25 20:57:22.744163 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_c5741eca-b932-4865-b29a-bd2a12a73795_vf08iy01" returned: 0 in 2.843s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 20:57:22.747190 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_c5741eca-b932-4865-b29a-bd2a12a73795_n1btzh6fncdv-master-1@ceph {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 20:57:22.936369 ncdv-master-1 sudo[145858]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_c5741eca-b932-4865-b29a-bd2a12a73795_n1btzh6fncdv-master-1@ceph Jun 25 20:57:22.938195 ncdv-master-1 sudo[145858]: pam_unix(sudo:session): session opened for user root by (uid=0) Jun 25 20:57:25.858352 ncdv-master-1 sudo[145858]: pam_unix(sudo:session): session closed for user root Jun 25 20:57:25.860755 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_c5741eca-b932-4865-b29a-bd2a12a73795_n1btzh6fncdv-master-1@ceph" returned: 0 in 3.113s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 20:57:25.861883 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.image_utils [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] c5741eca-b932-4865-b29a-bd2a12a73795 was vhdx, converting to raw {{(pid=130674) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:825}} Jun 25 20:57:25.863095 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_c5741eca-b932-4865-b29a-bd2a12a73795_n1btzh6fncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmpuaqgx8kv {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 20:57:25.906519 ncdv-master-1 sudo[145924]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_c5741eca-b932-4865-b29a-bd2a12a73795_n1btzh6fncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmpuaqgx8kv Jun 25 20:57:25.909114 ncdv-master-1 sudo[145924]: pam_unix(sudo:session): session opened for user root by (uid=0) Jun 25 20:57:28.408390 ncdv-master-1 sudo[145924]: pam_unix(sudo:session): session closed for user root Jun 25 20:57:28.411051 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_c5741eca-b932-4865-b29a-bd2a12a73795_n1btzh6fncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmpuaqgx8kv" returned: 0 in 2.547s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 20:57:28.412104 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_c5741eca-b932-4865-b29a-bd2a12a73795_n1btzh6fncdv-master-1@ceph {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 20:57:28.518142 ncdv-master-1 sudo[145981]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_c5741eca-b932-4865-b29a-bd2a12a73795_n1btzh6fncdv-master-1@ceph Jun 25 20:57:28.518926 ncdv-master-1 sudo[145981]: pam_unix(sudo:session): session opened for user root by (uid=0) Jun 25 20:57:29.839507 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=20,cinder:UPDATE=6 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:30.007463 ncdv-master-1 sudo[145981]: pam_unix(sudo:session): session closed for user root Jun 25 20:57:30.009593 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_c5741eca-b932-4865-b29a-bd2a12a73795_n1btzh6fncdv-master-1@ceph" returned: 0 in 1.597s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 20:57:30.010489 ncdv-master-1 cinder-volume[130674]: WARNING py.warnings [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Jun 25 20:57:30.010489 ncdv-master-1 cinder-volume[130674]: debtcollector.deprecate( Jun 25 20:57:30.010489 ncdv-master-1 cinder-volume[130674]: Jun 25 20:57:30.011443 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.image_utils [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c5741eca-b932-4865-b29a-bd2a12a73795_n1btzh6fncdv-master-1@ceph, size 700.00 MB, duration 2.55 sec, destination /opt/stack/data/cinder/conversion/tmpuaqgx8kv {{(pid=130674) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:419}} Jun 25 20:57:30.011955 ncdv-master-1 cinder-volume[130674]: INFO cinder.image.image_utils [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Converted 700.00 MB image at 274.62 MB/s Jun 25 20:57:30.013558 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:57:30.148025 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 20:57:30.151399 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Volume volume-74f093be-e96a-4a80-ad38-abd3f5585611 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 20:57:30.175711 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] deleting rbd volume volume-74f093be-e96a-4a80-ad38-abd3f5585611 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 20:57:30.473595 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Running cmd (subprocess): rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmpuaqgx8kv volume-74f093be-e96a-4a80-ad38-abd3f5585611 --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 20:57:32.447103 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-2823dd97-2c2c-4c76-a021-e47c720ea7ad tempest-AttachSCSIVolumeTestJSON-1691617548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 20:57:32.510888 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2823dd97-2c2c-4c76-a021-e47c720ea7ad tempest-AttachSCSIVolumeTestJSON-1691617548 None] Flow 'volume_create_manager' (19ea437e-2500-494c-b380-ac392e480c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 20:57:32.528844 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2823dd97-2c2c-4c76-a021-e47c720ea7ad tempest-AttachSCSIVolumeTestJSON-1691617548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64cdd436-29f5-4358-a698-0bacd8b79504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 20:57:32.597964 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2823dd97-2c2c-4c76-a021-e47c720ea7ad tempest-AttachSCSIVolumeTestJSON-1691617548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64cdd436-29f5-4358-a698-0bacd8b79504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T20:57:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-196992586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6dd8ada4-2839-42a5-ac94-ae375a885f43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c734d57dbb974b2bba1efc21917a7269',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T20:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T20:57:32Z,use_quota=True,user_id='9a8cd690a02e4b47afb24d9d4dba52b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 20:57:32.613224 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2823dd97-2c2c-4c76-a021-e47c720ea7ad tempest-AttachSCSIVolumeTestJSON-1691617548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (289055e7-f31a-4509-858a-622077df1135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 20:57:32.621507 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2823dd97-2c2c-4c76-a021-e47c720ea7ad tempest-AttachSCSIVolumeTestJSON-1691617548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (289055e7-f31a-4509-858a-622077df1135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 20:57:32.638743 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2823dd97-2c2c-4c76-a021-e47c720ea7ad tempest-AttachSCSIVolumeTestJSON-1691617548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00adc2d6-2a69-417e-89d1-c6a6aa2eb913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 20:57:32.646000 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2823dd97-2c2c-4c76-a021-e47c720ea7ad tempest-AttachSCSIVolumeTestJSON-1691617548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00adc2d6-2a69-417e-89d1-c6a6aa2eb913) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dd8ada4-2839-42a5-ac94-ae375a885f43', 'volume_name': 'volume-6dd8ada4-2839-42a5-ac94-ae375a885f43', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 20:57:32.655350 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2823dd97-2c2c-4c76-a021-e47c720ea7ad tempest-AttachSCSIVolumeTestJSON-1691617548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70ad5cd8-2f8c-46b4-9077-ab999c620952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 20:57:32.660683 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2823dd97-2c2c-4c76-a021-e47c720ea7ad tempest-AttachSCSIVolumeTestJSON-1691617548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70ad5cd8-2f8c-46b4-9077-ab999c620952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 20:57:32.666506 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2823dd97-2c2c-4c76-a021-e47c720ea7ad tempest-AttachSCSIVolumeTestJSON-1691617548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a70dfee1-c561-4eca-a486-a687546bc716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 20:57:32.684348 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-2823dd97-2c2c-4c76-a021-e47c720ea7ad tempest-AttachSCSIVolumeTestJSON-1691617548 None] Volume 6dd8ada4-2839-42a5-ac94-ae375a885f43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dd8ada4-2839-42a5-ac94-ae375a885f43', 'volume_size': 1} Jun 25 20:57:32.685066 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2823dd97-2c2c-4c76-a021-e47c720ea7ad tempest-AttachSCSIVolumeTestJSON-1691617548 None] creating volume 'volume-6dd8ada4-2839-42a5-ac94-ae375a885f43' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 20:57:32.688862 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2823dd97-2c2c-4c76-a021-e47c720ea7ad tempest-AttachSCSIVolumeTestJSON-1691617548 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:57:32.976281 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2823dd97-2c2c-4c76-a021-e47c720ea7ad tempest-AttachSCSIVolumeTestJSON-1691617548 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 20:57:32.977079 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2823dd97-2c2c-4c76-a021-e47c720ea7ad tempest-AttachSCSIVolumeTestJSON-1691617548 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 20:57:32.981138 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2823dd97-2c2c-4c76-a021-e47c720ea7ad tempest-AttachSCSIVolumeTestJSON-1691617548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a70dfee1-c561-4eca-a486-a687546bc716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dd8ada4-2839-42a5-ac94-ae375a885f43', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 20:57:32.989464 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2823dd97-2c2c-4c76-a021-e47c720ea7ad tempest-AttachSCSIVolumeTestJSON-1691617548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3617ee00-7d4d-4060-9ddf-ef54f1f484a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 20:57:33.010364 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-2823dd97-2c2c-4c76-a021-e47c720ea7ad tempest-AttachSCSIVolumeTestJSON-1691617548 None] Volume volume-6dd8ada4-2839-42a5-ac94-ae375a885f43 (6dd8ada4-2839-42a5-ac94-ae375a885f43): created successfully Jun 25 20:57:33.015315 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2823dd97-2c2c-4c76-a021-e47c720ea7ad tempest-AttachSCSIVolumeTestJSON-1691617548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3617ee00-7d4d-4060-9ddf-ef54f1f484a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 20:57:33.037056 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2823dd97-2c2c-4c76-a021-e47c720ea7ad tempest-AttachSCSIVolumeTestJSON-1691617548 None] Flow 'volume_create_manager' (19ea437e-2500-494c-b380-ac392e480c8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 20:57:33.062154 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-2823dd97-2c2c-4c76-a021-e47c720ea7ad tempest-AttachSCSIVolumeTestJSON-1691617548 None] Created volume successfully. Jun 25 20:57:35.263233 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-c21f9d85-da7f-40d0-bbf7-c1e6145581fd req-e23c2881-5023-4473-a9ef-4d3cd298502a tempest-AttachSCSIVolumeTestJSON-1691617548 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 20:57:35.890508 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-6fec9fad-e4d6-4b61-b5d3-6677f22e361b req-2c26a430-794c-4aee-b921-15846f782174 tempest-LiveMigrationTest-1661695200 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 20:57:36.193673 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] CMD "rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmpuaqgx8kv volume-74f093be-e96a-4a80-ad38-abd3f5585611 --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 5.720s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 20:57:36.458588 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:57:36.578249 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-c21f9d85-da7f-40d0-bbf7-c1e6145581fd req-e23c2881-5023-4473-a9ef-4d3cd298502a tempest-AttachSCSIVolumeTestJSON-1691617548 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.315s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 20:57:36.578979 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-c21f9d85-da7f-40d0-bbf7-c1e6145581fd req-e23c2881-5023-4473-a9ef-4d3cd298502a tempest-AttachSCSIVolumeTestJSON-1691617548 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-6dd8ada4-2839-42a5-ac94-ae375a885f43', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': '6dd8ada4-2839-42a5-ac94-ae375a885f43', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 20:57:36.631230 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-c21f9d85-da7f-40d0-bbf7-c1e6145581fd req-e23c2881-5023-4473-a9ef-4d3cd298502a tempest-AttachSCSIVolumeTestJSON-1691617548 None] Connection info returned from driver {'name': 'volumes/volume-6dd8ada4-2839-42a5-ac94-ae375a885f43', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '6dd8ada4-2839-42a5-ac94-ae375a885f43', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b628aa60-af81-437a-b159-28aa48eef9e2'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 25 20:57:36.764158 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 20:57:36.764158 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 20:57:36.764158 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.volume_utils [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Downloaded image c5741eca-b932-4865-b29a-bd2a12a73795 ((None, None)) to volume 74f093be-e96a-4a80-ad38-abd3f5585611 successfully. {{(pid=130674) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1223}} Jun 25 20:57:36.892889 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.image_utils [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Temporary image c5741eca-b932-4865-b29a-bd2a12a73795 for user 39e82edaa30d418d96ea37f942d62755 is deleted. {{(pid=130674) fetch /opt/stack/cinder/cinder/image/image_utils.py:1128}} Jun 25 20:57:37.007646 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-c21f9d85-da7f-40d0-bbf7-c1e6145581fd req-e23c2881-5023-4473-a9ef-4d3cd298502a tempest-AttachSCSIVolumeTestJSON-1691617548 None] attachment_update completed successfully. Jun 25 20:57:37.038904 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Deprecated: Default quota for resource: volumes_ceph is set by the default quota flag: quota_volumes_ceph, it is now deprecated. Please use the default quota class for default quota. Jun 25 20:57:37.041852 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Deprecated: Default quota for resource: gigabytes_ceph is set by the default quota flag: quota_gigabytes_ceph, it is now deprecated. Please use the default quota class for default quota. Jun 25 20:57:37.203632 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Created reservations ['97412b49-e30b-4376-b58b-9a0288c38b2e', '11e55809-f634-4461-af17-1034160673e4', 'ed88abf9-b6f9-4d61-b5f6-3cfbd7c4d475', 'bba83f12-1a9e-4964-b194-7a564e2f4d2b'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 20:57:37.238212 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Creating image volume entry: {'size': 1, 'replication_driver_data': None, 'launched_at': None, 'bootable': False, 'display_description': None, 'ec2_id': None, 'replication_extended_status': None, 'previous_status': None, 'replication_status': None, 'volume_glance_metadata': [{'key': 'signature_verified', 'value': 'False'}], 'encryption_key_id': None, 'multiattach': False, 'volume_type_id': '1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0', 'user_id': '39e82edaa30d418d96ea37f942d62755', 'scheduled_at': datetime.datetime(2022, 6, 25, 20, 56, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 25, 20, 56, 51, tzinfo=datetime.timezone.utc), 'deleted': False, 'host': 'ncdv-master-1@ceph#ceph', 'metadata': {}, 'volume_metadata': [], 'consistencygroup_id': None, 'display_name': 'image-c5741eca-b932-4865-b29a-bd2a12a73795', 'created_at': datetime.datetime(2022, 6, 25, 20, 56, 51, tzinfo=datetime.timezone.utc), 'service_uuid': None, 'terminated_at': None, 'availability_zone': 'nova', 'provider_auth': None, 'deleted_at': None, 'shared_targets': True, 'volume_admin_metadata': [], 'cluster_name': None, 'group_id': None, 'provider_geometry': None, 'provider_location': None, 'provider_id': None, 'project_id': 'a6e42207f22245d5b512d5a5e7be5fa7', 'attach_status': 'detached', 'status': 'creating', 'source_volid': '74f093be-e96a-4a80-ad38-abd3f5585611'}. {{(pid=130674) _clone_image_volume /opt/stack/cinder/cinder/volume/manager.py:1620}} Jun 25 20:57:37.258080 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-6fec9fad-e4d6-4b61-b5d3-6677f22e361b req-2c26a430-794c-4aee-b921-15846f782174 tempest-LiveMigrationTest-1661695200 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.368s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 20:57:37.260085 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-6fec9fad-e4d6-4b61-b5d3-6677f22e361b req-2c26a430-794c-4aee-b921-15846f782174 tempest-LiveMigrationTest-1661695200 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-dfb3f3d7-81ce-4d96-93a2-b60490b5cf87', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': 'dfb3f3d7-81ce-4d96-93a2-b60490b5cf87', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 20:57:37.325398 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-6fec9fad-e4d6-4b61-b5d3-6677f22e361b req-2c26a430-794c-4aee-b921-15846f782174 tempest-LiveMigrationTest-1661695200 None] Connection info returned from driver {'name': 'volumes/volume-dfb3f3d7-81ce-4d96-93a2-b60490b5cf87', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'dfb3f3d7-81ce-4d96-93a2-b60490b5cf87', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0ff865aa-6802-4241-9442-714cce9182b6'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 25 20:57:37.416247 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Volume reschedule parameters: False retry: None {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 20:57:37.449638 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Flow 'volume_create_manager' (27d4df2b-7372-4338-9d25-9da8d9c6a080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 20:57:37.456608 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c04218cf-c50e-4368-9deb-8df44ab5db64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 20:57:37.478303 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c04218cf-c50e-4368-9deb-8df44ab5db64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T20:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='image-c5741eca-b932-4865-b29a-bd2a12a73795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c8878629-87cd-43d0-b2bd-d32c807cd322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6e42207f22245d5b512d5a5e7be5fa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T20:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=74f093be-e96a-4a80-ad38-abd3f5585611,status='creating',terminated_at=None,updated_at=2022-06-25T20:56:51Z,use_quota=True,user_id='39e82edaa30d418d96ea37f942d62755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 20:57:37.487029 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3363e04-f267-4378-aa90-47bb01f7e6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 20:57:37.491333 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3363e04-f267-4378-aa90-47bb01f7e6db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 20:57:37.513310 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (901ff1e3-a4c4-4d82-8b1f-c1e3428ee154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 20:57:37.542271 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (901ff1e3-a4c4-4d82-8b1f-c1e3428ee154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c8878629-87cd-43d0-b2bd-d32c807cd322', 'volume_name': 'volume-c8878629-87cd-43d0-b2bd-d32c807cd322', 'volume_size': 1, 'source_volid': '74f093be-e96a-4a80-ad38-abd3f5585611', 'source_volstatus': 'downloading'}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 20:57:37.552473 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2efe6af-1052-415b-a7a3-d3ccd313d9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 20:57:37.560995 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2efe6af-1052-415b-a7a3-d3ccd313d9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 20:57:37.577511 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aec9edf-ebce-43b4-8620-99c6004a9421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 20:57:37.579088 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Volume c8878629-87cd-43d0-b2bd-d32c807cd322: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c8878629-87cd-43d0-b2bd-d32c807cd322', 'volume_size': 1, 'source_volid': '74f093be-e96a-4a80-ad38-abd3f5585611', 'source_volstatus': 'downloading'} Jun 25 20:57:37.599177 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:57:37.661866 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] creating snapshot='volume-c8878629-87cd-43d0-b2bd-d32c807cd322.clone_snap' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jun 25 20:57:38.082363 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] cloning 'volume-74f093be-e96a-4a80-ad38-abd3f5585611@volume-c8878629-87cd-43d0-b2bd-d32c807cd322.clone_snap' to 'volume-c8878629-87cd-43d0-b2bd-d32c807cd322' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jun 25 20:57:38.084848 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-6fec9fad-e4d6-4b61-b5d3-6677f22e361b req-2c26a430-794c-4aee-b921-15846f782174 tempest-LiveMigrationTest-1661695200 None] attachment_update completed successfully. Jun 25 20:57:38.268309 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Volume volume-74f093be-e96a-4a80-ad38-abd3f5585611 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 20:57:38.269954 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 20:57:38.271637 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 20:57:38.309423 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] clone created successfully {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jun 25 20:57:38.314630 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aec9edf-ebce-43b4-8620-99c6004a9421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8878629-87cd-43d0-b2bd-d32c807cd322', 'volume_size': 1, 'source_volid': '74f093be-e96a-4a80-ad38-abd3f5585611', 'source_volstatus': 'downloading'}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 20:57:38.321142 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14bffdfc-fea7-4dd6-a865-d63cdcbcf1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 20:57:38.331535 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Volume volume-c8878629-87cd-43d0-b2bd-d32c807cd322 (c8878629-87cd-43d0-b2bd-d32c807cd322): created successfully Jun 25 20:57:38.336461 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14bffdfc-fea7-4dd6-a865-d63cdcbcf1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 20:57:38.343718 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Flow 'volume_create_manager' (27d4df2b-7372-4338-9d25-9da8d9c6a080) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 20:57:38.354763 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Created volume successfully. Jun 25 20:57:38.390396 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Creating new image-volume cache entry for image c5741eca-b932-4865-b29a-bd2a12a73795 on ncdv-master-1@ceph#ceph {{(pid=130674) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:104}} Jun 25 20:57:38.400817 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] New image-volume cache entry created: {'id': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'volume_id': 'c8878629-87cd-43d0-b2bd-d32c807cd322', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53), 'last_used': datetime.datetime(2022, 6, 25, 20, 57, 38, 394016)}. {{(pid=130674) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:129}} Jun 25 20:57:38.411616 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Lock "b'cinder-c5741eca-b932-4865-b29a-bd2a12a73795'" released by "_prepare_image_cache_entry" :: held 46.587s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 20:57:38.411616 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.volume_utils [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Marking volume 74f093be-e96a-4a80-ad38-abd3f5585611 as bootable. {{(pid=130674) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 25 20:57:38.415622 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=74,cinder:UPDATE=18,cinder:DELETE=2,cinder:INSERT=6 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:38.422625 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Copying metadata from image c5741eca-b932-4865-b29a-bd2a12a73795 to 74f093be-e96a-4a80-ad38-abd3f5585611. {{(pid=130674) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jun 25 20:57:38.423208 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Creating volume glance metadata for volume 74f093be-e96a-4a80-ad38-abd3f5585611 backed by image c5741eca-b932-4865-b29a-bd2a12a73795 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=130674) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:674}} Jun 25 20:57:38.536909 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (841bac0b-4c2c-49fe-87ce-ffa87c484270) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74f093be-e96a-4a80-ad38-abd3f5585611', 'volume_size': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d98522b7634403f83ff66fd72edfd9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'created_at': datetime.datetime(2022, 6, 25, 20, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5741eca-b932-4865-b29a-bd2a12a73795/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 20:57:38.545203 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a46415f-0be2-4caa-9677-92fc8d361b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 20:57:38.562625 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Volume volume-74f093be-e96a-4a80-ad38-abd3f5585611 (74f093be-e96a-4a80-ad38-abd3f5585611): created successfully Jun 25 20:57:38.574266 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a46415f-0be2-4caa-9677-92fc8d361b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 20:57:38.581770 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Flow 'volume_create_manager' (13344dac-e6f9-41b7-a331-b5429e56c346) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 20:57:38.596954 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-f947a0d2-2f87-46cb-9ab2-4995a7eea961 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Created volume successfully. Jun 25 20:57:43.632959 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-b127eb9a-d33d-4017-ac2c-445882f9f6bd req-57252c3c-13cc-4090-9f8c-70f5822664c4 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 20:57:43.731492 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-c5d633c0-fbbd-4854-bb8e-352255157609 req-81bc9e1c-5d43-4a6e-8dad-f04d80a07cdd tempest-AttachSCSIVolumeTestJSON-1691617548 None] Terminate volume connection completed successfully. Jun 25 20:57:43.732178 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-c5d633c0-fbbd-4854-bb8e-352255157609 req-81bc9e1c-5d43-4a6e-8dad-f04d80a07cdd tempest-AttachSCSIVolumeTestJSON-1691617548 None] Deleting attachment b628aa60-af81-437a-b159-28aa48eef9e2. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 25 20:57:44.897255 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-b127eb9a-d33d-4017-ac2c-445882f9f6bd req-57252c3c-13cc-4090-9f8c-70f5822664c4 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.268s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 20:57:44.898728 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-b127eb9a-d33d-4017-ac2c-445882f9f6bd req-57252c3c-13cc-4090-9f8c-70f5822664c4 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-74f093be-e96a-4a80-ad38-abd3f5585611', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': '74f093be-e96a-4a80-ad38-abd3f5585611', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 20:57:44.929161 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=71,cinder:UPDATE=13,cinder:INSERT=14,cinder:DELETE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:44.943978 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-b127eb9a-d33d-4017-ac2c-445882f9f6bd req-57252c3c-13cc-4090-9f8c-70f5822664c4 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Connection info returned from driver {'name': 'volumes/volume-74f093be-e96a-4a80-ad38-abd3f5585611', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '74f093be-e96a-4a80-ad38-abd3f5585611', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '47efa6ff-7998-48e3-9570-0b0c453d9fa4'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 25 20:57:45.056587 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-b127eb9a-d33d-4017-ac2c-445882f9f6bd req-57252c3c-13cc-4090-9f8c-70f5822664c4 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] attachment_update completed successfully. Jun 25 20:57:52.114649 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 20:57:52.115832 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:57:52.228378 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:57:52.280325 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 20:57:54.944450 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-6fec9fad-e4d6-4b61-b5d3-6677f22e361b req-e111de84-35fb-4bde-bcdc-0121258ff9c3 tempest-LiveMigrationTest-1661695200 None] Terminate volume connection completed successfully. Jun 25 20:57:54.945179 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-6fec9fad-e4d6-4b61-b5d3-6677f22e361b req-e111de84-35fb-4bde-bcdc-0121258ff9c3 tempest-LiveMigrationTest-1661695200 None] Deleting attachment 2fd9029d-3c2c-4346-bfcf-0cde87d4874d. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 25 20:57:58.359345 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-022e6b58-39df-4d34-a72d-7aadc00a3c54 tempest-AttachSCSIVolumeTestJSON-1691617548 None] Lock "b'cinder-6dd8ada4-2839-42a5-ac94-ae375a885f43-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 20:57:58.448081 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-022e6b58-39df-4d34-a72d-7aadc00a3c54 tempest-AttachSCSIVolumeTestJSON-1691617548 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:57:58.557418 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-022e6b58-39df-4d34-a72d-7aadc00a3c54 tempest-AttachSCSIVolumeTestJSON-1691617548 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 20:57:58.558115 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-022e6b58-39df-4d34-a72d-7aadc00a3c54 tempest-AttachSCSIVolumeTestJSON-1691617548 None] Volume volume-6dd8ada4-2839-42a5-ac94-ae375a885f43 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 20:57:58.570240 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-022e6b58-39df-4d34-a72d-7aadc00a3c54 tempest-AttachSCSIVolumeTestJSON-1691617548 None] deleting rbd volume volume-6dd8ada4-2839-42a5-ac94-ae375a885f43 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 20:57:59.029267 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-022e6b58-39df-4d34-a72d-7aadc00a3c54 tempest-AttachSCSIVolumeTestJSON-1691617548 None] Created reservations ['8b075aa1-730a-41d7-8afb-9771a47c4db2', '781215f8-3714-4fcf-88db-e9ef041056b5', '53360ce7-45a4-4498-8f69-70eb293775ff', '8cd1cb7a-ca5d-41dc-8f24-6a5fefe81d60'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 20:57:59.145115 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-022e6b58-39df-4d34-a72d-7aadc00a3c54 tempest-AttachSCSIVolumeTestJSON-1691617548 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:57:59.235194 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-022e6b58-39df-4d34-a72d-7aadc00a3c54 tempest-AttachSCSIVolumeTestJSON-1691617548 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:57:59.328446 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-022e6b58-39df-4d34-a72d-7aadc00a3c54 tempest-AttachSCSIVolumeTestJSON-1691617548 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 20:57:59.360592 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-022e6b58-39df-4d34-a72d-7aadc00a3c54 tempest-AttachSCSIVolumeTestJSON-1691617548 None] Deleted volume successfully. Jun 25 20:57:59.388861 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-022e6b58-39df-4d34-a72d-7aadc00a3c54 tempest-AttachSCSIVolumeTestJSON-1691617548 None] Lock "b'cinder-6dd8ada4-2839-42a5-ac94-ae375a885f43-delete_volume'" released by "delete_volume" :: held 1.030s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 20:58:09.704334 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-17beb484-c9b2-4c7e-a6db-e06acae5d4c7 req-9118ab3a-b480-4998-875c-3b675ac2d363 tempest-LiveMigrationTest-185531048 None] Terminate volume connection completed successfully. Jun 25 20:58:09.705550 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-17beb484-c9b2-4c7e-a6db-e06acae5d4c7 req-9118ab3a-b480-4998-875c-3b675ac2d363 tempest-LiveMigrationTest-185531048 None] Deleting attachment 0ff865aa-6802-4241-9442-714cce9182b6. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 25 20:58:11.477825 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=41,cinder:INSERT=5,cinder:UPDATE=11 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:58:11.499490 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-c24d9b70-5f6e-493e-bc2f-2d3d60b6d463 tempest-LiveMigrationTest-185531048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 20:58:11.571093 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c24d9b70-5f6e-493e-bc2f-2d3d60b6d463 tempest-LiveMigrationTest-185531048 None] Flow 'volume_create_manager' (70a3c99b-13c1-4ba7-b9ae-b8fbfe53a722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 20:58:11.581044 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c24d9b70-5f6e-493e-bc2f-2d3d60b6d463 tempest-LiveMigrationTest-185531048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5647772b-cd87-40b3-9d54-e99fd6d42729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 20:58:11.604059 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c24d9b70-5f6e-493e-bc2f-2d3d60b6d463 tempest-LiveMigrationTest-185531048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5647772b-cd87-40b3-9d54-e99fd6d42729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T20:58:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1334887155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=81a43e53-60bb-4296-ad9a-0055b8bdf22f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8850e182ca148cb99d4eb414eb7c08d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T20:58:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T20:58:11Z,use_quota=True,user_id='e9c6e12528ea4760bed65f994df57783',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 20:58:11.611287 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c24d9b70-5f6e-493e-bc2f-2d3d60b6d463 tempest-LiveMigrationTest-185531048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f639b67b-f41a-45d7-b10a-587d7d004a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 20:58:11.616686 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c24d9b70-5f6e-493e-bc2f-2d3d60b6d463 tempest-LiveMigrationTest-185531048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f639b67b-f41a-45d7-b10a-587d7d004a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 20:58:11.622159 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c24d9b70-5f6e-493e-bc2f-2d3d60b6d463 tempest-LiveMigrationTest-185531048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccbb82d4-9fd1-491f-b8a3-c0cfe43a8be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 20:58:11.770689 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c24d9b70-5f6e-493e-bc2f-2d3d60b6d463 tempest-LiveMigrationTest-185531048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccbb82d4-9fd1-491f-b8a3-c0cfe43a8be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '81a43e53-60bb-4296-ad9a-0055b8bdf22f', 'volume_name': 'volume-81a43e53-60bb-4296-ad9a-0055b8bdf22f', 'volume_size': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d98522b7634403f83ff66fd72edfd9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'created_at': datetime.datetime(2022, 6, 25, 20, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5741eca-b932-4865-b29a-bd2a12a73795/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 20:58:11.790299 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c24d9b70-5f6e-493e-bc2f-2d3d60b6d463 tempest-LiveMigrationTest-185531048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (593ed465-0be2-4430-bc76-59a3ab9cd5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 20:58:11.806314 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c24d9b70-5f6e-493e-bc2f-2d3d60b6d463 tempest-LiveMigrationTest-185531048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (593ed465-0be2-4430-bc76-59a3ab9cd5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 20:58:11.842762 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c24d9b70-5f6e-493e-bc2f-2d3d60b6d463 tempest-LiveMigrationTest-185531048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4af1cb89-4059-4df1-8e1d-c79b92cfda51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 20:58:11.843982 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-c24d9b70-5f6e-493e-bc2f-2d3d60b6d463 tempest-LiveMigrationTest-185531048 None] Volume 81a43e53-60bb-4296-ad9a-0055b8bdf22f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-81a43e53-60bb-4296-ad9a-0055b8bdf22f', 'volume_size': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d98522b7634403f83ff66fd72edfd9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'created_at': datetime.datetime(2022, 6, 25, 20, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5741eca-b932-4865-b29a-bd2a12a73795/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 25 20:58:11.849857 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-c24d9b70-5f6e-493e-bc2f-2d3d60b6d463 tempest-LiveMigrationTest-185531048 None] Cloning 81a43e53-60bb-4296-ad9a-0055b8bdf22f from image c5741eca-b932-4865-b29a-bd2a12a73795 at location (None, None). {{(pid=130674) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1062}} Jun 25 20:58:11.915585 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-4ad8bd5d-811e-434f-bc9a-4e8690dc6d68 req-9442d6e7-7b92-413c-95b3-4699b6a09c16 tempest-LiveAutoBlockMigrationV225Test-1157528900 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 20:58:11.957800 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-c24d9b70-5f6e-493e-bc2f-2d3d60b6d463 tempest-LiveMigrationTest-185531048 None] Lock "b'cinder-c5741eca-b932-4865-b29a-bd2a12a73795'" acquired by "_prepare_image_cache_entry" :: waited 0.106s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 20:58:11.990758 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-c24d9b70-5f6e-493e-bc2f-2d3d60b6d463 tempest-LiveMigrationTest-185531048 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'volume_id': 'c8878629-87cd-43d0-b2bd-d32c807cd322', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53), 'last_used': datetime.datetime(2022, 6, 25, 20, 58, 11, 971691)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 25 20:58:11.991278 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-c24d9b70-5f6e-493e-bc2f-2d3d60b6d463 tempest-LiveMigrationTest-185531048 None] Image-volume cache entry image_update_at = 2022-06-25 20:42:53+00:00, requested image updated_at = 2022-06-25 20:42:53+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 25 20:58:11.991759 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-c24d9b70-5f6e-493e-bc2f-2d3d60b6d463 tempest-LiveMigrationTest-185531048 None] Found cache entry for image = c5741eca-b932-4865-b29a-bd2a12a73795 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:877}} Jun 25 20:58:12.014047 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-c24d9b70-5f6e-493e-bc2f-2d3d60b6d463 tempest-LiveMigrationTest-185531048 None] Lock "b'cinder-c5741eca-b932-4865-b29a-bd2a12a73795'" released by "_prepare_image_cache_entry" :: held 0.057s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 20:58:12.015143 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-c24d9b70-5f6e-493e-bc2f-2d3d60b6d463 tempest-LiveMigrationTest-185531048 None] Attempting to retrieve cache entry for image = c5741eca-b932-4865-b29a-bd2a12a73795 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:818}} Jun 25 20:58:12.032939 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-c24d9b70-5f6e-493e-bc2f-2d3d60b6d463 tempest-LiveMigrationTest-185531048 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'volume_id': 'c8878629-87cd-43d0-b2bd-d32c807cd322', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53), 'last_used': datetime.datetime(2022, 6, 25, 20, 58, 12, 25760)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 25 20:58:12.033390 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-c24d9b70-5f6e-493e-bc2f-2d3d60b6d463 tempest-LiveMigrationTest-185531048 None] Image-volume cache entry image_update_at = 2022-06-25 20:42:53+00:00, requested image updated_at = 2022-06-25 20:42:53+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 25 20:58:12.033811 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-c24d9b70-5f6e-493e-bc2f-2d3d60b6d463 tempest-LiveMigrationTest-185531048 None] Creating from source image-volume c8878629-87cd-43d0-b2bd-d32c807cd322 {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:832}} Jun 25 20:58:12.091078 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c24d9b70-5f6e-493e-bc2f-2d3d60b6d463 tempest-LiveMigrationTest-185531048 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:58:12.209594 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c24d9b70-5f6e-493e-bc2f-2d3d60b6d463 tempest-LiveMigrationTest-185531048 None] creating snapshot='volume-81a43e53-60bb-4296-ad9a-0055b8bdf22f.clone_snap' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jun 25 20:58:13.331326 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c24d9b70-5f6e-493e-bc2f-2d3d60b6d463 tempest-LiveMigrationTest-185531048 None] cloning 'volume-c8878629-87cd-43d0-b2bd-d32c807cd322@volume-81a43e53-60bb-4296-ad9a-0055b8bdf22f.clone_snap' to 'volume-81a43e53-60bb-4296-ad9a-0055b8bdf22f' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jun 25 20:58:13.418788 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-4ad8bd5d-811e-434f-bc9a-4e8690dc6d68 req-9442d6e7-7b92-413c-95b3-4699b6a09c16 tempest-LiveAutoBlockMigrationV225Test-1157528900 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.484s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 20:58:13.424583 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-4ad8bd5d-811e-434f-bc9a-4e8690dc6d68 req-9442d6e7-7b92-413c-95b3-4699b6a09c16 tempest-LiveAutoBlockMigrationV225Test-1157528900 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-74f093be-e96a-4a80-ad38-abd3f5585611', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': '74f093be-e96a-4a80-ad38-abd3f5585611', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 20:58:13.490996 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-4ad8bd5d-811e-434f-bc9a-4e8690dc6d68 req-9442d6e7-7b92-413c-95b3-4699b6a09c16 tempest-LiveAutoBlockMigrationV225Test-1157528900 None] Connection info returned from driver {'name': 'volumes/volume-74f093be-e96a-4a80-ad38-abd3f5585611', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '74f093be-e96a-4a80-ad38-abd3f5585611', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '3ee8eaa3-1295-402e-b602-3895ef8b49a0'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 25 20:58:13.680040 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c24d9b70-5f6e-493e-bc2f-2d3d60b6d463 tempest-LiveMigrationTest-185531048 None] Volume volume-74f093be-e96a-4a80-ad38-abd3f5585611 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 20:58:13.685826 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c24d9b70-5f6e-493e-bc2f-2d3d60b6d463 tempest-LiveMigrationTest-185531048 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 20:58:13.686287 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c24d9b70-5f6e-493e-bc2f-2d3d60b6d463 tempest-LiveMigrationTest-185531048 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 20:58:13.723832 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c24d9b70-5f6e-493e-bc2f-2d3d60b6d463 tempest-LiveMigrationTest-185531048 None] clone created successfully {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jun 25 20:58:13.726574 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.volume_utils [None req-c24d9b70-5f6e-493e-bc2f-2d3d60b6d463 tempest-LiveMigrationTest-185531048 None] Marking volume 81a43e53-60bb-4296-ad9a-0055b8bdf22f as bootable. {{(pid=130674) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 25 20:58:13.765365 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-c24d9b70-5f6e-493e-bc2f-2d3d60b6d463 tempest-LiveMigrationTest-185531048 None] Copying metadata from image c5741eca-b932-4865-b29a-bd2a12a73795 to 81a43e53-60bb-4296-ad9a-0055b8bdf22f. {{(pid=130674) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jun 25 20:58:13.768743 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-c24d9b70-5f6e-493e-bc2f-2d3d60b6d463 tempest-LiveMigrationTest-185531048 None] Creating volume glance metadata for volume 81a43e53-60bb-4296-ad9a-0055b8bdf22f backed by image c5741eca-b932-4865-b29a-bd2a12a73795 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=130674) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:674}} Jun 25 20:58:13.842568 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-4ad8bd5d-811e-434f-bc9a-4e8690dc6d68 req-9442d6e7-7b92-413c-95b3-4699b6a09c16 tempest-LiveAutoBlockMigrationV225Test-1157528900 None] attachment_update completed successfully. Jun 25 20:58:13.900412 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c24d9b70-5f6e-493e-bc2f-2d3d60b6d463 tempest-LiveMigrationTest-185531048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4af1cb89-4059-4df1-8e1d-c79b92cfda51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81a43e53-60bb-4296-ad9a-0055b8bdf22f', 'volume_size': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d98522b7634403f83ff66fd72edfd9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'created_at': datetime.datetime(2022, 6, 25, 20, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5741eca-b932-4865-b29a-bd2a12a73795/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 20:58:13.908997 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c24d9b70-5f6e-493e-bc2f-2d3d60b6d463 tempest-LiveMigrationTest-185531048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a1708d9-5610-4703-8ed8-3d10fb861edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 20:58:13.919898 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-c24d9b70-5f6e-493e-bc2f-2d3d60b6d463 tempest-LiveMigrationTest-185531048 None] Volume volume-81a43e53-60bb-4296-ad9a-0055b8bdf22f (81a43e53-60bb-4296-ad9a-0055b8bdf22f): created successfully Jun 25 20:58:13.924720 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c24d9b70-5f6e-493e-bc2f-2d3d60b6d463 tempest-LiveMigrationTest-185531048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a1708d9-5610-4703-8ed8-3d10fb861edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 20:58:13.940970 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c24d9b70-5f6e-493e-bc2f-2d3d60b6d463 tempest-LiveMigrationTest-185531048 None] Flow 'volume_create_manager' (70a3c99b-13c1-4ba7-b9ae-b8fbfe53a722) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 20:58:13.960096 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-c24d9b70-5f6e-493e-bc2f-2d3d60b6d463 tempest-LiveMigrationTest-185531048 None] Created volume successfully. Jun 25 20:58:18.651637 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=50,cinder:UPDATE=19,cinder:INSERT=10,cinder:DELETE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:58:18.669819 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-6b0071f7-5338-41f6-948d-2f514e9c6406 req-d884fdc9-f031-468e-b287-200b0bc6f107 tempest-LiveMigrationTest-185531048 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 20:58:20.065393 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-6b0071f7-5338-41f6-948d-2f514e9c6406 req-d884fdc9-f031-468e-b287-200b0bc6f107 tempest-LiveMigrationTest-185531048 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.395s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 20:58:20.066493 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-6b0071f7-5338-41f6-948d-2f514e9c6406 req-d884fdc9-f031-468e-b287-200b0bc6f107 tempest-LiveMigrationTest-185531048 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-81a43e53-60bb-4296-ad9a-0055b8bdf22f', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': '81a43e53-60bb-4296-ad9a-0055b8bdf22f', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 20:58:20.116958 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-6b0071f7-5338-41f6-948d-2f514e9c6406 req-d884fdc9-f031-468e-b287-200b0bc6f107 tempest-LiveMigrationTest-185531048 None] Connection info returned from driver {'name': 'volumes/volume-81a43e53-60bb-4296-ad9a-0055b8bdf22f', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '81a43e53-60bb-4296-ad9a-0055b8bdf22f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0b8f3ec2-600f-4b26-ac18-15065a0d37c9'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 25 20:58:20.252739 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-6b0071f7-5338-41f6-948d-2f514e9c6406 req-d884fdc9-f031-468e-b287-200b0bc6f107 tempest-LiveMigrationTest-185531048 None] attachment_update completed successfully. Jun 25 20:58:26.403408 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-4ad8bd5d-811e-434f-bc9a-4e8690dc6d68 req-ae28d977-fd1b-47d3-9766-e015d6048008 tempest-LiveAutoBlockMigrationV225Test-1157528900 None] Terminate volume connection completed successfully. Jun 25 20:58:26.405128 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-4ad8bd5d-811e-434f-bc9a-4e8690dc6d68 req-ae28d977-fd1b-47d3-9766-e015d6048008 tempest-LiveAutoBlockMigrationV225Test-1157528900 None] Deleting attachment 47efa6ff-7998-48e3-9570-0b0c453d9fa4. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 25 20:58:36.405482 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=11,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:58:43.346009 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=50,cinder:UPDATE=7,cinder:INSERT=6,cinder:DELETE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:58:47.727605 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-8567d062-63c4-4d6c-b0cd-9bc03a05b9df req-60b507fd-a862-49e2-9031-5f9ee581d1fe tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Terminate volume connection completed successfully. Jun 25 20:58:47.728077 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-8567d062-63c4-4d6c-b0cd-9bc03a05b9df req-60b507fd-a862-49e2-9031-5f9ee581d1fe tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Deleting attachment 3ee8eaa3-1295-402e-b602-3895ef8b49a0. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 25 20:58:48.190002 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [req-8567d062-63c4-4d6c-b0cd-9bc03a05b9df req-287c4998-4466-46db-a38d-3e4cc6d5f606 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Lock "b'cinder-74f093be-e96a-4a80-ad38-abd3f5585611-delete_volume'" acquired by "delete_volume" :: waited 0.077s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 20:58:48.299533 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-8567d062-63c4-4d6c-b0cd-9bc03a05b9df req-287c4998-4466-46db-a38d-3e4cc6d5f606 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:58:48.446462 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-8567d062-63c4-4d6c-b0cd-9bc03a05b9df req-287c4998-4466-46db-a38d-3e4cc6d5f606 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 20:58:48.447181 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-8567d062-63c4-4d6c-b0cd-9bc03a05b9df req-287c4998-4466-46db-a38d-3e4cc6d5f606 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] volume has clone snapshot(s) {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1288}} Jun 25 20:58:48.448948 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-8567d062-63c4-4d6c-b0cd-9bc03a05b9df req-287c4998-4466-46db-a38d-3e4cc6d5f606 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Volume volume-74f093be-e96a-4a80-ad38-abd3f5585611 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 20:58:48.717680 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [req-8567d062-63c4-4d6c-b0cd-9bc03a05b9df req-287c4998-4466-46db-a38d-3e4cc6d5f606 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Created reservations ['09d02c72-5889-4c20-b3c6-47a16c3263dd', '58d447a2-d8af-425b-9fed-c025d1a6b867', 'bb53adac-1619-4199-ab92-60bf97470856', '280ed682-3d96-40cf-9032-a82cb7c7ec36'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 20:58:48.812361 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-8567d062-63c4-4d6c-b0cd-9bc03a05b9df req-287c4998-4466-46db-a38d-3e4cc6d5f606 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:58:48.956196 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-8567d062-63c4-4d6c-b0cd-9bc03a05b9df req-287c4998-4466-46db-a38d-3e4cc6d5f606 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:58:49.059946 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [req-8567d062-63c4-4d6c-b0cd-9bc03a05b9df req-287c4998-4466-46db-a38d-3e4cc6d5f606 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 20:58:49.075777 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-8567d062-63c4-4d6c-b0cd-9bc03a05b9df req-287c4998-4466-46db-a38d-3e4cc6d5f606 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Deleted volume successfully. Jun 25 20:58:49.108416 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [req-8567d062-63c4-4d6c-b0cd-9bc03a05b9df req-287c4998-4466-46db-a38d-3e4cc6d5f606 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Lock "b'cinder-74f093be-e96a-4a80-ad38-abd3f5585611-delete_volume'" released by "delete_volume" :: held 0.921s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 20:58:52.120921 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 20:58:52.121729 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:58:52.208144 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:58:52.286579 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 20:58:52.325629 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-fd86a5be-81a6-4f13-8238-a104745afbd2 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Lock "b'cinder-ea776117-2993-45a1-9ace-9a0e96e6fb96-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 20:58:52.396338 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-fd86a5be-81a6-4f13-8238-a104745afbd2 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:58:52.475767 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-fd86a5be-81a6-4f13-8238-a104745afbd2 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 20:58:52.476984 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-fd86a5be-81a6-4f13-8238-a104745afbd2 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Volume volume-ea776117-2993-45a1-9ace-9a0e96e6fb96 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 20:58:52.486373 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-fd86a5be-81a6-4f13-8238-a104745afbd2 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] deleting rbd volume volume-ea776117-2993-45a1-9ace-9a0e96e6fb96 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 20:58:52.847703 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-fd86a5be-81a6-4f13-8238-a104745afbd2 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Created reservations ['8f769b2d-f1aa-401a-8553-99116ca42e0a', '7f43be8d-4183-43c9-a1fa-62a23909c735', '2a0a51ca-b446-4b7c-a17a-f30e698906b2', '6bbf51fc-5880-4b67-8867-4e86f644dee5'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 20:58:52.932107 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-fd86a5be-81a6-4f13-8238-a104745afbd2 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:58:52.983810 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-fd86a5be-81a6-4f13-8238-a104745afbd2 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:58:53.058463 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-fd86a5be-81a6-4f13-8238-a104745afbd2 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 20:58:53.066988 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-fd86a5be-81a6-4f13-8238-a104745afbd2 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Deleted volume successfully. Jun 25 20:58:53.109007 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-fd86a5be-81a6-4f13-8238-a104745afbd2 tempest-LiveAutoBlockMigrationV225Test-1642564932 None] Lock "b'cinder-ea776117-2993-45a1-9ace-9a0e96e6fb96-delete_volume'" released by "delete_volume" :: held 0.783s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 20:58:53.950018 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-5efc11bc-d8dd-4987-8e81-a614a2bb47e6 req-b2d0d830-8121-4bd8-9118-7de0120cca9d tempest-LiveMigrationTest-1661695200 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 20:58:54.895420 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-5efc11bc-d8dd-4987-8e81-a614a2bb47e6 req-b2d0d830-8121-4bd8-9118-7de0120cca9d tempest-LiveMigrationTest-1661695200 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.945s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 20:58:54.896248 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-5efc11bc-d8dd-4987-8e81-a614a2bb47e6 req-b2d0d830-8121-4bd8-9118-7de0120cca9d tempest-LiveMigrationTest-1661695200 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-81a43e53-60bb-4296-ad9a-0055b8bdf22f', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': '81a43e53-60bb-4296-ad9a-0055b8bdf22f', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 20:58:54.921948 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-5efc11bc-d8dd-4987-8e81-a614a2bb47e6 req-b2d0d830-8121-4bd8-9118-7de0120cca9d tempest-LiveMigrationTest-1661695200 None] Connection info returned from driver {'name': 'volumes/volume-81a43e53-60bb-4296-ad9a-0055b8bdf22f', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '81a43e53-60bb-4296-ad9a-0055b8bdf22f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '21f05193-2e96-41cc-aec1-62609a82e7b8'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 25 20:58:54.984205 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-5efc11bc-d8dd-4987-8e81-a614a2bb47e6 req-b2d0d830-8121-4bd8-9118-7de0120cca9d tempest-LiveMigrationTest-1661695200 None] attachment_update completed successfully. Jun 25 20:59:11.453164 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=57,cinder:UPDATE=22,cinder:INSERT=4 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:11.475582 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-5efc11bc-d8dd-4987-8e81-a614a2bb47e6 req-3a73ce4d-67b0-4bbd-a19b-74463b88b00d tempest-LiveMigrationTest-1661695200 None] Terminate volume connection completed successfully. Jun 25 20:59:11.476241 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-5efc11bc-d8dd-4987-8e81-a614a2bb47e6 req-3a73ce4d-67b0-4bbd-a19b-74463b88b00d tempest-LiveMigrationTest-1661695200 None] Deleting attachment 0b8f3ec2-600f-4b26-ac18-15065a0d37c9. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 25 20:59:23.350203 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=33,cinder:UPDATE=16,cinder:INSERT=4,cinder:DELETE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:27.700353 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-e3b94a4f-947f-4f00-a307-78307cd1c91e req-0b7b25c4-ac64-437e-a62b-77377dfe1ade tempest-LiveMigrationTest-185531048 None] Terminate volume connection completed successfully. Jun 25 20:59:27.702270 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-e3b94a4f-947f-4f00-a307-78307cd1c91e req-0b7b25c4-ac64-437e-a62b-77377dfe1ade tempest-LiveMigrationTest-185531048 None] Deleting attachment 21f05193-2e96-41cc-aec1-62609a82e7b8. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 25 20:59:28.134965 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [req-e3b94a4f-947f-4f00-a307-78307cd1c91e req-81ff8c1d-fc6c-474c-8054-f783c095ac1f tempest-LiveMigrationTest-185531048 None] Lock "b'cinder-81a43e53-60bb-4296-ad9a-0055b8bdf22f-delete_volume'" acquired by "delete_volume" :: waited 0.033s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 20:59:28.223248 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-e3b94a4f-947f-4f00-a307-78307cd1c91e req-81ff8c1d-fc6c-474c-8054-f783c095ac1f tempest-LiveMigrationTest-185531048 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:59:28.369139 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-e3b94a4f-947f-4f00-a307-78307cd1c91e req-81ff8c1d-fc6c-474c-8054-f783c095ac1f tempest-LiveMigrationTest-185531048 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 20:59:28.391610 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-e3b94a4f-947f-4f00-a307-78307cd1c91e req-81ff8c1d-fc6c-474c-8054-f783c095ac1f tempest-LiveMigrationTest-185531048 None] deleting rbd volume volume-81a43e53-60bb-4296-ad9a-0055b8bdf22f {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 20:59:28.926327 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-e3b94a4f-947f-4f00-a307-78307cd1c91e req-81ff8c1d-fc6c-474c-8054-f783c095ac1f tempest-LiveMigrationTest-185531048 None] volume is a clone so cleaning references {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jun 25 20:59:28.973530 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-e3b94a4f-947f-4f00-a307-78307cd1c91e req-81ff8c1d-fc6c-474c-8054-f783c095ac1f tempest-LiveMigrationTest-185531048 None] deleting parent snapshot volume-81a43e53-60bb-4296-ad9a-0055b8bdf22f.clone_snap {{(pid=130674) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jun 25 20:59:29.448505 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-6a9333d3-e66e-44dd-9fc3-703f14fc9a75 tempest-LiveMigrationTest-185531048 None] Lock "b'cinder-dfb3f3d7-81ce-4d96-93a2-b60490b5cf87-delete_volume'" acquired by "delete_volume" :: waited 0.039s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 20:59:29.568192 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6a9333d3-e66e-44dd-9fc3-703f14fc9a75 tempest-LiveMigrationTest-185531048 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:59:29.703523 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6a9333d3-e66e-44dd-9fc3-703f14fc9a75 tempest-LiveMigrationTest-185531048 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 20:59:29.703903 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6a9333d3-e66e-44dd-9fc3-703f14fc9a75 tempest-LiveMigrationTest-185531048 None] Volume volume-dfb3f3d7-81ce-4d96-93a2-b60490b5cf87 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 20:59:29.730788 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6a9333d3-e66e-44dd-9fc3-703f14fc9a75 tempest-LiveMigrationTest-185531048 None] deleting rbd volume volume-dfb3f3d7-81ce-4d96-93a2-b60490b5cf87 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 20:59:29.733831 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [req-e3b94a4f-947f-4f00-a307-78307cd1c91e req-81ff8c1d-fc6c-474c-8054-f783c095ac1f tempest-LiveMigrationTest-185531048 None] Created reservations ['0419ea61-b37a-46c4-87eb-0c8e928b6d4f', '3864c03a-cf6f-4b6b-a90a-8719ee41552f', 'ac0724d3-9c6c-405d-bd81-3d9914007afe', '54f5bfac-bcea-4c24-aaed-86592ed5cab9'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 20:59:29.911756 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-e3b94a4f-947f-4f00-a307-78307cd1c91e req-81ff8c1d-fc6c-474c-8054-f783c095ac1f tempest-LiveMigrationTest-185531048 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:59:30.006659 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-e3b94a4f-947f-4f00-a307-78307cd1c91e req-81ff8c1d-fc6c-474c-8054-f783c095ac1f tempest-LiveMigrationTest-185531048 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:59:30.091000 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [req-e3b94a4f-947f-4f00-a307-78307cd1c91e req-81ff8c1d-fc6c-474c-8054-f783c095ac1f tempest-LiveMigrationTest-185531048 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 20:59:30.097787 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-e3b94a4f-947f-4f00-a307-78307cd1c91e req-81ff8c1d-fc6c-474c-8054-f783c095ac1f tempest-LiveMigrationTest-185531048 None] Deleted volume successfully. Jun 25 20:59:30.120681 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [req-e3b94a4f-947f-4f00-a307-78307cd1c91e req-81ff8c1d-fc6c-474c-8054-f783c095ac1f tempest-LiveMigrationTest-185531048 None] Lock "b'cinder-81a43e53-60bb-4296-ad9a-0055b8bdf22f-delete_volume'" released by "delete_volume" :: held 1.986s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 20:59:30.219414 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-6a9333d3-e66e-44dd-9fc3-703f14fc9a75 tempest-LiveMigrationTest-185531048 None] Created reservations ['6dff2c85-d4fa-4c33-8e02-58153f3165a8', '8e7a2f7f-be99-4237-b25f-4517b8780c83', '619564db-b6cd-40d1-bae9-370508739e61', 'fc21df9e-6ce3-4391-9974-ff98269e190d'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 20:59:30.336939 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6a9333d3-e66e-44dd-9fc3-703f14fc9a75 tempest-LiveMigrationTest-185531048 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:59:30.423906 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6a9333d3-e66e-44dd-9fc3-703f14fc9a75 tempest-LiveMigrationTest-185531048 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:59:30.522168 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-6a9333d3-e66e-44dd-9fc3-703f14fc9a75 tempest-LiveMigrationTest-185531048 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 20:59:30.536341 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-6a9333d3-e66e-44dd-9fc3-703f14fc9a75 tempest-LiveMigrationTest-185531048 None] Deleted volume successfully. Jun 25 20:59:30.557810 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-6a9333d3-e66e-44dd-9fc3-703f14fc9a75 tempest-LiveMigrationTest-185531048 None] Lock "b'cinder-dfb3f3d7-81ce-4d96-93a2-b60490b5cf87-delete_volume'" released by "delete_volume" :: held 1.109s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 20:59:43.359451 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=38,cinder:UPDATE=22,cinder:INSERT=3,cinder:DELETE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:52.123395 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 20:59:52.125404 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:59:52.190999 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 20:59:52.278440 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:00:03.356859 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=24,cinder:UPDATE=14,cinder:INSERT=5,cinder:DELETE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:23.367619 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:33.369663 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:43.375990 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:52.124181 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:00:52.125783 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:00:52.251841 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:00:52.334256 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:01:03.380184 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:01:04.932230 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e4aa864-2811-4cc4-be66-7e9ea7c74af2 tempest-DeleteServersTestJSON-1854442856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:01:05.017584 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6e4aa864-2811-4cc4-be66-7e9ea7c74af2 tempest-DeleteServersTestJSON-1854442856 None] Flow 'volume_create_manager' (c464c200-b4da-4633-9b9a-f02916cf875a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:01:05.024239 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6e4aa864-2811-4cc4-be66-7e9ea7c74af2 tempest-DeleteServersTestJSON-1854442856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38af4123-d2c9-4cfa-84ab-82c6fc9839bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:01:05.053553 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6e4aa864-2811-4cc4-be66-7e9ea7c74af2 tempest-DeleteServersTestJSON-1854442856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38af4123-d2c9-4cfa-84ab-82c6fc9839bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:01:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-697218379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=06f3ff0b-ee4d-4e7f-9630-106497046641,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2076d2f07d34d44b9431dc1e9e78e14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:01:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:01:05Z,use_quota=True,user_id='259fbe1886a644c28632dc5c8a3c3568',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:01:05.073877 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6e4aa864-2811-4cc4-be66-7e9ea7c74af2 tempest-DeleteServersTestJSON-1854442856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (113cbd36-0cf2-4e9b-b67e-484fbf0d8c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:01:05.078205 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6e4aa864-2811-4cc4-be66-7e9ea7c74af2 tempest-DeleteServersTestJSON-1854442856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (113cbd36-0cf2-4e9b-b67e-484fbf0d8c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:01:05.091922 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6e4aa864-2811-4cc4-be66-7e9ea7c74af2 tempest-DeleteServersTestJSON-1854442856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d4fcca4-21c5-49f6-8f14-8a582cba6645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:01:05.096035 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6e4aa864-2811-4cc4-be66-7e9ea7c74af2 tempest-DeleteServersTestJSON-1854442856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d4fcca4-21c5-49f6-8f14-8a582cba6645) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06f3ff0b-ee4d-4e7f-9630-106497046641', 'volume_name': 'volume-06f3ff0b-ee4d-4e7f-9630-106497046641', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:01:05.111912 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6e4aa864-2811-4cc4-be66-7e9ea7c74af2 tempest-DeleteServersTestJSON-1854442856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b94398db-0301-451c-ae29-566fc669659d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:01:05.122266 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6e4aa864-2811-4cc4-be66-7e9ea7c74af2 tempest-DeleteServersTestJSON-1854442856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b94398db-0301-451c-ae29-566fc669659d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:01:05.127278 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6e4aa864-2811-4cc4-be66-7e9ea7c74af2 tempest-DeleteServersTestJSON-1854442856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5d7fb1e-4ef6-41ca-abfc-5a064e7e4e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:01:05.128370 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-6e4aa864-2811-4cc4-be66-7e9ea7c74af2 tempest-DeleteServersTestJSON-1854442856 None] Volume 06f3ff0b-ee4d-4e7f-9630-106497046641: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06f3ff0b-ee4d-4e7f-9630-106497046641', 'volume_size': 1} Jun 25 21:01:05.148287 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6e4aa864-2811-4cc4-be66-7e9ea7c74af2 tempest-DeleteServersTestJSON-1854442856 None] creating volume 'volume-06f3ff0b-ee4d-4e7f-9630-106497046641' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:01:05.149300 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6e4aa864-2811-4cc4-be66-7e9ea7c74af2 tempest-DeleteServersTestJSON-1854442856 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:01:05.300824 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6e4aa864-2811-4cc4-be66-7e9ea7c74af2 tempest-DeleteServersTestJSON-1854442856 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:01:05.301202 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6e4aa864-2811-4cc4-be66-7e9ea7c74af2 tempest-DeleteServersTestJSON-1854442856 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:01:05.305885 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6e4aa864-2811-4cc4-be66-7e9ea7c74af2 tempest-DeleteServersTestJSON-1854442856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5d7fb1e-4ef6-41ca-abfc-5a064e7e4e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06f3ff0b-ee4d-4e7f-9630-106497046641', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:01:05.316065 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6e4aa864-2811-4cc4-be66-7e9ea7c74af2 tempest-DeleteServersTestJSON-1854442856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbfa3be0-177f-4b75-8396-7e6144b8e733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:01:05.340513 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-6e4aa864-2811-4cc4-be66-7e9ea7c74af2 tempest-DeleteServersTestJSON-1854442856 None] Volume volume-06f3ff0b-ee4d-4e7f-9630-106497046641 (06f3ff0b-ee4d-4e7f-9630-106497046641): created successfully Jun 25 21:01:05.348024 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6e4aa864-2811-4cc4-be66-7e9ea7c74af2 tempest-DeleteServersTestJSON-1854442856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbfa3be0-177f-4b75-8396-7e6144b8e733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:01:05.369241 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6e4aa864-2811-4cc4-be66-7e9ea7c74af2 tempest-DeleteServersTestJSON-1854442856 None] Flow 'volume_create_manager' (c464c200-b4da-4633-9b9a-f02916cf875a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:01:05.443815 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-6e4aa864-2811-4cc4-be66-7e9ea7c74af2 tempest-DeleteServersTestJSON-1854442856 None] Created volume successfully. Jun 25 21:01:06.866885 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-bd6fab37-7faa-4789-bd20-d02e48d52fc3 req-ed5b8e41-c211-444f-8b96-69aefd8e8697 tempest-DeleteServersTestJSON-1854442856 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 21:01:08.757279 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-bd6fab37-7faa-4789-bd20-d02e48d52fc3 req-ed5b8e41-c211-444f-8b96-69aefd8e8697 tempest-DeleteServersTestJSON-1854442856 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.890s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 21:01:08.759770 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-bd6fab37-7faa-4789-bd20-d02e48d52fc3 req-ed5b8e41-c211-444f-8b96-69aefd8e8697 tempest-DeleteServersTestJSON-1854442856 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-06f3ff0b-ee4d-4e7f-9630-106497046641', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': '06f3ff0b-ee4d-4e7f-9630-106497046641', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 21:01:08.801010 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-bd6fab37-7faa-4789-bd20-d02e48d52fc3 req-ed5b8e41-c211-444f-8b96-69aefd8e8697 tempest-DeleteServersTestJSON-1854442856 None] Connection info returned from driver {'name': 'volumes/volume-06f3ff0b-ee4d-4e7f-9630-106497046641', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '06f3ff0b-ee4d-4e7f-9630-106497046641', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0053a9f5-2b50-40db-91b4-d5fb10cd9d9f'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 25 21:01:08.918399 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-bd6fab37-7faa-4789-bd20-d02e48d52fc3 req-ed5b8e41-c211-444f-8b96-69aefd8e8697 tempest-DeleteServersTestJSON-1854442856 None] attachment_update completed successfully. Jun 25 21:01:18.119932 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=21,cinder:UPDATE=5 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:01:18.151447 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-bd0866e1-6b06-42cb-83af-47d0b1ca6864 req-96b17e72-2caf-4f69-9f20-a11211c4d482 tempest-DeleteServersTestJSON-1854442856 None] Terminate volume connection completed successfully. Jun 25 21:01:18.152567 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-bd0866e1-6b06-42cb-83af-47d0b1ca6864 req-96b17e72-2caf-4f69-9f20-a11211c4d482 tempest-DeleteServersTestJSON-1854442856 None] Deleting attachment 0053a9f5-2b50-40db-91b4-d5fb10cd9d9f. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 25 21:01:27.546052 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-140792c5-42c0-4881-87f9-bc2d4a9f4126 tempest-ServersTestBootFromVolume-1548263687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:01:27.596955 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-140792c5-42c0-4881-87f9-bc2d4a9f4126 tempest-ServersTestBootFromVolume-1548263687 None] Flow 'volume_create_manager' (64e40462-6032-4d1c-aa16-f55dccca5a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:01:27.603962 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-140792c5-42c0-4881-87f9-bc2d4a9f4126 tempest-ServersTestBootFromVolume-1548263687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d852e9ec-f5a0-416b-a0bf-cf9973c332a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:01:27.625364 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-140792c5-42c0-4881-87f9-bc2d4a9f4126 tempest-ServersTestBootFromVolume-1548263687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d852e9ec-f5a0-416b-a0bf-cf9973c332a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1785157194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9c586065-2b39-4ffe-b34f-cbd319f8cac0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f998f8bc87c4e009254746816812231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:01:27Z,use_quota=True,user_id='f9abc0f22f944a95a70b23e50bafdccb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:01:27.631443 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-140792c5-42c0-4881-87f9-bc2d4a9f4126 tempest-ServersTestBootFromVolume-1548263687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (136afec9-66b9-4472-80e6-178fdba88dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:01:27.636351 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-140792c5-42c0-4881-87f9-bc2d4a9f4126 tempest-ServersTestBootFromVolume-1548263687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (136afec9-66b9-4472-80e6-178fdba88dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:01:27.642784 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-140792c5-42c0-4881-87f9-bc2d4a9f4126 tempest-ServersTestBootFromVolume-1548263687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68909e86-4339-402d-9157-367c1e23f057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:01:27.769805 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-140792c5-42c0-4881-87f9-bc2d4a9f4126 tempest-ServersTestBootFromVolume-1548263687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68909e86-4339-402d-9157-367c1e23f057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9c586065-2b39-4ffe-b34f-cbd319f8cac0', 'volume_name': 'volume-9c586065-2b39-4ffe-b34f-cbd319f8cac0', 'volume_size': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d98522b7634403f83ff66fd72edfd9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'created_at': datetime.datetime(2022, 6, 25, 20, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5741eca-b932-4865-b29a-bd2a12a73795/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:01:27.776583 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-140792c5-42c0-4881-87f9-bc2d4a9f4126 tempest-ServersTestBootFromVolume-1548263687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39597b54-d268-44c7-a520-167a74e38068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:01:27.780866 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-140792c5-42c0-4881-87f9-bc2d4a9f4126 tempest-ServersTestBootFromVolume-1548263687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39597b54-d268-44c7-a520-167a74e38068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:01:27.793195 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-140792c5-42c0-4881-87f9-bc2d4a9f4126 tempest-ServersTestBootFromVolume-1548263687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f91ff4c-5128-4b61-9b79-045fe46db546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:01:27.797214 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-140792c5-42c0-4881-87f9-bc2d4a9f4126 tempest-ServersTestBootFromVolume-1548263687 None] Volume 9c586065-2b39-4ffe-b34f-cbd319f8cac0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9c586065-2b39-4ffe-b34f-cbd319f8cac0', 'volume_size': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d98522b7634403f83ff66fd72edfd9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'created_at': datetime.datetime(2022, 6, 25, 20, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5741eca-b932-4865-b29a-bd2a12a73795/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 25 21:01:27.798202 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-140792c5-42c0-4881-87f9-bc2d4a9f4126 tempest-ServersTestBootFromVolume-1548263687 None] Cloning 9c586065-2b39-4ffe-b34f-cbd319f8cac0 from image c5741eca-b932-4865-b29a-bd2a12a73795 at location (None, None). {{(pid=130674) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1062}} Jun 25 21:01:27.822053 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-140792c5-42c0-4881-87f9-bc2d4a9f4126 tempest-ServersTestBootFromVolume-1548263687 None] Lock "b'cinder-c5741eca-b932-4865-b29a-bd2a12a73795'" acquired by "_prepare_image_cache_entry" :: waited 0.022s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:01:27.849156 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-140792c5-42c0-4881-87f9-bc2d4a9f4126 tempest-ServersTestBootFromVolume-1548263687 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'volume_id': 'c8878629-87cd-43d0-b2bd-d32c807cd322', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53), 'last_used': datetime.datetime(2022, 6, 25, 21, 1, 27, 842940)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 25 21:01:27.849957 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-140792c5-42c0-4881-87f9-bc2d4a9f4126 tempest-ServersTestBootFromVolume-1548263687 None] Image-volume cache entry image_update_at = 2022-06-25 20:42:53+00:00, requested image updated_at = 2022-06-25 20:42:53+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 25 21:01:27.850330 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-140792c5-42c0-4881-87f9-bc2d4a9f4126 tempest-ServersTestBootFromVolume-1548263687 None] Found cache entry for image = c5741eca-b932-4865-b29a-bd2a12a73795 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:877}} Jun 25 21:01:27.865562 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-140792c5-42c0-4881-87f9-bc2d4a9f4126 tempest-ServersTestBootFromVolume-1548263687 None] Lock "b'cinder-c5741eca-b932-4865-b29a-bd2a12a73795'" released by "_prepare_image_cache_entry" :: held 0.044s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:01:27.866788 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-140792c5-42c0-4881-87f9-bc2d4a9f4126 tempest-ServersTestBootFromVolume-1548263687 None] Attempting to retrieve cache entry for image = c5741eca-b932-4865-b29a-bd2a12a73795 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:818}} Jun 25 21:01:27.873166 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-140792c5-42c0-4881-87f9-bc2d4a9f4126 tempest-ServersTestBootFromVolume-1548263687 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'volume_id': 'c8878629-87cd-43d0-b2bd-d32c807cd322', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53), 'last_used': datetime.datetime(2022, 6, 25, 21, 1, 27, 870487)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 25 21:01:27.873588 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-140792c5-42c0-4881-87f9-bc2d4a9f4126 tempest-ServersTestBootFromVolume-1548263687 None] Image-volume cache entry image_update_at = 2022-06-25 20:42:53+00:00, requested image updated_at = 2022-06-25 20:42:53+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 25 21:01:27.874084 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-140792c5-42c0-4881-87f9-bc2d4a9f4126 tempest-ServersTestBootFromVolume-1548263687 None] Creating from source image-volume c8878629-87cd-43d0-b2bd-d32c807cd322 {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:832}} Jun 25 21:01:27.889368 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-140792c5-42c0-4881-87f9-bc2d4a9f4126 tempest-ServersTestBootFromVolume-1548263687 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:01:28.017270 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-140792c5-42c0-4881-87f9-bc2d4a9f4126 tempest-ServersTestBootFromVolume-1548263687 None] creating snapshot='volume-9c586065-2b39-4ffe-b34f-cbd319f8cac0.clone_snap' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jun 25 21:01:28.942071 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-140792c5-42c0-4881-87f9-bc2d4a9f4126 tempest-ServersTestBootFromVolume-1548263687 None] cloning 'volume-c8878629-87cd-43d0-b2bd-d32c807cd322@volume-9c586065-2b39-4ffe-b34f-cbd319f8cac0.clone_snap' to 'volume-9c586065-2b39-4ffe-b34f-cbd319f8cac0' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jun 25 21:01:29.147950 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-140792c5-42c0-4881-87f9-bc2d4a9f4126 tempest-ServersTestBootFromVolume-1548263687 None] Volume volume-74f093be-e96a-4a80-ad38-abd3f5585611.deleted is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:01:29.149681 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-140792c5-42c0-4881-87f9-bc2d4a9f4126 tempest-ServersTestBootFromVolume-1548263687 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:01:29.151410 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-140792c5-42c0-4881-87f9-bc2d4a9f4126 tempest-ServersTestBootFromVolume-1548263687 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:01:29.197905 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-140792c5-42c0-4881-87f9-bc2d4a9f4126 tempest-ServersTestBootFromVolume-1548263687 None] clone created successfully {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jun 25 21:01:29.199987 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.volume_utils [None req-140792c5-42c0-4881-87f9-bc2d4a9f4126 tempest-ServersTestBootFromVolume-1548263687 None] Marking volume 9c586065-2b39-4ffe-b34f-cbd319f8cac0 as bootable. {{(pid=130674) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 25 21:01:29.230969 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-140792c5-42c0-4881-87f9-bc2d4a9f4126 tempest-ServersTestBootFromVolume-1548263687 None] Copying metadata from image c5741eca-b932-4865-b29a-bd2a12a73795 to 9c586065-2b39-4ffe-b34f-cbd319f8cac0. {{(pid=130674) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jun 25 21:01:29.231809 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-140792c5-42c0-4881-87f9-bc2d4a9f4126 tempest-ServersTestBootFromVolume-1548263687 None] Creating volume glance metadata for volume 9c586065-2b39-4ffe-b34f-cbd319f8cac0 backed by image c5741eca-b932-4865-b29a-bd2a12a73795 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=130674) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:674}} Jun 25 21:01:29.400723 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-140792c5-42c0-4881-87f9-bc2d4a9f4126 tempest-ServersTestBootFromVolume-1548263687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f91ff4c-5128-4b61-9b79-045fe46db546) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c586065-2b39-4ffe-b34f-cbd319f8cac0', 'volume_size': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d98522b7634403f83ff66fd72edfd9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'created_at': datetime.datetime(2022, 6, 25, 20, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5741eca-b932-4865-b29a-bd2a12a73795/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:01:29.410863 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-140792c5-42c0-4881-87f9-bc2d4a9f4126 tempest-ServersTestBootFromVolume-1548263687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98326f01-4f56-43de-a9da-02cd3e70ac08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:01:29.426352 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-140792c5-42c0-4881-87f9-bc2d4a9f4126 tempest-ServersTestBootFromVolume-1548263687 None] Volume volume-9c586065-2b39-4ffe-b34f-cbd319f8cac0 (9c586065-2b39-4ffe-b34f-cbd319f8cac0): created successfully Jun 25 21:01:29.442829 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-140792c5-42c0-4881-87f9-bc2d4a9f4126 tempest-ServersTestBootFromVolume-1548263687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98326f01-4f56-43de-a9da-02cd3e70ac08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:01:29.453058 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-140792c5-42c0-4881-87f9-bc2d4a9f4126 tempest-ServersTestBootFromVolume-1548263687 None] Flow 'volume_create_manager' (64e40462-6032-4d1c-aa16-f55dccca5a2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:01:29.475373 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-140792c5-42c0-4881-87f9-bc2d4a9f4126 tempest-ServersTestBootFromVolume-1548263687 None] Created volume successfully. Jun 25 21:01:33.334556 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-de69bf56-dc0c-4fab-8571-e992cb6a60aa req-a83a1759-0d7e-4f7f-809f-48d99a124026 tempest-ServersTestBootFromVolume-1548263687 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 21:01:35.075188 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-de69bf56-dc0c-4fab-8571-e992cb6a60aa req-a83a1759-0d7e-4f7f-809f-48d99a124026 tempest-ServersTestBootFromVolume-1548263687 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.740s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 21:01:35.076098 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-de69bf56-dc0c-4fab-8571-e992cb6a60aa req-a83a1759-0d7e-4f7f-809f-48d99a124026 tempest-ServersTestBootFromVolume-1548263687 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9c586065-2b39-4ffe-b34f-cbd319f8cac0', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': '9c586065-2b39-4ffe-b34f-cbd319f8cac0', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 21:01:35.079613 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=41,cinder:UPDATE=8,cinder:DELETE=1,cinder:INSERT=12 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:01:35.118081 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-de69bf56-dc0c-4fab-8571-e992cb6a60aa req-a83a1759-0d7e-4f7f-809f-48d99a124026 tempest-ServersTestBootFromVolume-1548263687 None] Connection info returned from driver {'name': 'volumes/volume-9c586065-2b39-4ffe-b34f-cbd319f8cac0', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '9c586065-2b39-4ffe-b34f-cbd319f8cac0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '1e824004-1ddd-498c-bb0a-0b21a63c1f73'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 25 21:01:35.262193 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-de69bf56-dc0c-4fab-8571-e992cb6a60aa req-a83a1759-0d7e-4f7f-809f-48d99a124026 tempest-ServersTestBootFromVolume-1548263687 None] attachment_update completed successfully. Jun 25 21:01:45.248939 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:01:52.121572 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:01:52.122730 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:01:52.199037 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:01:52.269192 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:01:53.379815 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=31,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:02:13.393195 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:02:30.050121 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:02:30.075721 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-a059f4a3-2a76-495f-9c89-6d3b88314d95 tempest-ServerRescueNegativeTestJSON-722435674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:02:30.123219 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a059f4a3-2a76-495f-9c89-6d3b88314d95 tempest-ServerRescueNegativeTestJSON-722435674 None] Flow 'volume_create_manager' (3a37d50c-7546-4dd2-8642-a1539dbeedaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:02:30.141385 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a059f4a3-2a76-495f-9c89-6d3b88314d95 tempest-ServerRescueNegativeTestJSON-722435674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c791fed-ceac-4501-9e9a-6189c2c9b386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:02:30.187607 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a059f4a3-2a76-495f-9c89-6d3b88314d95 tempest-ServerRescueNegativeTestJSON-722435674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c791fed-ceac-4501-9e9a-6189c2c9b386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:02:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1996927782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=082cefb0-a9d8-47c3-9aba-5fc73d24ea5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3349ed72f824bcb9d1ce52d238bc870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:02:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:02:30Z,use_quota=True,user_id='a6a15dadfd0448fab9e84a89173ed7d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:02:30.194038 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a059f4a3-2a76-495f-9c89-6d3b88314d95 tempest-ServerRescueNegativeTestJSON-722435674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93efbc63-0527-418f-a129-c6696a0f9308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:02:30.199027 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a059f4a3-2a76-495f-9c89-6d3b88314d95 tempest-ServerRescueNegativeTestJSON-722435674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93efbc63-0527-418f-a129-c6696a0f9308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:02:30.204892 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a059f4a3-2a76-495f-9c89-6d3b88314d95 tempest-ServerRescueNegativeTestJSON-722435674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09a6fd8d-62d7-4e48-b390-c07c832a1bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:02:30.210297 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a059f4a3-2a76-495f-9c89-6d3b88314d95 tempest-ServerRescueNegativeTestJSON-722435674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09a6fd8d-62d7-4e48-b390-c07c832a1bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '082cefb0-a9d8-47c3-9aba-5fc73d24ea5d', 'volume_name': 'volume-082cefb0-a9d8-47c3-9aba-5fc73d24ea5d', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:02:30.216065 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a059f4a3-2a76-495f-9c89-6d3b88314d95 tempest-ServerRescueNegativeTestJSON-722435674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67b3cc84-1f85-4497-9000-352839a07c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:02:30.221160 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a059f4a3-2a76-495f-9c89-6d3b88314d95 tempest-ServerRescueNegativeTestJSON-722435674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67b3cc84-1f85-4497-9000-352839a07c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:02:30.225910 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a059f4a3-2a76-495f-9c89-6d3b88314d95 tempest-ServerRescueNegativeTestJSON-722435674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8a6c0f9-16c0-48ba-8edc-1527589d2ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:02:30.227206 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-a059f4a3-2a76-495f-9c89-6d3b88314d95 tempest-ServerRescueNegativeTestJSON-722435674 None] Volume 082cefb0-a9d8-47c3-9aba-5fc73d24ea5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-082cefb0-a9d8-47c3-9aba-5fc73d24ea5d', 'volume_size': 1} Jun 25 21:02:30.227752 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a059f4a3-2a76-495f-9c89-6d3b88314d95 tempest-ServerRescueNegativeTestJSON-722435674 None] creating volume 'volume-082cefb0-a9d8-47c3-9aba-5fc73d24ea5d' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:02:30.228658 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a059f4a3-2a76-495f-9c89-6d3b88314d95 tempest-ServerRescueNegativeTestJSON-722435674 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:02:30.353391 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a059f4a3-2a76-495f-9c89-6d3b88314d95 tempest-ServerRescueNegativeTestJSON-722435674 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:02:30.354006 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a059f4a3-2a76-495f-9c89-6d3b88314d95 tempest-ServerRescueNegativeTestJSON-722435674 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:02:30.358546 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a059f4a3-2a76-495f-9c89-6d3b88314d95 tempest-ServerRescueNegativeTestJSON-722435674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8a6c0f9-16c0-48ba-8edc-1527589d2ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-082cefb0-a9d8-47c3-9aba-5fc73d24ea5d', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:02:30.379324 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a059f4a3-2a76-495f-9c89-6d3b88314d95 tempest-ServerRescueNegativeTestJSON-722435674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db976917-2b12-414a-baba-13e9e1276201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:02:30.406247 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-a059f4a3-2a76-495f-9c89-6d3b88314d95 tempest-ServerRescueNegativeTestJSON-722435674 None] Volume volume-082cefb0-a9d8-47c3-9aba-5fc73d24ea5d (082cefb0-a9d8-47c3-9aba-5fc73d24ea5d): created successfully Jun 25 21:02:30.410751 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a059f4a3-2a76-495f-9c89-6d3b88314d95 tempest-ServerRescueNegativeTestJSON-722435674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db976917-2b12-414a-baba-13e9e1276201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:02:30.420202 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a059f4a3-2a76-495f-9c89-6d3b88314d95 tempest-ServerRescueNegativeTestJSON-722435674 None] Flow 'volume_create_manager' (3a37d50c-7546-4dd2-8642-a1539dbeedaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:02:30.447150 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-a059f4a3-2a76-495f-9c89-6d3b88314d95 tempest-ServerRescueNegativeTestJSON-722435674 None] Created volume successfully. Jun 25 21:02:40.452390 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:02:52.122417 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:02:52.123666 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:02:52.285530 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:02:52.373070 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:03:03.377766 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=11,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:09.827014 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-08134420-5a74-4f15-a081-b87e9accdd46 tempest-ServerRescueNegativeTestJSON-722435674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:03:09.889812 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-08134420-5a74-4f15-a081-b87e9accdd46 tempest-ServerRescueNegativeTestJSON-722435674 None] Flow 'volume_create_manager' (ea0e4f6c-b6a7-42a8-a550-045b88380198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:03:09.897903 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-08134420-5a74-4f15-a081-b87e9accdd46 tempest-ServerRescueNegativeTestJSON-722435674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0bb3012-ae1b-4ad6-ba60-e6e33d20e3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:03:09.936032 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-08134420-5a74-4f15-a081-b87e9accdd46 tempest-ServerRescueNegativeTestJSON-722435674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0bb3012-ae1b-4ad6-ba60-e6e33d20e3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2016074251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=070f896c-fc3e-40df-8fe0-538d88646485,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3349ed72f824bcb9d1ce52d238bc870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:03:10Z,use_quota=True,user_id='a6a15dadfd0448fab9e84a89173ed7d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:03:09.942795 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-08134420-5a74-4f15-a081-b87e9accdd46 tempest-ServerRescueNegativeTestJSON-722435674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8266a028-1d2b-47fc-9db0-103d4eb0c7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:03:09.947133 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-08134420-5a74-4f15-a081-b87e9accdd46 tempest-ServerRescueNegativeTestJSON-722435674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8266a028-1d2b-47fc-9db0-103d4eb0c7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:03:09.953618 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-08134420-5a74-4f15-a081-b87e9accdd46 tempest-ServerRescueNegativeTestJSON-722435674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ab6e822-b7ff-4a12-a53a-4e2adfd3de04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:03:09.958984 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-08134420-5a74-4f15-a081-b87e9accdd46 tempest-ServerRescueNegativeTestJSON-722435674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ab6e822-b7ff-4a12-a53a-4e2adfd3de04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '070f896c-fc3e-40df-8fe0-538d88646485', 'volume_name': 'volume-070f896c-fc3e-40df-8fe0-538d88646485', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:03:09.965326 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-08134420-5a74-4f15-a081-b87e9accdd46 tempest-ServerRescueNegativeTestJSON-722435674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69b37098-ed0e-4156-933e-318ed9992d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:03:09.970007 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-08134420-5a74-4f15-a081-b87e9accdd46 tempest-ServerRescueNegativeTestJSON-722435674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69b37098-ed0e-4156-933e-318ed9992d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:03:09.975073 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-08134420-5a74-4f15-a081-b87e9accdd46 tempest-ServerRescueNegativeTestJSON-722435674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a145f29-f6a8-41e3-a5bf-4cee6970de27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:03:09.976317 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-08134420-5a74-4f15-a081-b87e9accdd46 tempest-ServerRescueNegativeTestJSON-722435674 None] Volume 070f896c-fc3e-40df-8fe0-538d88646485: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-070f896c-fc3e-40df-8fe0-538d88646485', 'volume_size': 1} Jun 25 21:03:09.976938 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-08134420-5a74-4f15-a081-b87e9accdd46 tempest-ServerRescueNegativeTestJSON-722435674 None] creating volume 'volume-070f896c-fc3e-40df-8fe0-538d88646485' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:03:09.978756 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-08134420-5a74-4f15-a081-b87e9accdd46 tempest-ServerRescueNegativeTestJSON-722435674 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:03:10.092242 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-08134420-5a74-4f15-a081-b87e9accdd46 tempest-ServerRescueNegativeTestJSON-722435674 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:03:10.093056 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-08134420-5a74-4f15-a081-b87e9accdd46 tempest-ServerRescueNegativeTestJSON-722435674 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:03:10.097663 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-08134420-5a74-4f15-a081-b87e9accdd46 tempest-ServerRescueNegativeTestJSON-722435674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a145f29-f6a8-41e3-a5bf-4cee6970de27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-070f896c-fc3e-40df-8fe0-538d88646485', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:03:10.103435 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-08134420-5a74-4f15-a081-b87e9accdd46 tempest-ServerRescueNegativeTestJSON-722435674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d988cc1e-c351-4d66-bb87-ef6fb4e288ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:03:10.121787 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-08134420-5a74-4f15-a081-b87e9accdd46 tempest-ServerRescueNegativeTestJSON-722435674 None] Volume volume-070f896c-fc3e-40df-8fe0-538d88646485 (070f896c-fc3e-40df-8fe0-538d88646485): created successfully Jun 25 21:03:10.127566 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-08134420-5a74-4f15-a081-b87e9accdd46 tempest-ServerRescueNegativeTestJSON-722435674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d988cc1e-c351-4d66-bb87-ef6fb4e288ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:03:10.134214 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-08134420-5a74-4f15-a081-b87e9accdd46 tempest-ServerRescueNegativeTestJSON-722435674 None] Flow 'volume_create_manager' (ea0e4f6c-b6a7-42a8-a550-045b88380198) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:03:10.148899 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-08134420-5a74-4f15-a081-b87e9accdd46 tempest-ServerRescueNegativeTestJSON-722435674 None] Created volume successfully. Jun 25 21:03:13.404549 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=9,cinder:UPDATE=5 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:15.727731 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-865a603c-fa04-473b-be15-8ded2f3a0be2 req-960f3b71-d10f-4b23-9434-559237db9156 tempest-ServersTestBootFromVolume-1548263687 None] Terminate volume connection completed successfully. Jun 25 21:03:15.729072 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-865a603c-fa04-473b-be15-8ded2f3a0be2 req-960f3b71-d10f-4b23-9434-559237db9156 tempest-ServersTestBootFromVolume-1548263687 None] Deleting attachment 1e824004-1ddd-498c-bb0a-0b21a63c1f73. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 25 21:03:16.114607 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [req-865a603c-fa04-473b-be15-8ded2f3a0be2 req-ba5ecad7-7f5d-4061-9418-399ecbd103e1 tempest-ServersTestBootFromVolume-1548263687 None] Lock "b'cinder-9c586065-2b39-4ffe-b34f-cbd319f8cac0-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:03:16.249899 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-865a603c-fa04-473b-be15-8ded2f3a0be2 req-ba5ecad7-7f5d-4061-9418-399ecbd103e1 tempest-ServersTestBootFromVolume-1548263687 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:03:16.422764 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-865a603c-fa04-473b-be15-8ded2f3a0be2 req-ba5ecad7-7f5d-4061-9418-399ecbd103e1 tempest-ServersTestBootFromVolume-1548263687 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:03:16.447798 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-865a603c-fa04-473b-be15-8ded2f3a0be2 req-ba5ecad7-7f5d-4061-9418-399ecbd103e1 tempest-ServersTestBootFromVolume-1548263687 None] deleting rbd volume volume-9c586065-2b39-4ffe-b34f-cbd319f8cac0 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:03:17.073732 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-865a603c-fa04-473b-be15-8ded2f3a0be2 req-ba5ecad7-7f5d-4061-9418-399ecbd103e1 tempest-ServersTestBootFromVolume-1548263687 None] volume is a clone so cleaning references {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jun 25 21:03:17.120949 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-865a603c-fa04-473b-be15-8ded2f3a0be2 req-ba5ecad7-7f5d-4061-9418-399ecbd103e1 tempest-ServersTestBootFromVolume-1548263687 None] deleting parent snapshot volume-9c586065-2b39-4ffe-b34f-cbd319f8cac0.clone_snap {{(pid=130674) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jun 25 21:03:17.569781 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [req-865a603c-fa04-473b-be15-8ded2f3a0be2 req-ba5ecad7-7f5d-4061-9418-399ecbd103e1 tempest-ServersTestBootFromVolume-1548263687 None] Created reservations ['d1dbc8ff-7862-435a-bbe9-73374ed0c127', '57fc839a-9163-48be-8f0c-befe3635b1ee', '57d5062c-da84-461b-ad86-c5e196d1887b', 'c1e0f07e-2491-4f4d-9286-24d8336da0ee'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:03:17.716581 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-865a603c-fa04-473b-be15-8ded2f3a0be2 req-ba5ecad7-7f5d-4061-9418-399ecbd103e1 tempest-ServersTestBootFromVolume-1548263687 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:03:17.805080 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-865a603c-fa04-473b-be15-8ded2f3a0be2 req-ba5ecad7-7f5d-4061-9418-399ecbd103e1 tempest-ServersTestBootFromVolume-1548263687 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:03:17.908663 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [req-865a603c-fa04-473b-be15-8ded2f3a0be2 req-ba5ecad7-7f5d-4061-9418-399ecbd103e1 tempest-ServersTestBootFromVolume-1548263687 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:03:17.917800 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-865a603c-fa04-473b-be15-8ded2f3a0be2 req-ba5ecad7-7f5d-4061-9418-399ecbd103e1 tempest-ServersTestBootFromVolume-1548263687 None] Deleted volume successfully. Jun 25 21:03:17.949795 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [req-865a603c-fa04-473b-be15-8ded2f3a0be2 req-ba5ecad7-7f5d-4061-9418-399ecbd103e1 tempest-ServersTestBootFromVolume-1548263687 None] Lock "b'cinder-9c586065-2b39-4ffe-b34f-cbd319f8cac0-delete_volume'" released by "delete_volume" :: held 1.835s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:03:33.381445 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=14,cinder:UPDATE=10 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:43.375779 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=27,cinder:UPDATE=10,cinder:DELETE=2,cinder:INSERT=4 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:52.127223 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:03:52.129534 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:03:52.232524 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:03:52.303740 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:04:03.379725 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:13.386708 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:33.405368 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:43.394422 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:52.125123 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:04:52.125918 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:04:52.186539 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:04:52.248366 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:04:54.077563 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-639a28a0-8058-4de9-80e8-7b68a2846598 tempest-DeleteServersTestJSON-1854442856 None] Lock "b'cinder-06f3ff0b-ee4d-4e7f-9630-106497046641-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:04:54.118536 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-639a28a0-8058-4de9-80e8-7b68a2846598 tempest-DeleteServersTestJSON-1854442856 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:04:54.190363 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-639a28a0-8058-4de9-80e8-7b68a2846598 tempest-DeleteServersTestJSON-1854442856 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:04:54.191055 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-639a28a0-8058-4de9-80e8-7b68a2846598 tempest-DeleteServersTestJSON-1854442856 None] Volume volume-06f3ff0b-ee4d-4e7f-9630-106497046641 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:04:54.199276 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-639a28a0-8058-4de9-80e8-7b68a2846598 tempest-DeleteServersTestJSON-1854442856 None] deleting rbd volume volume-06f3ff0b-ee4d-4e7f-9630-106497046641 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:04:54.493765 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-639a28a0-8058-4de9-80e8-7b68a2846598 tempest-DeleteServersTestJSON-1854442856 None] Created reservations ['741d63ac-a1d0-4c1e-ad1b-47f2a70a3a93', 'fa8e9df7-3328-4ce7-968a-14fe514e3840', '7be4cfbc-bf0f-488e-92d1-4c2b645d5308', '7d8c9fc7-db87-487f-945e-48ebef0dba39'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:04:54.547981 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-639a28a0-8058-4de9-80e8-7b68a2846598 tempest-DeleteServersTestJSON-1854442856 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:04:54.582305 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-639a28a0-8058-4de9-80e8-7b68a2846598 tempest-DeleteServersTestJSON-1854442856 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:04:54.636881 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-639a28a0-8058-4de9-80e8-7b68a2846598 tempest-DeleteServersTestJSON-1854442856 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:04:54.641888 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-639a28a0-8058-4de9-80e8-7b68a2846598 tempest-DeleteServersTestJSON-1854442856 None] Deleted volume successfully. Jun 25 21:04:54.663238 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-639a28a0-8058-4de9-80e8-7b68a2846598 tempest-DeleteServersTestJSON-1854442856 None] Lock "b'cinder-06f3ff0b-ee4d-4e7f-9630-106497046641-delete_volume'" released by "delete_volume" :: held 0.586s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:05:13.389206 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=18,cinder:UPDATE=10,cinder:INSERT=4,cinder:DELETE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:05:14.167530 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=19,cinder:UPDATE=10 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:05:14.177180 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-83727b5f-eac9-49c2-8054-229dffcd0d3f req-a9b2bd83-0e57-45fa-ac53-42a74bd45293 tempest-ServerRescueNegativeTestJSON-722435674 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 21:05:15.939541 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-83727b5f-eac9-49c2-8054-229dffcd0d3f req-a9b2bd83-0e57-45fa-ac53-42a74bd45293 tempest-ServerRescueNegativeTestJSON-722435674 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.762s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 21:05:15.940706 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-83727b5f-eac9-49c2-8054-229dffcd0d3f req-a9b2bd83-0e57-45fa-ac53-42a74bd45293 tempest-ServerRescueNegativeTestJSON-722435674 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-070f896c-fc3e-40df-8fe0-538d88646485', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': '070f896c-fc3e-40df-8fe0-538d88646485', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 21:05:16.015767 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-83727b5f-eac9-49c2-8054-229dffcd0d3f req-a9b2bd83-0e57-45fa-ac53-42a74bd45293 tempest-ServerRescueNegativeTestJSON-722435674 None] Connection info returned from driver {'name': 'volumes/volume-070f896c-fc3e-40df-8fe0-538d88646485', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '070f896c-fc3e-40df-8fe0-538d88646485', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'beb27dd0-7dd9-4111-85fe-502fd16d638c'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 25 21:05:16.143820 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-83727b5f-eac9-49c2-8054-229dffcd0d3f req-a9b2bd83-0e57-45fa-ac53-42a74bd45293 tempest-ServerRescueNegativeTestJSON-722435674 None] attachment_update completed successfully. Jun 25 21:05:33.393944 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=13,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:05:43.409078 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=13,cinder:UPDATE=4 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:05:52.127146 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:05:52.127894 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:05:52.224837 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:05:52.321679 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:06:03.411361 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:13.417361 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:43.415619 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:43.436544 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=7 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:52.128880 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:06:52.129596 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:06:52.210932 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:06:52.287013 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:06:55.569228 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-b58064c7-11fc-4ade-a705-66ce4d554fcd req-f0a9278c-d704-4c13-91f9-bf3a8fe0bafe tempest-ServerRescueNegativeTestJSON-722435674 None] Terminate volume connection completed successfully. Jun 25 21:06:55.570548 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-b58064c7-11fc-4ade-a705-66ce4d554fcd req-f0a9278c-d704-4c13-91f9-bf3a8fe0bafe tempest-ServerRescueNegativeTestJSON-722435674 None] Deleting attachment beb27dd0-7dd9-4111-85fe-502fd16d638c. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 25 21:07:11.017117 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-d54dad43-5b6a-4465-8b3b-46184a568283 tempest-ServerRescueNegativeTestJSON-722435674 None] Lock "b'cinder-070f896c-fc3e-40df-8fe0-538d88646485-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:07:11.065827 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d54dad43-5b6a-4465-8b3b-46184a568283 tempest-ServerRescueNegativeTestJSON-722435674 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:07:11.147592 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d54dad43-5b6a-4465-8b3b-46184a568283 tempest-ServerRescueNegativeTestJSON-722435674 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:07:11.148210 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d54dad43-5b6a-4465-8b3b-46184a568283 tempest-ServerRescueNegativeTestJSON-722435674 None] Volume volume-070f896c-fc3e-40df-8fe0-538d88646485 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:07:11.160539 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d54dad43-5b6a-4465-8b3b-46184a568283 tempest-ServerRescueNegativeTestJSON-722435674 None] deleting rbd volume volume-070f896c-fc3e-40df-8fe0-538d88646485 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:07:11.671766 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-d54dad43-5b6a-4465-8b3b-46184a568283 tempest-ServerRescueNegativeTestJSON-722435674 None] Created reservations ['7555f3b0-dece-4f3c-b96a-da99b62652a9', 'ca8aba5a-23b5-44cb-b15e-5274752e78da', '4516d42f-9814-4e31-95f5-69b266a34a6d', '3420d8cd-1bf5-4023-a8c3-28abb1fa8d59'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:07:11.772681 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d54dad43-5b6a-4465-8b3b-46184a568283 tempest-ServerRescueNegativeTestJSON-722435674 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:07:11.853318 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d54dad43-5b6a-4465-8b3b-46184a568283 tempest-ServerRescueNegativeTestJSON-722435674 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:07:11.925574 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d54dad43-5b6a-4465-8b3b-46184a568283 tempest-ServerRescueNegativeTestJSON-722435674 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:07:11.934422 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-d54dad43-5b6a-4465-8b3b-46184a568283 tempest-ServerRescueNegativeTestJSON-722435674 None] Deleted volume successfully. Jun 25 21:07:11.963198 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-d54dad43-5b6a-4465-8b3b-46184a568283 tempest-ServerRescueNegativeTestJSON-722435674 None] Lock "b'cinder-070f896c-fc3e-40df-8fe0-538d88646485-delete_volume'" released by "delete_volume" :: held 0.954s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:07:12.218648 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-a7c9ae95-0ffd-40a4-a0b2-7fba14cfe3ea tempest-ServerRescueNegativeTestJSON-722435674 None] Lock "b'cinder-082cefb0-a9d8-47c3-9aba-5fc73d24ea5d-delete_volume'" acquired by "delete_volume" :: waited 0.029s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:07:12.287654 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a7c9ae95-0ffd-40a4-a0b2-7fba14cfe3ea tempest-ServerRescueNegativeTestJSON-722435674 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:07:12.385840 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a7c9ae95-0ffd-40a4-a0b2-7fba14cfe3ea tempest-ServerRescueNegativeTestJSON-722435674 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:07:12.386292 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a7c9ae95-0ffd-40a4-a0b2-7fba14cfe3ea tempest-ServerRescueNegativeTestJSON-722435674 None] Volume volume-082cefb0-a9d8-47c3-9aba-5fc73d24ea5d is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:07:12.401713 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a7c9ae95-0ffd-40a4-a0b2-7fba14cfe3ea tempest-ServerRescueNegativeTestJSON-722435674 None] deleting rbd volume volume-082cefb0-a9d8-47c3-9aba-5fc73d24ea5d {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:07:12.900796 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-a7c9ae95-0ffd-40a4-a0b2-7fba14cfe3ea tempest-ServerRescueNegativeTestJSON-722435674 None] Created reservations ['6ff5a906-e23e-41e3-94c8-03b5cc8ebd10', '2ce29b8c-8e9a-4ee4-b9ec-0b0d77a7b6d1', '7a69dd23-f8df-40fe-acd6-f59a6da10683', 'febdde71-2393-4112-9a1c-64d8764f7a3c'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:07:12.961397 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a7c9ae95-0ffd-40a4-a0b2-7fba14cfe3ea tempest-ServerRescueNegativeTestJSON-722435674 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:07:13.034558 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a7c9ae95-0ffd-40a4-a0b2-7fba14cfe3ea tempest-ServerRescueNegativeTestJSON-722435674 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:07:13.090792 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-a7c9ae95-0ffd-40a4-a0b2-7fba14cfe3ea tempest-ServerRescueNegativeTestJSON-722435674 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:07:13.096362 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-a7c9ae95-0ffd-40a4-a0b2-7fba14cfe3ea tempest-ServerRescueNegativeTestJSON-722435674 None] Deleted volume successfully. Jun 25 21:07:13.120684 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-a7c9ae95-0ffd-40a4-a0b2-7fba14cfe3ea tempest-ServerRescueNegativeTestJSON-722435674 None] Lock "b'cinder-082cefb0-a9d8-47c3-9aba-5fc73d24ea5d-delete_volume'" released by "delete_volume" :: held 0.902s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:07:23.421530 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=37,cinder:INSERT=3,cinder:UPDATE=21,cinder:DELETE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:07:23.422531 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:UPDATE=15,cinder:SELECT=26,cinder:INSERT=5 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:07:43.429888 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:07:44.073922 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-932bc66d-d08f-48ae-8657-5cc6543c808d tempest-TaggedBootDevicesTest-57416562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:07:44.099668 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-932bc66d-d08f-48ae-8657-5cc6543c808d tempest-TaggedBootDevicesTest-57416562 None] Flow 'volume_create_manager' (acb6e2c3-444c-4ec1-b4d1-93f424df8e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:07:44.108857 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-932bc66d-d08f-48ae-8657-5cc6543c808d tempest-TaggedBootDevicesTest-57416562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8406fda8-2648-4b70-a643-077fa430014c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:07:44.139624 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-932bc66d-d08f-48ae-8657-5cc6543c808d tempest-TaggedBootDevicesTest-57416562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8406fda8-2648-4b70-a643-077fa430014c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-2039894937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5ce7b5ae-636f-4c81-8e58-e20f8d77d741,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e97b91d23b24e7aba5860e7d0bd062c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:07:44Z,use_quota=True,user_id='ec129d5641ef457c99014e8f95fcfb5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:07:44.145794 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-932bc66d-d08f-48ae-8657-5cc6543c808d tempest-TaggedBootDevicesTest-57416562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5999586-68d0-41b5-94d5-5a7de4245e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:07:44.151017 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-932bc66d-d08f-48ae-8657-5cc6543c808d tempest-TaggedBootDevicesTest-57416562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5999586-68d0-41b5-94d5-5a7de4245e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:07:44.156349 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-932bc66d-d08f-48ae-8657-5cc6543c808d tempest-TaggedBootDevicesTest-57416562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a2f2e9b-cdca-44c9-8c0a-3fbb7659062e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:07:44.259020 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-932bc66d-d08f-48ae-8657-5cc6543c808d tempest-TaggedBootDevicesTest-57416562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a2f2e9b-cdca-44c9-8c0a-3fbb7659062e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5ce7b5ae-636f-4c81-8e58-e20f8d77d741', 'volume_name': 'volume-5ce7b5ae-636f-4c81-8e58-e20f8d77d741', 'volume_size': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d98522b7634403f83ff66fd72edfd9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'created_at': datetime.datetime(2022, 6, 25, 20, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5741eca-b932-4865-b29a-bd2a12a73795/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:07:44.263964 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-932bc66d-d08f-48ae-8657-5cc6543c808d tempest-TaggedBootDevicesTest-57416562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3820b4d7-dd6b-414c-b083-de783d77b7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:07:44.267928 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-932bc66d-d08f-48ae-8657-5cc6543c808d tempest-TaggedBootDevicesTest-57416562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3820b4d7-dd6b-414c-b083-de783d77b7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:07:44.289771 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-932bc66d-d08f-48ae-8657-5cc6543c808d tempest-TaggedBootDevicesTest-57416562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7c3f953-230d-487c-904b-03c07e1da15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:07:44.292000 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-932bc66d-d08f-48ae-8657-5cc6543c808d tempest-TaggedBootDevicesTest-57416562 None] Volume 5ce7b5ae-636f-4c81-8e58-e20f8d77d741: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5ce7b5ae-636f-4c81-8e58-e20f8d77d741', 'volume_size': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d98522b7634403f83ff66fd72edfd9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'created_at': datetime.datetime(2022, 6, 25, 20, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5741eca-b932-4865-b29a-bd2a12a73795/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 25 21:07:44.293322 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-932bc66d-d08f-48ae-8657-5cc6543c808d tempest-TaggedBootDevicesTest-57416562 None] Cloning 5ce7b5ae-636f-4c81-8e58-e20f8d77d741 from image c5741eca-b932-4865-b29a-bd2a12a73795 at location (None, None). {{(pid=130674) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1062}} Jun 25 21:07:44.304821 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-932bc66d-d08f-48ae-8657-5cc6543c808d tempest-TaggedBootDevicesTest-57416562 None] Lock "b'cinder-c5741eca-b932-4865-b29a-bd2a12a73795'" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:07:44.322125 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-932bc66d-d08f-48ae-8657-5cc6543c808d tempest-TaggedBootDevicesTest-57416562 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'volume_id': 'c8878629-87cd-43d0-b2bd-d32c807cd322', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53), 'last_used': datetime.datetime(2022, 6, 25, 21, 7, 44, 310419)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 25 21:07:44.323224 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-932bc66d-d08f-48ae-8657-5cc6543c808d tempest-TaggedBootDevicesTest-57416562 None] Image-volume cache entry image_update_at = 2022-06-25 20:42:53+00:00, requested image updated_at = 2022-06-25 20:42:53+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 25 21:07:44.323872 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-932bc66d-d08f-48ae-8657-5cc6543c808d tempest-TaggedBootDevicesTest-57416562 None] Found cache entry for image = c5741eca-b932-4865-b29a-bd2a12a73795 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:877}} Jun 25 21:07:44.338065 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-932bc66d-d08f-48ae-8657-5cc6543c808d tempest-TaggedBootDevicesTest-57416562 None] Lock "b'cinder-c5741eca-b932-4865-b29a-bd2a12a73795'" released by "_prepare_image_cache_entry" :: held 0.032s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:07:44.339743 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-932bc66d-d08f-48ae-8657-5cc6543c808d tempest-TaggedBootDevicesTest-57416562 None] Attempting to retrieve cache entry for image = c5741eca-b932-4865-b29a-bd2a12a73795 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:818}} Jun 25 21:07:44.349508 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-932bc66d-d08f-48ae-8657-5cc6543c808d tempest-TaggedBootDevicesTest-57416562 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'volume_id': 'c8878629-87cd-43d0-b2bd-d32c807cd322', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53), 'last_used': datetime.datetime(2022, 6, 25, 21, 7, 44, 346541)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 25 21:07:44.350878 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-932bc66d-d08f-48ae-8657-5cc6543c808d tempest-TaggedBootDevicesTest-57416562 None] Image-volume cache entry image_update_at = 2022-06-25 20:42:53+00:00, requested image updated_at = 2022-06-25 20:42:53+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 25 21:07:44.351828 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-932bc66d-d08f-48ae-8657-5cc6543c808d tempest-TaggedBootDevicesTest-57416562 None] Creating from source image-volume c8878629-87cd-43d0-b2bd-d32c807cd322 {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:832}} Jun 25 21:07:44.381561 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-932bc66d-d08f-48ae-8657-5cc6543c808d tempest-TaggedBootDevicesTest-57416562 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:07:44.495730 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-932bc66d-d08f-48ae-8657-5cc6543c808d tempest-TaggedBootDevicesTest-57416562 None] creating snapshot='volume-5ce7b5ae-636f-4c81-8e58-e20f8d77d741.clone_snap' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jun 25 21:07:45.506021 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-932bc66d-d08f-48ae-8657-5cc6543c808d tempest-TaggedBootDevicesTest-57416562 None] cloning 'volume-c8878629-87cd-43d0-b2bd-d32c807cd322@volume-5ce7b5ae-636f-4c81-8e58-e20f8d77d741.clone_snap' to 'volume-5ce7b5ae-636f-4c81-8e58-e20f8d77d741' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jun 25 21:07:45.767082 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-932bc66d-d08f-48ae-8657-5cc6543c808d tempest-TaggedBootDevicesTest-57416562 None] Volume volume-74f093be-e96a-4a80-ad38-abd3f5585611.deleted is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:07:45.768548 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-932bc66d-d08f-48ae-8657-5cc6543c808d tempest-TaggedBootDevicesTest-57416562 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:07:45.769103 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-932bc66d-d08f-48ae-8657-5cc6543c808d tempest-TaggedBootDevicesTest-57416562 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:07:45.835715 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-932bc66d-d08f-48ae-8657-5cc6543c808d tempest-TaggedBootDevicesTest-57416562 None] clone created successfully {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jun 25 21:07:45.836647 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.volume_utils [None req-932bc66d-d08f-48ae-8657-5cc6543c808d tempest-TaggedBootDevicesTest-57416562 None] Marking volume 5ce7b5ae-636f-4c81-8e58-e20f8d77d741 as bootable. {{(pid=130674) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 25 21:07:45.850317 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-932bc66d-d08f-48ae-8657-5cc6543c808d tempest-TaggedBootDevicesTest-57416562 None] Copying metadata from image c5741eca-b932-4865-b29a-bd2a12a73795 to 5ce7b5ae-636f-4c81-8e58-e20f8d77d741. {{(pid=130674) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jun 25 21:07:45.850801 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-932bc66d-d08f-48ae-8657-5cc6543c808d tempest-TaggedBootDevicesTest-57416562 None] Creating volume glance metadata for volume 5ce7b5ae-636f-4c81-8e58-e20f8d77d741 backed by image c5741eca-b932-4865-b29a-bd2a12a73795 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=130674) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:674}} Jun 25 21:07:46.031320 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-932bc66d-d08f-48ae-8657-5cc6543c808d tempest-TaggedBootDevicesTest-57416562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7c3f953-230d-487c-904b-03c07e1da15c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ce7b5ae-636f-4c81-8e58-e20f8d77d741', 'volume_size': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d98522b7634403f83ff66fd72edfd9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'created_at': datetime.datetime(2022, 6, 25, 20, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5741eca-b932-4865-b29a-bd2a12a73795/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:07:46.042377 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-932bc66d-d08f-48ae-8657-5cc6543c808d tempest-TaggedBootDevicesTest-57416562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f6293a5-a718-4603-b00a-ee5399a313a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:07:46.100781 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-932bc66d-d08f-48ae-8657-5cc6543c808d tempest-TaggedBootDevicesTest-57416562 None] Volume volume-5ce7b5ae-636f-4c81-8e58-e20f8d77d741 (5ce7b5ae-636f-4c81-8e58-e20f8d77d741): created successfully Jun 25 21:07:46.119694 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-932bc66d-d08f-48ae-8657-5cc6543c808d tempest-TaggedBootDevicesTest-57416562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f6293a5-a718-4603-b00a-ee5399a313a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:07:46.135877 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-932bc66d-d08f-48ae-8657-5cc6543c808d tempest-TaggedBootDevicesTest-57416562 None] Flow 'volume_create_manager' (acb6e2c3-444c-4ec1-b4d1-93f424df8e4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:07:46.180797 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-932bc66d-d08f-48ae-8657-5cc6543c808d tempest-TaggedBootDevicesTest-57416562 None] Created volume successfully. Jun 25 21:07:48.100281 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-97b89405-5e01-4008-b654-622946079c21 tempest-TaggedBootDevicesTest-57416562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:07:48.172624 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97b89405-5e01-4008-b654-622946079c21 tempest-TaggedBootDevicesTest-57416562 None] Flow 'volume_create_manager' (905a6bda-3a78-4b6e-9113-94f13fc6e1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:07:48.196045 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97b89405-5e01-4008-b654-622946079c21 tempest-TaggedBootDevicesTest-57416562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe6de974-07c5-433a-97d7-80d5d9342c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:07:48.233062 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97b89405-5e01-4008-b654-622946079c21 tempest-TaggedBootDevicesTest-57416562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe6de974-07c5-433a-97d7-80d5d9342c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1715820705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c7e78dca-d01a-47b0-9d2e-8dfacce8d58b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e97b91d23b24e7aba5860e7d0bd062c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:07:48Z,use_quota=True,user_id='ec129d5641ef457c99014e8f95fcfb5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:07:48.243664 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97b89405-5e01-4008-b654-622946079c21 tempest-TaggedBootDevicesTest-57416562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeb6c9c5-ee16-42b0-9d86-1f607ec7b5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:07:48.248604 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97b89405-5e01-4008-b654-622946079c21 tempest-TaggedBootDevicesTest-57416562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeb6c9c5-ee16-42b0-9d86-1f607ec7b5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:07:48.255995 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97b89405-5e01-4008-b654-622946079c21 tempest-TaggedBootDevicesTest-57416562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cb01a3f-319f-4e2c-8089-727e53f25084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:07:48.262145 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97b89405-5e01-4008-b654-622946079c21 tempest-TaggedBootDevicesTest-57416562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cb01a3f-319f-4e2c-8089-727e53f25084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7e78dca-d01a-47b0-9d2e-8dfacce8d58b', 'volume_name': 'volume-c7e78dca-d01a-47b0-9d2e-8dfacce8d58b', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:07:48.268461 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97b89405-5e01-4008-b654-622946079c21 tempest-TaggedBootDevicesTest-57416562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae35830b-27dc-40db-ab66-a83fd7bf63fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:07:48.273811 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97b89405-5e01-4008-b654-622946079c21 tempest-TaggedBootDevicesTest-57416562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae35830b-27dc-40db-ab66-a83fd7bf63fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:07:48.279683 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97b89405-5e01-4008-b654-622946079c21 tempest-TaggedBootDevicesTest-57416562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14b71464-ee78-45b0-8ee6-025d22370c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:07:48.281580 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-97b89405-5e01-4008-b654-622946079c21 tempest-TaggedBootDevicesTest-57416562 None] Volume c7e78dca-d01a-47b0-9d2e-8dfacce8d58b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7e78dca-d01a-47b0-9d2e-8dfacce8d58b', 'volume_size': 1} Jun 25 21:07:48.282169 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-97b89405-5e01-4008-b654-622946079c21 tempest-TaggedBootDevicesTest-57416562 None] creating volume 'volume-c7e78dca-d01a-47b0-9d2e-8dfacce8d58b' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:07:48.283492 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-97b89405-5e01-4008-b654-622946079c21 tempest-TaggedBootDevicesTest-57416562 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:07:48.415033 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-97b89405-5e01-4008-b654-622946079c21 tempest-TaggedBootDevicesTest-57416562 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:07:48.415508 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-97b89405-5e01-4008-b654-622946079c21 tempest-TaggedBootDevicesTest-57416562 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:07:48.420314 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97b89405-5e01-4008-b654-622946079c21 tempest-TaggedBootDevicesTest-57416562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14b71464-ee78-45b0-8ee6-025d22370c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7e78dca-d01a-47b0-9d2e-8dfacce8d58b', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:07:48.431435 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97b89405-5e01-4008-b654-622946079c21 tempest-TaggedBootDevicesTest-57416562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54b663a3-1c39-4f8b-a980-32b499a9e6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:07:48.455458 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-97b89405-5e01-4008-b654-622946079c21 tempest-TaggedBootDevicesTest-57416562 None] Volume volume-c7e78dca-d01a-47b0-9d2e-8dfacce8d58b (c7e78dca-d01a-47b0-9d2e-8dfacce8d58b): created successfully Jun 25 21:07:48.463320 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97b89405-5e01-4008-b654-622946079c21 tempest-TaggedBootDevicesTest-57416562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54b663a3-1c39-4f8b-a980-32b499a9e6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:07:48.479315 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97b89405-5e01-4008-b654-622946079c21 tempest-TaggedBootDevicesTest-57416562 None] Flow 'volume_create_manager' (905a6bda-3a78-4b6e-9113-94f13fc6e1b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:07:48.504884 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-97b89405-5e01-4008-b654-622946079c21 tempest-TaggedBootDevicesTest-57416562 None] Created volume successfully. Jun 25 21:07:49.648557 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e82744b-9b50-441b-843c-efdb45442301 tempest-TaggedBootDevicesTest-57416562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:07:49.688114 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4e82744b-9b50-441b-843c-efdb45442301 tempest-TaggedBootDevicesTest-57416562 None] Flow 'volume_create_manager' (c192b635-6d55-4674-8ab7-17e89aadddc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:07:49.697051 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4e82744b-9b50-441b-843c-efdb45442301 tempest-TaggedBootDevicesTest-57416562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0007bf7-96ed-400c-bca0-c4477fd4d3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:07:49.722141 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4e82744b-9b50-441b-843c-efdb45442301 tempest-TaggedBootDevicesTest-57416562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0007bf7-96ed-400c-bca0-c4477fd4d3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-70472049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=10e6b373-c491-4f43-9dc5-373fa07f9035,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e97b91d23b24e7aba5860e7d0bd062c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:07:50Z,use_quota=True,user_id='ec129d5641ef457c99014e8f95fcfb5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:07:49.731538 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4e82744b-9b50-441b-843c-efdb45442301 tempest-TaggedBootDevicesTest-57416562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72e5b52b-9607-4ba9-8fe9-3fd79c611302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:07:49.738211 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4e82744b-9b50-441b-843c-efdb45442301 tempest-TaggedBootDevicesTest-57416562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72e5b52b-9607-4ba9-8fe9-3fd79c611302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:07:49.749534 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4e82744b-9b50-441b-843c-efdb45442301 tempest-TaggedBootDevicesTest-57416562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82100823-34c4-48ee-bd63-694c9e4dfd88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:07:49.754737 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4e82744b-9b50-441b-843c-efdb45442301 tempest-TaggedBootDevicesTest-57416562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82100823-34c4-48ee-bd63-694c9e4dfd88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10e6b373-c491-4f43-9dc5-373fa07f9035', 'volume_name': 'volume-10e6b373-c491-4f43-9dc5-373fa07f9035', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:07:49.761431 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4e82744b-9b50-441b-843c-efdb45442301 tempest-TaggedBootDevicesTest-57416562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (866790c4-5db6-4f3f-8319-ddd6df59b1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:07:49.765826 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4e82744b-9b50-441b-843c-efdb45442301 tempest-TaggedBootDevicesTest-57416562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (866790c4-5db6-4f3f-8319-ddd6df59b1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:07:49.771864 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4e82744b-9b50-441b-843c-efdb45442301 tempest-TaggedBootDevicesTest-57416562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1887225b-45d0-4127-8b3c-37769eae4eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:07:49.773893 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-4e82744b-9b50-441b-843c-efdb45442301 tempest-TaggedBootDevicesTest-57416562 None] Volume 10e6b373-c491-4f43-9dc5-373fa07f9035: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10e6b373-c491-4f43-9dc5-373fa07f9035', 'volume_size': 1} Jun 25 21:07:49.774977 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4e82744b-9b50-441b-843c-efdb45442301 tempest-TaggedBootDevicesTest-57416562 None] creating volume 'volume-10e6b373-c491-4f43-9dc5-373fa07f9035' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:07:49.775812 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4e82744b-9b50-441b-843c-efdb45442301 tempest-TaggedBootDevicesTest-57416562 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:07:49.922955 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4e82744b-9b50-441b-843c-efdb45442301 tempest-TaggedBootDevicesTest-57416562 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:07:49.923809 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4e82744b-9b50-441b-843c-efdb45442301 tempest-TaggedBootDevicesTest-57416562 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:07:49.930638 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4e82744b-9b50-441b-843c-efdb45442301 tempest-TaggedBootDevicesTest-57416562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1887225b-45d0-4127-8b3c-37769eae4eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10e6b373-c491-4f43-9dc5-373fa07f9035', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:07:49.939845 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4e82744b-9b50-441b-843c-efdb45442301 tempest-TaggedBootDevicesTest-57416562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a559e562-bfce-4e3f-bd0b-a4d6a272763a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:07:49.965634 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-4e82744b-9b50-441b-843c-efdb45442301 tempest-TaggedBootDevicesTest-57416562 None] Volume volume-10e6b373-c491-4f43-9dc5-373fa07f9035 (10e6b373-c491-4f43-9dc5-373fa07f9035): created successfully Jun 25 21:07:49.971457 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4e82744b-9b50-441b-843c-efdb45442301 tempest-TaggedBootDevicesTest-57416562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a559e562-bfce-4e3f-bd0b-a4d6a272763a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:07:49.978405 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4e82744b-9b50-441b-843c-efdb45442301 tempest-TaggedBootDevicesTest-57416562 None] Flow 'volume_create_manager' (c192b635-6d55-4674-8ab7-17e89aadddc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:07:49.993164 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-4e82744b-9b50-441b-843c-efdb45442301 tempest-TaggedBootDevicesTest-57416562 None] Created volume successfully. Jun 25 21:07:52.131636 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:07:52.132352 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:07:52.209079 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:07:52.279999 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:08:03.435558 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=29,cinder:UPDATE=6,cinder:INSERT=4,cinder:DELETE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:08:13.916468 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=29,cinder:UPDATE=11,cinder:INSERT=8,cinder:DELETE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:08:13.918289 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-25e441e2-d9f8-4524-b1d0-561b5344b3e2 req-1da3a97d-5fd4-4805-8aee-7ad4e33a2ed7 tempest-TaggedBootDevicesTest-57416562 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 21:08:15.707868 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-25e441e2-d9f8-4524-b1d0-561b5344b3e2 req-1da3a97d-5fd4-4805-8aee-7ad4e33a2ed7 tempest-TaggedBootDevicesTest-57416562 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.789s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 21:08:15.708746 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-25e441e2-d9f8-4524-b1d0-561b5344b3e2 req-1da3a97d-5fd4-4805-8aee-7ad4e33a2ed7 tempest-TaggedBootDevicesTest-57416562 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-5ce7b5ae-636f-4c81-8e58-e20f8d77d741', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': '5ce7b5ae-636f-4c81-8e58-e20f8d77d741', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 21:08:15.766616 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-25e441e2-d9f8-4524-b1d0-561b5344b3e2 req-1da3a97d-5fd4-4805-8aee-7ad4e33a2ed7 tempest-TaggedBootDevicesTest-57416562 None] Connection info returned from driver {'name': 'volumes/volume-5ce7b5ae-636f-4c81-8e58-e20f8d77d741', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '5ce7b5ae-636f-4c81-8e58-e20f8d77d741', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '469002cd-7e89-45e0-90e7-60d08faf7155'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 25 21:08:15.885476 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-25e441e2-d9f8-4524-b1d0-561b5344b3e2 req-1da3a97d-5fd4-4805-8aee-7ad4e33a2ed7 tempest-TaggedBootDevicesTest-57416562 None] attachment_update completed successfully. Jun 25 21:08:16.438326 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-25e441e2-d9f8-4524-b1d0-561b5344b3e2 req-fc852c01-47c6-464c-b6e3-468b3a8b2e49 tempest-TaggedBootDevicesTest-57416562 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 21:08:17.652439 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-25e441e2-d9f8-4524-b1d0-561b5344b3e2 req-fc852c01-47c6-464c-b6e3-468b3a8b2e49 tempest-TaggedBootDevicesTest-57416562 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.214s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 21:08:17.654080 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-25e441e2-d9f8-4524-b1d0-561b5344b3e2 req-fc852c01-47c6-464c-b6e3-468b3a8b2e49 tempest-TaggedBootDevicesTest-57416562 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c7e78dca-d01a-47b0-9d2e-8dfacce8d58b', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': 'c7e78dca-d01a-47b0-9d2e-8dfacce8d58b', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 21:08:17.703275 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-25e441e2-d9f8-4524-b1d0-561b5344b3e2 req-fc852c01-47c6-464c-b6e3-468b3a8b2e49 tempest-TaggedBootDevicesTest-57416562 None] Connection info returned from driver {'name': 'volumes/volume-c7e78dca-d01a-47b0-9d2e-8dfacce8d58b', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'c7e78dca-d01a-47b0-9d2e-8dfacce8d58b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '93a81893-9f37-4d1a-8d4a-e1da17ce50dc'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 25 21:08:17.780977 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-25e441e2-d9f8-4524-b1d0-561b5344b3e2 req-fc852c01-47c6-464c-b6e3-468b3a8b2e49 tempest-TaggedBootDevicesTest-57416562 None] attachment_update completed successfully. Jun 25 21:08:18.331684 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-25e441e2-d9f8-4524-b1d0-561b5344b3e2 req-9be27aab-3ef8-4329-88ea-b5caca922410 tempest-TaggedBootDevicesTest-57416562 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 21:08:19.849940 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-25e441e2-d9f8-4524-b1d0-561b5344b3e2 req-9be27aab-3ef8-4329-88ea-b5caca922410 tempest-TaggedBootDevicesTest-57416562 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.518s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 21:08:19.851477 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-25e441e2-d9f8-4524-b1d0-561b5344b3e2 req-9be27aab-3ef8-4329-88ea-b5caca922410 tempest-TaggedBootDevicesTest-57416562 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-10e6b373-c491-4f43-9dc5-373fa07f9035', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': '10e6b373-c491-4f43-9dc5-373fa07f9035', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 21:08:19.895830 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-25e441e2-d9f8-4524-b1d0-561b5344b3e2 req-9be27aab-3ef8-4329-88ea-b5caca922410 tempest-TaggedBootDevicesTest-57416562 None] Connection info returned from driver {'name': 'volumes/volume-10e6b373-c491-4f43-9dc5-373fa07f9035', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '10e6b373-c491-4f43-9dc5-373fa07f9035', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c3418d67-c097-495e-aa4c-ccb8aa10accb'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 25 21:08:20.011161 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-25e441e2-d9f8-4524-b1d0-561b5344b3e2 req-9be27aab-3ef8-4329-88ea-b5caca922410 tempest-TaggedBootDevicesTest-57416562 None] attachment_update completed successfully. Jun 25 21:08:42.115014 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=42,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:08:42.141177 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0a8cfc6-100d-47a6-9b36-068707184cf4 tempest-TaggedBootDevicesTest_v242-1841146700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:08:42.211786 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a0a8cfc6-100d-47a6-9b36-068707184cf4 tempest-TaggedBootDevicesTest_v242-1841146700 None] Flow 'volume_create_manager' (0308bd73-ddad-4634-8a16-c51edbd3adac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:08:42.233023 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a0a8cfc6-100d-47a6-9b36-068707184cf4 tempest-TaggedBootDevicesTest_v242-1841146700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b812d56-51e0-4bdf-b490-02891c12fe73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:08:42.279048 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a0a8cfc6-100d-47a6-9b36-068707184cf4 tempest-TaggedBootDevicesTest_v242-1841146700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b812d56-51e0-4bdf-b490-02891c12fe73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-575855679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=77b4d6d2-e904-4959-879b-fbabba9a3139,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='094538b7d28d413fbea48441d35cad09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:08:42Z,use_quota=True,user_id='48103c7f170a4a97a3aa0402a52428c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:08:42.290011 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a0a8cfc6-100d-47a6-9b36-068707184cf4 tempest-TaggedBootDevicesTest_v242-1841146700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07c7ff03-80f3-4f6b-b837-46fd0fce5be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:08:42.295099 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a0a8cfc6-100d-47a6-9b36-068707184cf4 tempest-TaggedBootDevicesTest_v242-1841146700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07c7ff03-80f3-4f6b-b837-46fd0fce5be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:08:42.303072 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a0a8cfc6-100d-47a6-9b36-068707184cf4 tempest-TaggedBootDevicesTest_v242-1841146700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a2eb8c0-8737-40b0-87ad-2c1eee96b953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:08:42.457649 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a0a8cfc6-100d-47a6-9b36-068707184cf4 tempest-TaggedBootDevicesTest_v242-1841146700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a2eb8c0-8737-40b0-87ad-2c1eee96b953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '77b4d6d2-e904-4959-879b-fbabba9a3139', 'volume_name': 'volume-77b4d6d2-e904-4959-879b-fbabba9a3139', 'volume_size': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d98522b7634403f83ff66fd72edfd9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'created_at': datetime.datetime(2022, 6, 25, 20, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5741eca-b932-4865-b29a-bd2a12a73795/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:08:42.473541 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a0a8cfc6-100d-47a6-9b36-068707184cf4 tempest-TaggedBootDevicesTest_v242-1841146700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d03537e-8e21-41f8-b5c4-813369d1fe8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:08:42.489383 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a0a8cfc6-100d-47a6-9b36-068707184cf4 tempest-TaggedBootDevicesTest_v242-1841146700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d03537e-8e21-41f8-b5c4-813369d1fe8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:08:42.502489 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a0a8cfc6-100d-47a6-9b36-068707184cf4 tempest-TaggedBootDevicesTest_v242-1841146700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65bfc8a2-d9fe-4b60-9685-f26aabeffa67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:08:42.506967 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-a0a8cfc6-100d-47a6-9b36-068707184cf4 tempest-TaggedBootDevicesTest_v242-1841146700 None] Volume 77b4d6d2-e904-4959-879b-fbabba9a3139: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-77b4d6d2-e904-4959-879b-fbabba9a3139', 'volume_size': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d98522b7634403f83ff66fd72edfd9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'created_at': datetime.datetime(2022, 6, 25, 20, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5741eca-b932-4865-b29a-bd2a12a73795/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 25 21:08:42.509640 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0a8cfc6-100d-47a6-9b36-068707184cf4 tempest-TaggedBootDevicesTest_v242-1841146700 None] Cloning 77b4d6d2-e904-4959-879b-fbabba9a3139 from image c5741eca-b932-4865-b29a-bd2a12a73795 at location (None, None). {{(pid=130674) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1062}} Jun 25 21:08:42.534745 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-a0a8cfc6-100d-47a6-9b36-068707184cf4 tempest-TaggedBootDevicesTest_v242-1841146700 None] Lock "b'cinder-c5741eca-b932-4865-b29a-bd2a12a73795'" acquired by "_prepare_image_cache_entry" :: waited 0.024s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:08:42.559142 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-a0a8cfc6-100d-47a6-9b36-068707184cf4 tempest-TaggedBootDevicesTest_v242-1841146700 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'volume_id': 'c8878629-87cd-43d0-b2bd-d32c807cd322', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53), 'last_used': datetime.datetime(2022, 6, 25, 21, 8, 42, 543353)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 25 21:08:42.559615 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-a0a8cfc6-100d-47a6-9b36-068707184cf4 tempest-TaggedBootDevicesTest_v242-1841146700 None] Image-volume cache entry image_update_at = 2022-06-25 20:42:53+00:00, requested image updated_at = 2022-06-25 20:42:53+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 25 21:08:42.560077 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0a8cfc6-100d-47a6-9b36-068707184cf4 tempest-TaggedBootDevicesTest_v242-1841146700 None] Found cache entry for image = c5741eca-b932-4865-b29a-bd2a12a73795 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:877}} Jun 25 21:08:42.568334 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-a0a8cfc6-100d-47a6-9b36-068707184cf4 tempest-TaggedBootDevicesTest_v242-1841146700 None] Lock "b'cinder-c5741eca-b932-4865-b29a-bd2a12a73795'" released by "_prepare_image_cache_entry" :: held 0.031s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:08:42.570759 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0a8cfc6-100d-47a6-9b36-068707184cf4 tempest-TaggedBootDevicesTest_v242-1841146700 None] Attempting to retrieve cache entry for image = c5741eca-b932-4865-b29a-bd2a12a73795 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:818}} Jun 25 21:08:42.586132 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-a0a8cfc6-100d-47a6-9b36-068707184cf4 tempest-TaggedBootDevicesTest_v242-1841146700 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'volume_id': 'c8878629-87cd-43d0-b2bd-d32c807cd322', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53), 'last_used': datetime.datetime(2022, 6, 25, 21, 8, 42, 579431)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 25 21:08:42.586987 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-a0a8cfc6-100d-47a6-9b36-068707184cf4 tempest-TaggedBootDevicesTest_v242-1841146700 None] Image-volume cache entry image_update_at = 2022-06-25 20:42:53+00:00, requested image updated_at = 2022-06-25 20:42:53+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 25 21:08:42.587399 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0a8cfc6-100d-47a6-9b36-068707184cf4 tempest-TaggedBootDevicesTest_v242-1841146700 None] Creating from source image-volume c8878629-87cd-43d0-b2bd-d32c807cd322 {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:832}} Jun 25 21:08:42.624509 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a0a8cfc6-100d-47a6-9b36-068707184cf4 tempest-TaggedBootDevicesTest_v242-1841146700 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:08:42.782511 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a0a8cfc6-100d-47a6-9b36-068707184cf4 tempest-TaggedBootDevicesTest_v242-1841146700 None] creating snapshot='volume-77b4d6d2-e904-4959-879b-fbabba9a3139.clone_snap' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jun 25 21:08:43.414494 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a0a8cfc6-100d-47a6-9b36-068707184cf4 tempest-TaggedBootDevicesTest_v242-1841146700 None] cloning 'volume-c8878629-87cd-43d0-b2bd-d32c807cd322@volume-77b4d6d2-e904-4959-879b-fbabba9a3139.clone_snap' to 'volume-77b4d6d2-e904-4959-879b-fbabba9a3139' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jun 25 21:08:43.635156 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a0a8cfc6-100d-47a6-9b36-068707184cf4 tempest-TaggedBootDevicesTest_v242-1841146700 None] Volume volume-74f093be-e96a-4a80-ad38-abd3f5585611.deleted is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:08:43.636895 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a0a8cfc6-100d-47a6-9b36-068707184cf4 tempest-TaggedBootDevicesTest_v242-1841146700 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:08:43.637613 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a0a8cfc6-100d-47a6-9b36-068707184cf4 tempest-TaggedBootDevicesTest_v242-1841146700 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:08:43.679641 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a0a8cfc6-100d-47a6-9b36-068707184cf4 tempest-TaggedBootDevicesTest_v242-1841146700 None] clone created successfully {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jun 25 21:08:43.680705 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.volume_utils [None req-a0a8cfc6-100d-47a6-9b36-068707184cf4 tempest-TaggedBootDevicesTest_v242-1841146700 None] Marking volume 77b4d6d2-e904-4959-879b-fbabba9a3139 as bootable. {{(pid=130674) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 25 21:08:43.695147 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0a8cfc6-100d-47a6-9b36-068707184cf4 tempest-TaggedBootDevicesTest_v242-1841146700 None] Copying metadata from image c5741eca-b932-4865-b29a-bd2a12a73795 to 77b4d6d2-e904-4959-879b-fbabba9a3139. {{(pid=130674) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jun 25 21:08:43.695910 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0a8cfc6-100d-47a6-9b36-068707184cf4 tempest-TaggedBootDevicesTest_v242-1841146700 None] Creating volume glance metadata for volume 77b4d6d2-e904-4959-879b-fbabba9a3139 backed by image c5741eca-b932-4865-b29a-bd2a12a73795 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=130674) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:674}} Jun 25 21:08:43.867086 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a0a8cfc6-100d-47a6-9b36-068707184cf4 tempest-TaggedBootDevicesTest_v242-1841146700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65bfc8a2-d9fe-4b60-9685-f26aabeffa67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77b4d6d2-e904-4959-879b-fbabba9a3139', 'volume_size': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d98522b7634403f83ff66fd72edfd9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'created_at': datetime.datetime(2022, 6, 25, 20, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5741eca-b932-4865-b29a-bd2a12a73795/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:08:43.871918 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a0a8cfc6-100d-47a6-9b36-068707184cf4 tempest-TaggedBootDevicesTest_v242-1841146700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6dd42bc-c842-49b2-a3bf-bdb6d4487b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:08:43.884045 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-a0a8cfc6-100d-47a6-9b36-068707184cf4 tempest-TaggedBootDevicesTest_v242-1841146700 None] Volume volume-77b4d6d2-e904-4959-879b-fbabba9a3139 (77b4d6d2-e904-4959-879b-fbabba9a3139): created successfully Jun 25 21:08:43.889713 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a0a8cfc6-100d-47a6-9b36-068707184cf4 tempest-TaggedBootDevicesTest_v242-1841146700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6dd42bc-c842-49b2-a3bf-bdb6d4487b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:08:43.895826 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a0a8cfc6-100d-47a6-9b36-068707184cf4 tempest-TaggedBootDevicesTest_v242-1841146700 None] Flow 'volume_create_manager' (0308bd73-ddad-4634-8a16-c51edbd3adac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:08:43.927637 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-a0a8cfc6-100d-47a6-9b36-068707184cf4 tempest-TaggedBootDevicesTest_v242-1841146700 None] Created volume successfully. Jun 25 21:08:44.891159 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=43,cinder:UPDATE=14,cinder:INSERT=7,cinder:DELETE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:08:44.910753 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-00442397-0e40-4598-83cc-acc808502fe0 tempest-TaggedBootDevicesTest_v242-1841146700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:08:44.962301 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-00442397-0e40-4598-83cc-acc808502fe0 tempest-TaggedBootDevicesTest_v242-1841146700 None] Flow 'volume_create_manager' (0271564f-5d09-495f-b85e-6c2e7b094d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:08:44.970470 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-00442397-0e40-4598-83cc-acc808502fe0 tempest-TaggedBootDevicesTest_v242-1841146700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7426ded-e7dd-48af-bfe8-e71a7e5181be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:08:44.995571 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-00442397-0e40-4598-83cc-acc808502fe0 tempest-TaggedBootDevicesTest_v242-1841146700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7426ded-e7dd-48af-bfe8-e71a7e5181be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:08:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-262922416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=fbbe220f-e91a-425b-81dd-bebb3a0f18fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='094538b7d28d413fbea48441d35cad09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:08:45Z,use_quota=True,user_id='48103c7f170a4a97a3aa0402a52428c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:08:45.001859 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-00442397-0e40-4598-83cc-acc808502fe0 tempest-TaggedBootDevicesTest_v242-1841146700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d3b8fd6-6bca-4b1f-9fab-771474afda09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:08:45.007890 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-00442397-0e40-4598-83cc-acc808502fe0 tempest-TaggedBootDevicesTest_v242-1841146700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d3b8fd6-6bca-4b1f-9fab-771474afda09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:08:45.013569 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-00442397-0e40-4598-83cc-acc808502fe0 tempest-TaggedBootDevicesTest_v242-1841146700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bfeb7f1-a666-4304-a71c-8e44663425f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:08:45.019627 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-00442397-0e40-4598-83cc-acc808502fe0 tempest-TaggedBootDevicesTest_v242-1841146700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bfeb7f1-a666-4304-a71c-8e44663425f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbbe220f-e91a-425b-81dd-bebb3a0f18fb', 'volume_name': 'volume-fbbe220f-e91a-425b-81dd-bebb3a0f18fb', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:08:45.025076 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-00442397-0e40-4598-83cc-acc808502fe0 tempest-TaggedBootDevicesTest_v242-1841146700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec184f4d-4dd4-4ba6-b9de-be2a358dbcbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:08:45.029414 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-00442397-0e40-4598-83cc-acc808502fe0 tempest-TaggedBootDevicesTest_v242-1841146700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec184f4d-4dd4-4ba6-b9de-be2a358dbcbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:08:45.034494 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-00442397-0e40-4598-83cc-acc808502fe0 tempest-TaggedBootDevicesTest_v242-1841146700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6021a064-fa35-462a-9ef4-baa9c78e9218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:08:45.035868 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-00442397-0e40-4598-83cc-acc808502fe0 tempest-TaggedBootDevicesTest_v242-1841146700 None] Volume fbbe220f-e91a-425b-81dd-bebb3a0f18fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbbe220f-e91a-425b-81dd-bebb3a0f18fb', 'volume_size': 1} Jun 25 21:08:45.036469 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-00442397-0e40-4598-83cc-acc808502fe0 tempest-TaggedBootDevicesTest_v242-1841146700 None] creating volume 'volume-fbbe220f-e91a-425b-81dd-bebb3a0f18fb' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:08:45.037293 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-00442397-0e40-4598-83cc-acc808502fe0 tempest-TaggedBootDevicesTest_v242-1841146700 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:08:45.176984 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-00442397-0e40-4598-83cc-acc808502fe0 tempest-TaggedBootDevicesTest_v242-1841146700 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:08:45.177609 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-00442397-0e40-4598-83cc-acc808502fe0 tempest-TaggedBootDevicesTest_v242-1841146700 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:08:45.183971 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-00442397-0e40-4598-83cc-acc808502fe0 tempest-TaggedBootDevicesTest_v242-1841146700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6021a064-fa35-462a-9ef4-baa9c78e9218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbbe220f-e91a-425b-81dd-bebb3a0f18fb', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:08:45.194370 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-00442397-0e40-4598-83cc-acc808502fe0 tempest-TaggedBootDevicesTest_v242-1841146700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35cace25-f4df-4c55-9503-f656ef8c705d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:08:45.218994 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-00442397-0e40-4598-83cc-acc808502fe0 tempest-TaggedBootDevicesTest_v242-1841146700 None] Volume volume-fbbe220f-e91a-425b-81dd-bebb3a0f18fb (fbbe220f-e91a-425b-81dd-bebb3a0f18fb): created successfully Jun 25 21:08:45.225551 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-00442397-0e40-4598-83cc-acc808502fe0 tempest-TaggedBootDevicesTest_v242-1841146700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35cace25-f4df-4c55-9503-f656ef8c705d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:08:45.234219 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-00442397-0e40-4598-83cc-acc808502fe0 tempest-TaggedBootDevicesTest_v242-1841146700 None] Flow 'volume_create_manager' (0271564f-5d09-495f-b85e-6c2e7b094d8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:08:45.246151 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-00442397-0e40-4598-83cc-acc808502fe0 tempest-TaggedBootDevicesTest_v242-1841146700 None] Created volume successfully. Jun 25 21:08:46.461591 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-234512c6-8925-46f1-8846-bedead29c35a tempest-TaggedBootDevicesTest_v242-1841146700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:08:46.495005 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-234512c6-8925-46f1-8846-bedead29c35a tempest-TaggedBootDevicesTest_v242-1841146700 None] Flow 'volume_create_manager' (e930f1d6-8ae0-4ce5-b0d9-82b890fa1566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:08:46.506173 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-234512c6-8925-46f1-8846-bedead29c35a tempest-TaggedBootDevicesTest_v242-1841146700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1a8c80c-69df-4d28-8a8b-38c05c7058ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:08:46.537328 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-234512c6-8925-46f1-8846-bedead29c35a tempest-TaggedBootDevicesTest_v242-1841146700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1a8c80c-69df-4d28-8a8b-38c05c7058ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-2007252480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3021df6d-a2e9-4c08-8bf1-d7b623d3d3cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='094538b7d28d413fbea48441d35cad09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:08:46Z,use_quota=True,user_id='48103c7f170a4a97a3aa0402a52428c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:08:46.543314 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-234512c6-8925-46f1-8846-bedead29c35a tempest-TaggedBootDevicesTest_v242-1841146700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e3ee61-d764-43b6-99a4-45957eac7cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:08:46.547421 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-234512c6-8925-46f1-8846-bedead29c35a tempest-TaggedBootDevicesTest_v242-1841146700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e3ee61-d764-43b6-99a4-45957eac7cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:08:46.553931 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-234512c6-8925-46f1-8846-bedead29c35a tempest-TaggedBootDevicesTest_v242-1841146700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deb349a4-d2af-4ab0-8c07-ad8b3908ff0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:08:46.559301 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-234512c6-8925-46f1-8846-bedead29c35a tempest-TaggedBootDevicesTest_v242-1841146700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deb349a4-d2af-4ab0-8c07-ad8b3908ff0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3021df6d-a2e9-4c08-8bf1-d7b623d3d3cf', 'volume_name': 'volume-3021df6d-a2e9-4c08-8bf1-d7b623d3d3cf', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:08:46.564303 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-234512c6-8925-46f1-8846-bedead29c35a tempest-TaggedBootDevicesTest_v242-1841146700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97266fb0-4034-4d90-a9ef-a7fa5f4882b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:08:46.571618 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-234512c6-8925-46f1-8846-bedead29c35a tempest-TaggedBootDevicesTest_v242-1841146700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97266fb0-4034-4d90-a9ef-a7fa5f4882b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:08:46.577797 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-234512c6-8925-46f1-8846-bedead29c35a tempest-TaggedBootDevicesTest_v242-1841146700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (019ea3ff-4fb6-454b-b8d8-f5025a66a446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:08:46.579194 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-234512c6-8925-46f1-8846-bedead29c35a tempest-TaggedBootDevicesTest_v242-1841146700 None] Volume 3021df6d-a2e9-4c08-8bf1-d7b623d3d3cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3021df6d-a2e9-4c08-8bf1-d7b623d3d3cf', 'volume_size': 1} Jun 25 21:08:46.579764 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-234512c6-8925-46f1-8846-bedead29c35a tempest-TaggedBootDevicesTest_v242-1841146700 None] creating volume 'volume-3021df6d-a2e9-4c08-8bf1-d7b623d3d3cf' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:08:46.580641 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-234512c6-8925-46f1-8846-bedead29c35a tempest-TaggedBootDevicesTest_v242-1841146700 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:08:46.720092 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-234512c6-8925-46f1-8846-bedead29c35a tempest-TaggedBootDevicesTest_v242-1841146700 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:08:46.720566 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-234512c6-8925-46f1-8846-bedead29c35a tempest-TaggedBootDevicesTest_v242-1841146700 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:08:46.724529 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-234512c6-8925-46f1-8846-bedead29c35a tempest-TaggedBootDevicesTest_v242-1841146700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (019ea3ff-4fb6-454b-b8d8-f5025a66a446) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3021df6d-a2e9-4c08-8bf1-d7b623d3d3cf', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:08:46.730730 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-234512c6-8925-46f1-8846-bedead29c35a tempest-TaggedBootDevicesTest_v242-1841146700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (575d8f2b-6662-4434-a7be-63b2cdcdd5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:08:46.743331 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-234512c6-8925-46f1-8846-bedead29c35a tempest-TaggedBootDevicesTest_v242-1841146700 None] Volume volume-3021df6d-a2e9-4c08-8bf1-d7b623d3d3cf (3021df6d-a2e9-4c08-8bf1-d7b623d3d3cf): created successfully Jun 25 21:08:46.749195 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-234512c6-8925-46f1-8846-bedead29c35a tempest-TaggedBootDevicesTest_v242-1841146700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (575d8f2b-6662-4434-a7be-63b2cdcdd5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:08:46.757498 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-234512c6-8925-46f1-8846-bedead29c35a tempest-TaggedBootDevicesTest_v242-1841146700 None] Flow 'volume_create_manager' (e930f1d6-8ae0-4ce5-b0d9-82b890fa1566) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:08:46.774307 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-234512c6-8925-46f1-8846-bedead29c35a tempest-TaggedBootDevicesTest_v242-1841146700 None] Created volume successfully. Jun 25 21:08:51.053528 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-a75d016f-e543-4a59-b1fa-d7a169ecbf3a tempest-GroupsV314Test-1080192973 None] Group tempest-GroupsV314Test-Group-1474527224: creating Jun 25 21:08:51.109150 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-a75d016f-e543-4a59-b1fa-d7a169ecbf3a tempest-GroupsV314Test-1080192973 None] Group tempest-GroupsV314Test-Group-1474527224: created successfully Jun 25 21:08:51.131925 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-a75d016f-e543-4a59-b1fa-d7a169ecbf3a tempest-GroupsV314Test-1080192973 None] Create group completed successfully. Jun 25 21:08:52.135265 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:08:52.136099 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:08:52.206368 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:08:52.313285 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:08:52.945071 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb24b371-3573-411b-8632-1bca614d8c9a tempest-GroupsV314Test-1080192973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:08:52.973872 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-fb24b371-3573-411b-8632-1bca614d8c9a tempest-GroupsV314Test-1080192973 None] Flow 'volume_create_manager' (20c9bb8a-d8c1-43b5-be95-4e160f25ca5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:08:52.981331 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-fb24b371-3573-411b-8632-1bca614d8c9a tempest-GroupsV314Test-1080192973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adfdab75-cd46-4de6-acd4-aece9fc8e343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:08:53.010916 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-fb24b371-3573-411b-8632-1bca614d8c9a tempest-GroupsV314Test-1080192973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adfdab75-cd46-4de6-acd4-aece9fc8e343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsV314Test-Volume-2044950978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=49df8a50-9f4e-4c24-b048-e00a6155c05e,host='ncdv-master-1@ceph#ceph',id=eadf9163-02b1-4e60-8478-fecc83ae4974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99f99b1508a34675a3853518f7a1619a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:08:53Z,use_quota=True,user_id='d8fbe71cca9243f9960ecc81cf221439',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89c15745-ad35-442b-a1e1-08c114e67b3f),volume_type_id=89c15745-ad35-442b-a1e1-08c114e67b3f)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:08:53.022350 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-fb24b371-3573-411b-8632-1bca614d8c9a tempest-GroupsV314Test-1080192973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8324a766-2278-4ccd-af2c-081a24ed6f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:08:53.029497 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-fb24b371-3573-411b-8632-1bca614d8c9a tempest-GroupsV314Test-1080192973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8324a766-2278-4ccd-af2c-081a24ed6f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:08:53.035325 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-fb24b371-3573-411b-8632-1bca614d8c9a tempest-GroupsV314Test-1080192973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20973ad1-26af-478f-9870-ec26af19c448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:08:53.040570 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-fb24b371-3573-411b-8632-1bca614d8c9a tempest-GroupsV314Test-1080192973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20973ad1-26af-478f-9870-ec26af19c448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eadf9163-02b1-4e60-8478-fecc83ae4974', 'volume_name': 'volume-eadf9163-02b1-4e60-8478-fecc83ae4974', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:08:53.045686 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-fb24b371-3573-411b-8632-1bca614d8c9a tempest-GroupsV314Test-1080192973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dab41405-1bf4-4b2a-8442-8f03564e0a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:08:53.050301 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-fb24b371-3573-411b-8632-1bca614d8c9a tempest-GroupsV314Test-1080192973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dab41405-1bf4-4b2a-8442-8f03564e0a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:08:53.056261 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-fb24b371-3573-411b-8632-1bca614d8c9a tempest-GroupsV314Test-1080192973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c8b8d56-63c0-4440-9066-6914ec272f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:08:53.058270 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-fb24b371-3573-411b-8632-1bca614d8c9a tempest-GroupsV314Test-1080192973 None] Volume eadf9163-02b1-4e60-8478-fecc83ae4974: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eadf9163-02b1-4e60-8478-fecc83ae4974', 'volume_size': 1} Jun 25 21:08:53.058872 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-fb24b371-3573-411b-8632-1bca614d8c9a tempest-GroupsV314Test-1080192973 None] creating volume 'volume-eadf9163-02b1-4e60-8478-fecc83ae4974' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:08:53.060525 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-fb24b371-3573-411b-8632-1bca614d8c9a tempest-GroupsV314Test-1080192973 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:08:53.230841 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-fb24b371-3573-411b-8632-1bca614d8c9a tempest-GroupsV314Test-1080192973 None] extra_specs: {} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:08:53.231962 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-fb24b371-3573-411b-8632-1bca614d8c9a tempest-GroupsV314Test-1080192973 None] extra_specs: {} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:08:53.236803 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-fb24b371-3573-411b-8632-1bca614d8c9a tempest-GroupsV314Test-1080192973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c8b8d56-63c0-4440-9066-6914ec272f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eadf9163-02b1-4e60-8478-fecc83ae4974', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:08:53.243243 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-fb24b371-3573-411b-8632-1bca614d8c9a tempest-GroupsV314Test-1080192973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (557279fb-47f2-4242-a67f-1496f8001c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:08:53.265826 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-fb24b371-3573-411b-8632-1bca614d8c9a tempest-GroupsV314Test-1080192973 None] Volume volume-eadf9163-02b1-4e60-8478-fecc83ae4974 (eadf9163-02b1-4e60-8478-fecc83ae4974): created successfully Jun 25 21:08:53.278623 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-fb24b371-3573-411b-8632-1bca614d8c9a tempest-GroupsV314Test-1080192973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (557279fb-47f2-4242-a67f-1496f8001c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:08:53.287876 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-fb24b371-3573-411b-8632-1bca614d8c9a tempest-GroupsV314Test-1080192973 None] Flow 'volume_create_manager' (20c9bb8a-d8c1-43b5-be95-4e160f25ca5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:08:53.303961 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-fb24b371-3573-411b-8632-1bca614d8c9a tempest-GroupsV314Test-1080192973 None] Created volume successfully. Jun 25 21:08:55.396511 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cb4b3b42-5822-4d4f-acee-06e03b5ff5ba tempest-GroupsV314Test-1080192973 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:08:55.511503 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cb4b3b42-5822-4d4f-acee-06e03b5ff5ba tempest-GroupsV314Test-1080192973 None] creating snapshot='volume-0d2b87e0-d109-4afe-bc2d-171ece344f13.clone_snap' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jun 25 21:08:56.479647 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cb4b3b42-5822-4d4f-acee-06e03b5ff5ba tempest-GroupsV314Test-1080192973 None] cloning 'volume-eadf9163-02b1-4e60-8478-fecc83ae4974@volume-0d2b87e0-d109-4afe-bc2d-171ece344f13.clone_snap' to 'volume-0d2b87e0-d109-4afe-bc2d-171ece344f13' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jun 25 21:08:56.688348 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cb4b3b42-5822-4d4f-acee-06e03b5ff5ba tempest-GroupsV314Test-1080192973 None] Volume volume-eadf9163-02b1-4e60-8478-fecc83ae4974 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:08:56.700480 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cb4b3b42-5822-4d4f-acee-06e03b5ff5ba tempest-GroupsV314Test-1080192973 None] extra_specs: {} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:08:56.700852 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cb4b3b42-5822-4d4f-acee-06e03b5ff5ba tempest-GroupsV314Test-1080192973 None] extra_specs: {} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:08:56.763092 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cb4b3b42-5822-4d4f-acee-06e03b5ff5ba tempest-GroupsV314Test-1080192973 None] clone created successfully {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jun 25 21:08:56.876143 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-cb4b3b42-5822-4d4f-acee-06e03b5ff5ba tempest-GroupsV314Test-1080192973 None] Create group from source-group-49df8a50-9f4e-4c24-b048-e00a6155c05e completed successfully. Jun 25 21:08:57.486488 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5f023e36-0b40-4943-924d-d779c66accda tempest-GroupsV314Test-1080192973 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:08:57.597693 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5f023e36-0b40-4943-924d-d779c66accda tempest-GroupsV314Test-1080192973 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:08:57.619689 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5f023e36-0b40-4943-924d-d779c66accda tempest-GroupsV314Test-1080192973 None] deleting rbd volume volume-0d2b87e0-d109-4afe-bc2d-171ece344f13 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:08:58.068378 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5f023e36-0b40-4943-924d-d779c66accda tempest-GroupsV314Test-1080192973 None] volume is a clone so cleaning references {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jun 25 21:08:58.101083 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5f023e36-0b40-4943-924d-d779c66accda tempest-GroupsV314Test-1080192973 None] Volume volume-eadf9163-02b1-4e60-8478-fecc83ae4974 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:08:58.102276 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5f023e36-0b40-4943-924d-d779c66accda tempest-GroupsV314Test-1080192973 None] deleting parent snapshot volume-0d2b87e0-d109-4afe-bc2d-171ece344f13.clone_snap {{(pid=130674) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jun 25 21:08:58.578551 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-5f023e36-0b40-4943-924d-d779c66accda tempest-GroupsV314Test-1080192973 None] Created reservations ['2d39464a-7e80-4cce-859e-89c14af90001'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:08:58.605082 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-5f023e36-0b40-4943-924d-d779c66accda tempest-GroupsV314Test-1080192973 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1479136379 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1479136379, it is now deprecated. Please use the default quota class for default quota. Jun 25 21:08:58.605862 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-5f023e36-0b40-4943-924d-d779c66accda tempest-GroupsV314Test-1080192973 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1479136379 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1479136379, it is now deprecated. Please use the default quota class for default quota. Jun 25 21:08:58.640993 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-5f023e36-0b40-4943-924d-d779c66accda tempest-GroupsV314Test-1080192973 None] Created reservations ['652a5c3b-9d0d-49ed-af18-9d77d6cf96d8', '837c849c-4735-42f3-b0dc-d49417535ad5', 'd036afb7-bbde-4106-a8de-ece396edd477', 'f63ba312-3622-45e0-9735-04c85c5be4ff'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:08:58.787624 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5f023e36-0b40-4943-924d-d779c66accda tempest-GroupsV314Test-1080192973 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:08:58.839667 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5f023e36-0b40-4943-924d-d779c66accda tempest-GroupsV314Test-1080192973 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:08:58.934228 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-5f023e36-0b40-4943-924d-d779c66accda tempest-GroupsV314Test-1080192973 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:08:58.939139 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-5f023e36-0b40-4943-924d-d779c66accda tempest-GroupsV314Test-1080192973 None] Delete group completed successfully. Jun 25 21:09:00.108824 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=65,cinder:UPDATE=27,cinder:INSERT=7,cinder:DELETE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:00.130847 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3e93d91b-14df-439f-83be-f56ac3a248f1 tempest-GroupsV314Test-1080192973 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:09:00.202493 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3e93d91b-14df-439f-83be-f56ac3a248f1 tempest-GroupsV314Test-1080192973 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:09:00.203362 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3e93d91b-14df-439f-83be-f56ac3a248f1 tempest-GroupsV314Test-1080192973 None] Volume volume-eadf9163-02b1-4e60-8478-fecc83ae4974 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:09:00.214779 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3e93d91b-14df-439f-83be-f56ac3a248f1 tempest-GroupsV314Test-1080192973 None] deleting rbd volume volume-eadf9163-02b1-4e60-8478-fecc83ae4974 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:09:00.659321 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-3e93d91b-14df-439f-83be-f56ac3a248f1 tempest-GroupsV314Test-1080192973 None] Created reservations ['c629e6c5-57f5-4290-a249-b40859a0f975'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:09:00.703827 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-3e93d91b-14df-439f-83be-f56ac3a248f1 tempest-GroupsV314Test-1080192973 None] Created reservations ['bc952ec0-682c-4316-98a8-cae77ae59a5b', '0b462cee-c7db-4e0b-a47f-a0c696ebb70a', 'db41ae6b-5a27-4c19-a01c-2c27a2bf2fc8', '8caf4ed1-01e7-46a1-9877-6718caffe133'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:09:00.809256 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=73,cinder:UPDATE=21,cinder:DELETE=2,cinder:INSERT=4 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:00.827854 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3e93d91b-14df-439f-83be-f56ac3a248f1 tempest-GroupsV314Test-1080192973 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:09:00.880812 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3e93d91b-14df-439f-83be-f56ac3a248f1 tempest-GroupsV314Test-1080192973 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:09:00.923419 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-3e93d91b-14df-439f-83be-f56ac3a248f1 tempest-GroupsV314Test-1080192973 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:09:00.929853 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-3e93d91b-14df-439f-83be-f56ac3a248f1 tempest-GroupsV314Test-1080192973 None] Delete group completed successfully. Jun 25 21:09:08.942507 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b5ea52f-7134-4c01-8a83-3c6498daff77 tempest-ServersNegativeTestJSON-2131798312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:09:08.968054 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0b5ea52f-7134-4c01-8a83-3c6498daff77 tempest-ServersNegativeTestJSON-2131798312 None] Flow 'volume_create_manager' (8fc62c8b-6b8f-4ce2-ac92-46e123cf5261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:09:08.976183 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0b5ea52f-7134-4c01-8a83-3c6498daff77 tempest-ServersNegativeTestJSON-2131798312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ca3b673-e58a-4591-a7ad-0361fcf4c0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:09:08.993575 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0b5ea52f-7134-4c01-8a83-3c6498daff77 tempest-ServersNegativeTestJSON-2131798312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ca3b673-e58a-4591-a7ad-0361fcf4c0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-455372239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=dfe1704f-f1a7-473a-9ef3-a3a678f32ff3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8983a71e4a2142fc9fa3460969b2f425',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:09:09Z,use_quota=True,user_id='10c0287a5f02499cb26cc144cd7588cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:09:08.999338 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0b5ea52f-7134-4c01-8a83-3c6498daff77 tempest-ServersNegativeTestJSON-2131798312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90d540ab-b76a-4b18-91fd-aefc92ffbd2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:09:09.003676 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0b5ea52f-7134-4c01-8a83-3c6498daff77 tempest-ServersNegativeTestJSON-2131798312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90d540ab-b76a-4b18-91fd-aefc92ffbd2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:09:09.009087 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0b5ea52f-7134-4c01-8a83-3c6498daff77 tempest-ServersNegativeTestJSON-2131798312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb4c3fb9-9cbd-4f1f-bbe9-737fc2bf4dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:09:09.013375 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0b5ea52f-7134-4c01-8a83-3c6498daff77 tempest-ServersNegativeTestJSON-2131798312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb4c3fb9-9cbd-4f1f-bbe9-737fc2bf4dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfe1704f-f1a7-473a-9ef3-a3a678f32ff3', 'volume_name': 'volume-dfe1704f-f1a7-473a-9ef3-a3a678f32ff3', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:09:09.018274 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0b5ea52f-7134-4c01-8a83-3c6498daff77 tempest-ServersNegativeTestJSON-2131798312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9db11db7-4228-4961-9324-83b3e77665eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:09:09.022342 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0b5ea52f-7134-4c01-8a83-3c6498daff77 tempest-ServersNegativeTestJSON-2131798312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9db11db7-4228-4961-9324-83b3e77665eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:09:09.027393 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0b5ea52f-7134-4c01-8a83-3c6498daff77 tempest-ServersNegativeTestJSON-2131798312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d3ea3b0-55be-4f3f-af39-80fa6418a5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:09:09.028659 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-0b5ea52f-7134-4c01-8a83-3c6498daff77 tempest-ServersNegativeTestJSON-2131798312 None] Volume dfe1704f-f1a7-473a-9ef3-a3a678f32ff3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfe1704f-f1a7-473a-9ef3-a3a678f32ff3', 'volume_size': 1} Jun 25 21:09:09.029155 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0b5ea52f-7134-4c01-8a83-3c6498daff77 tempest-ServersNegativeTestJSON-2131798312 None] creating volume 'volume-dfe1704f-f1a7-473a-9ef3-a3a678f32ff3' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:09:09.030030 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0b5ea52f-7134-4c01-8a83-3c6498daff77 tempest-ServersNegativeTestJSON-2131798312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:09:09.113424 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0b5ea52f-7134-4c01-8a83-3c6498daff77 tempest-ServersNegativeTestJSON-2131798312 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:09:09.114138 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0b5ea52f-7134-4c01-8a83-3c6498daff77 tempest-ServersNegativeTestJSON-2131798312 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:09:09.118401 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0b5ea52f-7134-4c01-8a83-3c6498daff77 tempest-ServersNegativeTestJSON-2131798312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d3ea3b0-55be-4f3f-af39-80fa6418a5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfe1704f-f1a7-473a-9ef3-a3a678f32ff3', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:09:09.124113 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0b5ea52f-7134-4c01-8a83-3c6498daff77 tempest-ServersNegativeTestJSON-2131798312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (577746d7-fd2d-4344-b14d-0b795c439704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:09:09.135582 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-0b5ea52f-7134-4c01-8a83-3c6498daff77 tempest-ServersNegativeTestJSON-2131798312 None] Volume volume-dfe1704f-f1a7-473a-9ef3-a3a678f32ff3 (dfe1704f-f1a7-473a-9ef3-a3a678f32ff3): created successfully Jun 25 21:09:09.140560 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0b5ea52f-7134-4c01-8a83-3c6498daff77 tempest-ServersNegativeTestJSON-2131798312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (577746d7-fd2d-4344-b14d-0b795c439704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:09:09.148884 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0b5ea52f-7134-4c01-8a83-3c6498daff77 tempest-ServersNegativeTestJSON-2131798312 None] Flow 'volume_create_manager' (8fc62c8b-6b8f-4ce2-ac92-46e123cf5261) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:09:09.160999 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-0b5ea52f-7134-4c01-8a83-3c6498daff77 tempest-ServersNegativeTestJSON-2131798312 None] Created volume successfully. Jun 25 21:09:14.335671 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-5781eef5-4768-4daa-bea8-277799963e81 tempest-ServersNegativeTestJSON-2131798312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:09:14.398576 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-5781eef5-4768-4daa-bea8-277799963e81 tempest-ServersNegativeTestJSON-2131798312 None] Flow 'volume_create_manager' (b59849dd-022b-43b0-b5ea-9513c5ccfead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:09:14.413024 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-5781eef5-4768-4daa-bea8-277799963e81 tempest-ServersNegativeTestJSON-2131798312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5967a2e1-dff9-4a49-b3ad-05b19128f9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:09:14.452535 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-5781eef5-4768-4daa-bea8-277799963e81 tempest-ServersNegativeTestJSON-2131798312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5967a2e1-dff9-4a49-b3ad-05b19128f9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1544847280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=03b37d92-ce36-48dc-8227-a4cf921c9c6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8983a71e4a2142fc9fa3460969b2f425',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:09:14Z,use_quota=True,user_id='10c0287a5f02499cb26cc144cd7588cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:09:14.458849 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-5781eef5-4768-4daa-bea8-277799963e81 tempest-ServersNegativeTestJSON-2131798312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (620ec6f6-23fb-4f00-8767-8fdfe91419a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:09:14.463743 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-5781eef5-4768-4daa-bea8-277799963e81 tempest-ServersNegativeTestJSON-2131798312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (620ec6f6-23fb-4f00-8767-8fdfe91419a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:09:14.470023 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-5781eef5-4768-4daa-bea8-277799963e81 tempest-ServersNegativeTestJSON-2131798312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5265c38-18f8-4200-92fb-0b7ec5556ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:09:14.475987 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-5781eef5-4768-4daa-bea8-277799963e81 tempest-ServersNegativeTestJSON-2131798312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5265c38-18f8-4200-92fb-0b7ec5556ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03b37d92-ce36-48dc-8227-a4cf921c9c6b', 'volume_name': 'volume-03b37d92-ce36-48dc-8227-a4cf921c9c6b', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:09:14.482173 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-5781eef5-4768-4daa-bea8-277799963e81 tempest-ServersNegativeTestJSON-2131798312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00321418-694a-40b7-8380-6f05abe5c99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:09:14.486300 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-5781eef5-4768-4daa-bea8-277799963e81 tempest-ServersNegativeTestJSON-2131798312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00321418-694a-40b7-8380-6f05abe5c99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:09:14.491482 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-5781eef5-4768-4daa-bea8-277799963e81 tempest-ServersNegativeTestJSON-2131798312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ff1fdb7-6433-4fd9-abae-598ea180ffa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:09:14.492902 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-5781eef5-4768-4daa-bea8-277799963e81 tempest-ServersNegativeTestJSON-2131798312 None] Volume 03b37d92-ce36-48dc-8227-a4cf921c9c6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03b37d92-ce36-48dc-8227-a4cf921c9c6b', 'volume_size': 1} Jun 25 21:09:14.493491 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5781eef5-4768-4daa-bea8-277799963e81 tempest-ServersNegativeTestJSON-2131798312 None] creating volume 'volume-03b37d92-ce36-48dc-8227-a4cf921c9c6b' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:09:14.494631 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5781eef5-4768-4daa-bea8-277799963e81 tempest-ServersNegativeTestJSON-2131798312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:09:14.630758 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5781eef5-4768-4daa-bea8-277799963e81 tempest-ServersNegativeTestJSON-2131798312 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:09:14.631387 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5781eef5-4768-4daa-bea8-277799963e81 tempest-ServersNegativeTestJSON-2131798312 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:09:14.635413 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-5781eef5-4768-4daa-bea8-277799963e81 tempest-ServersNegativeTestJSON-2131798312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ff1fdb7-6433-4fd9-abae-598ea180ffa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03b37d92-ce36-48dc-8227-a4cf921c9c6b', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:09:14.642573 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-5781eef5-4768-4daa-bea8-277799963e81 tempest-ServersNegativeTestJSON-2131798312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36af1989-5e92-49c6-9299-ba5abfbcb7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:09:14.668903 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-5781eef5-4768-4daa-bea8-277799963e81 tempest-ServersNegativeTestJSON-2131798312 None] Volume volume-03b37d92-ce36-48dc-8227-a4cf921c9c6b (03b37d92-ce36-48dc-8227-a4cf921c9c6b): created successfully Jun 25 21:09:14.683927 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-5781eef5-4768-4daa-bea8-277799963e81 tempest-ServersNegativeTestJSON-2131798312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36af1989-5e92-49c6-9299-ba5abfbcb7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:09:14.693846 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-5781eef5-4768-4daa-bea8-277799963e81 tempest-ServersNegativeTestJSON-2131798312 None] Flow 'volume_create_manager' (b59849dd-022b-43b0-b5ea-9513c5ccfead) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:09:14.714870 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-5781eef5-4768-4daa-bea8-277799963e81 tempest-ServersNegativeTestJSON-2131798312 None] Created volume successfully. Jun 25 21:09:16.989980 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-845dea09-3fd6-4543-8b62-029a5160f41d req-d8c27684-7b32-4eb2-8b5c-1fc20118612a tempest-TaggedBootDevicesTest_v242-1841146700 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 21:09:18.488073 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-845dea09-3fd6-4543-8b62-029a5160f41d req-d8c27684-7b32-4eb2-8b5c-1fc20118612a tempest-TaggedBootDevicesTest_v242-1841146700 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.498s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 21:09:18.489337 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-845dea09-3fd6-4543-8b62-029a5160f41d req-d8c27684-7b32-4eb2-8b5c-1fc20118612a tempest-TaggedBootDevicesTest_v242-1841146700 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-77b4d6d2-e904-4959-879b-fbabba9a3139', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': '77b4d6d2-e904-4959-879b-fbabba9a3139', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 21:09:18.546824 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-845dea09-3fd6-4543-8b62-029a5160f41d req-d8c27684-7b32-4eb2-8b5c-1fc20118612a tempest-TaggedBootDevicesTest_v242-1841146700 None] Connection info returned from driver {'name': 'volumes/volume-77b4d6d2-e904-4959-879b-fbabba9a3139', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '77b4d6d2-e904-4959-879b-fbabba9a3139', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '4c8ead11-712c-4da8-a576-04039419404d'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 25 21:09:18.639741 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-845dea09-3fd6-4543-8b62-029a5160f41d req-d8c27684-7b32-4eb2-8b5c-1fc20118612a tempest-TaggedBootDevicesTest_v242-1841146700 None] attachment_update completed successfully. Jun 25 21:09:19.302708 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-845dea09-3fd6-4543-8b62-029a5160f41d req-f0fcc592-6b2e-4e1a-af5c-b7c2f8449214 tempest-TaggedBootDevicesTest_v242-1841146700 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 21:09:21.253486 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-845dea09-3fd6-4543-8b62-029a5160f41d req-f0fcc592-6b2e-4e1a-af5c-b7c2f8449214 tempest-TaggedBootDevicesTest_v242-1841146700 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.950s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 21:09:21.254329 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-845dea09-3fd6-4543-8b62-029a5160f41d req-f0fcc592-6b2e-4e1a-af5c-b7c2f8449214 tempest-TaggedBootDevicesTest_v242-1841146700 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-fbbe220f-e91a-425b-81dd-bebb3a0f18fb', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': 'fbbe220f-e91a-425b-81dd-bebb3a0f18fb', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 21:09:21.307686 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-845dea09-3fd6-4543-8b62-029a5160f41d req-f0fcc592-6b2e-4e1a-af5c-b7c2f8449214 tempest-TaggedBootDevicesTest_v242-1841146700 None] Connection info returned from driver {'name': 'volumes/volume-fbbe220f-e91a-425b-81dd-bebb3a0f18fb', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'fbbe220f-e91a-425b-81dd-bebb3a0f18fb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c85e13e2-c21a-4a02-b00d-a45c5db53608'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 25 21:09:21.439423 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-845dea09-3fd6-4543-8b62-029a5160f41d req-f0fcc592-6b2e-4e1a-af5c-b7c2f8449214 tempest-TaggedBootDevicesTest_v242-1841146700 None] attachment_update completed successfully. Jun 25 21:09:22.109833 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-845dea09-3fd6-4543-8b62-029a5160f41d req-4f494c43-2d4c-40b2-adb1-a2de118949cb tempest-TaggedBootDevicesTest_v242-1841146700 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 21:09:24.104228 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-845dea09-3fd6-4543-8b62-029a5160f41d req-4f494c43-2d4c-40b2-adb1-a2de118949cb tempest-TaggedBootDevicesTest_v242-1841146700 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.994s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 21:09:24.105931 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-845dea09-3fd6-4543-8b62-029a5160f41d req-4f494c43-2d4c-40b2-adb1-a2de118949cb tempest-TaggedBootDevicesTest_v242-1841146700 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-3021df6d-a2e9-4c08-8bf1-d7b623d3d3cf', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': '3021df6d-a2e9-4c08-8bf1-d7b623d3d3cf', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 21:09:24.158119 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-845dea09-3fd6-4543-8b62-029a5160f41d req-4f494c43-2d4c-40b2-adb1-a2de118949cb tempest-TaggedBootDevicesTest_v242-1841146700 None] Connection info returned from driver {'name': 'volumes/volume-3021df6d-a2e9-4c08-8bf1-d7b623d3d3cf', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '3021df6d-a2e9-4c08-8bf1-d7b623d3d3cf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '24cf4600-2980-43b1-ba34-c9173b3b2b4a'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 25 21:09:24.287464 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-845dea09-3fd6-4543-8b62-029a5160f41d req-4f494c43-2d4c-40b2-adb1-a2de118949cb tempest-TaggedBootDevicesTest_v242-1841146700 None] attachment_update completed successfully. Jun 25 21:09:33.435642 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:UPDATE=21,cinder:SELECT=58,cinder:INSERT=4,cinder:DELETE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:33.436571 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=41,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:36.028503 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-01965732-bae1-43c1-a0c6-4489a007f4f5 tempest-VolumeQuotasAdminTestJSON-445772328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:09:36.064592 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-01965732-bae1-43c1-a0c6-4489a007f4f5 tempest-VolumeQuotasAdminTestJSON-445772328 None] Flow 'volume_create_manager' (0bde1af8-7186-47f1-b5bf-564dc0ac457b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:09:36.075133 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-01965732-bae1-43c1-a0c6-4489a007f4f5 tempest-VolumeQuotasAdminTestJSON-445772328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d0e6cfd-c45a-4ef2-9f5e-562439730a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:09:36.110648 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-01965732-bae1-43c1-a0c6-4489a007f4f5 tempest-VolumeQuotasAdminTestJSON-445772328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d0e6cfd-c45a-4ef2-9f5e-562439730a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:09:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2139457351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e8328eee-1075-4b1e-b573-3b466902e270,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c2db543e1f6498ca352cb4c10f97407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:09:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:09:36Z,use_quota=True,user_id='ba111f294d66480cbdbe17c8fc7ad0f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:09:36.132675 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-01965732-bae1-43c1-a0c6-4489a007f4f5 tempest-VolumeQuotasAdminTestJSON-445772328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ebd8070-c6f0-48c8-9635-d8a14cccf212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:09:36.141494 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-01965732-bae1-43c1-a0c6-4489a007f4f5 tempest-VolumeQuotasAdminTestJSON-445772328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ebd8070-c6f0-48c8-9635-d8a14cccf212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:09:36.168175 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-01965732-bae1-43c1-a0c6-4489a007f4f5 tempest-VolumeQuotasAdminTestJSON-445772328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68e5debb-561e-4740-b7a8-5ee099d1a789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:09:36.182084 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-01965732-bae1-43c1-a0c6-4489a007f4f5 tempest-VolumeQuotasAdminTestJSON-445772328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68e5debb-561e-4740-b7a8-5ee099d1a789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8328eee-1075-4b1e-b573-3b466902e270', 'volume_name': 'volume-e8328eee-1075-4b1e-b573-3b466902e270', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:09:36.189459 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-01965732-bae1-43c1-a0c6-4489a007f4f5 tempest-VolumeQuotasAdminTestJSON-445772328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cea164c-43d0-443c-8c99-6d78fc79bf55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:09:36.195181 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-01965732-bae1-43c1-a0c6-4489a007f4f5 tempest-VolumeQuotasAdminTestJSON-445772328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cea164c-43d0-443c-8c99-6d78fc79bf55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:09:36.201540 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-01965732-bae1-43c1-a0c6-4489a007f4f5 tempest-VolumeQuotasAdminTestJSON-445772328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39c1f280-18e3-4b64-9ff2-e41086d9c387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:09:36.203057 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-01965732-bae1-43c1-a0c6-4489a007f4f5 tempest-VolumeQuotasAdminTestJSON-445772328 None] Volume e8328eee-1075-4b1e-b573-3b466902e270: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8328eee-1075-4b1e-b573-3b466902e270', 'volume_size': 1} Jun 25 21:09:36.203742 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-01965732-bae1-43c1-a0c6-4489a007f4f5 tempest-VolumeQuotasAdminTestJSON-445772328 None] creating volume 'volume-e8328eee-1075-4b1e-b573-3b466902e270' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:09:36.204707 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-01965732-bae1-43c1-a0c6-4489a007f4f5 tempest-VolumeQuotasAdminTestJSON-445772328 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:09:36.406495 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-01965732-bae1-43c1-a0c6-4489a007f4f5 tempest-VolumeQuotasAdminTestJSON-445772328 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:09:36.407542 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-01965732-bae1-43c1-a0c6-4489a007f4f5 tempest-VolumeQuotasAdminTestJSON-445772328 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:09:36.414172 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-01965732-bae1-43c1-a0c6-4489a007f4f5 tempest-VolumeQuotasAdminTestJSON-445772328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39c1f280-18e3-4b64-9ff2-e41086d9c387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8328eee-1075-4b1e-b573-3b466902e270', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:09:36.426616 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-01965732-bae1-43c1-a0c6-4489a007f4f5 tempest-VolumeQuotasAdminTestJSON-445772328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84c1cb67-cdc7-4957-a00b-e2a57bab43e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:09:36.452412 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-01965732-bae1-43c1-a0c6-4489a007f4f5 tempest-VolumeQuotasAdminTestJSON-445772328 None] Volume volume-e8328eee-1075-4b1e-b573-3b466902e270 (e8328eee-1075-4b1e-b573-3b466902e270): created successfully Jun 25 21:09:36.468104 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-01965732-bae1-43c1-a0c6-4489a007f4f5 tempest-VolumeQuotasAdminTestJSON-445772328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84c1cb67-cdc7-4957-a00b-e2a57bab43e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:09:36.489280 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-01965732-bae1-43c1-a0c6-4489a007f4f5 tempest-VolumeQuotasAdminTestJSON-445772328 None] Flow 'volume_create_manager' (0bde1af8-7186-47f1-b5bf-564dc0ac457b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:09:36.519227 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-01965732-bae1-43c1-a0c6-4489a007f4f5 tempest-VolumeQuotasAdminTestJSON-445772328 None] Created volume successfully. Jun 25 21:09:37.362699 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-caf35d6b-7ca4-4791-b5c3-056ca1ee8187 tempest-VolumeQuotasAdminTestJSON-445772328 None] Lock "b'cinder-e8328eee-1075-4b1e-b573-3b466902e270-delete_volume'" acquired by "delete_volume" :: waited 0.040s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:09:37.457442 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-caf35d6b-7ca4-4791-b5c3-056ca1ee8187 tempest-VolumeQuotasAdminTestJSON-445772328 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:09:37.587166 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-caf35d6b-7ca4-4791-b5c3-056ca1ee8187 tempest-VolumeQuotasAdminTestJSON-445772328 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:09:37.587685 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-caf35d6b-7ca4-4791-b5c3-056ca1ee8187 tempest-VolumeQuotasAdminTestJSON-445772328 None] Volume volume-e8328eee-1075-4b1e-b573-3b466902e270 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:09:37.605373 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-caf35d6b-7ca4-4791-b5c3-056ca1ee8187 tempest-VolumeQuotasAdminTestJSON-445772328 None] deleting rbd volume volume-e8328eee-1075-4b1e-b573-3b466902e270 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:09:38.287081 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-caf35d6b-7ca4-4791-b5c3-056ca1ee8187 tempest-VolumeQuotasAdminTestJSON-445772328 None] Created reservations ['d09e4434-a395-43c9-a15a-b6d16c3f3c82', 'd73ae348-24bb-4cfd-8e2b-a3f894ed9bc4', 'bef42dc6-3a19-4039-8798-4c1cc5c3034c', '88ccc7a1-88b6-43bf-8ca3-13c3ad36145d'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:09:38.411547 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-caf35d6b-7ca4-4791-b5c3-056ca1ee8187 tempest-VolumeQuotasAdminTestJSON-445772328 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:09:38.500879 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-caf35d6b-7ca4-4791-b5c3-056ca1ee8187 tempest-VolumeQuotasAdminTestJSON-445772328 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:09:38.615334 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-caf35d6b-7ca4-4791-b5c3-056ca1ee8187 tempest-VolumeQuotasAdminTestJSON-445772328 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:09:38.620735 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-caf35d6b-7ca4-4791-b5c3-056ca1ee8187 tempest-VolumeQuotasAdminTestJSON-445772328 None] Deleted volume successfully. Jun 25 21:09:38.645568 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-caf35d6b-7ca4-4791-b5c3-056ca1ee8187 tempest-VolumeQuotasAdminTestJSON-445772328 None] Lock "b'cinder-e8328eee-1075-4b1e-b573-3b466902e270-delete_volume'" released by "delete_volume" :: held 1.283s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:09:39.439784 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-bedc9d00-76d6-4e22-8c15-e49b37b22e38 tempest-VolumeQuotasAdminTestJSON-445772328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:09:39.523867 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-bedc9d00-76d6-4e22-8c15-e49b37b22e38 tempest-VolumeQuotasAdminTestJSON-445772328 None] Flow 'volume_create_manager' (e66b1a00-ea88-4bad-804d-9156dd34c5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:09:39.553315 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-bedc9d00-76d6-4e22-8c15-e49b37b22e38 tempest-VolumeQuotasAdminTestJSON-445772328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f85fc8b6-cb91-46fd-a576-49b58910804b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:09:39.635565 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-bedc9d00-76d6-4e22-8c15-e49b37b22e38 tempest-VolumeQuotasAdminTestJSON-445772328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f85fc8b6-cb91-46fd-a576-49b58910804b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1719396586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1c94cb07-84e4-4e5c-a8a1-34a303581f5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c2db543e1f6498ca352cb4c10f97407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:09:39Z,use_quota=True,user_id='ba111f294d66480cbdbe17c8fc7ad0f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:09:39.661261 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-bedc9d00-76d6-4e22-8c15-e49b37b22e38 tempest-VolumeQuotasAdminTestJSON-445772328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a258048e-64d2-46ce-97b6-8a6842e331b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:09:39.677293 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-bedc9d00-76d6-4e22-8c15-e49b37b22e38 tempest-VolumeQuotasAdminTestJSON-445772328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a258048e-64d2-46ce-97b6-8a6842e331b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:09:39.685354 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-bedc9d00-76d6-4e22-8c15-e49b37b22e38 tempest-VolumeQuotasAdminTestJSON-445772328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77740d12-83d9-4689-af8e-cde23016860c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:09:39.701188 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-bedc9d00-76d6-4e22-8c15-e49b37b22e38 tempest-VolumeQuotasAdminTestJSON-445772328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77740d12-83d9-4689-af8e-cde23016860c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c94cb07-84e4-4e5c-a8a1-34a303581f5b', 'volume_name': 'volume-1c94cb07-84e4-4e5c-a8a1-34a303581f5b', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:09:39.709591 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-bedc9d00-76d6-4e22-8c15-e49b37b22e38 tempest-VolumeQuotasAdminTestJSON-445772328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28284691-4de1-4cde-a20c-d1aa215d7ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:09:39.739453 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-bedc9d00-76d6-4e22-8c15-e49b37b22e38 tempest-VolumeQuotasAdminTestJSON-445772328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28284691-4de1-4cde-a20c-d1aa215d7ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:09:39.767812 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-bedc9d00-76d6-4e22-8c15-e49b37b22e38 tempest-VolumeQuotasAdminTestJSON-445772328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68e90280-1b93-4629-84d6-824cc2b0e9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:09:39.768364 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-bedc9d00-76d6-4e22-8c15-e49b37b22e38 tempest-VolumeQuotasAdminTestJSON-445772328 None] Volume 1c94cb07-84e4-4e5c-a8a1-34a303581f5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c94cb07-84e4-4e5c-a8a1-34a303581f5b', 'volume_size': 1} Jun 25 21:09:39.768797 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-bedc9d00-76d6-4e22-8c15-e49b37b22e38 tempest-VolumeQuotasAdminTestJSON-445772328 None] creating volume 'volume-1c94cb07-84e4-4e5c-a8a1-34a303581f5b' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:09:39.775241 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-bedc9d00-76d6-4e22-8c15-e49b37b22e38 tempest-VolumeQuotasAdminTestJSON-445772328 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:09:39.943688 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-bedc9d00-76d6-4e22-8c15-e49b37b22e38 tempest-VolumeQuotasAdminTestJSON-445772328 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:09:39.944264 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-bedc9d00-76d6-4e22-8c15-e49b37b22e38 tempest-VolumeQuotasAdminTestJSON-445772328 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:09:39.956704 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-bedc9d00-76d6-4e22-8c15-e49b37b22e38 tempest-VolumeQuotasAdminTestJSON-445772328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68e90280-1b93-4629-84d6-824cc2b0e9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c94cb07-84e4-4e5c-a8a1-34a303581f5b', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:09:39.962679 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-bedc9d00-76d6-4e22-8c15-e49b37b22e38 tempest-VolumeQuotasAdminTestJSON-445772328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e1730f0-881a-49fc-9552-5d54c1f22d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:09:39.984047 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-bedc9d00-76d6-4e22-8c15-e49b37b22e38 tempest-VolumeQuotasAdminTestJSON-445772328 None] Volume volume-1c94cb07-84e4-4e5c-a8a1-34a303581f5b (1c94cb07-84e4-4e5c-a8a1-34a303581f5b): created successfully Jun 25 21:09:39.997213 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-bedc9d00-76d6-4e22-8c15-e49b37b22e38 tempest-VolumeQuotasAdminTestJSON-445772328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e1730f0-881a-49fc-9552-5d54c1f22d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:09:40.009996 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-bedc9d00-76d6-4e22-8c15-e49b37b22e38 tempest-VolumeQuotasAdminTestJSON-445772328 None] Flow 'volume_create_manager' (e66b1a00-ea88-4bad-804d-9156dd34c5a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:09:40.037413 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-bedc9d00-76d6-4e22-8c15-e49b37b22e38 tempest-VolumeQuotasAdminTestJSON-445772328 None] Created volume successfully. Jun 25 21:09:41.634799 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-fd89a01a-ffbb-4ae9-bfc1-3f2e9a9a6a54 tempest-VolumeQuotasAdminTestJSON-1406129889 None] Transfer volume completed successfully. Jun 25 21:09:42.476447 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-0558b62f-3223-4888-a069-e77a6ef5276a tempest-VolumeQuotasAdminTestJSON-1032009120 None] Lock "b'cinder-1c94cb07-84e4-4e5c-a8a1-34a303581f5b-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:09:42.510083 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0558b62f-3223-4888-a069-e77a6ef5276a tempest-VolumeQuotasAdminTestJSON-1032009120 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:09:42.619742 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0558b62f-3223-4888-a069-e77a6ef5276a tempest-VolumeQuotasAdminTestJSON-1032009120 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:09:42.622122 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0558b62f-3223-4888-a069-e77a6ef5276a tempest-VolumeQuotasAdminTestJSON-1032009120 None] Volume volume-1c94cb07-84e4-4e5c-a8a1-34a303581f5b is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:09:42.631407 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0558b62f-3223-4888-a069-e77a6ef5276a tempest-VolumeQuotasAdminTestJSON-1032009120 None] deleting rbd volume volume-1c94cb07-84e4-4e5c-a8a1-34a303581f5b {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:09:43.178628 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-0558b62f-3223-4888-a069-e77a6ef5276a tempest-VolumeQuotasAdminTestJSON-1032009120 None] Created reservations ['4efe96bb-ebf5-40a2-8b12-6c74532e7ef5', 'c46c091e-dd03-4e64-b615-f3cfd00e4171', '8715b46e-8335-47df-aae0-3b2b4852c9ed', 'a656c4e3-c939-4e22-8835-555dca57a9e0'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:09:43.263756 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0558b62f-3223-4888-a069-e77a6ef5276a tempest-VolumeQuotasAdminTestJSON-1032009120 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:09:43.328565 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0558b62f-3223-4888-a069-e77a6ef5276a tempest-VolumeQuotasAdminTestJSON-1032009120 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:09:43.408146 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-0558b62f-3223-4888-a069-e77a6ef5276a tempest-VolumeQuotasAdminTestJSON-1032009120 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:09:43.413763 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-0558b62f-3223-4888-a069-e77a6ef5276a tempest-VolumeQuotasAdminTestJSON-1032009120 None] Deleted volume successfully. Jun 25 21:09:43.442268 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-0558b62f-3223-4888-a069-e77a6ef5276a tempest-VolumeQuotasAdminTestJSON-1032009120 None] Lock "b'cinder-1c94cb07-84e4-4e5c-a8a1-34a303581f5b-delete_volume'" released by "delete_volume" :: held 0.966s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:09:52.139374 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:09:52.140072 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:09:52.237986 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:09:52.322471 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:10:03.446174 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=28,cinder:UPDATE=27,cinder:INSERT=4,cinder:DELETE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:13.443527 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=46,cinder:UPDATE=15,cinder:DELETE=1,cinder:INSERT=4 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:28.275304 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c1a26f7-fb7d-449d-a968-bec8a0642bd1 tempest-VolumesActionsTest-770269746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:10:28.308243 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1c1a26f7-fb7d-449d-a968-bec8a0642bd1 tempest-VolumesActionsTest-770269746 None] Flow 'volume_create_manager' (5245b78c-d885-4b0f-8048-ebe5c94502b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:10:28.315603 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1c1a26f7-fb7d-449d-a968-bec8a0642bd1 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d5d655b-11e9-47ac-832b-4852cb87a9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:10:28.335973 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1c1a26f7-fb7d-449d-a968-bec8a0642bd1 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d5d655b-11e9-47ac-832b-4852cb87a9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1491366190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9cd0f720-ff3b-42ed-a832-c4d9fb3fc655,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc2d0a5c55aa4b37a53cb0fdf6c6ea45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:10:28Z,use_quota=True,user_id='3eb2928f8d734e61b71ae17ea712ac3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:10:28.344235 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1c1a26f7-fb7d-449d-a968-bec8a0642bd1 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18f6914d-9a2c-4de9-9768-2557d657bd9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:10:28.351579 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1c1a26f7-fb7d-449d-a968-bec8a0642bd1 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18f6914d-9a2c-4de9-9768-2557d657bd9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:10:28.359129 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1c1a26f7-fb7d-449d-a968-bec8a0642bd1 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00bebcf8-65c7-471e-b0f4-bbec9e66b47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:10:28.364369 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1c1a26f7-fb7d-449d-a968-bec8a0642bd1 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00bebcf8-65c7-471e-b0f4-bbec9e66b47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cd0f720-ff3b-42ed-a832-c4d9fb3fc655', 'volume_name': 'volume-9cd0f720-ff3b-42ed-a832-c4d9fb3fc655', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:10:28.371819 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1c1a26f7-fb7d-449d-a968-bec8a0642bd1 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2b46773-600e-41a6-aa34-dc10d67390dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:10:28.376642 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1c1a26f7-fb7d-449d-a968-bec8a0642bd1 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2b46773-600e-41a6-aa34-dc10d67390dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:10:28.382175 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1c1a26f7-fb7d-449d-a968-bec8a0642bd1 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (337fcb5a-876a-4a66-873a-14c749a905d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:10:28.383482 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-1c1a26f7-fb7d-449d-a968-bec8a0642bd1 tempest-VolumesActionsTest-770269746 None] Volume 9cd0f720-ff3b-42ed-a832-c4d9fb3fc655: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cd0f720-ff3b-42ed-a832-c4d9fb3fc655', 'volume_size': 1} Jun 25 21:10:28.384549 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1c1a26f7-fb7d-449d-a968-bec8a0642bd1 tempest-VolumesActionsTest-770269746 None] creating volume 'volume-9cd0f720-ff3b-42ed-a832-c4d9fb3fc655' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:10:28.385638 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1c1a26f7-fb7d-449d-a968-bec8a0642bd1 tempest-VolumesActionsTest-770269746 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:10:28.501151 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1c1a26f7-fb7d-449d-a968-bec8a0642bd1 tempest-VolumesActionsTest-770269746 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:10:28.501444 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1c1a26f7-fb7d-449d-a968-bec8a0642bd1 tempest-VolumesActionsTest-770269746 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:10:28.505612 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1c1a26f7-fb7d-449d-a968-bec8a0642bd1 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (337fcb5a-876a-4a66-873a-14c749a905d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cd0f720-ff3b-42ed-a832-c4d9fb3fc655', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:10:28.521337 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1c1a26f7-fb7d-449d-a968-bec8a0642bd1 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45231f02-b18a-4ffe-811c-1166f20526c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:10:28.546331 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-1c1a26f7-fb7d-449d-a968-bec8a0642bd1 tempest-VolumesActionsTest-770269746 None] Volume volume-9cd0f720-ff3b-42ed-a832-c4d9fb3fc655 (9cd0f720-ff3b-42ed-a832-c4d9fb3fc655): created successfully Jun 25 21:10:28.567930 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1c1a26f7-fb7d-449d-a968-bec8a0642bd1 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45231f02-b18a-4ffe-811c-1166f20526c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:10:28.594298 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1c1a26f7-fb7d-449d-a968-bec8a0642bd1 tempest-VolumesActionsTest-770269746 None] Flow 'volume_create_manager' (5245b78c-d885-4b0f-8048-ebe5c94502b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:10:28.613774 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-1c1a26f7-fb7d-449d-a968-bec8a0642bd1 tempest-VolumesActionsTest-770269746 None] Created volume successfully. Jun 25 21:10:29.325802 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-0209a9bd-aa2a-47dc-b910-00c69850232a tempest-VolumesActionsTest-770269746 None] Lock "b'cinder-9cd0f720-ff3b-42ed-a832-c4d9fb3fc655'" acquired by "attach_volume" :: waited 0.016s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:10:29.407921 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-0209a9bd-aa2a-47dc-b910-00c69850232a tempest-VolumesActionsTest-770269746 None] Attaching volume 9cd0f720-ff3b-42ed-a832-c4d9fb3fc655 to instance c7b26789-2359-4178-8de1-88f0006bac21 at mountpoint /dev/sdb on host None. Jun 25 21:10:29.466360 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-0209a9bd-aa2a-47dc-b910-00c69850232a tempest-VolumesActionsTest-770269746 None] Attach volume completed successfully. Jun 25 21:10:29.476542 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-0209a9bd-aa2a-47dc-b910-00c69850232a tempest-VolumesActionsTest-770269746 None] Lock "b'cinder-9cd0f720-ff3b-42ed-a832-c4d9fb3fc655'" released by "attach_volume" :: held 0.151s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:10:30.197056 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-4e2c821a-a7d4-4362-a0cb-ccea67cc219d tempest-VolumesActionsTest-1474698115 None] Terminate volume connection completed successfully. Jun 25 21:10:30.262566 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-4e2c821a-a7d4-4362-a0cb-ccea67cc219d tempest-VolumesActionsTest-1474698115 None] Lock "b'cinder-9cd0f720-ff3b-42ed-a832-c4d9fb3fc655-detach_volume'" acquired by "detach_volume" :: waited 0.013s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:10:30.277602 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-4e2c821a-a7d4-4362-a0cb-ccea67cc219d tempest-VolumesActionsTest-1474698115 None] Detaching volume 9cd0f720-ff3b-42ed-a832-c4d9fb3fc655 from instance c7b26789-2359-4178-8de1-88f0006bac21. Jun 25 21:10:30.325456 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-4e2c821a-a7d4-4362-a0cb-ccea67cc219d tempest-VolumesActionsTest-1474698115 None] Detach volume completed successfully. Jun 25 21:10:30.335759 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-4e2c821a-a7d4-4362-a0cb-ccea67cc219d tempest-VolumesActionsTest-1474698115 None] Lock "b'cinder-9cd0f720-ff3b-42ed-a832-c4d9fb3fc655-detach_volume'" released by "detach_volume" :: held 0.070s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:10:30.566542 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-f9151da3-3adb-48eb-9951-f69b87986d00 tempest-VolumesActionsTest-770269746 None] Lock "b'cinder-9cd0f720-ff3b-42ed-a832-c4d9fb3fc655-detach_volume'" acquired by "detach_volume" :: waited 0.014s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:10:30.567505 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-f9151da3-3adb-48eb-9951-f69b87986d00 tempest-VolumesActionsTest-770269746 None] Volume detach called, but volume not attached. Jun 25 21:10:30.591810 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-f9151da3-3adb-48eb-9951-f69b87986d00 tempest-VolumesActionsTest-770269746 None] Lock "b'cinder-9cd0f720-ff3b-42ed-a832-c4d9fb3fc655-detach_volume'" released by "detach_volume" :: held 0.025s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:10:35.015808 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=24,cinder:UPDATE=6,cinder:DELETE=1,cinder:INSERT=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:35.026491 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-adf0df53-da5f-4ffe-98af-43323c7e75e2 tempest-VolumesActionsTest-770269746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:10:35.052709 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-adf0df53-da5f-4ffe-98af-43323c7e75e2 tempest-VolumesActionsTest-770269746 None] Flow 'volume_create_manager' (e26d258c-ba27-49b5-87eb-11e3d4f0f7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:10:35.061821 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-adf0df53-da5f-4ffe-98af-43323c7e75e2 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4322549-53ee-4e92-84d1-410a53996a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:10:35.105014 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-adf0df53-da5f-4ffe-98af-43323c7e75e2 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4322549-53ee-4e92-84d1-410a53996a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-863970596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7686ee3f-8bfb-4487-b6f6-3dec051c824e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc2d0a5c55aa4b37a53cb0fdf6c6ea45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:10:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:10:35Z,use_quota=True,user_id='3eb2928f8d734e61b71ae17ea712ac3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:10:35.117212 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-adf0df53-da5f-4ffe-98af-43323c7e75e2 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da28b8c8-4713-41f2-8c52-59dffa58154c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:10:35.125281 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-adf0df53-da5f-4ffe-98af-43323c7e75e2 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da28b8c8-4713-41f2-8c52-59dffa58154c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:10:35.133419 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-adf0df53-da5f-4ffe-98af-43323c7e75e2 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd944404-e7ec-43e0-a5b6-1cc67e2a1852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:10:35.138519 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-adf0df53-da5f-4ffe-98af-43323c7e75e2 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd944404-e7ec-43e0-a5b6-1cc67e2a1852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7686ee3f-8bfb-4487-b6f6-3dec051c824e', 'volume_name': 'volume-7686ee3f-8bfb-4487-b6f6-3dec051c824e', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:10:35.144596 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-adf0df53-da5f-4ffe-98af-43323c7e75e2 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bf48c36-8484-4dda-95cc-3bd84b912a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:10:35.148659 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-adf0df53-da5f-4ffe-98af-43323c7e75e2 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bf48c36-8484-4dda-95cc-3bd84b912a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:10:35.154584 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-adf0df53-da5f-4ffe-98af-43323c7e75e2 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc132475-e34c-4de4-95c3-787ebe974861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:10:35.156372 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-adf0df53-da5f-4ffe-98af-43323c7e75e2 tempest-VolumesActionsTest-770269746 None] Volume 7686ee3f-8bfb-4487-b6f6-3dec051c824e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7686ee3f-8bfb-4487-b6f6-3dec051c824e', 'volume_size': 1} Jun 25 21:10:35.157017 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-adf0df53-da5f-4ffe-98af-43323c7e75e2 tempest-VolumesActionsTest-770269746 None] creating volume 'volume-7686ee3f-8bfb-4487-b6f6-3dec051c824e' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:10:35.158295 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-adf0df53-da5f-4ffe-98af-43323c7e75e2 tempest-VolumesActionsTest-770269746 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:10:35.271952 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-adf0df53-da5f-4ffe-98af-43323c7e75e2 tempest-VolumesActionsTest-770269746 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:10:35.273038 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-adf0df53-da5f-4ffe-98af-43323c7e75e2 tempest-VolumesActionsTest-770269746 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:10:35.282625 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-adf0df53-da5f-4ffe-98af-43323c7e75e2 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc132475-e34c-4de4-95c3-787ebe974861) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7686ee3f-8bfb-4487-b6f6-3dec051c824e', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:10:35.291560 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-adf0df53-da5f-4ffe-98af-43323c7e75e2 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eb6e874-b28f-4501-beb3-c6bf3c6d6dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:10:35.309356 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-adf0df53-da5f-4ffe-98af-43323c7e75e2 tempest-VolumesActionsTest-770269746 None] Volume volume-7686ee3f-8bfb-4487-b6f6-3dec051c824e (7686ee3f-8bfb-4487-b6f6-3dec051c824e): created successfully Jun 25 21:10:35.313015 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-adf0df53-da5f-4ffe-98af-43323c7e75e2 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eb6e874-b28f-4501-beb3-c6bf3c6d6dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:10:35.324503 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-adf0df53-da5f-4ffe-98af-43323c7e75e2 tempest-VolumesActionsTest-770269746 None] Flow 'volume_create_manager' (e26d258c-ba27-49b5-87eb-11e3d4f0f7ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:10:35.335817 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-adf0df53-da5f-4ffe-98af-43323c7e75e2 tempest-VolumesActionsTest-770269746 None] Created volume successfully. Jun 25 21:10:36.379436 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-04d15360-0fcf-45ae-bd19-a7d937b25d1d tempest-VolumesActionsTest-1474698115 None] Lock "b'cinder-7686ee3f-8bfb-4487-b6f6-3dec051c824e-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:10:36.473481 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-04d15360-0fcf-45ae-bd19-a7d937b25d1d tempest-VolumesActionsTest-1474698115 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:10:36.606980 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-04d15360-0fcf-45ae-bd19-a7d937b25d1d tempest-VolumesActionsTest-1474698115 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:10:36.607244 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-04d15360-0fcf-45ae-bd19-a7d937b25d1d tempest-VolumesActionsTest-1474698115 None] Volume volume-7686ee3f-8bfb-4487-b6f6-3dec051c824e is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:10:36.622140 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-04d15360-0fcf-45ae-bd19-a7d937b25d1d tempest-VolumesActionsTest-1474698115 None] deleting rbd volume volume-7686ee3f-8bfb-4487-b6f6-3dec051c824e {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:10:37.093143 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-04d15360-0fcf-45ae-bd19-a7d937b25d1d tempest-VolumesActionsTest-1474698115 None] Created reservations ['cdc24198-55f8-4307-b6f0-85f38912f72a', '2c9bcba3-af9e-4502-84af-e70885050df1', '80be0244-1256-41f5-8259-df516fd80ecc', '6c8244fd-a29b-4c6f-9ad5-b4081f590279'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:10:37.158215 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-04d15360-0fcf-45ae-bd19-a7d937b25d1d tempest-VolumesActionsTest-1474698115 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:10:37.238010 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-04d15360-0fcf-45ae-bd19-a7d937b25d1d tempest-VolumesActionsTest-1474698115 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:10:37.287455 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-04d15360-0fcf-45ae-bd19-a7d937b25d1d tempest-VolumesActionsTest-1474698115 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:10:37.300929 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-04d15360-0fcf-45ae-bd19-a7d937b25d1d tempest-VolumesActionsTest-1474698115 None] Deleted volume successfully. Jun 25 21:10:37.342373 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-04d15360-0fcf-45ae-bd19-a7d937b25d1d tempest-VolumesActionsTest-1474698115 None] Lock "b'cinder-7686ee3f-8bfb-4487-b6f6-3dec051c824e-delete_volume'" released by "delete_volume" :: held 0.962s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:10:38.296413 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-4134523a-59d8-4547-a28b-43df3235f993 tempest-VolumesActionsTest-770269746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:10:38.341965 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4134523a-59d8-4547-a28b-43df3235f993 tempest-VolumesActionsTest-770269746 None] Flow 'volume_create_manager' (6942105f-d6a9-4b9a-a34a-1b9505ddd238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:10:38.355066 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4134523a-59d8-4547-a28b-43df3235f993 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3b27b26-5d77-4638-bdf6-d328298441ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:10:38.383166 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4134523a-59d8-4547-a28b-43df3235f993 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3b27b26-5d77-4638-bdf6-d328298441ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-704343001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3746392e-2bee-465f-abe0-e84b47a3a364,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc2d0a5c55aa4b37a53cb0fdf6c6ea45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:10:38Z,use_quota=True,user_id='3eb2928f8d734e61b71ae17ea712ac3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:10:38.393557 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4134523a-59d8-4547-a28b-43df3235f993 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0858a8ac-3540-4201-8d32-c1f13166612d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:10:38.400891 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4134523a-59d8-4547-a28b-43df3235f993 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0858a8ac-3540-4201-8d32-c1f13166612d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:10:38.409862 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4134523a-59d8-4547-a28b-43df3235f993 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf6b41bb-51b7-4769-9901-d3ab499dbcf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:10:38.414761 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4134523a-59d8-4547-a28b-43df3235f993 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf6b41bb-51b7-4769-9901-d3ab499dbcf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3746392e-2bee-465f-abe0-e84b47a3a364', 'volume_name': 'volume-3746392e-2bee-465f-abe0-e84b47a3a364', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:10:38.421245 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4134523a-59d8-4547-a28b-43df3235f993 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c046e261-6de5-4ec3-b4d9-21888e8292fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:10:38.424622 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4134523a-59d8-4547-a28b-43df3235f993 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c046e261-6de5-4ec3-b4d9-21888e8292fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:10:38.436033 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4134523a-59d8-4547-a28b-43df3235f993 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3557b30c-dd61-451f-8f89-ac6b7759e0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:10:38.436033 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-4134523a-59d8-4547-a28b-43df3235f993 tempest-VolumesActionsTest-770269746 None] Volume 3746392e-2bee-465f-abe0-e84b47a3a364: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3746392e-2bee-465f-abe0-e84b47a3a364', 'volume_size': 1} Jun 25 21:10:38.436033 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4134523a-59d8-4547-a28b-43df3235f993 tempest-VolumesActionsTest-770269746 None] creating volume 'volume-3746392e-2bee-465f-abe0-e84b47a3a364' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:10:38.436033 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4134523a-59d8-4547-a28b-43df3235f993 tempest-VolumesActionsTest-770269746 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:10:38.631613 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4134523a-59d8-4547-a28b-43df3235f993 tempest-VolumesActionsTest-770269746 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:10:38.631993 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4134523a-59d8-4547-a28b-43df3235f993 tempest-VolumesActionsTest-770269746 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:10:38.640646 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4134523a-59d8-4547-a28b-43df3235f993 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3557b30c-dd61-451f-8f89-ac6b7759e0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3746392e-2bee-465f-abe0-e84b47a3a364', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:10:38.661353 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4134523a-59d8-4547-a28b-43df3235f993 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6550586f-98ad-4641-87e7-0ac03349e78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:10:38.677926 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-4134523a-59d8-4547-a28b-43df3235f993 tempest-VolumesActionsTest-770269746 None] Volume volume-3746392e-2bee-465f-abe0-e84b47a3a364 (3746392e-2bee-465f-abe0-e84b47a3a364): created successfully Jun 25 21:10:38.684037 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4134523a-59d8-4547-a28b-43df3235f993 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6550586f-98ad-4641-87e7-0ac03349e78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:10:38.700955 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4134523a-59d8-4547-a28b-43df3235f993 tempest-VolumesActionsTest-770269746 None] Flow 'volume_create_manager' (6942105f-d6a9-4b9a-a34a-1b9505ddd238) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:10:38.722134 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-4134523a-59d8-4547-a28b-43df3235f993 tempest-VolumesActionsTest-770269746 None] Created volume successfully. Jun 25 21:10:39.478608 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-9e174c88-7323-4ed8-9e27-24960912665f tempest-VolumesActionsTest-1474698115 None] Lock "b'cinder-3746392e-2bee-465f-abe0-e84b47a3a364-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:10:39.532311 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9e174c88-7323-4ed8-9e27-24960912665f tempest-VolumesActionsTest-1474698115 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:10:39.624168 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9e174c88-7323-4ed8-9e27-24960912665f tempest-VolumesActionsTest-1474698115 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:10:39.626290 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9e174c88-7323-4ed8-9e27-24960912665f tempest-VolumesActionsTest-1474698115 None] Volume volume-3746392e-2bee-465f-abe0-e84b47a3a364 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:10:39.637194 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9e174c88-7323-4ed8-9e27-24960912665f tempest-VolumesActionsTest-1474698115 None] deleting rbd volume volume-3746392e-2bee-465f-abe0-e84b47a3a364 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:10:39.960912 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-9e174c88-7323-4ed8-9e27-24960912665f tempest-VolumesActionsTest-1474698115 None] Created reservations ['fbfa14d6-04fc-457b-a781-6e9456f60321', '3ae60a3f-af38-4bdd-b00a-1745c94e1275', '6b2bf421-a14d-4e75-8ba4-4e5178c5e480', 'aa439eaf-223c-486e-be90-65835e0154ae'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:10:40.062044 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9e174c88-7323-4ed8-9e27-24960912665f tempest-VolumesActionsTest-1474698115 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:10:40.120416 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9e174c88-7323-4ed8-9e27-24960912665f tempest-VolumesActionsTest-1474698115 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:10:40.182400 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-9e174c88-7323-4ed8-9e27-24960912665f tempest-VolumesActionsTest-1474698115 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:10:40.197651 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-9e174c88-7323-4ed8-9e27-24960912665f tempest-VolumesActionsTest-1474698115 None] Deleted volume successfully. Jun 25 21:10:40.212079 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-9e174c88-7323-4ed8-9e27-24960912665f tempest-VolumesActionsTest-1474698115 None] Lock "b'cinder-3746392e-2bee-465f-abe0-e84b47a3a364-delete_volume'" released by "delete_volume" :: held 0.734s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:10:41.852564 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2d5a34c-107f-4004-afe0-bd2e9ec59400 tempest-VolumesActionsTest-770269746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:10:41.924733 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b2d5a34c-107f-4004-afe0-bd2e9ec59400 tempest-VolumesActionsTest-770269746 None] Flow 'volume_create_manager' (adbc8305-88f8-4762-89e3-4895286809a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:10:41.943677 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b2d5a34c-107f-4004-afe0-bd2e9ec59400 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12fe329e-e5e5-4eff-bd87-8fb8943768f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:10:41.994150 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b2d5a34c-107f-4004-afe0-bd2e9ec59400 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12fe329e-e5e5-4eff-bd87-8fb8943768f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:10:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1933250541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a7740a61-ca68-46bf-a627-63b966a2eeab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc2d0a5c55aa4b37a53cb0fdf6c6ea45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:10:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:10:42Z,use_quota=True,user_id='3eb2928f8d734e61b71ae17ea712ac3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:10:42.004112 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b2d5a34c-107f-4004-afe0-bd2e9ec59400 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (362fa127-f0d6-45a1-9fdf-27474f70dd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:10:42.013083 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b2d5a34c-107f-4004-afe0-bd2e9ec59400 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (362fa127-f0d6-45a1-9fdf-27474f70dd11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:10:42.029458 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b2d5a34c-107f-4004-afe0-bd2e9ec59400 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb0ed82e-86f6-4fe4-8aac-a249fe2be657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:10:42.038987 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b2d5a34c-107f-4004-afe0-bd2e9ec59400 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb0ed82e-86f6-4fe4-8aac-a249fe2be657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7740a61-ca68-46bf-a627-63b966a2eeab', 'volume_name': 'volume-a7740a61-ca68-46bf-a627-63b966a2eeab', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:10:42.048039 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b2d5a34c-107f-4004-afe0-bd2e9ec59400 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (127f0c24-564c-4eba-9248-dd45d860be81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:10:42.055305 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b2d5a34c-107f-4004-afe0-bd2e9ec59400 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (127f0c24-564c-4eba-9248-dd45d860be81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:10:42.063193 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b2d5a34c-107f-4004-afe0-bd2e9ec59400 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9172832-402d-46dc-8cfb-bc9ae5724503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:10:42.065040 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-b2d5a34c-107f-4004-afe0-bd2e9ec59400 tempest-VolumesActionsTest-770269746 None] Volume a7740a61-ca68-46bf-a627-63b966a2eeab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7740a61-ca68-46bf-a627-63b966a2eeab', 'volume_size': 1} Jun 25 21:10:42.066226 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b2d5a34c-107f-4004-afe0-bd2e9ec59400 tempest-VolumesActionsTest-770269746 None] creating volume 'volume-a7740a61-ca68-46bf-a627-63b966a2eeab' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:10:42.067305 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b2d5a34c-107f-4004-afe0-bd2e9ec59400 tempest-VolumesActionsTest-770269746 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:10:42.160110 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b2d5a34c-107f-4004-afe0-bd2e9ec59400 tempest-VolumesActionsTest-770269746 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:10:42.162639 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b2d5a34c-107f-4004-afe0-bd2e9ec59400 tempest-VolumesActionsTest-770269746 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:10:42.167840 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b2d5a34c-107f-4004-afe0-bd2e9ec59400 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9172832-402d-46dc-8cfb-bc9ae5724503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7740a61-ca68-46bf-a627-63b966a2eeab', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:10:42.180682 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b2d5a34c-107f-4004-afe0-bd2e9ec59400 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2aa6b8c-fe6f-4185-9976-444611edd2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:10:42.204727 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-b2d5a34c-107f-4004-afe0-bd2e9ec59400 tempest-VolumesActionsTest-770269746 None] Volume volume-a7740a61-ca68-46bf-a627-63b966a2eeab (a7740a61-ca68-46bf-a627-63b966a2eeab): created successfully Jun 25 21:10:42.209970 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b2d5a34c-107f-4004-afe0-bd2e9ec59400 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2aa6b8c-fe6f-4185-9976-444611edd2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:10:42.220966 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b2d5a34c-107f-4004-afe0-bd2e9ec59400 tempest-VolumesActionsTest-770269746 None] Flow 'volume_create_manager' (adbc8305-88f8-4762-89e3-4895286809a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:10:42.239071 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-b2d5a34c-107f-4004-afe0-bd2e9ec59400 tempest-VolumesActionsTest-770269746 None] Created volume successfully. Jun 25 21:10:43.491247 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-e82c31e6-4ff3-4937-bd70-fbd21dfc28bd tempest-VolumesActionsTest-1474698115 None] Lock "b'cinder-a7740a61-ca68-46bf-a627-63b966a2eeab-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:10:43.498053 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=61,cinder:UPDATE=27,cinder:DELETE=3,cinder:INSERT=5 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:43.554791 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e82c31e6-4ff3-4937-bd70-fbd21dfc28bd tempest-VolumesActionsTest-1474698115 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:10:43.675619 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e82c31e6-4ff3-4937-bd70-fbd21dfc28bd tempest-VolumesActionsTest-1474698115 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:10:43.677017 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e82c31e6-4ff3-4937-bd70-fbd21dfc28bd tempest-VolumesActionsTest-1474698115 None] Volume volume-a7740a61-ca68-46bf-a627-63b966a2eeab is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:10:43.703935 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e82c31e6-4ff3-4937-bd70-fbd21dfc28bd tempest-VolumesActionsTest-1474698115 None] deleting rbd volume volume-a7740a61-ca68-46bf-a627-63b966a2eeab {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:10:44.222455 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-e82c31e6-4ff3-4937-bd70-fbd21dfc28bd tempest-VolumesActionsTest-1474698115 None] Created reservations ['1b0803cb-ed5e-4066-b954-73dc4b60e403', '1530ba04-38f6-40df-b02e-a9b00dc70748', 'd5a33472-5b1c-4173-abd2-0d07cae89e4c', 'bcd1a254-f7bb-4fce-b78c-1b2e218769f3'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:10:44.320297 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e82c31e6-4ff3-4937-bd70-fbd21dfc28bd tempest-VolumesActionsTest-1474698115 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:10:44.422915 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e82c31e6-4ff3-4937-bd70-fbd21dfc28bd tempest-VolumesActionsTest-1474698115 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:10:44.499119 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-e82c31e6-4ff3-4937-bd70-fbd21dfc28bd tempest-VolumesActionsTest-1474698115 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:10:44.505067 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-e82c31e6-4ff3-4937-bd70-fbd21dfc28bd tempest-VolumesActionsTest-1474698115 None] Deleted volume successfully. Jun 25 21:10:44.525124 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-e82c31e6-4ff3-4937-bd70-fbd21dfc28bd tempest-VolumesActionsTest-1474698115 None] Lock "b'cinder-a7740a61-ca68-46bf-a627-63b966a2eeab-delete_volume'" released by "delete_volume" :: held 1.034s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:10:45.201457 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d6bd337-5b64-4259-98da-0fce3e55f443 tempest-VolumesActionsTest-770269746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:10:45.223823 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6d6bd337-5b64-4259-98da-0fce3e55f443 tempest-VolumesActionsTest-770269746 None] Flow 'volume_create_manager' (b93db2f2-498f-40fd-8e1a-0d2bc53084ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:10:45.233325 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6d6bd337-5b64-4259-98da-0fce3e55f443 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b30025c9-6fd0-42bd-9579-341eccbfd674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:10:45.253823 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6d6bd337-5b64-4259-98da-0fce3e55f443 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b30025c9-6fd0-42bd-9579-341eccbfd674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:10:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-861123338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=346fb217-58ab-4454-96a3-e2b9fb8d3c31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc2d0a5c55aa4b37a53cb0fdf6c6ea45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:10:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:10:45Z,use_quota=True,user_id='3eb2928f8d734e61b71ae17ea712ac3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:10:45.259725 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6d6bd337-5b64-4259-98da-0fce3e55f443 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3476958-755e-40aa-8a0a-06a296d3d218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:10:45.264039 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6d6bd337-5b64-4259-98da-0fce3e55f443 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3476958-755e-40aa-8a0a-06a296d3d218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:10:45.272096 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6d6bd337-5b64-4259-98da-0fce3e55f443 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63f4f99d-1315-4519-adbb-d9cfffdc4aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:10:45.276265 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6d6bd337-5b64-4259-98da-0fce3e55f443 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63f4f99d-1315-4519-adbb-d9cfffdc4aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '346fb217-58ab-4454-96a3-e2b9fb8d3c31', 'volume_name': 'volume-346fb217-58ab-4454-96a3-e2b9fb8d3c31', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:10:45.281584 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6d6bd337-5b64-4259-98da-0fce3e55f443 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (928670ce-1c73-4c10-8c2b-11b09931b0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:10:45.285970 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6d6bd337-5b64-4259-98da-0fce3e55f443 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (928670ce-1c73-4c10-8c2b-11b09931b0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:10:45.291846 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6d6bd337-5b64-4259-98da-0fce3e55f443 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b27fcaf-776a-4ecd-814a-9452b860018d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:10:45.294452 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-6d6bd337-5b64-4259-98da-0fce3e55f443 tempest-VolumesActionsTest-770269746 None] Volume 346fb217-58ab-4454-96a3-e2b9fb8d3c31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-346fb217-58ab-4454-96a3-e2b9fb8d3c31', 'volume_size': 1} Jun 25 21:10:45.295558 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6d6bd337-5b64-4259-98da-0fce3e55f443 tempest-VolumesActionsTest-770269746 None] creating volume 'volume-346fb217-58ab-4454-96a3-e2b9fb8d3c31' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:10:45.296691 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6d6bd337-5b64-4259-98da-0fce3e55f443 tempest-VolumesActionsTest-770269746 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:10:45.378981 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6d6bd337-5b64-4259-98da-0fce3e55f443 tempest-VolumesActionsTest-770269746 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:10:45.379513 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6d6bd337-5b64-4259-98da-0fce3e55f443 tempest-VolumesActionsTest-770269746 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:10:45.383721 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6d6bd337-5b64-4259-98da-0fce3e55f443 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b27fcaf-776a-4ecd-814a-9452b860018d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-346fb217-58ab-4454-96a3-e2b9fb8d3c31', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:10:45.392338 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6d6bd337-5b64-4259-98da-0fce3e55f443 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebf9e62f-26c5-4e39-80a0-613e74620745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:10:45.402228 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-6d6bd337-5b64-4259-98da-0fce3e55f443 tempest-VolumesActionsTest-770269746 None] Volume volume-346fb217-58ab-4454-96a3-e2b9fb8d3c31 (346fb217-58ab-4454-96a3-e2b9fb8d3c31): created successfully Jun 25 21:10:45.409233 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6d6bd337-5b64-4259-98da-0fce3e55f443 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebf9e62f-26c5-4e39-80a0-613e74620745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:10:45.415292 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6d6bd337-5b64-4259-98da-0fce3e55f443 tempest-VolumesActionsTest-770269746 None] Flow 'volume_create_manager' (b93db2f2-498f-40fd-8e1a-0d2bc53084ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:10:45.430665 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-6d6bd337-5b64-4259-98da-0fce3e55f443 tempest-VolumesActionsTest-770269746 None] Created volume successfully. Jun 25 21:10:46.498662 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-b35699f0-da6e-42a9-85de-ae34ce45f810 tempest-VolumesActionsTest-1474698115 None] Lock "b'cinder-346fb217-58ab-4454-96a3-e2b9fb8d3c31-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:10:46.540678 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b35699f0-da6e-42a9-85de-ae34ce45f810 tempest-VolumesActionsTest-1474698115 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:10:46.608168 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b35699f0-da6e-42a9-85de-ae34ce45f810 tempest-VolumesActionsTest-1474698115 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:10:46.608626 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b35699f0-da6e-42a9-85de-ae34ce45f810 tempest-VolumesActionsTest-1474698115 None] Volume volume-346fb217-58ab-4454-96a3-e2b9fb8d3c31 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:10:46.617113 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b35699f0-da6e-42a9-85de-ae34ce45f810 tempest-VolumesActionsTest-1474698115 None] deleting rbd volume volume-346fb217-58ab-4454-96a3-e2b9fb8d3c31 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:10:46.964748 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-b35699f0-da6e-42a9-85de-ae34ce45f810 tempest-VolumesActionsTest-1474698115 None] Created reservations ['8f356e19-2a9b-47d2-bade-b074a6da1686', '775c5d02-2e3b-4357-9dd9-2bfafd5f9370', '7eed7376-4e09-4862-aed9-5d2ef4b4bc89', '20e3ce2f-f956-48ee-a61b-c597714cf633'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:10:47.045685 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b35699f0-da6e-42a9-85de-ae34ce45f810 tempest-VolumesActionsTest-1474698115 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:10:47.117613 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b35699f0-da6e-42a9-85de-ae34ce45f810 tempest-VolumesActionsTest-1474698115 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:10:47.166917 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-b35699f0-da6e-42a9-85de-ae34ce45f810 tempest-VolumesActionsTest-1474698115 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:10:47.171991 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-b35699f0-da6e-42a9-85de-ae34ce45f810 tempest-VolumesActionsTest-1474698115 None] Deleted volume successfully. Jun 25 21:10:47.175647 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=52,cinder:UPDATE=39,cinder:INSERT=4,cinder:DELETE=5 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:47.194018 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-b35699f0-da6e-42a9-85de-ae34ce45f810 tempest-VolumesActionsTest-1474698115 None] Lock "b'cinder-346fb217-58ab-4454-96a3-e2b9fb8d3c31-delete_volume'" released by "delete_volume" :: held 0.695s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:10:48.172586 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e9cb228-6080-4bdc-b083-9e3dace54bf8 tempest-VolumesActionsTest-770269746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:10:48.193621 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7e9cb228-6080-4bdc-b083-9e3dace54bf8 tempest-VolumesActionsTest-770269746 None] Flow 'volume_create_manager' (fc2b947d-288e-4ce3-bfc1-04be25d22451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:10:48.201465 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7e9cb228-6080-4bdc-b083-9e3dace54bf8 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97c9910b-fa9b-4445-acd4-6ed07532291b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:10:48.218507 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7e9cb228-6080-4bdc-b083-9e3dace54bf8 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97c9910b-fa9b-4445-acd4-6ed07532291b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1081070539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=db882bbf-fa3d-467c-856c-dd68a55409ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc2d0a5c55aa4b37a53cb0fdf6c6ea45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:10:48Z,use_quota=True,user_id='3eb2928f8d734e61b71ae17ea712ac3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:10:48.225088 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7e9cb228-6080-4bdc-b083-9e3dace54bf8 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dab280ae-4a97-47b7-bc8e-9557486a9bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:10:48.229605 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7e9cb228-6080-4bdc-b083-9e3dace54bf8 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dab280ae-4a97-47b7-bc8e-9557486a9bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:10:48.235089 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7e9cb228-6080-4bdc-b083-9e3dace54bf8 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73b2ab75-ecd0-4ad4-874f-e7a6c122b109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:10:48.240220 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7e9cb228-6080-4bdc-b083-9e3dace54bf8 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73b2ab75-ecd0-4ad4-874f-e7a6c122b109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db882bbf-fa3d-467c-856c-dd68a55409ac', 'volume_name': 'volume-db882bbf-fa3d-467c-856c-dd68a55409ac', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:10:48.245596 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7e9cb228-6080-4bdc-b083-9e3dace54bf8 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5d9806a-3472-4a43-a186-3d876f1814a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:10:48.249591 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7e9cb228-6080-4bdc-b083-9e3dace54bf8 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5d9806a-3472-4a43-a186-3d876f1814a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:10:48.255025 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7e9cb228-6080-4bdc-b083-9e3dace54bf8 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06a824a5-3d76-48cc-85f6-24a946f82324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:10:48.256093 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-7e9cb228-6080-4bdc-b083-9e3dace54bf8 tempest-VolumesActionsTest-770269746 None] Volume db882bbf-fa3d-467c-856c-dd68a55409ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db882bbf-fa3d-467c-856c-dd68a55409ac', 'volume_size': 1} Jun 25 21:10:48.256781 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7e9cb228-6080-4bdc-b083-9e3dace54bf8 tempest-VolumesActionsTest-770269746 None] creating volume 'volume-db882bbf-fa3d-467c-856c-dd68a55409ac' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:10:48.257781 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7e9cb228-6080-4bdc-b083-9e3dace54bf8 tempest-VolumesActionsTest-770269746 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:10:48.345508 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7e9cb228-6080-4bdc-b083-9e3dace54bf8 tempest-VolumesActionsTest-770269746 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:10:48.345883 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7e9cb228-6080-4bdc-b083-9e3dace54bf8 tempest-VolumesActionsTest-770269746 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:10:48.350269 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7e9cb228-6080-4bdc-b083-9e3dace54bf8 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06a824a5-3d76-48cc-85f6-24a946f82324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db882bbf-fa3d-467c-856c-dd68a55409ac', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:10:48.358517 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7e9cb228-6080-4bdc-b083-9e3dace54bf8 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6accd32-75c2-426b-a165-9e38e6dc118c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:10:48.371355 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-7e9cb228-6080-4bdc-b083-9e3dace54bf8 tempest-VolumesActionsTest-770269746 None] Volume volume-db882bbf-fa3d-467c-856c-dd68a55409ac (db882bbf-fa3d-467c-856c-dd68a55409ac): created successfully Jun 25 21:10:48.377077 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7e9cb228-6080-4bdc-b083-9e3dace54bf8 tempest-VolumesActionsTest-770269746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6accd32-75c2-426b-a165-9e38e6dc118c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:10:48.382972 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7e9cb228-6080-4bdc-b083-9e3dace54bf8 tempest-VolumesActionsTest-770269746 None] Flow 'volume_create_manager' (fc2b947d-288e-4ce3-bfc1-04be25d22451) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:10:48.396616 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-7e9cb228-6080-4bdc-b083-9e3dace54bf8 tempest-VolumesActionsTest-770269746 None] Created volume successfully. Jun 25 21:10:50.130248 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-384b315a-a452-4e6c-b3af-6981248b1079 tempest-VolumesActionsTest-770269746 None] Lock "b'cinder-db882bbf-fa3d-467c-856c-dd68a55409ac-delete_volume'" acquired by "delete_volume" :: waited 0.041s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:10:50.253489 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-384b315a-a452-4e6c-b3af-6981248b1079 tempest-VolumesActionsTest-770269746 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:10:50.334017 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-384b315a-a452-4e6c-b3af-6981248b1079 tempest-VolumesActionsTest-770269746 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:10:50.334736 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-384b315a-a452-4e6c-b3af-6981248b1079 tempest-VolumesActionsTest-770269746 None] Volume volume-db882bbf-fa3d-467c-856c-dd68a55409ac is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:10:50.348697 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-384b315a-a452-4e6c-b3af-6981248b1079 tempest-VolumesActionsTest-770269746 None] deleting rbd volume volume-db882bbf-fa3d-467c-856c-dd68a55409ac {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:10:50.865173 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-384b315a-a452-4e6c-b3af-6981248b1079 tempest-VolumesActionsTest-770269746 None] Created reservations ['b585220f-bfce-44ed-8230-8ec7685cd8a9', 'ca7317d2-cd9e-4563-8e16-d25667058199', 'd980acb6-cfd9-415a-b2ff-8abc308885d2', 'f479d2b0-4421-4f68-82f2-78da9ab95359'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:10:50.929977 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-384b315a-a452-4e6c-b3af-6981248b1079 tempest-VolumesActionsTest-770269746 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:10:50.997795 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-384b315a-a452-4e6c-b3af-6981248b1079 tempest-VolumesActionsTest-770269746 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:10:51.100096 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-384b315a-a452-4e6c-b3af-6981248b1079 tempest-VolumesActionsTest-770269746 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:10:51.105876 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-384b315a-a452-4e6c-b3af-6981248b1079 tempest-VolumesActionsTest-770269746 None] Deleted volume successfully. Jun 25 21:10:51.139411 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-384b315a-a452-4e6c-b3af-6981248b1079 tempest-VolumesActionsTest-770269746 None] Lock "b'cinder-db882bbf-fa3d-467c-856c-dd68a55409ac-delete_volume'" released by "delete_volume" :: held 1.009s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:10:51.671571 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-648bda19-cd3e-4934-b6f7-14150d1bd5e4 tempest-VolumesActionsTest-770269746 None] Lock "b'cinder-9cd0f720-ff3b-42ed-a832-c4d9fb3fc655-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:10:51.737266 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-648bda19-cd3e-4934-b6f7-14150d1bd5e4 tempest-VolumesActionsTest-770269746 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:10:51.848797 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-648bda19-cd3e-4934-b6f7-14150d1bd5e4 tempest-VolumesActionsTest-770269746 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:10:51.849342 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-648bda19-cd3e-4934-b6f7-14150d1bd5e4 tempest-VolumesActionsTest-770269746 None] Volume volume-9cd0f720-ff3b-42ed-a832-c4d9fb3fc655 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:10:51.864131 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-648bda19-cd3e-4934-b6f7-14150d1bd5e4 tempest-VolumesActionsTest-770269746 None] deleting rbd volume volume-9cd0f720-ff3b-42ed-a832-c4d9fb3fc655 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:10:52.143743 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:10:52.145202 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:10:52.229965 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:10:52.298735 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:10:52.413552 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-648bda19-cd3e-4934-b6f7-14150d1bd5e4 tempest-VolumesActionsTest-770269746 None] Created reservations ['9872d885-a437-43e8-82b9-c36588f088d3', 'b4cf4949-6fa5-4e74-ace3-e3c1ef710840', '6aab7757-1f8b-4dfd-9e37-e40db4715f4d', 'f2ef8ace-1a6a-47e9-9db3-caf3ec79d9b7'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:10:52.547602 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-648bda19-cd3e-4934-b6f7-14150d1bd5e4 tempest-VolumesActionsTest-770269746 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:10:52.650012 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-648bda19-cd3e-4934-b6f7-14150d1bd5e4 tempest-VolumesActionsTest-770269746 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:10:52.710776 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-648bda19-cd3e-4934-b6f7-14150d1bd5e4 tempest-VolumesActionsTest-770269746 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:10:52.715744 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-648bda19-cd3e-4934-b6f7-14150d1bd5e4 tempest-VolumesActionsTest-770269746 None] Deleted volume successfully. Jun 25 21:10:52.735412 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-648bda19-cd3e-4934-b6f7-14150d1bd5e4 tempest-VolumesActionsTest-770269746 None] Lock "b'cinder-9cd0f720-ff3b-42ed-a832-c4d9fb3fc655-delete_volume'" released by "delete_volume" :: held 1.064s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:10:53.458264 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=56,cinder:INSERT=11,cinder:UPDATE=31,cinder:DELETE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:56.572124 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-b62ed4c0-e1f3-430f-836a-97da90d064af tempest-VolumesAdminNegativeTest-200725683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:10:56.605823 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b62ed4c0-e1f3-430f-836a-97da90d064af tempest-VolumesAdminNegativeTest-200725683 None] Flow 'volume_create_manager' (48109eef-7d83-47c5-9f92-2c11f3b409d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:10:56.612754 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b62ed4c0-e1f3-430f-836a-97da90d064af tempest-VolumesAdminNegativeTest-200725683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92070c94-ebd9-477d-849f-03a3cfefc338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:10:56.633725 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b62ed4c0-e1f3-430f-836a-97da90d064af tempest-VolumesAdminNegativeTest-200725683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92070c94-ebd9-477d-849f-03a3cfefc338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1848595384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6879f6a0-af86-4af1-af9c-74cd6cfe0c38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cc291ebc8c64e32a229e9a993f517a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:10:57Z,use_quota=True,user_id='bee65f1c37764bdb9985b4e96a97ce9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:10:56.640089 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b62ed4c0-e1f3-430f-836a-97da90d064af tempest-VolumesAdminNegativeTest-200725683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd3a1395-26ad-4ecb-8f59-8dad40a95be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:10:56.645493 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b62ed4c0-e1f3-430f-836a-97da90d064af tempest-VolumesAdminNegativeTest-200725683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd3a1395-26ad-4ecb-8f59-8dad40a95be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:10:56.651830 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b62ed4c0-e1f3-430f-836a-97da90d064af tempest-VolumesAdminNegativeTest-200725683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea9a6031-e3e5-4b0f-82a8-22f334c0aaac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:10:56.657912 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b62ed4c0-e1f3-430f-836a-97da90d064af tempest-VolumesAdminNegativeTest-200725683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea9a6031-e3e5-4b0f-82a8-22f334c0aaac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6879f6a0-af86-4af1-af9c-74cd6cfe0c38', 'volume_name': 'volume-6879f6a0-af86-4af1-af9c-74cd6cfe0c38', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:10:56.663841 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b62ed4c0-e1f3-430f-836a-97da90d064af tempest-VolumesAdminNegativeTest-200725683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fba39d7-cf0a-4d95-9450-bae797e69f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:10:56.668801 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b62ed4c0-e1f3-430f-836a-97da90d064af tempest-VolumesAdminNegativeTest-200725683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fba39d7-cf0a-4d95-9450-bae797e69f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:10:56.675566 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b62ed4c0-e1f3-430f-836a-97da90d064af tempest-VolumesAdminNegativeTest-200725683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe23bb96-9670-449d-9be6-f932bf1078ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:10:56.677341 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-b62ed4c0-e1f3-430f-836a-97da90d064af tempest-VolumesAdminNegativeTest-200725683 None] Volume 6879f6a0-af86-4af1-af9c-74cd6cfe0c38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6879f6a0-af86-4af1-af9c-74cd6cfe0c38', 'volume_size': 1} Jun 25 21:10:56.677829 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b62ed4c0-e1f3-430f-836a-97da90d064af tempest-VolumesAdminNegativeTest-200725683 None] creating volume 'volume-6879f6a0-af86-4af1-af9c-74cd6cfe0c38' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:10:56.678714 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b62ed4c0-e1f3-430f-836a-97da90d064af tempest-VolumesAdminNegativeTest-200725683 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:10:56.846351 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b62ed4c0-e1f3-430f-836a-97da90d064af tempest-VolumesAdminNegativeTest-200725683 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:10:56.848178 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b62ed4c0-e1f3-430f-836a-97da90d064af tempest-VolumesAdminNegativeTest-200725683 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:10:56.862171 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b62ed4c0-e1f3-430f-836a-97da90d064af tempest-VolumesAdminNegativeTest-200725683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe23bb96-9670-449d-9be6-f932bf1078ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6879f6a0-af86-4af1-af9c-74cd6cfe0c38', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:10:56.881505 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b62ed4c0-e1f3-430f-836a-97da90d064af tempest-VolumesAdminNegativeTest-200725683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (105f2a75-bc48-4323-8177-defa20cb60bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:10:56.902331 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-b62ed4c0-e1f3-430f-836a-97da90d064af tempest-VolumesAdminNegativeTest-200725683 None] Volume volume-6879f6a0-af86-4af1-af9c-74cd6cfe0c38 (6879f6a0-af86-4af1-af9c-74cd6cfe0c38): created successfully Jun 25 21:10:56.915492 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b62ed4c0-e1f3-430f-836a-97da90d064af tempest-VolumesAdminNegativeTest-200725683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (105f2a75-bc48-4323-8177-defa20cb60bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:10:56.938430 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b62ed4c0-e1f3-430f-836a-97da90d064af tempest-VolumesAdminNegativeTest-200725683 None] Flow 'volume_create_manager' (48109eef-7d83-47c5-9f92-2c11f3b409d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:10:56.956324 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-b62ed4c0-e1f3-430f-836a-97da90d064af tempest-VolumesAdminNegativeTest-200725683 None] Created volume successfully. Jun 25 21:10:58.276960 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-2af1cdac-3551-47db-8afa-5b385dbbbeef tempest-GroupsTest-171234475 None] Group tempest-Group1-1812828320: creating Jun 25 21:10:58.325043 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-2af1cdac-3551-47db-8afa-5b385dbbbeef tempest-GroupsTest-171234475 None] Group tempest-Group1-1812828320: created successfully Jun 25 21:10:58.344964 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-2af1cdac-3551-47db-8afa-5b385dbbbeef tempest-GroupsTest-171234475 None] Create group completed successfully. Jun 25 21:10:58.427309 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-c64dd419-5848-431a-ab0c-c7a3bd723539 req-0d0f8e75-0987-417f-bf3d-dbbf14c5308c tempest-VolumesAdminNegativeTest-200725683 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 21:10:59.651348 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-c64dd419-5848-431a-ab0c-c7a3bd723539 req-0d0f8e75-0987-417f-bf3d-dbbf14c5308c tempest-VolumesAdminNegativeTest-200725683 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.224s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 21:10:59.652284 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-c64dd419-5848-431a-ab0c-c7a3bd723539 req-0d0f8e75-0987-417f-bf3d-dbbf14c5308c tempest-VolumesAdminNegativeTest-200725683 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-6879f6a0-af86-4af1-af9c-74cd6cfe0c38', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': '6879f6a0-af86-4af1-af9c-74cd6cfe0c38', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 21:10:59.702736 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-c64dd419-5848-431a-ab0c-c7a3bd723539 req-0d0f8e75-0987-417f-bf3d-dbbf14c5308c tempest-VolumesAdminNegativeTest-200725683 None] Connection info returned from driver {'name': 'volumes/volume-6879f6a0-af86-4af1-af9c-74cd6cfe0c38', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '6879f6a0-af86-4af1-af9c-74cd6cfe0c38', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'bfab4598-d4fa-4ff2-b81e-bb7a567720b6'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 25 21:10:59.825508 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-8f3a31bd-8ae2-47cf-ac0a-425c551a52d8 tempest-GroupsTest-171234475 None] Group tempest-Group2-495893292: creating Jun 25 21:10:59.842395 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-c64dd419-5848-431a-ab0c-c7a3bd723539 req-0d0f8e75-0987-417f-bf3d-dbbf14c5308c tempest-VolumesAdminNegativeTest-200725683 None] attachment_update completed successfully. Jun 25 21:10:59.867014 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-8f3a31bd-8ae2-47cf-ac0a-425c551a52d8 tempest-GroupsTest-171234475 None] Group tempest-Group2-495893292: created successfully Jun 25 21:10:59.883412 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-8f3a31bd-8ae2-47cf-ac0a-425c551a52d8 tempest-GroupsTest-171234475 None] Create group completed successfully. Jun 25 21:11:01.545893 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-57225c36-74d2-4a01-9a0d-58010c1ff36c tempest-GroupsTest-171234475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:11:01.572127 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-57225c36-74d2-4a01-9a0d-58010c1ff36c tempest-GroupsTest-171234475 None] Flow 'volume_create_manager' (a18b1f0d-3ab7-4f91-81a3-dd91fd895772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:11:01.579428 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-57225c36-74d2-4a01-9a0d-58010c1ff36c tempest-GroupsTest-171234475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fe4062c-45f4-4bbb-9e2b-e95b1dda4041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:01.600841 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-57225c36-74d2-4a01-9a0d-58010c1ff36c tempest-GroupsTest-171234475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fe4062c-45f4-4bbb-9e2b-e95b1dda4041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1730851853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=06bb6311-8ff2-4ac8-bfa4-b7e68f5a5466,host='ncdv-master-1@ceph#ceph',id=a0e42ecd-8a4f-4e7d-ac53-84d28686f7df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfec02ac6e554fd9a702d0919ae04c39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:11:01Z,use_quota=True,user_id='0f65cf4de88348568ed3ba7f1499b3b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ef34207-3170-4830-9635-5e7c65b43936),volume_type_id=4ef34207-3170-4830-9635-5e7c65b43936)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:01.607223 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-57225c36-74d2-4a01-9a0d-58010c1ff36c tempest-GroupsTest-171234475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3ba3bc1-2f28-43bb-ac03-2419496380be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:01.611374 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-57225c36-74d2-4a01-9a0d-58010c1ff36c tempest-GroupsTest-171234475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3ba3bc1-2f28-43bb-ac03-2419496380be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:01.625829 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-57225c36-74d2-4a01-9a0d-58010c1ff36c tempest-GroupsTest-171234475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57975604-1ad9-49d5-8288-156348fc6a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:01.630252 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-57225c36-74d2-4a01-9a0d-58010c1ff36c tempest-GroupsTest-171234475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57975604-1ad9-49d5-8288-156348fc6a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0e42ecd-8a4f-4e7d-ac53-84d28686f7df', 'volume_name': 'volume-a0e42ecd-8a4f-4e7d-ac53-84d28686f7df', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:01.635648 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-57225c36-74d2-4a01-9a0d-58010c1ff36c tempest-GroupsTest-171234475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7c575da-39de-4f1b-9740-0dd6f3e9b265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:01.640634 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-57225c36-74d2-4a01-9a0d-58010c1ff36c tempest-GroupsTest-171234475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7c575da-39de-4f1b-9740-0dd6f3e9b265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:01.647405 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-57225c36-74d2-4a01-9a0d-58010c1ff36c tempest-GroupsTest-171234475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df9e9307-805e-4451-8fce-ebf178d37a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:01.648678 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-57225c36-74d2-4a01-9a0d-58010c1ff36c tempest-GroupsTest-171234475 None] Volume a0e42ecd-8a4f-4e7d-ac53-84d28686f7df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0e42ecd-8a4f-4e7d-ac53-84d28686f7df', 'volume_size': 1} Jun 25 21:11:01.649261 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-57225c36-74d2-4a01-9a0d-58010c1ff36c tempest-GroupsTest-171234475 None] creating volume 'volume-a0e42ecd-8a4f-4e7d-ac53-84d28686f7df' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:11:01.650419 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-57225c36-74d2-4a01-9a0d-58010c1ff36c tempest-GroupsTest-171234475 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:01.814178 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-57225c36-74d2-4a01-9a0d-58010c1ff36c tempest-GroupsTest-171234475 None] extra_specs: {} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:11:01.814879 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-57225c36-74d2-4a01-9a0d-58010c1ff36c tempest-GroupsTest-171234475 None] extra_specs: {} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:11:01.819494 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-57225c36-74d2-4a01-9a0d-58010c1ff36c tempest-GroupsTest-171234475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df9e9307-805e-4451-8fce-ebf178d37a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0e42ecd-8a4f-4e7d-ac53-84d28686f7df', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:01.834272 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-57225c36-74d2-4a01-9a0d-58010c1ff36c tempest-GroupsTest-171234475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (142d0b91-c4ee-4e65-a3e7-ac890fc912bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:01.858771 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-57225c36-74d2-4a01-9a0d-58010c1ff36c tempest-GroupsTest-171234475 None] Volume volume-a0e42ecd-8a4f-4e7d-ac53-84d28686f7df (a0e42ecd-8a4f-4e7d-ac53-84d28686f7df): created successfully Jun 25 21:11:01.864366 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-57225c36-74d2-4a01-9a0d-58010c1ff36c tempest-GroupsTest-171234475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (142d0b91-c4ee-4e65-a3e7-ac890fc912bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:01.871216 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-57225c36-74d2-4a01-9a0d-58010c1ff36c tempest-GroupsTest-171234475 None] Flow 'volume_create_manager' (a18b1f0d-3ab7-4f91-81a3-dd91fd895772) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:11:01.885135 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-57225c36-74d2-4a01-9a0d-58010c1ff36c tempest-GroupsTest-171234475 None] Created volume successfully. Jun 25 21:11:03.115927 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-7418551d-a531-4907-aaed-6e7565f757d3 tempest-VolumesTransfersTest-1091475715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:11:03.159709 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7418551d-a531-4907-aaed-6e7565f757d3 tempest-VolumesTransfersTest-1091475715 None] Flow 'volume_create_manager' (fec312cf-2a4b-4f68-b7fd-a454d4e912a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:11:03.183241 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7418551d-a531-4907-aaed-6e7565f757d3 tempest-VolumesTransfersTest-1091475715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5967eeb8-7fff-483a-b06a-d1190a492cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:03.206986 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7418551d-a531-4907-aaed-6e7565f757d3 tempest-VolumesTransfersTest-1091475715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5967eeb8-7fff-483a-b06a-d1190a492cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1985155443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8e0b2a7e-06d5-4d64-8b85-9e5a63ac4bab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f90af973311a4475b9fc523b3ec4f4b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:11:03Z,use_quota=True,user_id='7659a4ff473e46b0998b6aaf236f72b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:03.213277 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7418551d-a531-4907-aaed-6e7565f757d3 tempest-VolumesTransfersTest-1091475715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1bb6478-3993-40d6-9e04-57845d70241f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:03.217344 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7418551d-a531-4907-aaed-6e7565f757d3 tempest-VolumesTransfersTest-1091475715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1bb6478-3993-40d6-9e04-57845d70241f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:03.222576 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7418551d-a531-4907-aaed-6e7565f757d3 tempest-VolumesTransfersTest-1091475715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19094648-d2b8-428a-b2d4-badb24836ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:03.226785 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7418551d-a531-4907-aaed-6e7565f757d3 tempest-VolumesTransfersTest-1091475715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19094648-d2b8-428a-b2d4-badb24836ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e0b2a7e-06d5-4d64-8b85-9e5a63ac4bab', 'volume_name': 'volume-8e0b2a7e-06d5-4d64-8b85-9e5a63ac4bab', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:03.231845 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7418551d-a531-4907-aaed-6e7565f757d3 tempest-VolumesTransfersTest-1091475715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (151cc44d-c604-4d35-8c70-fc5b1c4328dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:03.236406 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7418551d-a531-4907-aaed-6e7565f757d3 tempest-VolumesTransfersTest-1091475715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (151cc44d-c604-4d35-8c70-fc5b1c4328dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:03.241069 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7418551d-a531-4907-aaed-6e7565f757d3 tempest-VolumesTransfersTest-1091475715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (234f2fd0-44f8-468a-9a9d-96c70ecad9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:03.242200 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-7418551d-a531-4907-aaed-6e7565f757d3 tempest-VolumesTransfersTest-1091475715 None] Volume 8e0b2a7e-06d5-4d64-8b85-9e5a63ac4bab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e0b2a7e-06d5-4d64-8b85-9e5a63ac4bab', 'volume_size': 1} Jun 25 21:11:03.249046 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7418551d-a531-4907-aaed-6e7565f757d3 tempest-VolumesTransfersTest-1091475715 None] creating volume 'volume-8e0b2a7e-06d5-4d64-8b85-9e5a63ac4bab' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:11:03.250881 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7418551d-a531-4907-aaed-6e7565f757d3 tempest-VolumesTransfersTest-1091475715 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:03.346604 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7418551d-a531-4907-aaed-6e7565f757d3 tempest-VolumesTransfersTest-1091475715 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:11:03.347101 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7418551d-a531-4907-aaed-6e7565f757d3 tempest-VolumesTransfersTest-1091475715 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:11:03.352889 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7418551d-a531-4907-aaed-6e7565f757d3 tempest-VolumesTransfersTest-1091475715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (234f2fd0-44f8-468a-9a9d-96c70ecad9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e0b2a7e-06d5-4d64-8b85-9e5a63ac4bab', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:03.360883 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7418551d-a531-4907-aaed-6e7565f757d3 tempest-VolumesTransfersTest-1091475715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed27b483-fa8f-45c5-a1d5-0919a4618131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:03.387428 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-7418551d-a531-4907-aaed-6e7565f757d3 tempest-VolumesTransfersTest-1091475715 None] Volume volume-8e0b2a7e-06d5-4d64-8b85-9e5a63ac4bab (8e0b2a7e-06d5-4d64-8b85-9e5a63ac4bab): created successfully Jun 25 21:11:03.393353 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7418551d-a531-4907-aaed-6e7565f757d3 tempest-VolumesTransfersTest-1091475715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed27b483-fa8f-45c5-a1d5-0919a4618131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:03.401970 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7418551d-a531-4907-aaed-6e7565f757d3 tempest-VolumesTransfersTest-1091475715 None] Flow 'volume_create_manager' (fec312cf-2a4b-4f68-b7fd-a454d4e912a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:11:03.423681 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-7418551d-a531-4907-aaed-6e7565f757d3 tempest-VolumesTransfersTest-1091475715 None] Created volume successfully. Jun 25 21:11:03.448008 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1621e766-097b-4cf7-a89f-fb5f00906dbc tempest-GroupsTest-171234475 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:03.520948 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1621e766-097b-4cf7-a89f-fb5f00906dbc tempest-GroupsTest-171234475 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:11:03.521369 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1621e766-097b-4cf7-a89f-fb5f00906dbc tempest-GroupsTest-171234475 None] Volume volume-a0e42ecd-8a4f-4e7d-ac53-84d28686f7df is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:11:03.530414 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1621e766-097b-4cf7-a89f-fb5f00906dbc tempest-GroupsTest-171234475 None] deleting rbd volume volume-a0e42ecd-8a4f-4e7d-ac53-84d28686f7df {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:11:03.546622 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-99dcbb88-4135-4019-bb78-ccf72e80559b req-85be06a0-1831-4315-a8f1-eb2e1407f40e tempest-VolumesAdminNegativeTest-200725683 None] Terminate volume connection completed successfully. Jun 25 21:11:03.547083 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-99dcbb88-4135-4019-bb78-ccf72e80559b req-85be06a0-1831-4315-a8f1-eb2e1407f40e tempest-VolumesAdminNegativeTest-200725683 None] Deleting attachment bfab4598-d4fa-4ff2-b81e-bb7a567720b6. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 25 21:11:03.875419 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-1621e766-097b-4cf7-a89f-fb5f00906dbc tempest-GroupsTest-171234475 None] Created reservations ['9d751773-4d66-4bed-b86c-415f1957c935'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:11:03.881313 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=63,cinder:UPDATE=29,cinder:DELETE=3,cinder:INSERT=5 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:03.923813 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-1621e766-097b-4cf7-a89f-fb5f00906dbc tempest-GroupsTest-171234475 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-146974291 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-146974291, it is now deprecated. Please use the default quota class for default quota. Jun 25 21:11:03.925128 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-1621e766-097b-4cf7-a89f-fb5f00906dbc tempest-GroupsTest-171234475 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-146974291 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-146974291, it is now deprecated. Please use the default quota class for default quota. Jun 25 21:11:03.972038 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-1621e766-097b-4cf7-a89f-fb5f00906dbc tempest-GroupsTest-171234475 None] Created reservations ['f44e62b5-0f19-448d-8059-137cc32a6721', '7da03634-42fa-454c-8860-07ed9f4ad789', '682585e0-2f13-4ec5-93c8-a9c66e5070cc', '278c2376-3b14-4688-906c-987d2e724c04'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:11:04.150550 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1621e766-097b-4cf7-a89f-fb5f00906dbc tempest-GroupsTest-171234475 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:04.234011 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1621e766-097b-4cf7-a89f-fb5f00906dbc tempest-GroupsTest-171234475 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:04.304988 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-1621e766-097b-4cf7-a89f-fb5f00906dbc tempest-GroupsTest-171234475 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:11:04.312056 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-1621e766-097b-4cf7-a89f-fb5f00906dbc tempest-GroupsTest-171234475 None] Delete group completed successfully. Jun 25 21:11:04.583980 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=73,cinder:UPDATE=24,cinder:DELETE=1,cinder:INSERT=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:04.615527 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-efbafb17-c4c6-40c6-86c1-b5455c69483c tempest-GroupsTest-171234475 None] Created reservations ['e2922730-c9ee-497c-bc9a-094340121aca'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:11:04.654788 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-efbafb17-c4c6-40c6-86c1-b5455c69483c tempest-GroupsTest-171234475 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:04.695959 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-efbafb17-c4c6-40c6-86c1-b5455c69483c tempest-GroupsTest-171234475 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:04.731695 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-efbafb17-c4c6-40c6-86c1-b5455c69483c tempest-GroupsTest-171234475 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:11:04.736977 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-efbafb17-c4c6-40c6-86c1-b5455c69483c tempest-GroupsTest-171234475 None] Delete group completed successfully. Jun 25 21:11:04.824720 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-dac25e3e-5e01-4b00-a4ae-32b19d84bf54 tempest-VolumesTransfersTest-525139849 None] Transfer volume completed successfully. Jun 25 21:11:05.243542 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-72ff01c8-608d-4d7d-9471-573b082861cc tempest-VolumesTransfersTest-1683911995 None] Lock "b'cinder-8e0b2a7e-06d5-4d64-8b85-9e5a63ac4bab-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:11:05.286829 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-72ff01c8-608d-4d7d-9471-573b082861cc tempest-VolumesTransfersTest-1683911995 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:05.358177 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-72ff01c8-608d-4d7d-9471-573b082861cc tempest-VolumesTransfersTest-1683911995 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:11:05.358612 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-72ff01c8-608d-4d7d-9471-573b082861cc tempest-VolumesTransfersTest-1683911995 None] Volume volume-8e0b2a7e-06d5-4d64-8b85-9e5a63ac4bab is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:11:05.364279 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-72ff01c8-608d-4d7d-9471-573b082861cc tempest-VolumesTransfersTest-1683911995 None] deleting rbd volume volume-8e0b2a7e-06d5-4d64-8b85-9e5a63ac4bab {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:11:05.640688 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-72ff01c8-608d-4d7d-9471-573b082861cc tempest-VolumesTransfersTest-1683911995 None] Created reservations ['92b8c282-ebf7-4d56-81bc-013f71b45e4a', 'eab91cfb-04aa-4fb0-8671-ecb1dd065e5f', '7b1ab6a6-2385-4585-87fa-4ced7552c2fc', '2cf8ab10-175b-4c50-ae2f-817694419ffe'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:11:05.716806 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-72ff01c8-608d-4d7d-9471-573b082861cc tempest-VolumesTransfersTest-1683911995 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:05.789690 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-72ff01c8-608d-4d7d-9471-573b082861cc tempest-VolumesTransfersTest-1683911995 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:05.848189 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-72ff01c8-608d-4d7d-9471-573b082861cc tempest-VolumesTransfersTest-1683911995 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:11:05.860272 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-72ff01c8-608d-4d7d-9471-573b082861cc tempest-VolumesTransfersTest-1683911995 None] Deleted volume successfully. Jun 25 21:11:05.881429 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-1923fbb2-25e3-4a70-a22f-767f2673fa74 tempest-AttachVolumeTestJSON-931041757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:11:05.904466 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1923fbb2-25e3-4a70-a22f-767f2673fa74 tempest-AttachVolumeTestJSON-931041757 None] Flow 'volume_create_manager' (494a68a3-6846-4fae-b99b-1e400229bbd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:11:05.911577 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1923fbb2-25e3-4a70-a22f-767f2673fa74 tempest-AttachVolumeTestJSON-931041757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6176fc73-e941-41a0-9cac-edc50de51c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:05.917023 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-72ff01c8-608d-4d7d-9471-573b082861cc tempest-VolumesTransfersTest-1683911995 None] Lock "b'cinder-8e0b2a7e-06d5-4d64-8b85-9e5a63ac4bab-delete_volume'" released by "delete_volume" :: held 0.674s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:11:05.932340 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1923fbb2-25e3-4a70-a22f-767f2673fa74 tempest-AttachVolumeTestJSON-931041757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6176fc73-e941-41a0-9cac-edc50de51c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-514263183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d3c85d3e-4e4f-43ae-8178-accc09ce263b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5b521724c3d49069bb1aa8c2428b75c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:11:06Z,use_quota=True,user_id='6bcfb45bd9404205aefe7d1d2b33cd25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:05.941844 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1923fbb2-25e3-4a70-a22f-767f2673fa74 tempest-AttachVolumeTestJSON-931041757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe0753b7-3b81-458e-8ddc-6c4215046e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:05.943206 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1923fbb2-25e3-4a70-a22f-767f2673fa74 tempest-AttachVolumeTestJSON-931041757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe0753b7-3b81-458e-8ddc-6c4215046e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:05.949206 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1923fbb2-25e3-4a70-a22f-767f2673fa74 tempest-AttachVolumeTestJSON-931041757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ea8b564-16de-4efe-83f2-0e1d92e7cdc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:05.953828 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1923fbb2-25e3-4a70-a22f-767f2673fa74 tempest-AttachVolumeTestJSON-931041757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ea8b564-16de-4efe-83f2-0e1d92e7cdc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3c85d3e-4e4f-43ae-8178-accc09ce263b', 'volume_name': 'volume-d3c85d3e-4e4f-43ae-8178-accc09ce263b', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:05.959394 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1923fbb2-25e3-4a70-a22f-767f2673fa74 tempest-AttachVolumeTestJSON-931041757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91b157d2-c153-4b0b-b0ae-327502f85ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:05.964467 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1923fbb2-25e3-4a70-a22f-767f2673fa74 tempest-AttachVolumeTestJSON-931041757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91b157d2-c153-4b0b-b0ae-327502f85ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:05.970561 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1923fbb2-25e3-4a70-a22f-767f2673fa74 tempest-AttachVolumeTestJSON-931041757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86a818d2-6262-4ed2-bed4-ea47258b5f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:05.971480 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-1923fbb2-25e3-4a70-a22f-767f2673fa74 tempest-AttachVolumeTestJSON-931041757 None] Volume d3c85d3e-4e4f-43ae-8178-accc09ce263b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3c85d3e-4e4f-43ae-8178-accc09ce263b', 'volume_size': 1} Jun 25 21:11:05.971880 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1923fbb2-25e3-4a70-a22f-767f2673fa74 tempest-AttachVolumeTestJSON-931041757 None] creating volume 'volume-d3c85d3e-4e4f-43ae-8178-accc09ce263b' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:11:05.972941 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1923fbb2-25e3-4a70-a22f-767f2673fa74 tempest-AttachVolumeTestJSON-931041757 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:06.067975 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1923fbb2-25e3-4a70-a22f-767f2673fa74 tempest-AttachVolumeTestJSON-931041757 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:11:06.069454 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1923fbb2-25e3-4a70-a22f-767f2673fa74 tempest-AttachVolumeTestJSON-931041757 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:11:06.076806 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1923fbb2-25e3-4a70-a22f-767f2673fa74 tempest-AttachVolumeTestJSON-931041757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86a818d2-6262-4ed2-bed4-ea47258b5f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3c85d3e-4e4f-43ae-8178-accc09ce263b', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:06.095551 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1923fbb2-25e3-4a70-a22f-767f2673fa74 tempest-AttachVolumeTestJSON-931041757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d286d70f-9fc1-4977-9ea7-43fb784fbd71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:06.123510 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-1923fbb2-25e3-4a70-a22f-767f2673fa74 tempest-AttachVolumeTestJSON-931041757 None] Volume volume-d3c85d3e-4e4f-43ae-8178-accc09ce263b (d3c85d3e-4e4f-43ae-8178-accc09ce263b): created successfully Jun 25 21:11:06.143901 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1923fbb2-25e3-4a70-a22f-767f2673fa74 tempest-AttachVolumeTestJSON-931041757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d286d70f-9fc1-4977-9ea7-43fb784fbd71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:06.155737 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1923fbb2-25e3-4a70-a22f-767f2673fa74 tempest-AttachVolumeTestJSON-931041757 None] Flow 'volume_create_manager' (494a68a3-6846-4fae-b99b-1e400229bbd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:11:06.180064 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-1923fbb2-25e3-4a70-a22f-767f2673fa74 tempest-AttachVolumeTestJSON-931041757 None] Created volume successfully. Jun 25 21:11:06.503856 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-4d0758fe-cadf-4f8c-8ba6-6b0163081627 tempest-GroupsTest-171234475 None] Group tempest-GroupsTest-Group-1392689709: creating Jun 25 21:11:06.560247 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-4d0758fe-cadf-4f8c-8ba6-6b0163081627 tempest-GroupsTest-171234475 None] Group tempest-GroupsTest-Group-1392689709: created successfully Jun 25 21:11:06.614013 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-4d0758fe-cadf-4f8c-8ba6-6b0163081627 tempest-GroupsTest-171234475 None] Create group completed successfully. Jun 25 21:11:07.230817 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d1a9b3e-a233-4e00-acd2-4c62e275f9f9 tempest-VolumesTransfersTest-1091475715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:11:07.295680 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2d1a9b3e-a233-4e00-acd2-4c62e275f9f9 tempest-VolumesTransfersTest-1091475715 None] Flow 'volume_create_manager' (135dc974-7cec-45cc-a13d-b5b5fffed10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:11:07.304413 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2d1a9b3e-a233-4e00-acd2-4c62e275f9f9 tempest-VolumesTransfersTest-1091475715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23ff905a-b32e-429b-9019-102556baf8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:07.328089 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2d1a9b3e-a233-4e00-acd2-4c62e275f9f9 tempest-VolumesTransfersTest-1091475715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23ff905a-b32e-429b-9019-102556baf8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-747346358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5055e1ab-3d0d-4707-aa1a-7279ac551bfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f90af973311a4475b9fc523b3ec4f4b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:11:07Z,use_quota=True,user_id='7659a4ff473e46b0998b6aaf236f72b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:07.335496 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2d1a9b3e-a233-4e00-acd2-4c62e275f9f9 tempest-VolumesTransfersTest-1091475715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c36c4cde-f797-44ff-bdb6-9550b699c86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:07.340497 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2d1a9b3e-a233-4e00-acd2-4c62e275f9f9 tempest-VolumesTransfersTest-1091475715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c36c4cde-f797-44ff-bdb6-9550b699c86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:07.346880 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2d1a9b3e-a233-4e00-acd2-4c62e275f9f9 tempest-VolumesTransfersTest-1091475715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33f766ff-d174-46e8-9f3b-da5e47c50b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:07.352747 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2d1a9b3e-a233-4e00-acd2-4c62e275f9f9 tempest-VolumesTransfersTest-1091475715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33f766ff-d174-46e8-9f3b-da5e47c50b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5055e1ab-3d0d-4707-aa1a-7279ac551bfd', 'volume_name': 'volume-5055e1ab-3d0d-4707-aa1a-7279ac551bfd', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:07.358396 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2d1a9b3e-a233-4e00-acd2-4c62e275f9f9 tempest-VolumesTransfersTest-1091475715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60419867-c1df-455c-ab13-212d03849b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:07.363009 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2d1a9b3e-a233-4e00-acd2-4c62e275f9f9 tempest-VolumesTransfersTest-1091475715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60419867-c1df-455c-ab13-212d03849b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:07.369485 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2d1a9b3e-a233-4e00-acd2-4c62e275f9f9 tempest-VolumesTransfersTest-1091475715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3d0589b-70d2-42ef-aeb6-13ab8b33f921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:07.371019 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-2d1a9b3e-a233-4e00-acd2-4c62e275f9f9 tempest-VolumesTransfersTest-1091475715 None] Volume 5055e1ab-3d0d-4707-aa1a-7279ac551bfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5055e1ab-3d0d-4707-aa1a-7279ac551bfd', 'volume_size': 1} Jun 25 21:11:07.371616 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2d1a9b3e-a233-4e00-acd2-4c62e275f9f9 tempest-VolumesTransfersTest-1091475715 None] creating volume 'volume-5055e1ab-3d0d-4707-aa1a-7279ac551bfd' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:11:07.372525 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2d1a9b3e-a233-4e00-acd2-4c62e275f9f9 tempest-VolumesTransfersTest-1091475715 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:07.523407 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2d1a9b3e-a233-4e00-acd2-4c62e275f9f9 tempest-VolumesTransfersTest-1091475715 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:11:07.525662 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2d1a9b3e-a233-4e00-acd2-4c62e275f9f9 tempest-VolumesTransfersTest-1091475715 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:11:07.536994 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2d1a9b3e-a233-4e00-acd2-4c62e275f9f9 tempest-VolumesTransfersTest-1091475715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3d0589b-70d2-42ef-aeb6-13ab8b33f921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5055e1ab-3d0d-4707-aa1a-7279ac551bfd', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:07.548149 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2d1a9b3e-a233-4e00-acd2-4c62e275f9f9 tempest-VolumesTransfersTest-1091475715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bdabe61-0a7a-44aa-a117-0edbd17f0f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:07.614305 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-2d1a9b3e-a233-4e00-acd2-4c62e275f9f9 tempest-VolumesTransfersTest-1091475715 None] Volume volume-5055e1ab-3d0d-4707-aa1a-7279ac551bfd (5055e1ab-3d0d-4707-aa1a-7279ac551bfd): created successfully Jun 25 21:11:07.619089 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2d1a9b3e-a233-4e00-acd2-4c62e275f9f9 tempest-VolumesTransfersTest-1091475715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bdabe61-0a7a-44aa-a117-0edbd17f0f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:07.630752 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2d1a9b3e-a233-4e00-acd2-4c62e275f9f9 tempest-VolumesTransfersTest-1091475715 None] Flow 'volume_create_manager' (135dc974-7cec-45cc-a13d-b5b5fffed10d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:11:07.652133 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-2d1a9b3e-a233-4e00-acd2-4c62e275f9f9 tempest-VolumesTransfersTest-1091475715 None] Created volume successfully. Jun 25 21:11:08.062864 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-04909523-6bcf-4cb5-9058-dae81f25dd9f req-3efe6662-e9df-49d9-9bee-f249263d0b33 tempest-AttachVolumeTestJSON-931041757 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 21:11:08.515074 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-03771b2e-fa23-4246-a737-550f1a9b6657 tempest-GroupsTest-171234475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:11:08.608874 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-03771b2e-fa23-4246-a737-550f1a9b6657 tempest-GroupsTest-171234475 None] Flow 'volume_create_manager' (06d8840f-4e93-404f-9c76-eeb667130b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:11:08.632571 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-03771b2e-fa23-4246-a737-550f1a9b6657 tempest-GroupsTest-171234475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb6b439b-6800-41a8-8fda-9f4b08390d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:08.688665 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-03771b2e-fa23-4246-a737-550f1a9b6657 tempest-GroupsTest-171234475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb6b439b-6800-41a8-8fda-9f4b08390d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:11:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-27446915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5cd367e2-d4d0-437a-85fc-598a068f35b6,host='ncdv-master-1@ceph#ceph',id=7dd38d2f-6fea-40d5-88af-fd31ecacbc72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfec02ac6e554fd9a702d0919ae04c39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:11:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:11:08Z,use_quota=True,user_id='0f65cf4de88348568ed3ba7f1499b3b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3878297-c0c0-477f-9637-5e5d29ae80ae),volume_type_id=f3878297-c0c0-477f-9637-5e5d29ae80ae)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:08.713122 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-03771b2e-fa23-4246-a737-550f1a9b6657 tempest-GroupsTest-171234475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34064a12-8921-4355-9b01-42c500c9ae8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:08.717935 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-03771b2e-fa23-4246-a737-550f1a9b6657 tempest-GroupsTest-171234475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34064a12-8921-4355-9b01-42c500c9ae8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:08.723354 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-03771b2e-fa23-4246-a737-550f1a9b6657 tempest-GroupsTest-171234475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14cc32d0-138f-48f2-968c-f6227921097f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:08.738413 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-03771b2e-fa23-4246-a737-550f1a9b6657 tempest-GroupsTest-171234475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14cc32d0-138f-48f2-968c-f6227921097f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dd38d2f-6fea-40d5-88af-fd31ecacbc72', 'volume_name': 'volume-7dd38d2f-6fea-40d5-88af-fd31ecacbc72', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:08.753423 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-03771b2e-fa23-4246-a737-550f1a9b6657 tempest-GroupsTest-171234475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc5e7cc7-01ee-46e8-9929-408995f28bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:08.776875 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-03771b2e-fa23-4246-a737-550f1a9b6657 tempest-GroupsTest-171234475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc5e7cc7-01ee-46e8-9929-408995f28bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:08.788368 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-03771b2e-fa23-4246-a737-550f1a9b6657 tempest-GroupsTest-171234475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c61bad5c-2977-4d7d-930e-d85dd6128bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:08.789702 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-03771b2e-fa23-4246-a737-550f1a9b6657 tempest-GroupsTest-171234475 None] Volume 7dd38d2f-6fea-40d5-88af-fd31ecacbc72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dd38d2f-6fea-40d5-88af-fd31ecacbc72', 'volume_size': 1} Jun 25 21:11:08.808128 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-03771b2e-fa23-4246-a737-550f1a9b6657 tempest-GroupsTest-171234475 None] creating volume 'volume-7dd38d2f-6fea-40d5-88af-fd31ecacbc72' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:11:08.809215 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-03771b2e-fa23-4246-a737-550f1a9b6657 tempest-GroupsTest-171234475 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:08.986686 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-03771b2e-fa23-4246-a737-550f1a9b6657 tempest-GroupsTest-171234475 None] extra_specs: {} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:11:08.987439 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-03771b2e-fa23-4246-a737-550f1a9b6657 tempest-GroupsTest-171234475 None] extra_specs: {} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:11:08.996405 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-03771b2e-fa23-4246-a737-550f1a9b6657 tempest-GroupsTest-171234475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c61bad5c-2977-4d7d-930e-d85dd6128bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dd38d2f-6fea-40d5-88af-fd31ecacbc72', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:09.004622 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-03771b2e-fa23-4246-a737-550f1a9b6657 tempest-GroupsTest-171234475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb4b62cd-b8f7-40d1-87ec-b98df8a0e851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:09.019356 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-03771b2e-fa23-4246-a737-550f1a9b6657 tempest-GroupsTest-171234475 None] Volume volume-7dd38d2f-6fea-40d5-88af-fd31ecacbc72 (7dd38d2f-6fea-40d5-88af-fd31ecacbc72): created successfully Jun 25 21:11:09.025833 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-03771b2e-fa23-4246-a737-550f1a9b6657 tempest-GroupsTest-171234475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb4b62cd-b8f7-40d1-87ec-b98df8a0e851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:09.035110 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-03771b2e-fa23-4246-a737-550f1a9b6657 tempest-GroupsTest-171234475 None] Flow 'volume_create_manager' (06d8840f-4e93-404f-9c76-eeb667130b01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:11:09.049101 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-03771b2e-fa23-4246-a737-550f1a9b6657 tempest-GroupsTest-171234475 None] Created volume successfully. Jun 25 21:11:09.128062 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-ca4820b8-d932-4b50-ba1f-b6610a569b4c tempest-VolumesTransfersTest-1683911995 None] Lock "b'cinder-5055e1ab-3d0d-4707-aa1a-7279ac551bfd-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:11:09.214064 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ca4820b8-d932-4b50-ba1f-b6610a569b4c tempest-VolumesTransfersTest-1683911995 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:09.358401 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ca4820b8-d932-4b50-ba1f-b6610a569b4c tempest-VolumesTransfersTest-1683911995 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:11:09.359156 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ca4820b8-d932-4b50-ba1f-b6610a569b4c tempest-VolumesTransfersTest-1683911995 None] Volume volume-5055e1ab-3d0d-4707-aa1a-7279ac551bfd is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:11:09.373896 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ca4820b8-d932-4b50-ba1f-b6610a569b4c tempest-VolumesTransfersTest-1683911995 None] deleting rbd volume volume-5055e1ab-3d0d-4707-aa1a-7279ac551bfd {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:11:09.964337 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-ca4820b8-d932-4b50-ba1f-b6610a569b4c tempest-VolumesTransfersTest-1683911995 None] Created reservations ['54e5bec2-fca6-4e31-8d10-318eb4332fa0', '7cb70414-5e37-4bf1-864f-7355adf5d3a8', '9adc4bbf-fe0a-49a8-b224-56f7b337e58b', 'b03549cc-9e28-46e7-97dd-24267c85def8'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:11:10.179295 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ca4820b8-d932-4b50-ba1f-b6610a569b4c tempest-VolumesTransfersTest-1683911995 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:10.297068 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ca4820b8-d932-4b50-ba1f-b6610a569b4c tempest-VolumesTransfersTest-1683911995 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:10.355258 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-ca4820b8-d932-4b50-ba1f-b6610a569b4c tempest-VolumesTransfersTest-1683911995 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:11:10.360245 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-04909523-6bcf-4cb5-9058-dae81f25dd9f req-3efe6662-e9df-49d9-9bee-f249263d0b33 tempest-AttachVolumeTestJSON-931041757 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 2.298s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 21:11:10.361714 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-04909523-6bcf-4cb5-9058-dae81f25dd9f req-3efe6662-e9df-49d9-9bee-f249263d0b33 tempest-AttachVolumeTestJSON-931041757 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d3c85d3e-4e4f-43ae-8178-accc09ce263b', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': 'd3c85d3e-4e4f-43ae-8178-accc09ce263b', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 21:11:10.366110 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-ca4820b8-d932-4b50-ba1f-b6610a569b4c tempest-VolumesTransfersTest-1683911995 None] Deleted volume successfully. Jun 25 21:11:10.414399 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-ca4820b8-d932-4b50-ba1f-b6610a569b4c tempest-VolumesTransfersTest-1683911995 None] Lock "b'cinder-5055e1ab-3d0d-4707-aa1a-7279ac551bfd-delete_volume'" released by "delete_volume" :: held 1.287s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:11:10.417191 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-04909523-6bcf-4cb5-9058-dae81f25dd9f req-3efe6662-e9df-49d9-9bee-f249263d0b33 tempest-AttachVolumeTestJSON-931041757 None] Connection info returned from driver {'name': 'volumes/volume-d3c85d3e-4e4f-43ae-8178-accc09ce263b', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd3c85d3e-4e4f-43ae-8178-accc09ce263b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b068a5d8-684e-4b56-aad2-c3864774a718'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 25 21:11:10.443494 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:INSERT=5,cinder:UPDATE=35,cinder:SELECT=57,cinder:DELETE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:10.529399 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-06d1ccda-93c9-4257-88a8-d69a0192302f tempest-GroupsTest-171234475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:11:10.639232 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-06d1ccda-93c9-4257-88a8-d69a0192302f tempest-GroupsTest-171234475 None] Flow 'volume_create_manager' (2530003f-a35d-44c0-a6e6-f108765e25b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:11:10.667742 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-06d1ccda-93c9-4257-88a8-d69a0192302f tempest-GroupsTest-171234475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (853e3e47-5d7c-4382-8bb9-a52b2d3b6ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:10.725593 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-06d1ccda-93c9-4257-88a8-d69a0192302f tempest-GroupsTest-171234475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (853e3e47-5d7c-4382-8bb9-a52b2d3b6ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:11:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-1142704411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5cd367e2-d4d0-437a-85fc-598a068f35b6,host='ncdv-master-1@ceph#ceph',id=8b15908a-2295-418c-b60f-419b6445aff3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfec02ac6e554fd9a702d0919ae04c39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:11:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:11:10Z,use_quota=True,user_id='0f65cf4de88348568ed3ba7f1499b3b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3878297-c0c0-477f-9637-5e5d29ae80ae),volume_type_id=f3878297-c0c0-477f-9637-5e5d29ae80ae)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:10.748031 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-06d1ccda-93c9-4257-88a8-d69a0192302f tempest-GroupsTest-171234475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdf42f60-b793-4689-8104-fdee5e32c22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:10.765825 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-06d1ccda-93c9-4257-88a8-d69a0192302f tempest-GroupsTest-171234475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdf42f60-b793-4689-8104-fdee5e32c22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:10.784224 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-06d1ccda-93c9-4257-88a8-d69a0192302f tempest-GroupsTest-171234475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71dba7c1-0a05-43d5-82b2-3755f5391d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:10.795315 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-06d1ccda-93c9-4257-88a8-d69a0192302f tempest-GroupsTest-171234475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71dba7c1-0a05-43d5-82b2-3755f5391d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b15908a-2295-418c-b60f-419b6445aff3', 'volume_name': 'volume-8b15908a-2295-418c-b60f-419b6445aff3', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:10.810166 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-06d1ccda-93c9-4257-88a8-d69a0192302f tempest-GroupsTest-171234475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50379690-2ced-4336-9901-6325bcce379b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:10.822558 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-06d1ccda-93c9-4257-88a8-d69a0192302f tempest-GroupsTest-171234475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50379690-2ced-4336-9901-6325bcce379b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:10.838177 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-06d1ccda-93c9-4257-88a8-d69a0192302f tempest-GroupsTest-171234475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72acc340-0ef5-44aa-a915-63c8e540cbd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:10.845654 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-06d1ccda-93c9-4257-88a8-d69a0192302f tempest-GroupsTest-171234475 None] Volume 8b15908a-2295-418c-b60f-419b6445aff3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b15908a-2295-418c-b60f-419b6445aff3', 'volume_size': 1} Jun 25 21:11:10.847491 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-06d1ccda-93c9-4257-88a8-d69a0192302f tempest-GroupsTest-171234475 None] creating volume 'volume-8b15908a-2295-418c-b60f-419b6445aff3' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:11:10.855743 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-06d1ccda-93c9-4257-88a8-d69a0192302f tempest-GroupsTest-171234475 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:10.933267 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-04909523-6bcf-4cb5-9058-dae81f25dd9f req-3efe6662-e9df-49d9-9bee-f249263d0b33 tempest-AttachVolumeTestJSON-931041757 None] attachment_update completed successfully. Jun 25 21:11:11.017046 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-06d1ccda-93c9-4257-88a8-d69a0192302f tempest-GroupsTest-171234475 None] extra_specs: {} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:11:11.019118 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-06d1ccda-93c9-4257-88a8-d69a0192302f tempest-GroupsTest-171234475 None] extra_specs: {} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:11:11.025339 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-06d1ccda-93c9-4257-88a8-d69a0192302f tempest-GroupsTest-171234475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72acc340-0ef5-44aa-a915-63c8e540cbd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b15908a-2295-418c-b60f-419b6445aff3', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:11.033762 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-06d1ccda-93c9-4257-88a8-d69a0192302f tempest-GroupsTest-171234475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (309e89cc-b358-4281-a7a1-28fbb196b23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:11.072764 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-06d1ccda-93c9-4257-88a8-d69a0192302f tempest-GroupsTest-171234475 None] Volume volume-8b15908a-2295-418c-b60f-419b6445aff3 (8b15908a-2295-418c-b60f-419b6445aff3): created successfully Jun 25 21:11:11.080743 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-06d1ccda-93c9-4257-88a8-d69a0192302f tempest-GroupsTest-171234475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (309e89cc-b358-4281-a7a1-28fbb196b23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:11.089689 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-06d1ccda-93c9-4257-88a8-d69a0192302f tempest-GroupsTest-171234475 None] Flow 'volume_create_manager' (2530003f-a35d-44c0-a6e6-f108765e25b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:11:11.110819 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-06d1ccda-93c9-4257-88a8-d69a0192302f tempest-GroupsTest-171234475 None] Created volume successfully. Jun 25 21:11:12.181340 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:UPDATE=28,cinder:SELECT=64,cinder:INSERT=6,cinder:DELETE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:12.217505 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-fe1122cc-b211-4c7c-8cae-f7b9c8cc62e0 tempest-GroupsTest-171234475 None] Update group completed successfully. Jun 25 21:11:13.664770 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-d7c53b3d-6422-46ef-9987-478145c7b542 tempest-GroupsTest-171234475 None] Update group completed successfully. Jun 25 21:11:15.403518 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3c70a8eb-e1ac-4163-a7ad-d0314da04108 tempest-GroupsTest-171234475 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:15.472165 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3c70a8eb-e1ac-4163-a7ad-d0314da04108 tempest-GroupsTest-171234475 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:11:15.472914 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3c70a8eb-e1ac-4163-a7ad-d0314da04108 tempest-GroupsTest-171234475 None] Volume volume-7dd38d2f-6fea-40d5-88af-fd31ecacbc72 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:11:15.506485 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3c70a8eb-e1ac-4163-a7ad-d0314da04108 tempest-GroupsTest-171234475 None] deleting rbd volume volume-7dd38d2f-6fea-40d5-88af-fd31ecacbc72 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:11:15.892163 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3c70a8eb-e1ac-4163-a7ad-d0314da04108 tempest-GroupsTest-171234475 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:16.022557 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3c70a8eb-e1ac-4163-a7ad-d0314da04108 tempest-GroupsTest-171234475 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:11:16.022971 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3c70a8eb-e1ac-4163-a7ad-d0314da04108 tempest-GroupsTest-171234475 None] Volume volume-8b15908a-2295-418c-b60f-419b6445aff3 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:11:16.046986 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3c70a8eb-e1ac-4163-a7ad-d0314da04108 tempest-GroupsTest-171234475 None] deleting rbd volume volume-8b15908a-2295-418c-b60f-419b6445aff3 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:11:16.485523 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-3c70a8eb-e1ac-4163-a7ad-d0314da04108 tempest-GroupsTest-171234475 None] Created reservations ['210426ae-9fd0-470f-b50d-475d7d56806c'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:11:16.528113 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-3c70a8eb-e1ac-4163-a7ad-d0314da04108 tempest-GroupsTest-171234475 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1284628317 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1284628317, it is now deprecated. Please use the default quota class for default quota. Jun 25 21:11:16.529115 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-3c70a8eb-e1ac-4163-a7ad-d0314da04108 tempest-GroupsTest-171234475 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1284628317 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1284628317, it is now deprecated. Please use the default quota class for default quota. Jun 25 21:11:16.557003 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-3c70a8eb-e1ac-4163-a7ad-d0314da04108 tempest-GroupsTest-171234475 None] Created reservations ['bb84e032-01be-41c6-9999-4fd387df2ef0', '4621842f-e137-4528-a1a5-1fb79d162cbf', 'f018520a-e843-4348-a35a-f67e286e61fc', 'd5ed306e-00fe-4dc4-b962-4204a27d650f'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:11:16.800135 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-3c70a8eb-e1ac-4163-a7ad-d0314da04108 tempest-GroupsTest-171234475 None] Created reservations ['caf43a32-7942-48a8-a6fa-01fc372b5bc9', 'c306650a-4830-4427-b615-700e6c9188f9', '08b98ede-b978-44c9-a16c-07ec5cc810be', '3c54d045-e51a-4786-8c5d-b023db2d5455'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:11:16.989288 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3c70a8eb-e1ac-4163-a7ad-d0314da04108 tempest-GroupsTest-171234475 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:17.092905 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3c70a8eb-e1ac-4163-a7ad-d0314da04108 tempest-GroupsTest-171234475 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:17.170608 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-3c70a8eb-e1ac-4163-a7ad-d0314da04108 tempest-GroupsTest-171234475 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:11:17.176415 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-3c70a8eb-e1ac-4163-a7ad-d0314da04108 tempest-GroupsTest-171234475 None] Delete group completed successfully. Jun 25 21:11:17.435949 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e5a5acb-b4b8-4574-a965-466ebd17a253 tempest-VolumesBackupsV39Test-575773543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:11:17.511903 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0e5a5acb-b4b8-4574-a965-466ebd17a253 tempest-VolumesBackupsV39Test-575773543 None] Flow 'volume_create_manager' (320e04d9-8872-41f7-b058-d264ff679c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:11:17.529166 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0e5a5acb-b4b8-4574-a965-466ebd17a253 tempest-VolumesBackupsV39Test-575773543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eb22461-8c8c-41cd-bb68-305db2202bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:17.572823 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0e5a5acb-b4b8-4574-a965-466ebd17a253 tempest-VolumesBackupsV39Test-575773543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eb22461-8c8c-41cd-bb68-305db2202bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Volume-286042389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3d5d4665-4543-4d59-8cdc-58a42461ce88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb400da5a98a4db5b56a37371e4a50a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:11:17Z,use_quota=True,user_id='d287cd428abe49778f5172794db2ea49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:17.585124 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0e5a5acb-b4b8-4574-a965-466ebd17a253 tempest-VolumesBackupsV39Test-575773543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dc13042-d19f-4efa-ab32-e0c6fda08179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:17.590283 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0e5a5acb-b4b8-4574-a965-466ebd17a253 tempest-VolumesBackupsV39Test-575773543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dc13042-d19f-4efa-ab32-e0c6fda08179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:17.596039 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0e5a5acb-b4b8-4574-a965-466ebd17a253 tempest-VolumesBackupsV39Test-575773543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8056f66-7255-4f60-b5af-e5cbf636c984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:17.604672 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0e5a5acb-b4b8-4574-a965-466ebd17a253 tempest-VolumesBackupsV39Test-575773543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8056f66-7255-4f60-b5af-e5cbf636c984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d5d4665-4543-4d59-8cdc-58a42461ce88', 'volume_name': 'volume-3d5d4665-4543-4d59-8cdc-58a42461ce88', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:17.612464 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0e5a5acb-b4b8-4574-a965-466ebd17a253 tempest-VolumesBackupsV39Test-575773543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e86525b4-5541-485d-860c-f5c78bdc6ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:17.616440 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0e5a5acb-b4b8-4574-a965-466ebd17a253 tempest-VolumesBackupsV39Test-575773543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e86525b4-5541-485d-860c-f5c78bdc6ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:17.626213 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0e5a5acb-b4b8-4574-a965-466ebd17a253 tempest-VolumesBackupsV39Test-575773543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fa5b8f7-df77-4619-8491-597edd82ea62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:17.628543 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-0e5a5acb-b4b8-4574-a965-466ebd17a253 tempest-VolumesBackupsV39Test-575773543 None] Volume 3d5d4665-4543-4d59-8cdc-58a42461ce88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d5d4665-4543-4d59-8cdc-58a42461ce88', 'volume_size': 1} Jun 25 21:11:17.629499 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0e5a5acb-b4b8-4574-a965-466ebd17a253 tempest-VolumesBackupsV39Test-575773543 None] creating volume 'volume-3d5d4665-4543-4d59-8cdc-58a42461ce88' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:11:17.630935 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0e5a5acb-b4b8-4574-a965-466ebd17a253 tempest-VolumesBackupsV39Test-575773543 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:17.755543 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0e5a5acb-b4b8-4574-a965-466ebd17a253 tempest-VolumesBackupsV39Test-575773543 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:11:17.756325 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0e5a5acb-b4b8-4574-a965-466ebd17a253 tempest-VolumesBackupsV39Test-575773543 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:11:17.766760 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0e5a5acb-b4b8-4574-a965-466ebd17a253 tempest-VolumesBackupsV39Test-575773543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fa5b8f7-df77-4619-8491-597edd82ea62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d5d4665-4543-4d59-8cdc-58a42461ce88', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:17.778495 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0e5a5acb-b4b8-4574-a965-466ebd17a253 tempest-VolumesBackupsV39Test-575773543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54fc29e5-7208-49b3-b354-7f557ecb74d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:17.797331 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-0e5a5acb-b4b8-4574-a965-466ebd17a253 tempest-VolumesBackupsV39Test-575773543 None] Volume volume-3d5d4665-4543-4d59-8cdc-58a42461ce88 (3d5d4665-4543-4d59-8cdc-58a42461ce88): created successfully Jun 25 21:11:17.801648 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0e5a5acb-b4b8-4574-a965-466ebd17a253 tempest-VolumesBackupsV39Test-575773543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54fc29e5-7208-49b3-b354-7f557ecb74d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:17.820277 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0e5a5acb-b4b8-4574-a965-466ebd17a253 tempest-VolumesBackupsV39Test-575773543 None] Flow 'volume_create_manager' (320e04d9-8872-41f7-b058-d264ff679c7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:11:17.841454 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-0e5a5acb-b4b8-4574-a965-466ebd17a253 tempest-VolumesBackupsV39Test-575773543 None] Created volume successfully. Jun 25 21:11:18.458208 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-2d297ba3-5408-4e1f-a502-97f15fc82c7c tempest-VolumesBackupsV39Test-575773543 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-06-25T21:11:18Z,data_timestamp=2022-06-25T21:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Backup-1883418161',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=f9fa1b65-91be-4ad2-87cf-38793de848bb,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='eb400da5a98a4db5b56a37371e4a50a6',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='d287cd428abe49778f5172794db2ea49',volume_id=3d5d4665-4543-4d59-8cdc-58a42461ce88) Jun 25 21:11:18.464010 ncdv-master-1 cinder-volume[130674]: INFO cinder.rpc [None req-2d297ba3-5408-4e1f-a502-97f15fc82c7c tempest-VolumesBackupsV39Test-575773543 None] Automatically selected cinder-backup objects version 1.39 as minimum service version. Jun 25 21:11:18.469330 ncdv-master-1 cinder-volume[130674]: INFO cinder.rpc [None req-2d297ba3-5408-4e1f-a502-97f15fc82c7c tempest-VolumesBackupsV39Test-575773543 None] Automatically selected cinder-backup RPC version 2.3 as minimum service version. Jun 25 21:11:18.470372 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.backup.rpcapi [None req-2d297ba3-5408-4e1f-a502-97f15fc82c7c tempest-VolumesBackupsV39Test-575773543 None] continue_backup in rpcapi backup_id f9fa1b65-91be-4ad2-87cf-38793de848bb {{(pid=130674) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Jun 25 21:11:19.717868 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e1f6a3b-c93f-4d05-b5e7-26a408b6ff13 tempest-VolumesAdminNegativeTest-200725683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:11:19.739329 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4e1f6a3b-c93f-4d05-b5e7-26a408b6ff13 tempest-VolumesAdminNegativeTest-200725683 None] Flow 'volume_create_manager' (8741cd15-ee8d-4237-a2af-450cba6fb89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:11:19.747142 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4e1f6a3b-c93f-4d05-b5e7-26a408b6ff13 tempest-VolumesAdminNegativeTest-200725683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2690daf4-03fa-4a38-aab7-0d51ebfd235b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:19.769347 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4e1f6a3b-c93f-4d05-b5e7-26a408b6ff13 tempest-VolumesAdminNegativeTest-200725683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2690daf4-03fa-4a38-aab7-0d51ebfd235b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1042580870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=36e34598-7571-43c8-8858-a1dec36e12c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cc291ebc8c64e32a229e9a993f517a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:11:20Z,use_quota=True,user_id='bee65f1c37764bdb9985b4e96a97ce9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:19.776766 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4e1f6a3b-c93f-4d05-b5e7-26a408b6ff13 tempest-VolumesAdminNegativeTest-200725683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d40cb1b7-7844-42c7-ba44-1fa8f3b7a611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:19.781404 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4e1f6a3b-c93f-4d05-b5e7-26a408b6ff13 tempest-VolumesAdminNegativeTest-200725683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d40cb1b7-7844-42c7-ba44-1fa8f3b7a611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:19.786587 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4e1f6a3b-c93f-4d05-b5e7-26a408b6ff13 tempest-VolumesAdminNegativeTest-200725683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46b472ce-7028-491f-b158-e6d7e199b961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:19.790703 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4e1f6a3b-c93f-4d05-b5e7-26a408b6ff13 tempest-VolumesAdminNegativeTest-200725683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46b472ce-7028-491f-b158-e6d7e199b961) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36e34598-7571-43c8-8858-a1dec36e12c4', 'volume_name': 'volume-36e34598-7571-43c8-8858-a1dec36e12c4', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:19.795583 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4e1f6a3b-c93f-4d05-b5e7-26a408b6ff13 tempest-VolumesAdminNegativeTest-200725683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52daef7e-105a-4132-9ead-fdf00f85f076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:19.799647 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4e1f6a3b-c93f-4d05-b5e7-26a408b6ff13 tempest-VolumesAdminNegativeTest-200725683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52daef7e-105a-4132-9ead-fdf00f85f076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:19.804225 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4e1f6a3b-c93f-4d05-b5e7-26a408b6ff13 tempest-VolumesAdminNegativeTest-200725683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26fa5373-d18d-415b-9aac-362ff3d4ed8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:19.805354 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-4e1f6a3b-c93f-4d05-b5e7-26a408b6ff13 tempest-VolumesAdminNegativeTest-200725683 None] Volume 36e34598-7571-43c8-8858-a1dec36e12c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36e34598-7571-43c8-8858-a1dec36e12c4', 'volume_size': 1} Jun 25 21:11:19.805742 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4e1f6a3b-c93f-4d05-b5e7-26a408b6ff13 tempest-VolumesAdminNegativeTest-200725683 None] creating volume 'volume-36e34598-7571-43c8-8858-a1dec36e12c4' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:11:19.807368 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4e1f6a3b-c93f-4d05-b5e7-26a408b6ff13 tempest-VolumesAdminNegativeTest-200725683 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:19.902969 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4e1f6a3b-c93f-4d05-b5e7-26a408b6ff13 tempest-VolumesAdminNegativeTest-200725683 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:11:19.903598 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4e1f6a3b-c93f-4d05-b5e7-26a408b6ff13 tempest-VolumesAdminNegativeTest-200725683 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:11:19.908274 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4e1f6a3b-c93f-4d05-b5e7-26a408b6ff13 tempest-VolumesAdminNegativeTest-200725683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26fa5373-d18d-415b-9aac-362ff3d4ed8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36e34598-7571-43c8-8858-a1dec36e12c4', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:19.913964 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4e1f6a3b-c93f-4d05-b5e7-26a408b6ff13 tempest-VolumesAdminNegativeTest-200725683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2df62dd7-31a0-4ffd-aca5-0512131ead93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:19.925810 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-4e1f6a3b-c93f-4d05-b5e7-26a408b6ff13 tempest-VolumesAdminNegativeTest-200725683 None] Volume volume-36e34598-7571-43c8-8858-a1dec36e12c4 (36e34598-7571-43c8-8858-a1dec36e12c4): created successfully Jun 25 21:11:19.931583 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4e1f6a3b-c93f-4d05-b5e7-26a408b6ff13 tempest-VolumesAdminNegativeTest-200725683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2df62dd7-31a0-4ffd-aca5-0512131ead93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:19.938371 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4e1f6a3b-c93f-4d05-b5e7-26a408b6ff13 tempest-VolumesAdminNegativeTest-200725683 None] Flow 'volume_create_manager' (8741cd15-ee8d-4237-a2af-450cba6fb89b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:11:19.948692 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-4e1f6a3b-c93f-4d05-b5e7-26a408b6ff13 tempest-VolumesAdminNegativeTest-200725683 None] Created volume successfully. Jun 25 21:11:20.912582 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-c5878c59-4591-49ac-8b1e-daa8395619e8 tempest-VolumesAdminNegativeTest-200725683 None] Lock "b'cinder-36e34598-7571-43c8-8858-a1dec36e12c4-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:11:20.954522 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c5878c59-4591-49ac-8b1e-daa8395619e8 tempest-VolumesAdminNegativeTest-200725683 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:21.028910 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c5878c59-4591-49ac-8b1e-daa8395619e8 tempest-VolumesAdminNegativeTest-200725683 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:11:21.029337 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c5878c59-4591-49ac-8b1e-daa8395619e8 tempest-VolumesAdminNegativeTest-200725683 None] Volume volume-36e34598-7571-43c8-8858-a1dec36e12c4 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:11:21.038540 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c5878c59-4591-49ac-8b1e-daa8395619e8 tempest-VolumesAdminNegativeTest-200725683 None] deleting rbd volume volume-36e34598-7571-43c8-8858-a1dec36e12c4 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:11:21.305089 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=65,cinder:DELETE=3,cinder:UPDATE=27,cinder:INSERT=5 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:21.314462 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-c5878c59-4591-49ac-8b1e-daa8395619e8 tempest-VolumesAdminNegativeTest-200725683 None] Created reservations ['ff124888-7510-4d17-82e9-60f877a574d8', 'fde080f2-070e-4bb0-86c2-e4a9233872bc', '5000d13b-cecb-4d0f-90dc-ac6ffbe54927', '698957d7-895f-4c0b-a4d1-b1cf2dfaa65f'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:11:21.375870 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c5878c59-4591-49ac-8b1e-daa8395619e8 tempest-VolumesAdminNegativeTest-200725683 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:21.431850 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c5878c59-4591-49ac-8b1e-daa8395619e8 tempest-VolumesAdminNegativeTest-200725683 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:21.490667 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-c5878c59-4591-49ac-8b1e-daa8395619e8 tempest-VolumesAdminNegativeTest-200725683 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:11:21.499347 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-c5878c59-4591-49ac-8b1e-daa8395619e8 tempest-VolumesAdminNegativeTest-200725683 None] Deleted volume successfully. Jun 25 21:11:21.519043 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-c5878c59-4591-49ac-8b1e-daa8395619e8 tempest-VolumesAdminNegativeTest-200725683 None] Lock "b'cinder-36e34598-7571-43c8-8858-a1dec36e12c4-delete_volume'" released by "delete_volume" :: held 0.607s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:11:21.854703 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-997ad6e7-e819-46a7-a127-c1a10ea6144e tempest-VolumesListAdminTestJSON-1555560392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:11:21.873635 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-997ad6e7-e819-46a7-a127-c1a10ea6144e tempest-VolumesListAdminTestJSON-1555560392 None] Flow 'volume_create_manager' (42c91b8d-ec49-4529-8ee0-92be9859b7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:11:21.880466 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-997ad6e7-e819-46a7-a127-c1a10ea6144e tempest-VolumesListAdminTestJSON-1555560392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (317d244c-084d-4d09-aa7d-ea576dec94eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:21.884396 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=59,cinder:UPDATE=32,cinder:INSERT=8,cinder:DELETE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:21.897212 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-997ad6e7-e819-46a7-a127-c1a10ea6144e tempest-VolumesListAdminTestJSON-1555560392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (317d244c-084d-4d09-aa7d-ea576dec94eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:11:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1492179493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ab0a58d8-d8f5-414c-8893-5c437d79b9c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='068165e4a2894e02a78027afd2cb306d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:11:22Z,use_quota=True,user_id='2d15986dabe249e6932792b8988233e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:21.902684 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-997ad6e7-e819-46a7-a127-c1a10ea6144e tempest-VolumesListAdminTestJSON-1555560392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77f7561a-2ea0-4f0c-8da1-81c5db1229a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:21.906892 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-997ad6e7-e819-46a7-a127-c1a10ea6144e tempest-VolumesListAdminTestJSON-1555560392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77f7561a-2ea0-4f0c-8da1-81c5db1229a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:21.920030 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-997ad6e7-e819-46a7-a127-c1a10ea6144e tempest-VolumesListAdminTestJSON-1555560392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfa8fc50-2497-42ff-8edc-4f2eb187e90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:21.920030 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-997ad6e7-e819-46a7-a127-c1a10ea6144e tempest-VolumesListAdminTestJSON-1555560392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfa8fc50-2497-42ff-8edc-4f2eb187e90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab0a58d8-d8f5-414c-8893-5c437d79b9c0', 'volume_name': 'volume-ab0a58d8-d8f5-414c-8893-5c437d79b9c0', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:21.921891 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-997ad6e7-e819-46a7-a127-c1a10ea6144e tempest-VolumesListAdminTestJSON-1555560392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7624b6b6-ded5-4070-b536-0efc8252bea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:21.925763 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-997ad6e7-e819-46a7-a127-c1a10ea6144e tempest-VolumesListAdminTestJSON-1555560392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7624b6b6-ded5-4070-b536-0efc8252bea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:21.930366 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-997ad6e7-e819-46a7-a127-c1a10ea6144e tempest-VolumesListAdminTestJSON-1555560392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (effc504a-6084-4e4d-8b06-f4f344c4364d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:21.931447 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-997ad6e7-e819-46a7-a127-c1a10ea6144e tempest-VolumesListAdminTestJSON-1555560392 None] Volume ab0a58d8-d8f5-414c-8893-5c437d79b9c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab0a58d8-d8f5-414c-8893-5c437d79b9c0', 'volume_size': 1} Jun 25 21:11:21.931837 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-997ad6e7-e819-46a7-a127-c1a10ea6144e tempest-VolumesListAdminTestJSON-1555560392 None] creating volume 'volume-ab0a58d8-d8f5-414c-8893-5c437d79b9c0' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:11:21.932642 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-997ad6e7-e819-46a7-a127-c1a10ea6144e tempest-VolumesListAdminTestJSON-1555560392 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:22.018644 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-997ad6e7-e819-46a7-a127-c1a10ea6144e tempest-VolumesListAdminTestJSON-1555560392 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:11:22.019210 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-997ad6e7-e819-46a7-a127-c1a10ea6144e tempest-VolumesListAdminTestJSON-1555560392 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:11:22.024771 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-997ad6e7-e819-46a7-a127-c1a10ea6144e tempest-VolumesListAdminTestJSON-1555560392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (effc504a-6084-4e4d-8b06-f4f344c4364d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab0a58d8-d8f5-414c-8893-5c437d79b9c0', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:22.030732 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-997ad6e7-e819-46a7-a127-c1a10ea6144e tempest-VolumesListAdminTestJSON-1555560392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f27c998-d332-4a84-8856-d97ddf2694cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:22.044053 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-997ad6e7-e819-46a7-a127-c1a10ea6144e tempest-VolumesListAdminTestJSON-1555560392 None] Volume volume-ab0a58d8-d8f5-414c-8893-5c437d79b9c0 (ab0a58d8-d8f5-414c-8893-5c437d79b9c0): created successfully Jun 25 21:11:22.047902 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-997ad6e7-e819-46a7-a127-c1a10ea6144e tempest-VolumesListAdminTestJSON-1555560392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f27c998-d332-4a84-8856-d97ddf2694cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:22.053773 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-997ad6e7-e819-46a7-a127-c1a10ea6144e tempest-VolumesListAdminTestJSON-1555560392 None] Flow 'volume_create_manager' (42c91b8d-ec49-4529-8ee0-92be9859b7bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:11:22.063717 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-997ad6e7-e819-46a7-a127-c1a10ea6144e tempest-VolumesListAdminTestJSON-1555560392 None] Created volume successfully. Jun 25 21:11:23.335635 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f63fd36-5974-4e97-9c9d-be743e0ec42c tempest-VolumesListAdminTestJSON-1555560392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:11:23.356917 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8f63fd36-5974-4e97-9c9d-be743e0ec42c tempest-VolumesListAdminTestJSON-1555560392 None] Flow 'volume_create_manager' (f92acc96-f7bd-44f5-a7b2-4793a1fec3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:11:23.364082 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8f63fd36-5974-4e97-9c9d-be743e0ec42c tempest-VolumesListAdminTestJSON-1555560392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30311942-1d30-4dc7-92ad-1bdeebdb785e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:23.380899 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8f63fd36-5974-4e97-9c9d-be743e0ec42c tempest-VolumesListAdminTestJSON-1555560392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30311942-1d30-4dc7-92ad-1bdeebdb785e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1056566121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b0d4d1e3-3cca-4b6b-acb7-00ea4d012042,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='068165e4a2894e02a78027afd2cb306d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:11:23Z,use_quota=True,user_id='2d15986dabe249e6932792b8988233e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:23.386220 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8f63fd36-5974-4e97-9c9d-be743e0ec42c tempest-VolumesListAdminTestJSON-1555560392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b495bc8e-4607-439e-b94a-ae0935bc9136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:23.390785 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8f63fd36-5974-4e97-9c9d-be743e0ec42c tempest-VolumesListAdminTestJSON-1555560392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b495bc8e-4607-439e-b94a-ae0935bc9136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:23.396188 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8f63fd36-5974-4e97-9c9d-be743e0ec42c tempest-VolumesListAdminTestJSON-1555560392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37e40928-7e8d-485f-9656-a993e6f4f005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:23.401717 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8f63fd36-5974-4e97-9c9d-be743e0ec42c tempest-VolumesListAdminTestJSON-1555560392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37e40928-7e8d-485f-9656-a993e6f4f005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0d4d1e3-3cca-4b6b-acb7-00ea4d012042', 'volume_name': 'volume-b0d4d1e3-3cca-4b6b-acb7-00ea4d012042', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:23.407379 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8f63fd36-5974-4e97-9c9d-be743e0ec42c tempest-VolumesListAdminTestJSON-1555560392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86424c9d-d75a-4a0e-a35a-c926dc6121b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:23.412173 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8f63fd36-5974-4e97-9c9d-be743e0ec42c tempest-VolumesListAdminTestJSON-1555560392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86424c9d-d75a-4a0e-a35a-c926dc6121b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:23.418558 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8f63fd36-5974-4e97-9c9d-be743e0ec42c tempest-VolumesListAdminTestJSON-1555560392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (446e3068-19a0-4952-8217-5082966d3b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:23.419710 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-8f63fd36-5974-4e97-9c9d-be743e0ec42c tempest-VolumesListAdminTestJSON-1555560392 None] Volume b0d4d1e3-3cca-4b6b-acb7-00ea4d012042: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0d4d1e3-3cca-4b6b-acb7-00ea4d012042', 'volume_size': 1} Jun 25 21:11:23.420100 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8f63fd36-5974-4e97-9c9d-be743e0ec42c tempest-VolumesListAdminTestJSON-1555560392 None] creating volume 'volume-b0d4d1e3-3cca-4b6b-acb7-00ea4d012042' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:11:23.421635 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8f63fd36-5974-4e97-9c9d-be743e0ec42c tempest-VolumesListAdminTestJSON-1555560392 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:23.523054 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8f63fd36-5974-4e97-9c9d-be743e0ec42c tempest-VolumesListAdminTestJSON-1555560392 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:11:23.523724 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8f63fd36-5974-4e97-9c9d-be743e0ec42c tempest-VolumesListAdminTestJSON-1555560392 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:11:23.527862 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8f63fd36-5974-4e97-9c9d-be743e0ec42c tempest-VolumesListAdminTestJSON-1555560392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (446e3068-19a0-4952-8217-5082966d3b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0d4d1e3-3cca-4b6b-acb7-00ea4d012042', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:23.536336 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8f63fd36-5974-4e97-9c9d-be743e0ec42c tempest-VolumesListAdminTestJSON-1555560392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acdf1dfe-9740-4b1b-909d-16514cccd75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:23.564972 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-8f63fd36-5974-4e97-9c9d-be743e0ec42c tempest-VolumesListAdminTestJSON-1555560392 None] Volume volume-b0d4d1e3-3cca-4b6b-acb7-00ea4d012042 (b0d4d1e3-3cca-4b6b-acb7-00ea4d012042): created successfully Jun 25 21:11:23.572478 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8f63fd36-5974-4e97-9c9d-be743e0ec42c tempest-VolumesListAdminTestJSON-1555560392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acdf1dfe-9740-4b1b-909d-16514cccd75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:23.584223 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8f63fd36-5974-4e97-9c9d-be743e0ec42c tempest-VolumesListAdminTestJSON-1555560392 None] Flow 'volume_create_manager' (f92acc96-f7bd-44f5-a7b2-4793a1fec3f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:11:23.596260 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-8f63fd36-5974-4e97-9c9d-be743e0ec42c tempest-VolumesListAdminTestJSON-1555560392 None] Created volume successfully. Jun 25 21:11:23.840606 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-2d297ba3-5408-4e1f-a502-97f15fc82c7c tempest-VolumesBackupsV39Test-575773543 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 21:11:24.354222 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [req-9b0bebf5-db53-486a-b39c-0a185c671aea req-0cc44143-6c78-4fdc-b9ff-f2fa70be85e8 tempest-VolumesSnapshotsTestJSON-1030822409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:11:24.387676 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-9b0bebf5-db53-486a-b39c-0a185c671aea req-0cc44143-6c78-4fdc-b9ff-f2fa70be85e8 tempest-VolumesSnapshotsTestJSON-1030822409 None] Flow 'volume_create_manager' (7534718d-f80d-4baa-82b2-b8533da2ae35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:11:24.424047 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-9b0bebf5-db53-486a-b39c-0a185c671aea req-0cc44143-6c78-4fdc-b9ff-f2fa70be85e8 tempest-VolumesSnapshotsTestJSON-1030822409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caa38777-efc6-44a9-8ebc-43f5ed1ce97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:24.448371 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-9b0bebf5-db53-486a-b39c-0a185c671aea req-0cc44143-6c78-4fdc-b9ff-f2fa70be85e8 tempest-VolumesSnapshotsTestJSON-1030822409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caa38777-efc6-44a9-8ebc-43f5ed1ce97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-979935565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=610e16aa-feec-4f36-8277-ba9db76db73a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba3c632ea72243429aedaf10e5af8ec2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:11:24Z,use_quota=True,user_id='a045ffc3ca714026846fa943dc735596',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:24.456989 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-9b0bebf5-db53-486a-b39c-0a185c671aea req-0cc44143-6c78-4fdc-b9ff-f2fa70be85e8 tempest-VolumesSnapshotsTestJSON-1030822409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32d4596b-f409-4001-9dc4-c2efb2edd438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:24.464113 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-9b0bebf5-db53-486a-b39c-0a185c671aea req-0cc44143-6c78-4fdc-b9ff-f2fa70be85e8 tempest-VolumesSnapshotsTestJSON-1030822409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32d4596b-f409-4001-9dc4-c2efb2edd438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:24.470492 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-9b0bebf5-db53-486a-b39c-0a185c671aea req-0cc44143-6c78-4fdc-b9ff-f2fa70be85e8 tempest-VolumesSnapshotsTestJSON-1030822409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e46deb02-e199-4e8f-b266-1f627973f4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:24.475813 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-9b0bebf5-db53-486a-b39c-0a185c671aea req-0cc44143-6c78-4fdc-b9ff-f2fa70be85e8 tempest-VolumesSnapshotsTestJSON-1030822409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e46deb02-e199-4e8f-b266-1f627973f4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '610e16aa-feec-4f36-8277-ba9db76db73a', 'volume_name': 'volume-610e16aa-feec-4f36-8277-ba9db76db73a', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:24.482332 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-9b0bebf5-db53-486a-b39c-0a185c671aea req-0cc44143-6c78-4fdc-b9ff-f2fa70be85e8 tempest-VolumesSnapshotsTestJSON-1030822409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0485d84-7bce-4db6-b239-6885ad463025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:24.488632 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-9b0bebf5-db53-486a-b39c-0a185c671aea req-0cc44143-6c78-4fdc-b9ff-f2fa70be85e8 tempest-VolumesSnapshotsTestJSON-1030822409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0485d84-7bce-4db6-b239-6885ad463025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:24.495052 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-9b0bebf5-db53-486a-b39c-0a185c671aea req-0cc44143-6c78-4fdc-b9ff-f2fa70be85e8 tempest-VolumesSnapshotsTestJSON-1030822409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f3c0d75-6561-423b-9cf5-a54bb486c505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:24.497187 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [req-9b0bebf5-db53-486a-b39c-0a185c671aea req-0cc44143-6c78-4fdc-b9ff-f2fa70be85e8 tempest-VolumesSnapshotsTestJSON-1030822409 None] Volume 610e16aa-feec-4f36-8277-ba9db76db73a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-610e16aa-feec-4f36-8277-ba9db76db73a', 'volume_size': 1} Jun 25 21:11:24.497974 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-9b0bebf5-db53-486a-b39c-0a185c671aea req-0cc44143-6c78-4fdc-b9ff-f2fa70be85e8 tempest-VolumesSnapshotsTestJSON-1030822409 None] creating volume 'volume-610e16aa-feec-4f36-8277-ba9db76db73a' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:11:24.499002 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-9b0bebf5-db53-486a-b39c-0a185c671aea req-0cc44143-6c78-4fdc-b9ff-f2fa70be85e8 tempest-VolumesSnapshotsTestJSON-1030822409 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:24.588652 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-9b0bebf5-db53-486a-b39c-0a185c671aea req-0cc44143-6c78-4fdc-b9ff-f2fa70be85e8 tempest-VolumesSnapshotsTestJSON-1030822409 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:11:24.589038 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-9b0bebf5-db53-486a-b39c-0a185c671aea req-0cc44143-6c78-4fdc-b9ff-f2fa70be85e8 tempest-VolumesSnapshotsTestJSON-1030822409 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:11:24.592752 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-9b0bebf5-db53-486a-b39c-0a185c671aea req-0cc44143-6c78-4fdc-b9ff-f2fa70be85e8 tempest-VolumesSnapshotsTestJSON-1030822409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f3c0d75-6561-423b-9cf5-a54bb486c505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-610e16aa-feec-4f36-8277-ba9db76db73a', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:24.597801 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-9b0bebf5-db53-486a-b39c-0a185c671aea req-0cc44143-6c78-4fdc-b9ff-f2fa70be85e8 tempest-VolumesSnapshotsTestJSON-1030822409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de9cfa1a-da9f-46bc-95d8-8ed16b133ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:24.607829 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [req-9b0bebf5-db53-486a-b39c-0a185c671aea req-0cc44143-6c78-4fdc-b9ff-f2fa70be85e8 tempest-VolumesSnapshotsTestJSON-1030822409 None] Volume volume-610e16aa-feec-4f36-8277-ba9db76db73a (610e16aa-feec-4f36-8277-ba9db76db73a): created successfully Jun 25 21:11:24.611502 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-9b0bebf5-db53-486a-b39c-0a185c671aea req-0cc44143-6c78-4fdc-b9ff-f2fa70be85e8 tempest-VolumesSnapshotsTestJSON-1030822409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de9cfa1a-da9f-46bc-95d8-8ed16b133ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:24.617051 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-9b0bebf5-db53-486a-b39c-0a185c671aea req-0cc44143-6c78-4fdc-b9ff-f2fa70be85e8 tempest-VolumesSnapshotsTestJSON-1030822409 None] Flow 'volume_create_manager' (7534718d-f80d-4baa-82b2-b8533da2ae35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:11:24.628350 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-9b0bebf5-db53-486a-b39c-0a185c671aea req-0cc44143-6c78-4fdc-b9ff-f2fa70be85e8 tempest-VolumesSnapshotsTestJSON-1030822409 None] Created volume successfully. Jun 25 21:11:24.863785 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2209db9-82cf-4ad6-aa8a-ac3f58a29082 tempest-VolumesListAdminTestJSON-1555560392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:11:24.894515 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f2209db9-82cf-4ad6-aa8a-ac3f58a29082 tempest-VolumesListAdminTestJSON-1555560392 None] Flow 'volume_create_manager' (8a7c51b8-4f15-4876-af4f-bb887d40cbd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:11:24.905213 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f2209db9-82cf-4ad6-aa8a-ac3f58a29082 tempest-VolumesListAdminTestJSON-1555560392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (426fc867-bb47-43de-9647-9aa08e798558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:24.911597 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-2d297ba3-5408-4e1f-a502-97f15fc82c7c tempest-VolumesBackupsV39Test-575773543 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.071s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 21:11:24.912391 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2d297ba3-5408-4e1f-a502-97f15fc82c7c tempest-VolumesBackupsV39Test-575773543 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-3d5d4665-4543-4d59-8cdc-58a42461ce88', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': '3d5d4665-4543-4d59-8cdc-58a42461ce88', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 21:11:24.931654 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f2209db9-82cf-4ad6-aa8a-ac3f58a29082 tempest-VolumesListAdminTestJSON-1555560392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (426fc867-bb47-43de-9647-9aa08e798558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:11:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1386202395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=47949b9a-a1d0-4111-a8be-862899347a94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='068165e4a2894e02a78027afd2cb306d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:11:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:11:25Z,use_quota=True,user_id='2d15986dabe249e6932792b8988233e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:24.937873 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f2209db9-82cf-4ad6-aa8a-ac3f58a29082 tempest-VolumesListAdminTestJSON-1555560392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12b7098a-ff5e-4584-853a-716e348b7c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:24.942404 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f2209db9-82cf-4ad6-aa8a-ac3f58a29082 tempest-VolumesListAdminTestJSON-1555560392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12b7098a-ff5e-4584-853a-716e348b7c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:24.948784 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f2209db9-82cf-4ad6-aa8a-ac3f58a29082 tempest-VolumesListAdminTestJSON-1555560392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7d4ba2c-b487-4f20-a38d-ab275ec65d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:24.953198 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f2209db9-82cf-4ad6-aa8a-ac3f58a29082 tempest-VolumesListAdminTestJSON-1555560392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7d4ba2c-b487-4f20-a38d-ab275ec65d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47949b9a-a1d0-4111-a8be-862899347a94', 'volume_name': 'volume-47949b9a-a1d0-4111-a8be-862899347a94', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:24.958990 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f2209db9-82cf-4ad6-aa8a-ac3f58a29082 tempest-VolumesListAdminTestJSON-1555560392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d1495f6-4c7c-4470-a538-349b24f03a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:24.963560 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f2209db9-82cf-4ad6-aa8a-ac3f58a29082 tempest-VolumesListAdminTestJSON-1555560392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d1495f6-4c7c-4470-a538-349b24f03a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:24.969182 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f2209db9-82cf-4ad6-aa8a-ac3f58a29082 tempest-VolumesListAdminTestJSON-1555560392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8ea6d23-8d00-4c35-a20e-396b6d35ed5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:24.970583 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-f2209db9-82cf-4ad6-aa8a-ac3f58a29082 tempest-VolumesListAdminTestJSON-1555560392 None] Volume 47949b9a-a1d0-4111-a8be-862899347a94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47949b9a-a1d0-4111-a8be-862899347a94', 'volume_size': 1} Jun 25 21:11:24.971013 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f2209db9-82cf-4ad6-aa8a-ac3f58a29082 tempest-VolumesListAdminTestJSON-1555560392 None] creating volume 'volume-47949b9a-a1d0-4111-a8be-862899347a94' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:11:24.971712 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f2209db9-82cf-4ad6-aa8a-ac3f58a29082 tempest-VolumesListAdminTestJSON-1555560392 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:25.011239 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-2d297ba3-5408-4e1f-a502-97f15fc82c7c tempest-VolumesBackupsV39Test-575773543 None] Initialize volume connection completed successfully. Jun 25 21:11:25.041882 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f2209db9-82cf-4ad6-aa8a-ac3f58a29082 tempest-VolumesListAdminTestJSON-1555560392 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:11:25.042250 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f2209db9-82cf-4ad6-aa8a-ac3f58a29082 tempest-VolumesListAdminTestJSON-1555560392 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:11:25.049109 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f2209db9-82cf-4ad6-aa8a-ac3f58a29082 tempest-VolumesListAdminTestJSON-1555560392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8ea6d23-8d00-4c35-a20e-396b6d35ed5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47949b9a-a1d0-4111-a8be-862899347a94', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:25.054370 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f2209db9-82cf-4ad6-aa8a-ac3f58a29082 tempest-VolumesListAdminTestJSON-1555560392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72ac41e5-3bea-4067-856a-a86648918b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:25.066751 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-f2209db9-82cf-4ad6-aa8a-ac3f58a29082 tempest-VolumesListAdminTestJSON-1555560392 None] Volume volume-47949b9a-a1d0-4111-a8be-862899347a94 (47949b9a-a1d0-4111-a8be-862899347a94): created successfully Jun 25 21:11:25.072304 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f2209db9-82cf-4ad6-aa8a-ac3f58a29082 tempest-VolumesListAdminTestJSON-1555560392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72ac41e5-3bea-4067-856a-a86648918b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:25.080919 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f2209db9-82cf-4ad6-aa8a-ac3f58a29082 tempest-VolumesListAdminTestJSON-1555560392 None] Flow 'volume_create_manager' (8a7c51b8-4f15-4876-af4f-bb887d40cbd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:11:25.089724 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-f2209db9-82cf-4ad6-aa8a-ac3f58a29082 tempest-VolumesListAdminTestJSON-1555560392 None] Created volume successfully. Jun 25 21:11:25.712665 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-d19cd23f-1454-4c02-b99c-f04838439272 req-44bc1ad8-c2a2-4c02-9762-b20321e8e8a4 tempest-VolumesSnapshotsTestJSON-1030822409 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:25.954211 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-112c13f9-23af-48c2-b48e-4fe5a4f395c6 tempest-VolumesAdminNegativeTest-200725683 None] Lock "b'cinder-6879f6a0-af86-4af1-af9c-74cd6cfe0c38-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:11:26.012187 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-112c13f9-23af-48c2-b48e-4fe5a4f395c6 tempest-VolumesAdminNegativeTest-200725683 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:26.096997 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-112c13f9-23af-48c2-b48e-4fe5a4f395c6 tempest-VolumesAdminNegativeTest-200725683 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:11:26.097836 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-112c13f9-23af-48c2-b48e-4fe5a4f395c6 tempest-VolumesAdminNegativeTest-200725683 None] Volume volume-6879f6a0-af86-4af1-af9c-74cd6cfe0c38 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:11:26.110291 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-112c13f9-23af-48c2-b48e-4fe5a4f395c6 tempest-VolumesAdminNegativeTest-200725683 None] deleting rbd volume volume-6879f6a0-af86-4af1-af9c-74cd6cfe0c38 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:11:26.467302 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-112c13f9-23af-48c2-b48e-4fe5a4f395c6 tempest-VolumesAdminNegativeTest-200725683 None] Created reservations ['0ed32890-7c69-46f2-9ccf-8117dd858649', 'a821aeab-5252-4d02-a371-dca94f779ccd', '92d39c59-7da3-4905-92e2-fd2b0172537f', 'ef1869b8-31b1-467c-888d-42968cf12e0b'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:11:26.523802 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-112c13f9-23af-48c2-b48e-4fe5a4f395c6 tempest-VolumesAdminNegativeTest-200725683 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:26.572931 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-112c13f9-23af-48c2-b48e-4fe5a4f395c6 tempest-VolumesAdminNegativeTest-200725683 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:26.603385 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-112c13f9-23af-48c2-b48e-4fe5a4f395c6 tempest-VolumesAdminNegativeTest-200725683 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:11:26.619487 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-112c13f9-23af-48c2-b48e-4fe5a4f395c6 tempest-VolumesAdminNegativeTest-200725683 None] Deleted volume successfully. Jun 25 21:11:26.639246 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dddfa7c-a005-4dc7-be20-250f53a670b4 tempest-VolumesListAdminTestJSON-753676292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:11:26.662048 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8dddfa7c-a005-4dc7-be20-250f53a670b4 tempest-VolumesListAdminTestJSON-753676292 None] Flow 'volume_create_manager' (1e380a97-b64e-4437-a4a1-5a3603bc2a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:11:26.669373 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8dddfa7c-a005-4dc7-be20-250f53a670b4 tempest-VolumesListAdminTestJSON-753676292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8343c94-2ebe-4ff6-90fc-632e0b6183ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:26.673478 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-112c13f9-23af-48c2-b48e-4fe5a4f395c6 tempest-VolumesAdminNegativeTest-200725683 None] Lock "b'cinder-6879f6a0-af86-4af1-af9c-74cd6cfe0c38-delete_volume'" released by "delete_volume" :: held 0.719s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:11:26.700581 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8dddfa7c-a005-4dc7-be20-250f53a670b4 tempest-VolumesListAdminTestJSON-753676292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8343c94-2ebe-4ff6-90fc-632e0b6183ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b65a442f-14ff-46ad-9215-e95b8d39f507,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebd5f213bf0249daa7372257d6686260',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:11:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:11:27Z,use_quota=True,user_id='1824a4e8b2a7422b8b9fa8e840fec30a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:26.706020 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8dddfa7c-a005-4dc7-be20-250f53a670b4 tempest-VolumesListAdminTestJSON-753676292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8d9275d-92c2-4f36-9289-104b859aa39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:26.709994 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8dddfa7c-a005-4dc7-be20-250f53a670b4 tempest-VolumesListAdminTestJSON-753676292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8d9275d-92c2-4f36-9289-104b859aa39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:26.715407 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8dddfa7c-a005-4dc7-be20-250f53a670b4 tempest-VolumesListAdminTestJSON-753676292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7704b10e-852d-441d-8bee-dc80d8b2c45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:26.719396 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8dddfa7c-a005-4dc7-be20-250f53a670b4 tempest-VolumesListAdminTestJSON-753676292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7704b10e-852d-441d-8bee-dc80d8b2c45b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b65a442f-14ff-46ad-9215-e95b8d39f507', 'volume_name': 'volume-b65a442f-14ff-46ad-9215-e95b8d39f507', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:26.724475 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8dddfa7c-a005-4dc7-be20-250f53a670b4 tempest-VolumesListAdminTestJSON-753676292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e8f1825-77ec-4bfe-ae5a-df378913cfa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:26.728285 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8dddfa7c-a005-4dc7-be20-250f53a670b4 tempest-VolumesListAdminTestJSON-753676292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e8f1825-77ec-4bfe-ae5a-df378913cfa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:26.732901 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8dddfa7c-a005-4dc7-be20-250f53a670b4 tempest-VolumesListAdminTestJSON-753676292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (654c2feb-f791-4747-8182-4cd01461b9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:26.733931 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-8dddfa7c-a005-4dc7-be20-250f53a670b4 tempest-VolumesListAdminTestJSON-753676292 None] Volume b65a442f-14ff-46ad-9215-e95b8d39f507: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b65a442f-14ff-46ad-9215-e95b8d39f507', 'volume_size': 1} Jun 25 21:11:26.734341 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8dddfa7c-a005-4dc7-be20-250f53a670b4 tempest-VolumesListAdminTestJSON-753676292 None] creating volume 'volume-b65a442f-14ff-46ad-9215-e95b8d39f507' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:11:26.735108 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8dddfa7c-a005-4dc7-be20-250f53a670b4 tempest-VolumesListAdminTestJSON-753676292 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:26.772208 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-d19cd23f-1454-4c02-b99c-f04838439272 req-44bc1ad8-c2a2-4c02-9762-b20321e8e8a4 tempest-VolumesSnapshotsTestJSON-1030822409 None] Create snapshot completed successfully Jun 25 21:11:26.812242 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8dddfa7c-a005-4dc7-be20-250f53a670b4 tempest-VolumesListAdminTestJSON-753676292 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:11:26.812696 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8dddfa7c-a005-4dc7-be20-250f53a670b4 tempest-VolumesListAdminTestJSON-753676292 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:11:26.816405 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8dddfa7c-a005-4dc7-be20-250f53a670b4 tempest-VolumesListAdminTestJSON-753676292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (654c2feb-f791-4747-8182-4cd01461b9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b65a442f-14ff-46ad-9215-e95b8d39f507', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:26.820948 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8dddfa7c-a005-4dc7-be20-250f53a670b4 tempest-VolumesListAdminTestJSON-753676292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22133dce-51bb-4f70-aa2f-ee981511efad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:26.832398 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-8dddfa7c-a005-4dc7-be20-250f53a670b4 tempest-VolumesListAdminTestJSON-753676292 None] Volume volume-b65a442f-14ff-46ad-9215-e95b8d39f507 (b65a442f-14ff-46ad-9215-e95b8d39f507): created successfully Jun 25 21:11:26.836621 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8dddfa7c-a005-4dc7-be20-250f53a670b4 tempest-VolumesListAdminTestJSON-753676292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22133dce-51bb-4f70-aa2f-ee981511efad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:26.843604 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8dddfa7c-a005-4dc7-be20-250f53a670b4 tempest-VolumesListAdminTestJSON-753676292 None] Flow 'volume_create_manager' (1e380a97-b64e-4437-a4a1-5a3603bc2a59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:11:26.854673 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-8dddfa7c-a005-4dc7-be20-250f53a670b4 tempest-VolumesListAdminTestJSON-753676292 None] Created volume successfully. Jun 25 21:11:27.031845 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [req-5631dd46-15ec-400e-bfe8-127b61999f75 req-debe009c-aa84-45c4-804f-54e3619c1eca tempest-VolumesSnapshotsTestJSON-1030822409 None] Lock "b'cinder-3ed1a4de-c8ef-4621-aeb2-6556a78f2882-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.020s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:11:27.033516 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-5631dd46-15ec-400e-bfe8-127b61999f75 req-debe009c-aa84-45c4-804f-54e3619c1eca tempest-VolumesSnapshotsTestJSON-1030822409 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:27.718282 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [req-5631dd46-15ec-400e-bfe8-127b61999f75 req-debe009c-aa84-45c4-804f-54e3619c1eca tempest-VolumesSnapshotsTestJSON-1030822409 None] Deprecated: Default quota for resource: snapshots_ceph is set by the default quota flag: quota_snapshots_ceph, it is now deprecated. Please use the default quota class for default quota. Jun 25 21:11:27.740109 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-2834161f-ffbe-40ec-a605-06e17124ccfc tempest-VolumesListAdminTestJSON-753676292 None] Lock "b'cinder-b65a442f-14ff-46ad-9215-e95b8d39f507-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:11:27.752499 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [req-5631dd46-15ec-400e-bfe8-127b61999f75 req-debe009c-aa84-45c4-804f-54e3619c1eca tempest-VolumesSnapshotsTestJSON-1030822409 None] Created reservations ['7c5693ed-fa29-4941-a132-8a471a2da19f', '98431fa8-40d6-40d4-a399-8fccf0d589d4', '7f8f287f-5bc7-458a-b649-d25544f836d6', '2c68d3b4-3cf5-4767-8162-94850773edd1'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:11:27.782734 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2834161f-ffbe-40ec-a605-06e17124ccfc tempest-VolumesListAdminTestJSON-753676292 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:27.839561 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2834161f-ffbe-40ec-a605-06e17124ccfc tempest-VolumesListAdminTestJSON-753676292 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:11:27.840220 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2834161f-ffbe-40ec-a605-06e17124ccfc tempest-VolumesListAdminTestJSON-753676292 None] Volume volume-b65a442f-14ff-46ad-9215-e95b8d39f507 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:11:27.849310 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2834161f-ffbe-40ec-a605-06e17124ccfc tempest-VolumesListAdminTestJSON-753676292 None] deleting rbd volume volume-b65a442f-14ff-46ad-9215-e95b8d39f507 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:11:27.899110 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-5631dd46-15ec-400e-bfe8-127b61999f75 req-debe009c-aa84-45c4-804f-54e3619c1eca tempest-VolumesSnapshotsTestJSON-1030822409 None] Delete snapshot completed successfully. Jun 25 21:11:27.909135 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-1056be23-64a0-46ba-a69c-3b1d721c960c tempest-VolumesListAdminTestJSON-1555560392 None] Lock "b'cinder-47949b9a-a1d0-4111-a8be-862899347a94-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:11:27.953690 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [req-5631dd46-15ec-400e-bfe8-127b61999f75 req-debe009c-aa84-45c4-804f-54e3619c1eca tempest-VolumesSnapshotsTestJSON-1030822409 None] Lock "b'cinder-3ed1a4de-c8ef-4621-aeb2-6556a78f2882-delete_snapshot'" released by "delete_snapshot" :: held 0.922s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:11:27.956898 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1056be23-64a0-46ba-a69c-3b1d721c960c tempest-VolumesListAdminTestJSON-1555560392 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:28.001405 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1056be23-64a0-46ba-a69c-3b1d721c960c tempest-VolumesListAdminTestJSON-1555560392 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:11:28.002215 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1056be23-64a0-46ba-a69c-3b1d721c960c tempest-VolumesListAdminTestJSON-1555560392 None] Volume volume-47949b9a-a1d0-4111-a8be-862899347a94 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:11:28.008266 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1056be23-64a0-46ba-a69c-3b1d721c960c tempest-VolumesListAdminTestJSON-1555560392 None] deleting rbd volume volume-47949b9a-a1d0-4111-a8be-862899347a94 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:11:28.159893 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-2834161f-ffbe-40ec-a605-06e17124ccfc tempest-VolumesListAdminTestJSON-753676292 None] Created reservations ['f2152c38-4b97-4960-805b-3664f5d770de', '0a08d342-6b98-4266-94e1-4271fcc309fa', '75f1360e-75e5-4acb-bbd1-9134c26d4fe7', '54a28405-a8e5-48cc-8676-87fcc584b0a3'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:11:28.176727 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=63,cinder:UPDATE=30,cinder:INSERT=6,cinder:DELETE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:28.186614 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=60,cinder:DELETE=6,cinder:UPDATE=28,cinder:INSERT=6 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:28.233731 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2834161f-ffbe-40ec-a605-06e17124ccfc tempest-VolumesListAdminTestJSON-753676292 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:28.284802 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2834161f-ffbe-40ec-a605-06e17124ccfc tempest-VolumesListAdminTestJSON-753676292 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:28.317315 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-2834161f-ffbe-40ec-a605-06e17124ccfc tempest-VolumesListAdminTestJSON-753676292 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:11:28.334681 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-2834161f-ffbe-40ec-a605-06e17124ccfc tempest-VolumesListAdminTestJSON-753676292 None] Deleted volume successfully. Jun 25 21:11:28.346475 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [req-949e4a05-17cc-42de-a332-e1afc1d63907 req-bee30acf-4e2a-4f29-845f-bc611d8adf46 tempest-VolumesSnapshotsTestJSON-1030822409 None] Lock "b'cinder-610e16aa-feec-4f36-8277-ba9db76db73a-delete_volume'" acquired by "delete_volume" :: waited 0.116s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:11:28.365214 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-2834161f-ffbe-40ec-a605-06e17124ccfc tempest-VolumesListAdminTestJSON-753676292 None] Lock "b'cinder-b65a442f-14ff-46ad-9215-e95b8d39f507-delete_volume'" released by "delete_volume" :: held 0.625s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:11:28.410695 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-949e4a05-17cc-42de-a332-e1afc1d63907 req-bee30acf-4e2a-4f29-845f-bc611d8adf46 tempest-VolumesSnapshotsTestJSON-1030822409 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:28.458275 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-949e4a05-17cc-42de-a332-e1afc1d63907 req-bee30acf-4e2a-4f29-845f-bc611d8adf46 tempest-VolumesSnapshotsTestJSON-1030822409 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:11:28.458526 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-949e4a05-17cc-42de-a332-e1afc1d63907 req-bee30acf-4e2a-4f29-845f-bc611d8adf46 tempest-VolumesSnapshotsTestJSON-1030822409 None] Volume volume-610e16aa-feec-4f36-8277-ba9db76db73a is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:11:28.467364 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-949e4a05-17cc-42de-a332-e1afc1d63907 req-bee30acf-4e2a-4f29-845f-bc611d8adf46 tempest-VolumesSnapshotsTestJSON-1030822409 None] deleting rbd volume volume-610e16aa-feec-4f36-8277-ba9db76db73a {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:11:28.470240 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-1056be23-64a0-46ba-a69c-3b1d721c960c tempest-VolumesListAdminTestJSON-1555560392 None] Created reservations ['625fa333-4cdd-44cd-9b45-8314f06ec0fd', 'ab20226a-a90a-4b12-9314-3f4750d1c40b', 'fb880d21-89b8-48e6-a221-04e655a973d1', '4d89869b-7295-47d5-8d13-63231b1d68fd'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:11:28.564484 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1056be23-64a0-46ba-a69c-3b1d721c960c tempest-VolumesListAdminTestJSON-1555560392 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:28.627237 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1056be23-64a0-46ba-a69c-3b1d721c960c tempest-VolumesListAdminTestJSON-1555560392 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:28.671222 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-1056be23-64a0-46ba-a69c-3b1d721c960c tempest-VolumesListAdminTestJSON-1555560392 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:11:28.676540 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-1056be23-64a0-46ba-a69c-3b1d721c960c tempest-VolumesListAdminTestJSON-1555560392 None] Deleted volume successfully. Jun 25 21:11:28.698644 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-1056be23-64a0-46ba-a69c-3b1d721c960c tempest-VolumesListAdminTestJSON-1555560392 None] Lock "b'cinder-47949b9a-a1d0-4111-a8be-862899347a94-delete_volume'" released by "delete_volume" :: held 0.789s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:11:28.910415 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-2d297ba3-5408-4e1f-a502-97f15fc82c7c tempest-VolumesBackupsV39Test-575773543 None] Terminate volume connection completed successfully. Jun 25 21:11:28.943080 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-2d297ba3-5408-4e1f-a502-97f15fc82c7c tempest-VolumesBackupsV39Test-575773543 None] Remove volume export completed successfully. Jun 25 21:11:28.953788 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [req-949e4a05-17cc-42de-a332-e1afc1d63907 req-bee30acf-4e2a-4f29-845f-bc611d8adf46 tempest-VolumesSnapshotsTestJSON-1030822409 None] Created reservations ['7c79e47c-5fc8-440d-b10c-08b8a15ab969', 'be852c68-8055-4ef7-91c1-348585ddf381', 'f520bc94-4522-4857-ac64-3d035b361179', 'd5440f9c-41d9-4c5e-b6b3-348ecf92c449'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:11:29.026298 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-949e4a05-17cc-42de-a332-e1afc1d63907 req-bee30acf-4e2a-4f29-845f-bc611d8adf46 tempest-VolumesSnapshotsTestJSON-1030822409 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:29.080403 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-949e4a05-17cc-42de-a332-e1afc1d63907 req-bee30acf-4e2a-4f29-845f-bc611d8adf46 tempest-VolumesSnapshotsTestJSON-1030822409 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:29.145606 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [req-949e4a05-17cc-42de-a332-e1afc1d63907 req-bee30acf-4e2a-4f29-845f-bc611d8adf46 tempest-VolumesSnapshotsTestJSON-1030822409 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:11:29.155695 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-949e4a05-17cc-42de-a332-e1afc1d63907 req-bee30acf-4e2a-4f29-845f-bc611d8adf46 tempest-VolumesSnapshotsTestJSON-1030822409 None] Deleted volume successfully. Jun 25 21:11:29.171319 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-a1ee9f0a-a479-48c4-b3c6-416e0d731c11 tempest-VolumesListAdminTestJSON-1555560392 None] Lock "b'cinder-b0d4d1e3-3cca-4b6b-acb7-00ea4d012042-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:11:29.178989 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [req-949e4a05-17cc-42de-a332-e1afc1d63907 req-bee30acf-4e2a-4f29-845f-bc611d8adf46 tempest-VolumesSnapshotsTestJSON-1030822409 None] Lock "b'cinder-610e16aa-feec-4f36-8277-ba9db76db73a-delete_volume'" released by "delete_volume" :: held 0.833s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:11:29.211431 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a1ee9f0a-a479-48c4-b3c6-416e0d731c11 tempest-VolumesListAdminTestJSON-1555560392 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:29.289007 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a1ee9f0a-a479-48c4-b3c6-416e0d731c11 tempest-VolumesListAdminTestJSON-1555560392 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:11:29.289448 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a1ee9f0a-a479-48c4-b3c6-416e0d731c11 tempest-VolumesListAdminTestJSON-1555560392 None] Volume volume-b0d4d1e3-3cca-4b6b-acb7-00ea4d012042 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:11:29.300857 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a1ee9f0a-a479-48c4-b3c6-416e0d731c11 tempest-VolumesListAdminTestJSON-1555560392 None] deleting rbd volume volume-b0d4d1e3-3cca-4b6b-acb7-00ea4d012042 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:11:30.129204 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-a1ee9f0a-a479-48c4-b3c6-416e0d731c11 tempest-VolumesListAdminTestJSON-1555560392 None] Created reservations ['76669f33-20f4-451a-9515-6f1e68badbd4', '7110482a-b3fb-4f6c-a397-e439defe5d55', 'd3031558-cd61-42d4-b330-f4924459ce10', '2682f5e8-ce9c-4380-bcff-2cb6f0deaf6b'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:11:30.306475 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a1ee9f0a-a479-48c4-b3c6-416e0d731c11 tempest-VolumesListAdminTestJSON-1555560392 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:30.411897 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a1ee9f0a-a479-48c4-b3c6-416e0d731c11 tempest-VolumesListAdminTestJSON-1555560392 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:30.472025 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-a1ee9f0a-a479-48c4-b3c6-416e0d731c11 tempest-VolumesListAdminTestJSON-1555560392 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:11:30.476710 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-a1ee9f0a-a479-48c4-b3c6-416e0d731c11 tempest-VolumesListAdminTestJSON-1555560392 None] Deleted volume successfully. Jun 25 21:11:30.502340 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-a1ee9f0a-a479-48c4-b3c6-416e0d731c11 tempest-VolumesListAdminTestJSON-1555560392 None] Lock "b'cinder-b0d4d1e3-3cca-4b6b-acb7-00ea4d012042-delete_volume'" released by "delete_volume" :: held 1.331s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:11:31.450278 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-f4f22e52-9145-4de4-99c7-cc20075d3068 tempest-VolumesListAdminTestJSON-1555560392 None] Lock "b'cinder-ab0a58d8-d8f5-414c-8893-5c437d79b9c0-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:11:31.553929 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f4f22e52-9145-4de4-99c7-cc20075d3068 tempest-VolumesListAdminTestJSON-1555560392 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:31.664555 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f4f22e52-9145-4de4-99c7-cc20075d3068 tempest-VolumesListAdminTestJSON-1555560392 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:11:31.665058 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f4f22e52-9145-4de4-99c7-cc20075d3068 tempest-VolumesListAdminTestJSON-1555560392 None] Volume volume-ab0a58d8-d8f5-414c-8893-5c437d79b9c0 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:11:31.688060 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f4f22e52-9145-4de4-99c7-cc20075d3068 tempest-VolumesListAdminTestJSON-1555560392 None] deleting rbd volume volume-ab0a58d8-d8f5-414c-8893-5c437d79b9c0 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:11:32.296203 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-f4f22e52-9145-4de4-99c7-cc20075d3068 tempest-VolumesListAdminTestJSON-1555560392 None] Created reservations ['b022e342-404a-4564-bbeb-3a7124d29ffe', '6eb2cff6-52e7-41c3-a494-79deb7593b69', '4c001a62-c65d-4079-867d-be13e84ce2dc', '9ec8d20b-a7a9-41ed-a185-7969d8b34595'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:11:32.323206 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=52,cinder:UPDATE=34,cinder:DELETE=4,cinder:INSERT=10 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:32.362716 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f4f22e52-9145-4de4-99c7-cc20075d3068 tempest-VolumesListAdminTestJSON-1555560392 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:32.423457 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f4f22e52-9145-4de4-99c7-cc20075d3068 tempest-VolumesListAdminTestJSON-1555560392 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:32.486141 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-f4f22e52-9145-4de4-99c7-cc20075d3068 tempest-VolumesListAdminTestJSON-1555560392 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:11:32.491190 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-f4f22e52-9145-4de4-99c7-cc20075d3068 tempest-VolumesListAdminTestJSON-1555560392 None] Deleted volume successfully. Jun 25 21:11:32.510091 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-f4f22e52-9145-4de4-99c7-cc20075d3068 tempest-VolumesListAdminTestJSON-1555560392 None] Lock "b'cinder-ab0a58d8-d8f5-414c-8893-5c437d79b9c0-delete_volume'" released by "delete_volume" :: held 1.060s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:11:32.560716 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-b2b440c3-8b33-46a0-8d6d-ba8782c6bf80 tempest-VolumesBackupsV39Test-575773543 None] Lock "b'cinder-3d5d4665-4543-4d59-8cdc-58a42461ce88-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:11:32.639875 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b2b440c3-8b33-46a0-8d6d-ba8782c6bf80 tempest-VolumesBackupsV39Test-575773543 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:33.835376 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b2b440c3-8b33-46a0-8d6d-ba8782c6bf80 tempest-VolumesBackupsV39Test-575773543 None] Volume volume-3d5d4665-4543-4d59-8cdc-58a42461ce88 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:11:33.890577 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b2b440c3-8b33-46a0-8d6d-ba8782c6bf80 tempest-VolumesBackupsV39Test-575773543 None] deleting rbd volume volume-3d5d4665-4543-4d59-8cdc-58a42461ce88 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:11:34.371875 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:UPDATE=38,cinder:SELECT=56,cinder:INSERT=6 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:34.391659 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-b2b440c3-8b33-46a0-8d6d-ba8782c6bf80 tempest-VolumesBackupsV39Test-575773543 None] Created reservations ['9d0ced08-d6f2-48ac-b0a6-ac32bd2a7315', '71acbf2a-2f57-4b56-ad24-823382e31b3a', '8bd53315-0fa5-434a-9bfa-638272e6a83c', 'a560682f-50f4-4452-b17f-a1b61c3b510f'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:11:34.464263 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b2b440c3-8b33-46a0-8d6d-ba8782c6bf80 tempest-VolumesBackupsV39Test-575773543 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:34.524374 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b2b440c3-8b33-46a0-8d6d-ba8782c6bf80 tempest-VolumesBackupsV39Test-575773543 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:34.604141 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-b2b440c3-8b33-46a0-8d6d-ba8782c6bf80 tempest-VolumesBackupsV39Test-575773543 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:11:34.613320 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-b2b440c3-8b33-46a0-8d6d-ba8782c6bf80 tempest-VolumesBackupsV39Test-575773543 None] Deleted volume successfully. Jun 25 21:11:34.642833 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-b2b440c3-8b33-46a0-8d6d-ba8782c6bf80 tempest-VolumesBackupsV39Test-575773543 None] Lock "b'cinder-3d5d4665-4543-4d59-8cdc-58a42461ce88-delete_volume'" released by "delete_volume" :: held 2.082s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:11:41.743889 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-58aa0fb1-b44f-4abe-9e65-8293b38a8d3c tempest-VolumesMetadataTest-716153679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:11:41.797033 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-58aa0fb1-b44f-4abe-9e65-8293b38a8d3c tempest-VolumesMetadataTest-716153679 None] Flow 'volume_create_manager' (aa95e894-fe79-4fd8-91cf-c5b9df7f370b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:11:41.804483 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-58aa0fb1-b44f-4abe-9e65-8293b38a8d3c tempest-VolumesMetadataTest-716153679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (081bf9b6-c85f-4da0-8382-8c877096f102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:41.824179 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-58aa0fb1-b44f-4abe-9e65-8293b38a8d3c tempest-VolumesMetadataTest-716153679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (081bf9b6-c85f-4da0-8382-8c877096f102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-451959597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b06a7054-55f8-48b2-ab71-8b9d64611b27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5181b01bbc4eb8b3a64d503bc5fa9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:11:42Z,use_quota=True,user_id='9a1c6426288240e7b3d9a44f49b74e19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:41.830863 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-58aa0fb1-b44f-4abe-9e65-8293b38a8d3c tempest-VolumesMetadataTest-716153679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81aa9c47-9103-4362-a2dd-caac17a34e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:41.835361 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-58aa0fb1-b44f-4abe-9e65-8293b38a8d3c tempest-VolumesMetadataTest-716153679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81aa9c47-9103-4362-a2dd-caac17a34e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:41.841640 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-58aa0fb1-b44f-4abe-9e65-8293b38a8d3c tempest-VolumesMetadataTest-716153679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f819b71-765b-42e5-8e7b-0eb6f52a574a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:41.846283 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-58aa0fb1-b44f-4abe-9e65-8293b38a8d3c tempest-VolumesMetadataTest-716153679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f819b71-765b-42e5-8e7b-0eb6f52a574a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b06a7054-55f8-48b2-ab71-8b9d64611b27', 'volume_name': 'volume-b06a7054-55f8-48b2-ab71-8b9d64611b27', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:41.851622 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-58aa0fb1-b44f-4abe-9e65-8293b38a8d3c tempest-VolumesMetadataTest-716153679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4c8b12b-7cbc-4ed2-a0c3-01d340bd3314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:41.856297 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-58aa0fb1-b44f-4abe-9e65-8293b38a8d3c tempest-VolumesMetadataTest-716153679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4c8b12b-7cbc-4ed2-a0c3-01d340bd3314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:41.861750 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-58aa0fb1-b44f-4abe-9e65-8293b38a8d3c tempest-VolumesMetadataTest-716153679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1b6e2f6-d54d-4f22-874b-b4bae53e6023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:41.863230 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-58aa0fb1-b44f-4abe-9e65-8293b38a8d3c tempest-VolumesMetadataTest-716153679 None] Volume b06a7054-55f8-48b2-ab71-8b9d64611b27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b06a7054-55f8-48b2-ab71-8b9d64611b27', 'volume_size': 1} Jun 25 21:11:41.863805 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-58aa0fb1-b44f-4abe-9e65-8293b38a8d3c tempest-VolumesMetadataTest-716153679 None] creating volume 'volume-b06a7054-55f8-48b2-ab71-8b9d64611b27' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:11:41.864813 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-58aa0fb1-b44f-4abe-9e65-8293b38a8d3c tempest-VolumesMetadataTest-716153679 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:41.974807 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-58aa0fb1-b44f-4abe-9e65-8293b38a8d3c tempest-VolumesMetadataTest-716153679 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:11:41.975471 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-58aa0fb1-b44f-4abe-9e65-8293b38a8d3c tempest-VolumesMetadataTest-716153679 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:11:41.979661 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-58aa0fb1-b44f-4abe-9e65-8293b38a8d3c tempest-VolumesMetadataTest-716153679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1b6e2f6-d54d-4f22-874b-b4bae53e6023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b06a7054-55f8-48b2-ab71-8b9d64611b27', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:41.989036 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-58aa0fb1-b44f-4abe-9e65-8293b38a8d3c tempest-VolumesMetadataTest-716153679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f815960-a556-42c9-88ae-f169cc0843ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:42.020524 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-58aa0fb1-b44f-4abe-9e65-8293b38a8d3c tempest-VolumesMetadataTest-716153679 None] Volume volume-b06a7054-55f8-48b2-ab71-8b9d64611b27 (b06a7054-55f8-48b2-ab71-8b9d64611b27): created successfully Jun 25 21:11:42.025940 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-58aa0fb1-b44f-4abe-9e65-8293b38a8d3c tempest-VolumesMetadataTest-716153679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f815960-a556-42c9-88ae-f169cc0843ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:42.033347 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-58aa0fb1-b44f-4abe-9e65-8293b38a8d3c tempest-VolumesMetadataTest-716153679 None] Flow 'volume_create_manager' (aa95e894-fe79-4fd8-91cf-c5b9df7f370b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:11:42.045803 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-58aa0fb1-b44f-4abe-9e65-8293b38a8d3c tempest-VolumesMetadataTest-716153679 None] Created volume successfully. Jun 25 21:11:43.784342 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-2da08988-f138-421a-a957-d8b7e07e6a65 tempest-VolumesMetadataTest-716153679 None] Lock "b'cinder-b06a7054-55f8-48b2-ab71-8b9d64611b27-delete_volume'" acquired by "delete_volume" :: waited 0.027s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:11:43.843071 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2da08988-f138-421a-a957-d8b7e07e6a65 tempest-VolumesMetadataTest-716153679 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:43.934352 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2da08988-f138-421a-a957-d8b7e07e6a65 tempest-VolumesMetadataTest-716153679 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:11:43.934782 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2da08988-f138-421a-a957-d8b7e07e6a65 tempest-VolumesMetadataTest-716153679 None] Volume volume-b06a7054-55f8-48b2-ab71-8b9d64611b27 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:11:43.956766 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2da08988-f138-421a-a957-d8b7e07e6a65 tempest-VolumesMetadataTest-716153679 None] deleting rbd volume volume-b06a7054-55f8-48b2-ab71-8b9d64611b27 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:11:44.754553 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-2da08988-f138-421a-a957-d8b7e07e6a65 tempest-VolumesMetadataTest-716153679 None] Created reservations ['df45d11b-8026-4b83-a9b9-6a47169b342f', '80a518b9-efd2-4424-b368-f94e7d4ba749', '6f3c6569-cc57-4659-9246-8fe66a7915fd', 'beabed5f-8ef4-4fee-a0e2-389dff27fd44'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:11:44.850091 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2da08988-f138-421a-a957-d8b7e07e6a65 tempest-VolumesMetadataTest-716153679 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:44.954811 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2da08988-f138-421a-a957-d8b7e07e6a65 tempest-VolumesMetadataTest-716153679 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:45.036103 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-2da08988-f138-421a-a957-d8b7e07e6a65 tempest-VolumesMetadataTest-716153679 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:11:45.042950 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-2da08988-f138-421a-a957-d8b7e07e6a65 tempest-VolumesMetadataTest-716153679 None] Deleted volume successfully. Jun 25 21:11:45.063415 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-2da08988-f138-421a-a957-d8b7e07e6a65 tempest-VolumesMetadataTest-716153679 None] Lock "b'cinder-b06a7054-55f8-48b2-ab71-8b9d64611b27-delete_volume'" released by "delete_volume" :: held 1.277s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:11:47.450973 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-6cbca8a8-f902-423b-a12e-750672055583 tempest-ServersNegativeTestJSON-2131798312 None] Lock "b'cinder-03b37d92-ce36-48dc-8227-a4cf921c9c6b-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:11:47.545182 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6cbca8a8-f902-423b-a12e-750672055583 tempest-ServersNegativeTestJSON-2131798312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:47.647558 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6cbca8a8-f902-423b-a12e-750672055583 tempest-ServersNegativeTestJSON-2131798312 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:11:47.647913 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6cbca8a8-f902-423b-a12e-750672055583 tempest-ServersNegativeTestJSON-2131798312 None] Volume volume-03b37d92-ce36-48dc-8227-a4cf921c9c6b is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:11:47.659758 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6cbca8a8-f902-423b-a12e-750672055583 tempest-ServersNegativeTestJSON-2131798312 None] deleting rbd volume volume-03b37d92-ce36-48dc-8227-a4cf921c9c6b {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:11:48.118424 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-6cbca8a8-f902-423b-a12e-750672055583 tempest-ServersNegativeTestJSON-2131798312 None] Created reservations ['731d7933-94d5-4c9a-b5a1-c2bbaaa23a7f', 'ab0e6e28-9346-4483-a922-aeaf88e946ff', 'e6db5566-18b5-41f7-bba2-d38bf28b2e61', 'f0c2765c-3adc-43e7-af82-fcade5919290'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:11:48.221496 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6cbca8a8-f902-423b-a12e-750672055583 tempest-ServersNegativeTestJSON-2131798312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:48.306157 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6cbca8a8-f902-423b-a12e-750672055583 tempest-ServersNegativeTestJSON-2131798312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:48.388326 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-6cbca8a8-f902-423b-a12e-750672055583 tempest-ServersNegativeTestJSON-2131798312 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:11:48.395215 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-6cbca8a8-f902-423b-a12e-750672055583 tempest-ServersNegativeTestJSON-2131798312 None] Deleted volume successfully. Jun 25 21:11:48.425589 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-6cbca8a8-f902-423b-a12e-750672055583 tempest-ServersNegativeTestJSON-2131798312 None] Lock "b'cinder-03b37d92-ce36-48dc-8227-a4cf921c9c6b-delete_volume'" released by "delete_volume" :: held 0.975s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:11:48.675757 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-034ae544-ebfb-4555-8619-5655a351996e tempest-ServersNegativeTestJSON-2131798312 None] Lock "b'cinder-dfe1704f-f1a7-473a-9ef3-a3a678f32ff3-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:11:48.749493 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-034ae544-ebfb-4555-8619-5655a351996e tempest-ServersNegativeTestJSON-2131798312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:48.845559 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-034ae544-ebfb-4555-8619-5655a351996e tempest-ServersNegativeTestJSON-2131798312 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:11:48.846168 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-034ae544-ebfb-4555-8619-5655a351996e tempest-ServersNegativeTestJSON-2131798312 None] Volume volume-dfe1704f-f1a7-473a-9ef3-a3a678f32ff3 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:11:48.853992 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-034ae544-ebfb-4555-8619-5655a351996e tempest-ServersNegativeTestJSON-2131798312 None] deleting rbd volume volume-dfe1704f-f1a7-473a-9ef3-a3a678f32ff3 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:11:49.261230 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-034ae544-ebfb-4555-8619-5655a351996e tempest-ServersNegativeTestJSON-2131798312 None] Created reservations ['0d6dc07c-f2d1-4e4c-a05a-da5dca0edc1a', 'f47c749a-c1c7-4cf4-949a-6572b1e5708d', '30bdcf34-fed7-4204-9862-97e1ad538b53', 'ff5e7a28-267f-42d9-b907-a550d5069bd8'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:11:49.354607 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-034ae544-ebfb-4555-8619-5655a351996e tempest-ServersNegativeTestJSON-2131798312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:49.409666 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-034ae544-ebfb-4555-8619-5655a351996e tempest-ServersNegativeTestJSON-2131798312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:49.467507 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-034ae544-ebfb-4555-8619-5655a351996e tempest-ServersNegativeTestJSON-2131798312 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:11:49.472565 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-034ae544-ebfb-4555-8619-5655a351996e tempest-ServersNegativeTestJSON-2131798312 None] Deleted volume successfully. Jun 25 21:11:49.499385 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-034ae544-ebfb-4555-8619-5655a351996e tempest-ServersNegativeTestJSON-2131798312 None] Lock "b'cinder-dfe1704f-f1a7-473a-9ef3-a3a678f32ff3-delete_volume'" released by "delete_volume" :: held 0.824s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:11:50.966539 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=54,cinder:DELETE=3,cinder:UPDATE=37,cinder:INSERT=6 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:50.975863 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae022722-2ce6-4457-900c-a37245b88c07 tempest-VolumesListTestJSON-984325300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:11:50.995589 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ae022722-2ce6-4457-900c-a37245b88c07 tempest-VolumesListTestJSON-984325300 None] Flow 'volume_create_manager' (c61c2b98-2707-4b1b-bb2b-91c17f0c7f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:11:51.002041 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ae022722-2ce6-4457-900c-a37245b88c07 tempest-VolumesListTestJSON-984325300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58b648e2-42d1-4479-bb27-d125b188f065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:51.020222 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ae022722-2ce6-4457-900c-a37245b88c07 tempest-VolumesListTestJSON-984325300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58b648e2-42d1-4479-bb27-d125b188f065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1280254603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=073b2f5c-f75f-44f4-8fec-9972f78d616c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b05e14f0b76a41f88c1b7de024102aed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:11:51Z,use_quota=True,user_id='d84cb991e49d4b15909b91d8d37843ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:51.025702 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ae022722-2ce6-4457-900c-a37245b88c07 tempest-VolumesListTestJSON-984325300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdb73901-0f09-49a3-a5dc-11a8805c98cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:51.030110 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ae022722-2ce6-4457-900c-a37245b88c07 tempest-VolumesListTestJSON-984325300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdb73901-0f09-49a3-a5dc-11a8805c98cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:51.035372 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ae022722-2ce6-4457-900c-a37245b88c07 tempest-VolumesListTestJSON-984325300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (520978e8-a60f-472d-9385-44f80221a635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:51.039356 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ae022722-2ce6-4457-900c-a37245b88c07 tempest-VolumesListTestJSON-984325300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (520978e8-a60f-472d-9385-44f80221a635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '073b2f5c-f75f-44f4-8fec-9972f78d616c', 'volume_name': 'volume-073b2f5c-f75f-44f4-8fec-9972f78d616c', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:51.044682 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ae022722-2ce6-4457-900c-a37245b88c07 tempest-VolumesListTestJSON-984325300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a134c95d-f320-462a-881d-e3aed3b82db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:51.049083 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ae022722-2ce6-4457-900c-a37245b88c07 tempest-VolumesListTestJSON-984325300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a134c95d-f320-462a-881d-e3aed3b82db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:51.054145 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ae022722-2ce6-4457-900c-a37245b88c07 tempest-VolumesListTestJSON-984325300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c633a40-c2e3-46f7-9271-134f5872a5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:51.055093 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-ae022722-2ce6-4457-900c-a37245b88c07 tempest-VolumesListTestJSON-984325300 None] Volume 073b2f5c-f75f-44f4-8fec-9972f78d616c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-073b2f5c-f75f-44f4-8fec-9972f78d616c', 'volume_size': 1} Jun 25 21:11:51.055482 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ae022722-2ce6-4457-900c-a37245b88c07 tempest-VolumesListTestJSON-984325300 None] creating volume 'volume-073b2f5c-f75f-44f4-8fec-9972f78d616c' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:11:51.056259 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ae022722-2ce6-4457-900c-a37245b88c07 tempest-VolumesListTestJSON-984325300 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:51.139501 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ae022722-2ce6-4457-900c-a37245b88c07 tempest-VolumesListTestJSON-984325300 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:11:51.140247 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ae022722-2ce6-4457-900c-a37245b88c07 tempest-VolumesListTestJSON-984325300 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:11:51.144217 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ae022722-2ce6-4457-900c-a37245b88c07 tempest-VolumesListTestJSON-984325300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c633a40-c2e3-46f7-9271-134f5872a5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-073b2f5c-f75f-44f4-8fec-9972f78d616c', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:51.148847 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ae022722-2ce6-4457-900c-a37245b88c07 tempest-VolumesListTestJSON-984325300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b405d634-9c4b-4712-a21b-11bba5a879e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:51.159276 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-ae022722-2ce6-4457-900c-a37245b88c07 tempest-VolumesListTestJSON-984325300 None] Volume volume-073b2f5c-f75f-44f4-8fec-9972f78d616c (073b2f5c-f75f-44f4-8fec-9972f78d616c): created successfully Jun 25 21:11:51.163247 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ae022722-2ce6-4457-900c-a37245b88c07 tempest-VolumesListTestJSON-984325300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b405d634-9c4b-4712-a21b-11bba5a879e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:51.168922 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ae022722-2ce6-4457-900c-a37245b88c07 tempest-VolumesListTestJSON-984325300 None] Flow 'volume_create_manager' (c61c2b98-2707-4b1b-bb2b-91c17f0c7f2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:11:51.183197 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-ae022722-2ce6-4457-900c-a37245b88c07 tempest-VolumesListTestJSON-984325300 None] Created volume successfully. Jun 25 21:11:53.022000 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:UPDATE=34,cinder:SELECT=53,cinder:DELETE=3,cinder:INSERT=10 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:53.073653 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-a34333b0-55b5-464e-b316-c1585627cf61 tempest-VolumesListTestJSON-984325300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:11:53.143386 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a34333b0-55b5-464e-b316-c1585627cf61 tempest-VolumesListTestJSON-984325300 None] Flow 'volume_create_manager' (42d935ad-9f64-4eb3-a890-76942cab020a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:11:53.153043 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a34333b0-55b5-464e-b316-c1585627cf61 tempest-VolumesListTestJSON-984325300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebd7b0a4-5fe4-496d-80c6-274c30ec6cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:53.182308 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a34333b0-55b5-464e-b316-c1585627cf61 tempest-VolumesListTestJSON-984325300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebd7b0a4-5fe4-496d-80c6-274c30ec6cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-878650908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=21942eea-fd6f-4195-8f8a-2014abe9ebbf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b05e14f0b76a41f88c1b7de024102aed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:11:53Z,use_quota=True,user_id='d84cb991e49d4b15909b91d8d37843ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:53.192943 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a34333b0-55b5-464e-b316-c1585627cf61 tempest-VolumesListTestJSON-984325300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (893fb147-b214-4049-9c4f-d127e3d84afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:53.199062 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a34333b0-55b5-464e-b316-c1585627cf61 tempest-VolumesListTestJSON-984325300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (893fb147-b214-4049-9c4f-d127e3d84afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:53.207554 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a34333b0-55b5-464e-b316-c1585627cf61 tempest-VolumesListTestJSON-984325300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d519016-65bc-4bf9-b6e8-7aa9779343b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:53.216203 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a34333b0-55b5-464e-b316-c1585627cf61 tempest-VolumesListTestJSON-984325300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d519016-65bc-4bf9-b6e8-7aa9779343b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21942eea-fd6f-4195-8f8a-2014abe9ebbf', 'volume_name': 'volume-21942eea-fd6f-4195-8f8a-2014abe9ebbf', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:53.223255 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a34333b0-55b5-464e-b316-c1585627cf61 tempest-VolumesListTestJSON-984325300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3adaa669-2501-48a5-ae65-68b55cb6ea44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:53.232441 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a34333b0-55b5-464e-b316-c1585627cf61 tempest-VolumesListTestJSON-984325300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3adaa669-2501-48a5-ae65-68b55cb6ea44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:53.239509 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a34333b0-55b5-464e-b316-c1585627cf61 tempest-VolumesListTestJSON-984325300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e92de9fe-f9fe-4f64-b6f8-0b1e2e2b95ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:53.242006 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-a34333b0-55b5-464e-b316-c1585627cf61 tempest-VolumesListTestJSON-984325300 None] Volume 21942eea-fd6f-4195-8f8a-2014abe9ebbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21942eea-fd6f-4195-8f8a-2014abe9ebbf', 'volume_size': 1} Jun 25 21:11:53.242695 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a34333b0-55b5-464e-b316-c1585627cf61 tempest-VolumesListTestJSON-984325300 None] creating volume 'volume-21942eea-fd6f-4195-8f8a-2014abe9ebbf' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:11:53.243781 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a34333b0-55b5-464e-b316-c1585627cf61 tempest-VolumesListTestJSON-984325300 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:53.410949 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a34333b0-55b5-464e-b316-c1585627cf61 tempest-VolumesListTestJSON-984325300 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:11:53.411331 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a34333b0-55b5-464e-b316-c1585627cf61 tempest-VolumesListTestJSON-984325300 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:11:53.415233 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a34333b0-55b5-464e-b316-c1585627cf61 tempest-VolumesListTestJSON-984325300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e92de9fe-f9fe-4f64-b6f8-0b1e2e2b95ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21942eea-fd6f-4195-8f8a-2014abe9ebbf', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:53.419919 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a34333b0-55b5-464e-b316-c1585627cf61 tempest-VolumesListTestJSON-984325300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b2b5e85-d86f-43c4-a0f4-65f4a2fe3ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:53.455222 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-a34333b0-55b5-464e-b316-c1585627cf61 tempest-VolumesListTestJSON-984325300 None] Volume volume-21942eea-fd6f-4195-8f8a-2014abe9ebbf (21942eea-fd6f-4195-8f8a-2014abe9ebbf): created successfully Jun 25 21:11:53.465114 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a34333b0-55b5-464e-b316-c1585627cf61 tempest-VolumesListTestJSON-984325300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b2b5e85-d86f-43c4-a0f4-65f4a2fe3ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:53.483085 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a34333b0-55b5-464e-b316-c1585627cf61 tempest-VolumesListTestJSON-984325300 None] Flow 'volume_create_manager' (42d935ad-9f64-4eb3-a890-76942cab020a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:11:53.512159 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-a34333b0-55b5-464e-b316-c1585627cf61 tempest-VolumesListTestJSON-984325300 None] Created volume successfully. Jun 25 21:11:55.091373 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-789ffbe6-3929-4b26-a619-0ca62f12c00c tempest-VolumesListTestJSON-984325300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:11:55.148860 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-789ffbe6-3929-4b26-a619-0ca62f12c00c tempest-VolumesListTestJSON-984325300 None] Flow 'volume_create_manager' (60d49a53-c0b2-41b5-b62d-c2e1e029c55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:11:55.157091 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-789ffbe6-3929-4b26-a619-0ca62f12c00c tempest-VolumesListTestJSON-984325300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a96941ff-d4f0-4230-9b4d-2b2f194d4516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:55.207203 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-789ffbe6-3929-4b26-a619-0ca62f12c00c tempest-VolumesListTestJSON-984325300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a96941ff-d4f0-4230-9b4d-2b2f194d4516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-143745293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2b368794-f289-42f9-aa2b-082d536fdb8e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b05e14f0b76a41f88c1b7de024102aed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:11:55Z,use_quota=True,user_id='d84cb991e49d4b15909b91d8d37843ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:55.218445 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-789ffbe6-3929-4b26-a619-0ca62f12c00c tempest-VolumesListTestJSON-984325300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c7b4b0e-7d8c-4fa5-aa28-26e9a61cf82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:55.233213 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-789ffbe6-3929-4b26-a619-0ca62f12c00c tempest-VolumesListTestJSON-984325300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c7b4b0e-7d8c-4fa5-aa28-26e9a61cf82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:55.238903 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-789ffbe6-3929-4b26-a619-0ca62f12c00c tempest-VolumesListTestJSON-984325300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (125b3759-48f6-46f1-9bd7-28800e076a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:55.251720 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-789ffbe6-3929-4b26-a619-0ca62f12c00c tempest-VolumesListTestJSON-984325300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (125b3759-48f6-46f1-9bd7-28800e076a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b368794-f289-42f9-aa2b-082d536fdb8e', 'volume_name': 'volume-2b368794-f289-42f9-aa2b-082d536fdb8e', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:55.268202 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-789ffbe6-3929-4b26-a619-0ca62f12c00c tempest-VolumesListTestJSON-984325300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49f1be0f-6100-42cd-9f44-81c2685548f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:55.277345 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-789ffbe6-3929-4b26-a619-0ca62f12c00c tempest-VolumesListTestJSON-984325300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49f1be0f-6100-42cd-9f44-81c2685548f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:55.284652 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-789ffbe6-3929-4b26-a619-0ca62f12c00c tempest-VolumesListTestJSON-984325300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd32b3ed-f19e-4560-8f05-819fb5b9eee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:55.289151 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-789ffbe6-3929-4b26-a619-0ca62f12c00c tempest-VolumesListTestJSON-984325300 None] Volume 2b368794-f289-42f9-aa2b-082d536fdb8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b368794-f289-42f9-aa2b-082d536fdb8e', 'volume_size': 1} Jun 25 21:11:55.290098 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-789ffbe6-3929-4b26-a619-0ca62f12c00c tempest-VolumesListTestJSON-984325300 None] creating volume 'volume-2b368794-f289-42f9-aa2b-082d536fdb8e' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:11:55.291055 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-789ffbe6-3929-4b26-a619-0ca62f12c00c tempest-VolumesListTestJSON-984325300 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:11:55.409191 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-789ffbe6-3929-4b26-a619-0ca62f12c00c tempest-VolumesListTestJSON-984325300 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:11:55.409781 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-789ffbe6-3929-4b26-a619-0ca62f12c00c tempest-VolumesListTestJSON-984325300 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:11:55.415511 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-789ffbe6-3929-4b26-a619-0ca62f12c00c tempest-VolumesListTestJSON-984325300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd32b3ed-f19e-4560-8f05-819fb5b9eee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b368794-f289-42f9-aa2b-082d536fdb8e', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:55.422351 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-789ffbe6-3929-4b26-a619-0ca62f12c00c tempest-VolumesListTestJSON-984325300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01dc17b2-9f97-48d3-8e84-25f08f16803f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:11:55.439253 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-789ffbe6-3929-4b26-a619-0ca62f12c00c tempest-VolumesListTestJSON-984325300 None] Volume volume-2b368794-f289-42f9-aa2b-082d536fdb8e (2b368794-f289-42f9-aa2b-082d536fdb8e): created successfully Jun 25 21:11:55.450036 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-789ffbe6-3929-4b26-a619-0ca62f12c00c tempest-VolumesListTestJSON-984325300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01dc17b2-9f97-48d3-8e84-25f08f16803f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:11:55.460080 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-789ffbe6-3929-4b26-a619-0ca62f12c00c tempest-VolumesListTestJSON-984325300 None] Flow 'volume_create_manager' (60d49a53-c0b2-41b5-b62d-c2e1e029c55c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:11:55.484468 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-789ffbe6-3929-4b26-a619-0ca62f12c00c tempest-VolumesListTestJSON-984325300 None] Created volume successfully. Jun 25 21:12:00.726170 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-f5d73d62-908c-4ef9-a57e-5f94ba8fcd32 tempest-VolumesListTestJSON-984325300 None] Lock "b'cinder-2b368794-f289-42f9-aa2b-082d536fdb8e-delete_volume'" acquired by "delete_volume" :: waited 0.033s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:12:00.842325 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f5d73d62-908c-4ef9-a57e-5f94ba8fcd32 tempest-VolumesListTestJSON-984325300 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:12:00.974239 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f5d73d62-908c-4ef9-a57e-5f94ba8fcd32 tempest-VolumesListTestJSON-984325300 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:12:00.974998 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f5d73d62-908c-4ef9-a57e-5f94ba8fcd32 tempest-VolumesListTestJSON-984325300 None] Volume volume-2b368794-f289-42f9-aa2b-082d536fdb8e is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:12:00.992209 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f5d73d62-908c-4ef9-a57e-5f94ba8fcd32 tempest-VolumesListTestJSON-984325300 None] deleting rbd volume volume-2b368794-f289-42f9-aa2b-082d536fdb8e {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:12:01.596558 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-f5d73d62-908c-4ef9-a57e-5f94ba8fcd32 tempest-VolumesListTestJSON-984325300 None] Created reservations ['aa961d6b-10b6-4517-8928-632748ab9fad', 'a0cd7839-118a-402b-b87b-2646b50df1a5', 'd5d329da-d4a5-415f-a2d1-501e3c29ea7c', '8eeed4f6-55e8-48ba-ac1b-9e841d37e93b'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:12:01.690792 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f5d73d62-908c-4ef9-a57e-5f94ba8fcd32 tempest-VolumesListTestJSON-984325300 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:12:01.762339 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f5d73d62-908c-4ef9-a57e-5f94ba8fcd32 tempest-VolumesListTestJSON-984325300 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:12:01.820824 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-f5d73d62-908c-4ef9-a57e-5f94ba8fcd32 tempest-VolumesListTestJSON-984325300 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:12:01.825631 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-f5d73d62-908c-4ef9-a57e-5f94ba8fcd32 tempest-VolumesListTestJSON-984325300 None] Deleted volume successfully. Jun 25 21:12:01.853966 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-f5d73d62-908c-4ef9-a57e-5f94ba8fcd32 tempest-VolumesListTestJSON-984325300 None] Lock "b'cinder-2b368794-f289-42f9-aa2b-082d536fdb8e-delete_volume'" released by "delete_volume" :: held 1.128s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:12:02.077225 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-8b85390e-6060-4e60-9adb-714ee0b608f5 tempest-VolumesListTestJSON-984325300 None] Lock "b'cinder-21942eea-fd6f-4195-8f8a-2014abe9ebbf-delete_volume'" acquired by "delete_volume" :: waited 0.026s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:12:02.165997 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8b85390e-6060-4e60-9adb-714ee0b608f5 tempest-VolumesListTestJSON-984325300 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:12:02.277828 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8b85390e-6060-4e60-9adb-714ee0b608f5 tempest-VolumesListTestJSON-984325300 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:12:02.278215 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8b85390e-6060-4e60-9adb-714ee0b608f5 tempest-VolumesListTestJSON-984325300 None] Volume volume-21942eea-fd6f-4195-8f8a-2014abe9ebbf is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:12:02.301396 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8b85390e-6060-4e60-9adb-714ee0b608f5 tempest-VolumesListTestJSON-984325300 None] deleting rbd volume volume-21942eea-fd6f-4195-8f8a-2014abe9ebbf {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:12:02.871607 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-8b85390e-6060-4e60-9adb-714ee0b608f5 tempest-VolumesListTestJSON-984325300 None] Created reservations ['546f35df-843d-46d4-89f0-a5e5afd7e179', 'bcc1382c-4cca-4fe3-bb55-4cd56d69070b', '68c13edc-85ea-4d2f-b508-0a915b9653e4', 'b1bb011e-da00-4bf1-bd90-83e5e9a33d5e'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:12:03.018694 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8b85390e-6060-4e60-9adb-714ee0b608f5 tempest-VolumesListTestJSON-984325300 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:12:03.161296 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8b85390e-6060-4e60-9adb-714ee0b608f5 tempest-VolumesListTestJSON-984325300 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:12:03.275840 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8b85390e-6060-4e60-9adb-714ee0b608f5 tempest-VolumesListTestJSON-984325300 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:12:03.281468 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-8b85390e-6060-4e60-9adb-714ee0b608f5 tempest-VolumesListTestJSON-984325300 None] Deleted volume successfully. Jun 25 21:12:03.316122 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-8b85390e-6060-4e60-9adb-714ee0b608f5 tempest-VolumesListTestJSON-984325300 None] Lock "b'cinder-21942eea-fd6f-4195-8f8a-2014abe9ebbf-delete_volume'" released by "delete_volume" :: held 1.239s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:12:03.387668 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-daab7c3b-6fb9-4c32-ac92-a9a7e32cb087 tempest-VolumesListTestJSON-984325300 None] Lock "b'cinder-073b2f5c-f75f-44f4-8fec-9972f78d616c-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:12:03.493195 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-daab7c3b-6fb9-4c32-ac92-a9a7e32cb087 tempest-VolumesListTestJSON-984325300 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:12:03.621738 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-daab7c3b-6fb9-4c32-ac92-a9a7e32cb087 tempest-VolumesListTestJSON-984325300 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:12:03.624176 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-daab7c3b-6fb9-4c32-ac92-a9a7e32cb087 tempest-VolumesListTestJSON-984325300 None] Volume volume-073b2f5c-f75f-44f4-8fec-9972f78d616c is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:12:03.643046 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-daab7c3b-6fb9-4c32-ac92-a9a7e32cb087 tempest-VolumesListTestJSON-984325300 None] deleting rbd volume volume-073b2f5c-f75f-44f4-8fec-9972f78d616c {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:12:04.274174 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-daab7c3b-6fb9-4c32-ac92-a9a7e32cb087 tempest-VolumesListTestJSON-984325300 None] Created reservations ['74ed71c7-706e-4e91-ac80-ee98d2051c83', 'eceed48d-dff0-44e3-9a18-59fa4d058462', 'df66c80c-68f9-4d57-a4e4-8fcd35982abe', 'a9a52eca-c7fb-4e62-aadd-009a6b28fe3f'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:12:04.426670 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-daab7c3b-6fb9-4c32-ac92-a9a7e32cb087 tempest-VolumesListTestJSON-984325300 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:12:04.552015 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-daab7c3b-6fb9-4c32-ac92-a9a7e32cb087 tempest-VolumesListTestJSON-984325300 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:12:04.672955 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-daab7c3b-6fb9-4c32-ac92-a9a7e32cb087 tempest-VolumesListTestJSON-984325300 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:12:04.679072 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-daab7c3b-6fb9-4c32-ac92-a9a7e32cb087 tempest-VolumesListTestJSON-984325300 None] Deleted volume successfully. Jun 25 21:12:04.708451 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-daab7c3b-6fb9-4c32-ac92-a9a7e32cb087 tempest-VolumesListTestJSON-984325300 None] Lock "b'cinder-073b2f5c-f75f-44f4-8fec-9972f78d616c-delete_volume'" released by "delete_volume" :: held 1.319s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:12:06.942585 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=51,cinder:DELETE=5,cinder:UPDATE=37,cinder:INSERT=7 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:06.956197 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-345199f8-7ea8-4b98-9164-5b1ebd981f40 req-e91bd6cf-7037-41fa-82c6-8afc0d83dc4f tempest-AttachVolumeTestJSON-931041757 None] Terminate volume connection completed successfully. Jun 25 21:12:06.956667 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-345199f8-7ea8-4b98-9164-5b1ebd981f40 req-e91bd6cf-7037-41fa-82c6-8afc0d83dc4f tempest-AttachVolumeTestJSON-931041757 None] Deleting attachment b068a5d8-684e-4b56-aad2-c3864774a718. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 25 21:12:23.974764 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:UPDATE=20,cinder:SELECT=49,cinder:DELETE=1,cinder:INSERT=5 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:43.974995 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:52.148881 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:12:52.149821 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:12:52.228391 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:12:52.310655 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:12:53.975914 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:03.974688 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:13.975762 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:20.727473 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-1bf16cb2-373e-4afb-ba79-b869ff36956a req-1e4ffde6-b066-44c0-bf3a-9144bacba95a tempest-TaggedBootDevicesTest-57416562 None] Terminate volume connection completed successfully. Jun 25 21:13:20.730025 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-1bf16cb2-373e-4afb-ba79-b869ff36956a req-1e4ffde6-b066-44c0-bf3a-9144bacba95a tempest-TaggedBootDevicesTest-57416562 None] Deleting attachment 469002cd-7e89-45e0-90e7-60d08faf7155. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 25 21:13:20.999045 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-1bf16cb2-373e-4afb-ba79-b869ff36956a req-16ac5d49-e52e-4055-8997-477fbdbb8941 tempest-TaggedBootDevicesTest-57416562 None] Terminate volume connection completed successfully. Jun 25 21:13:21.000360 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-1bf16cb2-373e-4afb-ba79-b869ff36956a req-16ac5d49-e52e-4055-8997-477fbdbb8941 tempest-TaggedBootDevicesTest-57416562 None] Deleting attachment 93a81893-9f37-4d1a-8d4a-e1da17ce50dc. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 25 21:13:21.280774 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-1bf16cb2-373e-4afb-ba79-b869ff36956a req-b21a12dc-bd63-4334-9be3-94378e91d3fb tempest-TaggedBootDevicesTest-57416562 None] Terminate volume connection completed successfully. Jun 25 21:13:21.283670 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-1bf16cb2-373e-4afb-ba79-b869ff36956a req-b21a12dc-bd63-4334-9be3-94378e91d3fb tempest-TaggedBootDevicesTest-57416562 None] Deleting attachment c3418d67-c097-495e-aa4c-ccb8aa10accb. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 25 21:13:32.996720 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-d8bf90b4-8a05-427c-aa5b-743c7075ec49 tempest-TaggedBootDevicesTest-57416562 None] Lock "b'cinder-10e6b373-c491-4f43-9dc5-373fa07f9035-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:13:33.100506 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d8bf90b4-8a05-427c-aa5b-743c7075ec49 tempest-TaggedBootDevicesTest-57416562 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:13:33.186982 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d8bf90b4-8a05-427c-aa5b-743c7075ec49 tempest-TaggedBootDevicesTest-57416562 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:13:33.187560 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d8bf90b4-8a05-427c-aa5b-743c7075ec49 tempest-TaggedBootDevicesTest-57416562 None] Volume volume-10e6b373-c491-4f43-9dc5-373fa07f9035 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:13:33.207432 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d8bf90b4-8a05-427c-aa5b-743c7075ec49 tempest-TaggedBootDevicesTest-57416562 None] deleting rbd volume volume-10e6b373-c491-4f43-9dc5-373fa07f9035 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:13:33.634496 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-d8bf90b4-8a05-427c-aa5b-743c7075ec49 tempest-TaggedBootDevicesTest-57416562 None] Created reservations ['8b9459fd-2f2c-4454-bd97-d7d2edff3b12', '1af07cd8-87cd-4d28-9698-b7f2fab4ae80', '1a02aaf5-cc16-475e-856d-c50958785c61', '1c2aa6bf-cacb-4fa8-b301-0b4526b11eeb'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:13:33.779057 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d8bf90b4-8a05-427c-aa5b-743c7075ec49 tempest-TaggedBootDevicesTest-57416562 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:13:33.875672 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d8bf90b4-8a05-427c-aa5b-743c7075ec49 tempest-TaggedBootDevicesTest-57416562 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:13:33.952143 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d8bf90b4-8a05-427c-aa5b-743c7075ec49 tempest-TaggedBootDevicesTest-57416562 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:13:33.958662 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-d8bf90b4-8a05-427c-aa5b-743c7075ec49 tempest-TaggedBootDevicesTest-57416562 None] Deleted volume successfully. Jun 25 21:13:34.033288 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=25,cinder:UPDATE=11,cinder:INSERT=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:34.072344 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-d8bf90b4-8a05-427c-aa5b-743c7075ec49 tempest-TaggedBootDevicesTest-57416562 None] Lock "b'cinder-10e6b373-c491-4f43-9dc5-373fa07f9035-delete_volume'" released by "delete_volume" :: held 1.076s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:13:34.437465 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-f30b737d-cad3-4ac9-a09a-79da59551849 tempest-TaggedBootDevicesTest-57416562 None] Lock "b'cinder-c7e78dca-d01a-47b0-9d2e-8dfacce8d58b-delete_volume'" acquired by "delete_volume" :: waited 0.032s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:13:34.527680 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f30b737d-cad3-4ac9-a09a-79da59551849 tempest-TaggedBootDevicesTest-57416562 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:13:34.633207 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f30b737d-cad3-4ac9-a09a-79da59551849 tempest-TaggedBootDevicesTest-57416562 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:13:34.633630 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f30b737d-cad3-4ac9-a09a-79da59551849 tempest-TaggedBootDevicesTest-57416562 None] Volume volume-c7e78dca-d01a-47b0-9d2e-8dfacce8d58b is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:13:34.643716 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f30b737d-cad3-4ac9-a09a-79da59551849 tempest-TaggedBootDevicesTest-57416562 None] deleting rbd volume volume-c7e78dca-d01a-47b0-9d2e-8dfacce8d58b {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:13:35.221343 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-f30b737d-cad3-4ac9-a09a-79da59551849 tempest-TaggedBootDevicesTest-57416562 None] Created reservations ['3081755f-7f80-4a33-9217-7f3b029cb1a0', '89959182-e7ee-47d1-ae77-18c570a501f5', 'fa1863cc-4888-4132-bed5-ffdd65b30b47', '48ef00bf-daed-419f-ab24-370bf351397e'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:13:35.322873 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f30b737d-cad3-4ac9-a09a-79da59551849 tempest-TaggedBootDevicesTest-57416562 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:13:35.415536 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f30b737d-cad3-4ac9-a09a-79da59551849 tempest-TaggedBootDevicesTest-57416562 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:13:35.477355 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-f30b737d-cad3-4ac9-a09a-79da59551849 tempest-TaggedBootDevicesTest-57416562 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:13:35.486336 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-f30b737d-cad3-4ac9-a09a-79da59551849 tempest-TaggedBootDevicesTest-57416562 None] Deleted volume successfully. Jun 25 21:13:35.520989 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-f30b737d-cad3-4ac9-a09a-79da59551849 tempest-TaggedBootDevicesTest-57416562 None] Lock "b'cinder-c7e78dca-d01a-47b0-9d2e-8dfacce8d58b-delete_volume'" released by "delete_volume" :: held 1.083s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:13:35.645563 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-c3a069c0-0b1c-4761-9459-6e8d8ac3d770 tempest-TaggedBootDevicesTest-57416562 None] Lock "b'cinder-5ce7b5ae-636f-4c81-8e58-e20f8d77d741-delete_volume'" acquired by "delete_volume" :: waited 0.027s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:13:35.749130 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c3a069c0-0b1c-4761-9459-6e8d8ac3d770 tempest-TaggedBootDevicesTest-57416562 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:13:35.941741 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c3a069c0-0b1c-4761-9459-6e8d8ac3d770 tempest-TaggedBootDevicesTest-57416562 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:13:35.951745 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c3a069c0-0b1c-4761-9459-6e8d8ac3d770 tempest-TaggedBootDevicesTest-57416562 None] deleting rbd volume volume-5ce7b5ae-636f-4c81-8e58-e20f8d77d741 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:13:36.596960 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c3a069c0-0b1c-4761-9459-6e8d8ac3d770 tempest-TaggedBootDevicesTest-57416562 None] volume is a clone so cleaning references {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jun 25 21:13:36.647174 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c3a069c0-0b1c-4761-9459-6e8d8ac3d770 tempest-TaggedBootDevicesTest-57416562 None] deleting parent snapshot volume-5ce7b5ae-636f-4c81-8e58-e20f8d77d741.clone_snap {{(pid=130674) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jun 25 21:13:37.107461 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-c3a069c0-0b1c-4761-9459-6e8d8ac3d770 tempest-TaggedBootDevicesTest-57416562 None] Created reservations ['aaed6e31-74ae-4d41-a9dc-de3870596320', '30e5ed33-9af3-4083-ba62-4f67ae2a717e', '103ed0a1-3357-4a50-aae1-5e9e8bc2e137', '795df1c4-d5a9-46db-84f5-4b70e353244d'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:13:37.238947 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c3a069c0-0b1c-4761-9459-6e8d8ac3d770 tempest-TaggedBootDevicesTest-57416562 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:13:37.335116 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c3a069c0-0b1c-4761-9459-6e8d8ac3d770 tempest-TaggedBootDevicesTest-57416562 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:13:37.428320 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-c3a069c0-0b1c-4761-9459-6e8d8ac3d770 tempest-TaggedBootDevicesTest-57416562 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:13:37.433962 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-c3a069c0-0b1c-4761-9459-6e8d8ac3d770 tempest-TaggedBootDevicesTest-57416562 None] Deleted volume successfully. Jun 25 21:13:37.482380 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-c3a069c0-0b1c-4761-9459-6e8d8ac3d770 tempest-TaggedBootDevicesTest-57416562 None] Lock "b'cinder-5ce7b5ae-636f-4c81-8e58-e20f8d77d741-delete_volume'" released by "delete_volume" :: held 1.837s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:13:52.147115 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:13:52.148648 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:13:52.188299 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:13:52.219029 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:13:53.981549 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=47,cinder:UPDATE=24,cinder:INSERT=6,cinder:DELETE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:56.227470 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-79c2c6de-bc15-4174-b38e-3fc10734d67b tempest-BackendsCapabilitiesAdminTestsJSON-1620270789 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:b8435c3c-9c73-4367-b32e-070fd9e26614:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=130674) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4736}} Jun 25 21:13:56.274955 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a8a82689-4458-4ce5-bf6c-aa9d7aed010d tempest-BackendsCapabilitiesAdminTestsJSON-1620270789 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:b8435c3c-9c73-4367-b32e-070fd9e26614:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=130674) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4736}} Jun 25 21:14:10.117233 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-9bf45eec-3b55-4c66-a438-026ebaa8c0b4 tempest-GroupsV320Test-1470063641 None] Group tempest-GroupsV320Test-Group-1393781641: creating Jun 25 21:14:10.121321 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=29,cinder:INSERT=4,cinder:UPDATE=19 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:10.165084 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-9bf45eec-3b55-4c66-a438-026ebaa8c0b4 tempest-GroupsV320Test-1470063641 None] Group tempest-GroupsV320Test-Group-1393781641: created successfully Jun 25 21:14:10.175407 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-9bf45eec-3b55-4c66-a438-026ebaa8c0b4 tempest-GroupsV320Test-1470063641 None] Create group completed successfully. Jun 25 21:14:12.016399 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-9b323107-b41e-4bd5-8a7f-5968ae3bebab tempest-GroupsV320Test-1470063641 None] Created reservations ['8e65823d-03f2-48f5-879d-62ae926432a8'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:14:12.079479 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9b323107-b41e-4bd5-8a7f-5968ae3bebab tempest-GroupsV320Test-1470063641 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:14:12.142043 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9b323107-b41e-4bd5-8a7f-5968ae3bebab tempest-GroupsV320Test-1470063641 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:14:12.215726 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-9b323107-b41e-4bd5-8a7f-5968ae3bebab tempest-GroupsV320Test-1470063641 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:14:12.221082 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-9b323107-b41e-4bd5-8a7f-5968ae3bebab tempest-GroupsV320Test-1470063641 None] Delete group completed successfully. Jun 25 21:14:14.703855 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-273b7bae-fc3a-4c04-92bd-34d5aede8a64 req-5b29813e-ebee-447a-be09-c35b71d11f88 tempest-TaggedBootDevicesTest_v242-1841146700 None] Terminate volume connection completed successfully. Jun 25 21:14:14.704412 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-273b7bae-fc3a-4c04-92bd-34d5aede8a64 req-5b29813e-ebee-447a-be09-c35b71d11f88 tempest-TaggedBootDevicesTest_v242-1841146700 None] Deleting attachment 4c8ead11-712c-4da8-a576-04039419404d. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 25 21:14:14.869519 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-273b7bae-fc3a-4c04-92bd-34d5aede8a64 req-d905f238-18ab-4e24-ba6a-9ed83c39d36c tempest-TaggedBootDevicesTest_v242-1841146700 None] Terminate volume connection completed successfully. Jun 25 21:14:14.870404 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-273b7bae-fc3a-4c04-92bd-34d5aede8a64 req-d905f238-18ab-4e24-ba6a-9ed83c39d36c tempest-TaggedBootDevicesTest_v242-1841146700 None] Deleting attachment c85e13e2-c21a-4a02-b00d-a45c5db53608. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 25 21:14:15.093707 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-273b7bae-fc3a-4c04-92bd-34d5aede8a64 req-8c0c0097-9fc1-4a9f-b1d6-1b2765f1d301 tempest-TaggedBootDevicesTest_v242-1841146700 None] Terminate volume connection completed successfully. Jun 25 21:14:15.094488 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-273b7bae-fc3a-4c04-92bd-34d5aede8a64 req-8c0c0097-9fc1-4a9f-b1d6-1b2765f1d301 tempest-TaggedBootDevicesTest_v242-1841146700 None] Deleting attachment 24cf4600-2980-43b1-ba34-c9173b3b2b4a. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 25 21:14:23.973163 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-5b7078ed-597b-46ca-b523-430e4df35973 tempest-TaggedBootDevicesTest_v242-1841146700 None] Lock "b'cinder-3021df6d-a2e9-4c08-8bf1-d7b623d3d3cf-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:14:24.011551 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=31,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:24.030953 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5b7078ed-597b-46ca-b523-430e4df35973 tempest-TaggedBootDevicesTest_v242-1841146700 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:14:24.124538 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5b7078ed-597b-46ca-b523-430e4df35973 tempest-TaggedBootDevicesTest_v242-1841146700 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:14:24.124982 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5b7078ed-597b-46ca-b523-430e4df35973 tempest-TaggedBootDevicesTest_v242-1841146700 None] Volume volume-3021df6d-a2e9-4c08-8bf1-d7b623d3d3cf is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:14:24.134376 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5b7078ed-597b-46ca-b523-430e4df35973 tempest-TaggedBootDevicesTest_v242-1841146700 None] deleting rbd volume volume-3021df6d-a2e9-4c08-8bf1-d7b623d3d3cf {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:14:24.468319 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-5b7078ed-597b-46ca-b523-430e4df35973 tempest-TaggedBootDevicesTest_v242-1841146700 None] Created reservations ['00079220-2a49-47bc-94bc-eb7a1cacc493', '5549fcd2-51ed-4691-bcce-eb0a65d2ead9', 'dbee91f2-0314-4149-ad93-ad969390f4da', 'aaa2f38c-aff7-4a08-8ea4-d0114064a653'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:14:24.519742 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5b7078ed-597b-46ca-b523-430e4df35973 tempest-TaggedBootDevicesTest_v242-1841146700 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:14:24.562465 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5b7078ed-597b-46ca-b523-430e4df35973 tempest-TaggedBootDevicesTest_v242-1841146700 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:14:24.613189 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-5b7078ed-597b-46ca-b523-430e4df35973 tempest-TaggedBootDevicesTest_v242-1841146700 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:14:24.617788 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-5b7078ed-597b-46ca-b523-430e4df35973 tempest-TaggedBootDevicesTest_v242-1841146700 None] Deleted volume successfully. Jun 25 21:14:24.631888 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-5b7078ed-597b-46ca-b523-430e4df35973 tempest-TaggedBootDevicesTest_v242-1841146700 None] Lock "b'cinder-3021df6d-a2e9-4c08-8bf1-d7b623d3d3cf-delete_volume'" released by "delete_volume" :: held 0.659s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:14:25.268935 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-df128a18-ab05-4163-8966-66933f5b9a1b tempest-TaggedBootDevicesTest_v242-1841146700 None] Lock "b'cinder-fbbe220f-e91a-425b-81dd-bebb3a0f18fb-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:14:25.313523 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-df128a18-ab05-4163-8966-66933f5b9a1b tempest-TaggedBootDevicesTest_v242-1841146700 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:14:25.388922 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-df128a18-ab05-4163-8966-66933f5b9a1b tempest-TaggedBootDevicesTest_v242-1841146700 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:14:25.389394 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-df128a18-ab05-4163-8966-66933f5b9a1b tempest-TaggedBootDevicesTest_v242-1841146700 None] Volume volume-fbbe220f-e91a-425b-81dd-bebb3a0f18fb is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:14:25.399019 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-df128a18-ab05-4163-8966-66933f5b9a1b tempest-TaggedBootDevicesTest_v242-1841146700 None] deleting rbd volume volume-fbbe220f-e91a-425b-81dd-bebb3a0f18fb {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:14:25.981146 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-df128a18-ab05-4163-8966-66933f5b9a1b tempest-TaggedBootDevicesTest_v242-1841146700 None] Created reservations ['c48dc41f-c2c6-4757-8390-53ea18ca6b4f', '8e47e6a2-bcf4-442d-ae0e-138f90e14f34', 'bf7d9d52-d1f3-4769-91c2-b4629a26d741', '8a332342-ec5f-43e4-9468-33939b701a4e'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:14:26.053397 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-df128a18-ab05-4163-8966-66933f5b9a1b tempest-TaggedBootDevicesTest_v242-1841146700 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:14:26.140983 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-df128a18-ab05-4163-8966-66933f5b9a1b tempest-TaggedBootDevicesTest_v242-1841146700 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:14:26.212287 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-df128a18-ab05-4163-8966-66933f5b9a1b tempest-TaggedBootDevicesTest_v242-1841146700 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:14:26.222279 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-df128a18-ab05-4163-8966-66933f5b9a1b tempest-TaggedBootDevicesTest_v242-1841146700 None] Deleted volume successfully. Jun 25 21:14:26.253674 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-df128a18-ab05-4163-8966-66933f5b9a1b tempest-TaggedBootDevicesTest_v242-1841146700 None] Lock "b'cinder-fbbe220f-e91a-425b-81dd-bebb3a0f18fb-delete_volume'" released by "delete_volume" :: held 0.978s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:14:26.471583 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-190f59d4-b5c4-410b-a2c3-9a244001ca4c tempest-TaggedBootDevicesTest_v242-1841146700 None] Lock "b'cinder-77b4d6d2-e904-4959-879b-fbabba9a3139-delete_volume'" acquired by "delete_volume" :: waited 0.032s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:14:26.579080 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-190f59d4-b5c4-410b-a2c3-9a244001ca4c tempest-TaggedBootDevicesTest_v242-1841146700 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:14:26.738626 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-190f59d4-b5c4-410b-a2c3-9a244001ca4c tempest-TaggedBootDevicesTest_v242-1841146700 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:14:26.756911 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-190f59d4-b5c4-410b-a2c3-9a244001ca4c tempest-TaggedBootDevicesTest_v242-1841146700 None] deleting rbd volume volume-77b4d6d2-e904-4959-879b-fbabba9a3139 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:14:27.372044 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-190f59d4-b5c4-410b-a2c3-9a244001ca4c tempest-TaggedBootDevicesTest_v242-1841146700 None] volume is a clone so cleaning references {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jun 25 21:14:27.422218 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-190f59d4-b5c4-410b-a2c3-9a244001ca4c tempest-TaggedBootDevicesTest_v242-1841146700 None] deleting parent snapshot volume-77b4d6d2-e904-4959-879b-fbabba9a3139.clone_snap {{(pid=130674) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jun 25 21:14:28.175194 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-190f59d4-b5c4-410b-a2c3-9a244001ca4c tempest-TaggedBootDevicesTest_v242-1841146700 None] Created reservations ['e5a81ee0-03c4-4807-b30e-28a22d00157e', 'a684a4ba-f0a2-4c9c-bea3-d6a85bc5fab5', '2cf9cbfa-eb97-4a2c-a8c4-34fe71952550', '12d544b0-077d-438f-8c36-dfada6d5ba03'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:14:28.234906 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-190f59d4-b5c4-410b-a2c3-9a244001ca4c tempest-TaggedBootDevicesTest_v242-1841146700 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:14:28.263578 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-190f59d4-b5c4-410b-a2c3-9a244001ca4c tempest-TaggedBootDevicesTest_v242-1841146700 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:14:28.306453 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-190f59d4-b5c4-410b-a2c3-9a244001ca4c tempest-TaggedBootDevicesTest_v242-1841146700 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:14:28.317160 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-190f59d4-b5c4-410b-a2c3-9a244001ca4c tempest-TaggedBootDevicesTest_v242-1841146700 None] Deleted volume successfully. Jun 25 21:14:28.333353 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-190f59d4-b5c4-410b-a2c3-9a244001ca4c tempest-TaggedBootDevicesTest_v242-1841146700 None] Lock "b'cinder-77b4d6d2-e904-4959-879b-fbabba9a3139-delete_volume'" released by "delete_volume" :: held 1.867s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:14:33.665749 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed6cf171-34e1-4199-979f-ae5991d32153 tempest-VolumeSnapshotQuotasNegativeTestJSON-659444228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:14:33.699144 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ed6cf171-34e1-4199-979f-ae5991d32153 tempest-VolumeSnapshotQuotasNegativeTestJSON-659444228 None] Flow 'volume_create_manager' (854bce07-4db7-40e4-80c6-e802841627f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:14:33.711007 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ed6cf171-34e1-4199-979f-ae5991d32153 tempest-VolumeSnapshotQuotasNegativeTestJSON-659444228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38bb5de2-6229-4228-93ab-0ca6b0c40731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:14:33.733960 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ed6cf171-34e1-4199-979f-ae5991d32153 tempest-VolumeSnapshotQuotasNegativeTestJSON-659444228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38bb5de2-6229-4228-93ab-0ca6b0c40731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1599321345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ff39d166-b615-49f3-898b-2e2339938b4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e8a07c496724a57933c68f21c3ef0f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:14:34Z,use_quota=True,user_id='53407f2b6ac44d288abf9ed4ab2a069f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:14:33.743984 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ed6cf171-34e1-4199-979f-ae5991d32153 tempest-VolumeSnapshotQuotasNegativeTestJSON-659444228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (364edef6-4717-4a41-bb30-48d3b63eee3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:14:33.751526 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ed6cf171-34e1-4199-979f-ae5991d32153 tempest-VolumeSnapshotQuotasNegativeTestJSON-659444228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (364edef6-4717-4a41-bb30-48d3b63eee3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:14:33.766026 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ed6cf171-34e1-4199-979f-ae5991d32153 tempest-VolumeSnapshotQuotasNegativeTestJSON-659444228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72e2ab75-a887-405b-8263-f3f55aaa521f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:14:33.781128 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ed6cf171-34e1-4199-979f-ae5991d32153 tempest-VolumeSnapshotQuotasNegativeTestJSON-659444228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72e2ab75-a887-405b-8263-f3f55aaa521f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff39d166-b615-49f3-898b-2e2339938b4f', 'volume_name': 'volume-ff39d166-b615-49f3-898b-2e2339938b4f', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:14:33.799671 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ed6cf171-34e1-4199-979f-ae5991d32153 tempest-VolumeSnapshotQuotasNegativeTestJSON-659444228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eb3bc5d-343b-4fdc-86c8-192c22da2a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:14:33.805185 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ed6cf171-34e1-4199-979f-ae5991d32153 tempest-VolumeSnapshotQuotasNegativeTestJSON-659444228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eb3bc5d-343b-4fdc-86c8-192c22da2a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:14:33.811581 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ed6cf171-34e1-4199-979f-ae5991d32153 tempest-VolumeSnapshotQuotasNegativeTestJSON-659444228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39358fc6-eedc-4076-9a52-a8aae938492a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:14:33.813105 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-ed6cf171-34e1-4199-979f-ae5991d32153 tempest-VolumeSnapshotQuotasNegativeTestJSON-659444228 None] Volume ff39d166-b615-49f3-898b-2e2339938b4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff39d166-b615-49f3-898b-2e2339938b4f', 'volume_size': 1} Jun 25 21:14:33.813840 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ed6cf171-34e1-4199-979f-ae5991d32153 tempest-VolumeSnapshotQuotasNegativeTestJSON-659444228 None] creating volume 'volume-ff39d166-b615-49f3-898b-2e2339938b4f' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:14:33.815643 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ed6cf171-34e1-4199-979f-ae5991d32153 tempest-VolumeSnapshotQuotasNegativeTestJSON-659444228 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:14:33.918939 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ed6cf171-34e1-4199-979f-ae5991d32153 tempest-VolumeSnapshotQuotasNegativeTestJSON-659444228 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:14:33.919663 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ed6cf171-34e1-4199-979f-ae5991d32153 tempest-VolumeSnapshotQuotasNegativeTestJSON-659444228 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:14:33.927780 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ed6cf171-34e1-4199-979f-ae5991d32153 tempest-VolumeSnapshotQuotasNegativeTestJSON-659444228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39358fc6-eedc-4076-9a52-a8aae938492a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff39d166-b615-49f3-898b-2e2339938b4f', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:14:33.936145 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ed6cf171-34e1-4199-979f-ae5991d32153 tempest-VolumeSnapshotQuotasNegativeTestJSON-659444228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3810913-2324-4274-b3b5-a0827d6ad9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:14:33.959399 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-ed6cf171-34e1-4199-979f-ae5991d32153 tempest-VolumeSnapshotQuotasNegativeTestJSON-659444228 None] Volume volume-ff39d166-b615-49f3-898b-2e2339938b4f (ff39d166-b615-49f3-898b-2e2339938b4f): created successfully Jun 25 21:14:33.964869 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ed6cf171-34e1-4199-979f-ae5991d32153 tempest-VolumeSnapshotQuotasNegativeTestJSON-659444228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3810913-2324-4274-b3b5-a0827d6ad9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:14:33.984776 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ed6cf171-34e1-4199-979f-ae5991d32153 tempest-VolumeSnapshotQuotasNegativeTestJSON-659444228 None] Flow 'volume_create_manager' (854bce07-4db7-40e4-80c6-e802841627f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:14:34.018588 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-ed6cf171-34e1-4199-979f-ae5991d32153 tempest-VolumeSnapshotQuotasNegativeTestJSON-659444228 None] Created volume successfully. Jun 25 21:14:34.038677 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=67,cinder:UPDATE=23,cinder:INSERT=7,cinder:DELETE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:34.985373 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f1fc2664-9feb-4ffb-99e8-a1f96c9620c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-659444228 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:14:35.338142 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-f1fc2664-9feb-4ffb-99e8-a1f96c9620c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-659444228 None] Create snapshot completed successfully Jun 25 21:14:36.727800 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-4076f0ed-1d4f-4c19-bed8-86788aa63d2b tempest-VolumeSnapshotQuotasNegativeTestJSON-659444228 None] Lock "b'cinder-3a650eba-91bb-49b0-a3d0-db5836cf8709-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:14:36.731272 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4076f0ed-1d4f-4c19-bed8-86788aa63d2b tempest-VolumeSnapshotQuotasNegativeTestJSON-659444228 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:14:37.172587 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-4076f0ed-1d4f-4c19-bed8-86788aa63d2b tempest-VolumeSnapshotQuotasNegativeTestJSON-659444228 None] Created reservations ['2058cd47-f5e7-484c-8b84-b92115e470df', '4db0dac8-5c34-4a87-a2e2-44b33488164a', '6a8b4f11-f561-4572-b8e8-b3992c43ab58', '8c2e6f53-32b2-4293-b2fe-f1420d2ffbac'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:14:37.227409 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-4076f0ed-1d4f-4c19-bed8-86788aa63d2b tempest-VolumeSnapshotQuotasNegativeTestJSON-659444228 None] Delete snapshot completed successfully. Jun 25 21:14:37.234893 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-4076f0ed-1d4f-4c19-bed8-86788aa63d2b tempest-VolumeSnapshotQuotasNegativeTestJSON-659444228 None] Lock "b'cinder-3a650eba-91bb-49b0-a3d0-db5836cf8709-delete_snapshot'" released by "delete_snapshot" :: held 0.507s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:14:37.894434 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-d910e59a-03fd-4e02-bc5e-474412f1b873 tempest-VolumeSnapshotQuotasNegativeTestJSON-659444228 None] Lock "b'cinder-ff39d166-b615-49f3-898b-2e2339938b4f-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:14:37.906986 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=49,cinder:INSERT=7,cinder:UPDATE=42,cinder:DELETE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:37.952041 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d910e59a-03fd-4e02-bc5e-474412f1b873 tempest-VolumeSnapshotQuotasNegativeTestJSON-659444228 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:14:38.014083 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d910e59a-03fd-4e02-bc5e-474412f1b873 tempest-VolumeSnapshotQuotasNegativeTestJSON-659444228 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:14:38.014533 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d910e59a-03fd-4e02-bc5e-474412f1b873 tempest-VolumeSnapshotQuotasNegativeTestJSON-659444228 None] Volume volume-ff39d166-b615-49f3-898b-2e2339938b4f is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:14:38.022346 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d910e59a-03fd-4e02-bc5e-474412f1b873 tempest-VolumeSnapshotQuotasNegativeTestJSON-659444228 None] deleting rbd volume volume-ff39d166-b615-49f3-898b-2e2339938b4f {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:14:38.366951 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-d910e59a-03fd-4e02-bc5e-474412f1b873 tempest-VolumeSnapshotQuotasNegativeTestJSON-659444228 None] Created reservations ['b303be20-97a4-4da8-a7f6-fb377fcc61d2', '35b47a57-81c0-4f94-a717-4306ae60f10c', '40c895cc-7be0-403d-ac1c-7367e9adff78', 'cb2d2a86-0bf5-4702-a009-b0fc2628fb73'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:14:38.454606 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d910e59a-03fd-4e02-bc5e-474412f1b873 tempest-VolumeSnapshotQuotasNegativeTestJSON-659444228 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:14:38.523719 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d910e59a-03fd-4e02-bc5e-474412f1b873 tempest-VolumeSnapshotQuotasNegativeTestJSON-659444228 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:14:38.615280 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d910e59a-03fd-4e02-bc5e-474412f1b873 tempest-VolumeSnapshotQuotasNegativeTestJSON-659444228 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:14:38.620217 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-d910e59a-03fd-4e02-bc5e-474412f1b873 tempest-VolumeSnapshotQuotasNegativeTestJSON-659444228 None] Deleted volume successfully. Jun 25 21:14:38.641562 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-d910e59a-03fd-4e02-bc5e-474412f1b873 tempest-VolumeSnapshotQuotasNegativeTestJSON-659444228 None] Lock "b'cinder-ff39d166-b615-49f3-898b-2e2339938b4f-delete_volume'" released by "delete_volume" :: held 0.747s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:14:48.628974 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=6,cinder:INSERT=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:51.014381 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f15c199-2e7e-488a-8a3e-59a7378de26b tempest-AttachVolumeTestJSON-931041757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:14:51.038379 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1f15c199-2e7e-488a-8a3e-59a7378de26b tempest-AttachVolumeTestJSON-931041757 None] Flow 'volume_create_manager' (e7069984-0946-48af-a1c6-ca41bc0c85e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:14:51.046769 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1f15c199-2e7e-488a-8a3e-59a7378de26b tempest-AttachVolumeTestJSON-931041757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af9e9396-221c-41b2-983a-bb7d815b1566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:14:51.112749 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1f15c199-2e7e-488a-8a3e-59a7378de26b tempest-AttachVolumeTestJSON-931041757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af9e9396-221c-41b2-983a-bb7d815b1566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:14:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-911660704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2673345e-0e06-4c27-a28f-280fa1677d48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5b521724c3d49069bb1aa8c2428b75c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:14:51Z,use_quota=True,user_id='6bcfb45bd9404205aefe7d1d2b33cd25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:14:51.119162 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1f15c199-2e7e-488a-8a3e-59a7378de26b tempest-AttachVolumeTestJSON-931041757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72122d45-0b22-47e5-b2c5-89a2da7f05de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:14:51.124491 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1f15c199-2e7e-488a-8a3e-59a7378de26b tempest-AttachVolumeTestJSON-931041757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72122d45-0b22-47e5-b2c5-89a2da7f05de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:14:51.131134 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1f15c199-2e7e-488a-8a3e-59a7378de26b tempest-AttachVolumeTestJSON-931041757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5daf48c9-76cd-4f12-8a97-b2f2cd5d2e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:14:51.135624 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1f15c199-2e7e-488a-8a3e-59a7378de26b tempest-AttachVolumeTestJSON-931041757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5daf48c9-76cd-4f12-8a97-b2f2cd5d2e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2673345e-0e06-4c27-a28f-280fa1677d48', 'volume_name': 'volume-2673345e-0e06-4c27-a28f-280fa1677d48', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:14:51.143173 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1f15c199-2e7e-488a-8a3e-59a7378de26b tempest-AttachVolumeTestJSON-931041757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf36cc55-69a1-488c-9ef6-633fa463b856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:14:51.148360 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1f15c199-2e7e-488a-8a3e-59a7378de26b tempest-AttachVolumeTestJSON-931041757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf36cc55-69a1-488c-9ef6-633fa463b856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:14:51.161354 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1f15c199-2e7e-488a-8a3e-59a7378de26b tempest-AttachVolumeTestJSON-931041757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (149d8a2a-0f6d-4d39-a0f4-0f95475e0860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:14:51.163453 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-1f15c199-2e7e-488a-8a3e-59a7378de26b tempest-AttachVolumeTestJSON-931041757 None] Volume 2673345e-0e06-4c27-a28f-280fa1677d48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2673345e-0e06-4c27-a28f-280fa1677d48', 'volume_size': 1} Jun 25 21:14:51.164075 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1f15c199-2e7e-488a-8a3e-59a7378de26b tempest-AttachVolumeTestJSON-931041757 None] creating volume 'volume-2673345e-0e06-4c27-a28f-280fa1677d48' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:14:51.165072 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1f15c199-2e7e-488a-8a3e-59a7378de26b tempest-AttachVolumeTestJSON-931041757 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:14:51.291605 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1f15c199-2e7e-488a-8a3e-59a7378de26b tempest-AttachVolumeTestJSON-931041757 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:14:51.292675 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1f15c199-2e7e-488a-8a3e-59a7378de26b tempest-AttachVolumeTestJSON-931041757 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:14:51.296507 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1f15c199-2e7e-488a-8a3e-59a7378de26b tempest-AttachVolumeTestJSON-931041757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (149d8a2a-0f6d-4d39-a0f4-0f95475e0860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2673345e-0e06-4c27-a28f-280fa1677d48', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:14:51.301443 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1f15c199-2e7e-488a-8a3e-59a7378de26b tempest-AttachVolumeTestJSON-931041757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2cfdfed-417f-4c81-a0d2-cef260a71186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:14:51.313704 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-1f15c199-2e7e-488a-8a3e-59a7378de26b tempest-AttachVolumeTestJSON-931041757 None] Volume volume-2673345e-0e06-4c27-a28f-280fa1677d48 (2673345e-0e06-4c27-a28f-280fa1677d48): created successfully Jun 25 21:14:51.317921 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1f15c199-2e7e-488a-8a3e-59a7378de26b tempest-AttachVolumeTestJSON-931041757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2cfdfed-417f-4c81-a0d2-cef260a71186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:14:51.331422 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1f15c199-2e7e-488a-8a3e-59a7378de26b tempest-AttachVolumeTestJSON-931041757 None] Flow 'volume_create_manager' (e7069984-0946-48af-a1c6-ca41bc0c85e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:14:51.344369 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-1f15c199-2e7e-488a-8a3e-59a7378de26b tempest-AttachVolumeTestJSON-931041757 None] Created volume successfully. Jun 25 21:14:52.144786 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:14:52.145755 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:14:52.259325 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:14:52.350619 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:14:52.746577 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-b3ca3bed-94bb-4923-9944-18bbb817f157 req-a7a05818-698e-463d-9eb2-fadea5560c76 tempest-AttachVolumeTestJSON-931041757 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 21:14:53.952450 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-34e8e401-57fb-4cf2-a55d-5269c79b2a1a tempest-VolumesDeleteCascade-59104413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:14:53.983845 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-34e8e401-57fb-4cf2-a55d-5269c79b2a1a tempest-VolumesDeleteCascade-59104413 None] Flow 'volume_create_manager' (07b7cc02-61b3-4dbd-a574-4fe453876940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:14:54.008020 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-34e8e401-57fb-4cf2-a55d-5269c79b2a1a tempest-VolumesDeleteCascade-59104413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fdc25d4-933c-4bb5-b26b-3e0015b1abd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:14:54.079241 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-34e8e401-57fb-4cf2-a55d-5269c79b2a1a tempest-VolumesDeleteCascade-59104413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fdc25d4-933c-4bb5-b26b-3e0015b1abd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1391068751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f53da017-4e1e-4dea-a50a-b3384645e81b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c29fd4309504c509cd9e3bff2729681',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:14:54Z,use_quota=True,user_id='8219c458a3bc4c43aabdcd2ab810cca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:14:54.093456 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-34e8e401-57fb-4cf2-a55d-5269c79b2a1a tempest-VolumesDeleteCascade-59104413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99c26a8d-684e-46c7-bcda-4eb398e8cea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:14:54.103726 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-34e8e401-57fb-4cf2-a55d-5269c79b2a1a tempest-VolumesDeleteCascade-59104413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99c26a8d-684e-46c7-bcda-4eb398e8cea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:14:54.118636 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-34e8e401-57fb-4cf2-a55d-5269c79b2a1a tempest-VolumesDeleteCascade-59104413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b8c2b00-8c3d-478c-8294-8001c15a2366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:14:54.127186 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-34e8e401-57fb-4cf2-a55d-5269c79b2a1a tempest-VolumesDeleteCascade-59104413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b8c2b00-8c3d-478c-8294-8001c15a2366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f53da017-4e1e-4dea-a50a-b3384645e81b', 'volume_name': 'volume-f53da017-4e1e-4dea-a50a-b3384645e81b', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:14:54.139602 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-34e8e401-57fb-4cf2-a55d-5269c79b2a1a tempest-VolumesDeleteCascade-59104413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cf051f3-38dd-4fb0-908b-464c9dad3a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:14:54.146415 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-34e8e401-57fb-4cf2-a55d-5269c79b2a1a tempest-VolumesDeleteCascade-59104413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cf051f3-38dd-4fb0-908b-464c9dad3a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:14:54.152742 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-34e8e401-57fb-4cf2-a55d-5269c79b2a1a tempest-VolumesDeleteCascade-59104413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb90de2f-bc05-4218-a58a-bd4adcc40510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:14:54.155462 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-34e8e401-57fb-4cf2-a55d-5269c79b2a1a tempest-VolumesDeleteCascade-59104413 None] Volume f53da017-4e1e-4dea-a50a-b3384645e81b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f53da017-4e1e-4dea-a50a-b3384645e81b', 'volume_size': 1} Jun 25 21:14:54.156375 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-34e8e401-57fb-4cf2-a55d-5269c79b2a1a tempest-VolumesDeleteCascade-59104413 None] creating volume 'volume-f53da017-4e1e-4dea-a50a-b3384645e81b' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:14:54.157508 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-34e8e401-57fb-4cf2-a55d-5269c79b2a1a tempest-VolumesDeleteCascade-59104413 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:14:54.220351 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-b3ca3bed-94bb-4923-9944-18bbb817f157 req-a7a05818-698e-463d-9eb2-fadea5560c76 tempest-AttachVolumeTestJSON-931041757 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.474s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 21:14:54.227363 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-b3ca3bed-94bb-4923-9944-18bbb817f157 req-a7a05818-698e-463d-9eb2-fadea5560c76 tempest-AttachVolumeTestJSON-931041757 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2673345e-0e06-4c27-a28f-280fa1677d48', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': '2673345e-0e06-4c27-a28f-280fa1677d48', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 21:14:54.267875 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-b3ca3bed-94bb-4923-9944-18bbb817f157 req-a7a05818-698e-463d-9eb2-fadea5560c76 tempest-AttachVolumeTestJSON-931041757 None] Connection info returned from driver {'name': 'volumes/volume-2673345e-0e06-4c27-a28f-280fa1677d48', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '2673345e-0e06-4c27-a28f-280fa1677d48', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '402357ad-97d8-4628-904e-ec1879ba338a'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 25 21:14:54.294893 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-34e8e401-57fb-4cf2-a55d-5269c79b2a1a tempest-VolumesDeleteCascade-59104413 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:14:54.295291 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-34e8e401-57fb-4cf2-a55d-5269c79b2a1a tempest-VolumesDeleteCascade-59104413 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:14:54.299372 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-34e8e401-57fb-4cf2-a55d-5269c79b2a1a tempest-VolumesDeleteCascade-59104413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb90de2f-bc05-4218-a58a-bd4adcc40510) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f53da017-4e1e-4dea-a50a-b3384645e81b', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:14:54.304626 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-34e8e401-57fb-4cf2-a55d-5269c79b2a1a tempest-VolumesDeleteCascade-59104413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85faf342-8958-442b-a394-e21e95894d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:14:54.336213 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-34e8e401-57fb-4cf2-a55d-5269c79b2a1a tempest-VolumesDeleteCascade-59104413 None] Volume volume-f53da017-4e1e-4dea-a50a-b3384645e81b (f53da017-4e1e-4dea-a50a-b3384645e81b): created successfully Jun 25 21:14:54.340810 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-34e8e401-57fb-4cf2-a55d-5269c79b2a1a tempest-VolumesDeleteCascade-59104413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85faf342-8958-442b-a394-e21e95894d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:14:54.348868 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-34e8e401-57fb-4cf2-a55d-5269c79b2a1a tempest-VolumesDeleteCascade-59104413 None] Flow 'volume_create_manager' (07b7cc02-61b3-4dbd-a574-4fe453876940) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:14:54.367530 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-34e8e401-57fb-4cf2-a55d-5269c79b2a1a tempest-VolumesDeleteCascade-59104413 None] Created volume successfully. Jun 25 21:14:54.400898 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-b3ca3bed-94bb-4923-9944-18bbb817f157 req-a7a05818-698e-463d-9eb2-fadea5560c76 tempest-AttachVolumeTestJSON-931041757 None] attachment_update completed successfully. Jun 25 21:14:55.302592 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2bf40788-3660-48c1-be02-2317ef487e6e tempest-VolumesDeleteCascade-59104413 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:14:56.393354 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-2bf40788-3660-48c1-be02-2317ef487e6e tempest-VolumesDeleteCascade-59104413 None] Create snapshot completed successfully Jun 25 21:14:57.203527 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-31ed7eda-8b7d-4a96-ab49-a9209c496791 tempest-AttachVolumeTestJSON-931041757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:14:57.267463 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-31ed7eda-8b7d-4a96-ab49-a9209c496791 tempest-AttachVolumeTestJSON-931041757 None] Flow 'volume_create_manager' (28a5a9d4-2f04-4884-a96d-606b3e0fe80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:14:57.296827 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-31ed7eda-8b7d-4a96-ab49-a9209c496791 tempest-AttachVolumeTestJSON-931041757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35dd829c-7cfc-454a-9089-6e0e52c110d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:14:57.361436 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-31ed7eda-8b7d-4a96-ab49-a9209c496791 tempest-AttachVolumeTestJSON-931041757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35dd829c-7cfc-454a-9089-6e0e52c110d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1081751649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3f59969f-4d18-4fe6-8ebe-8f673720b514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5b521724c3d49069bb1aa8c2428b75c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:14:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:14:57Z,use_quota=True,user_id='6bcfb45bd9404205aefe7d1d2b33cd25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:14:57.368096 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-31ed7eda-8b7d-4a96-ab49-a9209c496791 tempest-AttachVolumeTestJSON-931041757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (953ba020-c8c2-45c0-8bd7-0598cb104f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:14:57.390194 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-31ed7eda-8b7d-4a96-ab49-a9209c496791 tempest-AttachVolumeTestJSON-931041757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (953ba020-c8c2-45c0-8bd7-0598cb104f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:14:57.400167 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-31ed7eda-8b7d-4a96-ab49-a9209c496791 tempest-AttachVolumeTestJSON-931041757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc49396b-7746-49b5-aa7d-c2e8c1f0d56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:14:57.406719 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-31ed7eda-8b7d-4a96-ab49-a9209c496791 tempest-AttachVolumeTestJSON-931041757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc49396b-7746-49b5-aa7d-c2e8c1f0d56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f59969f-4d18-4fe6-8ebe-8f673720b514', 'volume_name': 'volume-3f59969f-4d18-4fe6-8ebe-8f673720b514', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:14:57.413307 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-31ed7eda-8b7d-4a96-ab49-a9209c496791 tempest-AttachVolumeTestJSON-931041757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd347380-5b95-4b3b-a4fb-b1ce7ab3024f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:14:57.419321 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-31ed7eda-8b7d-4a96-ab49-a9209c496791 tempest-AttachVolumeTestJSON-931041757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd347380-5b95-4b3b-a4fb-b1ce7ab3024f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:14:57.425092 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-31ed7eda-8b7d-4a96-ab49-a9209c496791 tempest-AttachVolumeTestJSON-931041757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc6c0b3b-de7c-4b78-8467-7482ae6e2677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:14:57.427257 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-31ed7eda-8b7d-4a96-ab49-a9209c496791 tempest-AttachVolumeTestJSON-931041757 None] Volume 3f59969f-4d18-4fe6-8ebe-8f673720b514: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f59969f-4d18-4fe6-8ebe-8f673720b514', 'volume_size': 1} Jun 25 21:14:57.427866 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-31ed7eda-8b7d-4a96-ab49-a9209c496791 tempest-AttachVolumeTestJSON-931041757 None] creating volume 'volume-3f59969f-4d18-4fe6-8ebe-8f673720b514' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:14:57.430342 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-31ed7eda-8b7d-4a96-ab49-a9209c496791 tempest-AttachVolumeTestJSON-931041757 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:14:57.575336 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-31ed7eda-8b7d-4a96-ab49-a9209c496791 tempest-AttachVolumeTestJSON-931041757 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:14:57.575949 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-31ed7eda-8b7d-4a96-ab49-a9209c496791 tempest-AttachVolumeTestJSON-931041757 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:14:57.580727 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-31ed7eda-8b7d-4a96-ab49-a9209c496791 tempest-AttachVolumeTestJSON-931041757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc6c0b3b-de7c-4b78-8467-7482ae6e2677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f59969f-4d18-4fe6-8ebe-8f673720b514', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:14:57.587408 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-31ed7eda-8b7d-4a96-ab49-a9209c496791 tempest-AttachVolumeTestJSON-931041757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5524d29-28af-424f-b896-568cce79d107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:14:57.623682 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-31ed7eda-8b7d-4a96-ab49-a9209c496791 tempest-AttachVolumeTestJSON-931041757 None] Volume volume-3f59969f-4d18-4fe6-8ebe-8f673720b514 (3f59969f-4d18-4fe6-8ebe-8f673720b514): created successfully Jun 25 21:14:57.630060 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-31ed7eda-8b7d-4a96-ab49-a9209c496791 tempest-AttachVolumeTestJSON-931041757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5524d29-28af-424f-b896-568cce79d107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:14:57.644895 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-31ed7eda-8b7d-4a96-ab49-a9209c496791 tempest-AttachVolumeTestJSON-931041757 None] Flow 'volume_create_manager' (28a5a9d4-2f04-4884-a96d-606b3e0fe80a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:14:57.657659 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-31ed7eda-8b7d-4a96-ab49-a9209c496791 tempest-AttachVolumeTestJSON-931041757 None] Created volume successfully. Jun 25 21:14:57.800168 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=66,cinder:UPDATE=28,cinder:INSERT=3,cinder:DELETE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:57.842410 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ef353a88-75d0-498d-b130-4ba7d13fb80b tempest-VolumesDeleteCascade-59104413 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:14:58.397469 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-ef353a88-75d0-498d-b130-4ba7d13fb80b tempest-VolumesDeleteCascade-59104413 None] Create snapshot completed successfully Jun 25 21:14:59.036321 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-c583c7a6-3501-47bc-ad2d-70dfff1f511c req-f3df0dff-b123-4701-8e5f-fb0f887551ab tempest-AttachVolumeTestJSON-931041757 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 21:14:59.161747 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-2698ea9e-24ce-462f-889b-11627aba3994 tempest-VolumesDeleteCascade-59104413 None] Lock "b'cinder-f53da017-4e1e-4dea-a50a-b3384645e81b-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:14:59.249898 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2698ea9e-24ce-462f-889b-11627aba3994 tempest-VolumesDeleteCascade-59104413 None] Performing cascade delete. {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/manager.py:968}} Jun 25 21:14:59.276924 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-2698ea9e-24ce-462f-889b-11627aba3994 tempest-VolumesDeleteCascade-59104413 None] Lock "b'cinder-19f5a600-8cc6-4d8d-9615-7e04c499950e-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.013s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:14:59.307770 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2698ea9e-24ce-462f-889b-11627aba3994 tempest-VolumesDeleteCascade-59104413 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:15:00.496363 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-2698ea9e-24ce-462f-889b-11627aba3994 tempest-VolumesDeleteCascade-59104413 None] Created reservations ['4e33f704-6830-40a6-93d5-c4af7700096b', '43abb69c-5b17-4510-bee6-ed4e3af6d418', '55a34e10-2287-438c-83da-c2261d5634aa', '0d6e5eee-15b9-4927-beed-0f49bd793857'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:15:00.580600 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-2698ea9e-24ce-462f-889b-11627aba3994 tempest-VolumesDeleteCascade-59104413 None] Delete snapshot completed successfully. Jun 25 21:15:00.586022 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-2698ea9e-24ce-462f-889b-11627aba3994 tempest-VolumesDeleteCascade-59104413 None] Lock "b'cinder-19f5a600-8cc6-4d8d-9615-7e04c499950e-delete_snapshot'" released by "delete_snapshot" :: held 1.309s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:15:00.602917 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-2698ea9e-24ce-462f-889b-11627aba3994 tempest-VolumesDeleteCascade-59104413 None] Lock "b'cinder-a4ac5d9b-6bc8-4306-8d38-1f4d2f2a6b7b-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.016s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:15:00.629371 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2698ea9e-24ce-462f-889b-11627aba3994 tempest-VolumesDeleteCascade-59104413 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:15:00.719129 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-c583c7a6-3501-47bc-ad2d-70dfff1f511c req-f3df0dff-b123-4701-8e5f-fb0f887551ab tempest-AttachVolumeTestJSON-931041757 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.685s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 21:15:00.719766 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-c583c7a6-3501-47bc-ad2d-70dfff1f511c req-f3df0dff-b123-4701-8e5f-fb0f887551ab tempest-AttachVolumeTestJSON-931041757 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-3f59969f-4d18-4fe6-8ebe-8f673720b514', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': '3f59969f-4d18-4fe6-8ebe-8f673720b514', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 21:15:00.773091 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-c583c7a6-3501-47bc-ad2d-70dfff1f511c req-f3df0dff-b123-4701-8e5f-fb0f887551ab tempest-AttachVolumeTestJSON-931041757 None] Connection info returned from driver {'name': 'volumes/volume-3f59969f-4d18-4fe6-8ebe-8f673720b514', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '3f59969f-4d18-4fe6-8ebe-8f673720b514', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'cb4018ff-749b-4fa4-8872-5d7090c430d4'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 25 21:15:00.873429 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-c583c7a6-3501-47bc-ad2d-70dfff1f511c req-f3df0dff-b123-4701-8e5f-fb0f887551ab tempest-AttachVolumeTestJSON-931041757 None] attachment_update completed successfully. Jun 25 21:15:01.537498 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-2698ea9e-24ce-462f-889b-11627aba3994 tempest-VolumesDeleteCascade-59104413 None] Created reservations ['cb1b2b14-4461-4d4b-9df7-e74c12e250c4', '8517c09a-58df-4330-bc3d-c554b8dd9c79', 'decdc3c0-6494-4a1c-8be9-bab91e8da4a4', 'b60db4e8-720a-4bfe-b580-669f3fd7d2fb'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:15:01.635982 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-2698ea9e-24ce-462f-889b-11627aba3994 tempest-VolumesDeleteCascade-59104413 None] Delete snapshot completed successfully. Jun 25 21:15:01.641917 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-2698ea9e-24ce-462f-889b-11627aba3994 tempest-VolumesDeleteCascade-59104413 None] Lock "b'cinder-a4ac5d9b-6bc8-4306-8d38-1f4d2f2a6b7b-delete_snapshot'" released by "delete_snapshot" :: held 1.039s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:15:01.642607 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2698ea9e-24ce-462f-889b-11627aba3994 tempest-VolumesDeleteCascade-59104413 None] Snapshots deleted, issuing volume delete {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/manager.py:983}} Jun 25 21:15:01.647046 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2698ea9e-24ce-462f-889b-11627aba3994 tempest-VolumesDeleteCascade-59104413 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:15:01.796286 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2698ea9e-24ce-462f-889b-11627aba3994 tempest-VolumesDeleteCascade-59104413 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:15:01.797173 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2698ea9e-24ce-462f-889b-11627aba3994 tempest-VolumesDeleteCascade-59104413 None] Volume volume-f53da017-4e1e-4dea-a50a-b3384645e81b is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:15:01.809581 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2698ea9e-24ce-462f-889b-11627aba3994 tempest-VolumesDeleteCascade-59104413 None] deleting rbd volume volume-f53da017-4e1e-4dea-a50a-b3384645e81b {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:15:02.391978 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-2698ea9e-24ce-462f-889b-11627aba3994 tempest-VolumesDeleteCascade-59104413 None] Created reservations ['ffa65d6e-1201-4923-8e52-e217518e05eb', 'dda69421-c96e-49a3-bb23-0a616fe6088d', '31d6783d-c1d1-496a-ba35-e6a0ab24efdd', '2a3e10d2-55ab-4c3b-aec1-956752d0596e'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:15:02.396601 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=70,cinder:UPDATE=22,cinder:DELETE=3,cinder:INSERT=5 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:02.488768 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2698ea9e-24ce-462f-889b-11627aba3994 tempest-VolumesDeleteCascade-59104413 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:15:02.578732 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2698ea9e-24ce-462f-889b-11627aba3994 tempest-VolumesDeleteCascade-59104413 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:15:02.624359 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-2698ea9e-24ce-462f-889b-11627aba3994 tempest-VolumesDeleteCascade-59104413 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:15:02.629313 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-2698ea9e-24ce-462f-889b-11627aba3994 tempest-VolumesDeleteCascade-59104413 None] Deleted volume successfully. Jun 25 21:15:02.648353 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-2698ea9e-24ce-462f-889b-11627aba3994 tempest-VolumesDeleteCascade-59104413 None] Lock "b'cinder-f53da017-4e1e-4dea-a50a-b3384645e81b-delete_volume'" released by "delete_volume" :: held 3.487s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:15:05.731255 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-38fb012e-03dc-4132-8b91-19a450b7a3ae req-b01783ce-9a97-48bc-b49a-0b4a99bc25f4 tempest-AttachVolumeTestJSON-931041757 None] Terminate volume connection completed successfully. Jun 25 21:15:05.735020 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-38fb012e-03dc-4132-8b91-19a450b7a3ae req-b01783ce-9a97-48bc-b49a-0b4a99bc25f4 tempest-AttachVolumeTestJSON-931041757 None] Deleting attachment 402357ad-97d8-4628-904e-ec1879ba338a. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 25 21:15:07.717946 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-642a8972-8718-41ae-a3a3-f799e2efabd6 req-40ef3408-8e45-4afb-a333-8dbb0088e9f5 tempest-AttachVolumeTestJSON-931041757 None] Terminate volume connection completed successfully. Jun 25 21:15:07.718535 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-642a8972-8718-41ae-a3a3-f799e2efabd6 req-40ef3408-8e45-4afb-a333-8dbb0088e9f5 tempest-AttachVolumeTestJSON-931041757 None] Deleting attachment cb4018ff-749b-4fa4-8872-5d7090c430d4. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 25 21:15:09.126169 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-79d41844-bc2f-48cd-afeb-60ba3b66cef9 tempest-VolumesTransfersV355Test-651766624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:15:09.188170 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-79d41844-bc2f-48cd-afeb-60ba3b66cef9 tempest-VolumesTransfersV355Test-651766624 None] Flow 'volume_create_manager' (71ad8e9f-76af-4ea6-b1a2-099f8f650e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:15:09.210587 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-79d41844-bc2f-48cd-afeb-60ba3b66cef9 tempest-VolumesTransfersV355Test-651766624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (950928d6-d565-401e-bdc3-245ad0ad32ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:15:09.251164 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-79d41844-bc2f-48cd-afeb-60ba3b66cef9 tempest-VolumesTransfersV355Test-651766624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (950928d6-d565-401e-bdc3-245ad0ad32ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:15:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1654557467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2e66177c-6b1e-40e7-be53-dd9f2b381b90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5618e65880fd442faa4f9c254710ad00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:15:09Z,use_quota=True,user_id='aa7ce089aecd4bb7b9cbf57ec3432605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:15:09.261485 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-79d41844-bc2f-48cd-afeb-60ba3b66cef9 tempest-VolumesTransfersV355Test-651766624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f1d117c-3e7d-49df-831e-154eb9e81fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:15:09.266488 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-79d41844-bc2f-48cd-afeb-60ba3b66cef9 tempest-VolumesTransfersV355Test-651766624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f1d117c-3e7d-49df-831e-154eb9e81fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:15:09.278593 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-79d41844-bc2f-48cd-afeb-60ba3b66cef9 tempest-VolumesTransfersV355Test-651766624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d5a18e3-0c59-484f-8d36-b2b3b417a062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:15:09.285960 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-79d41844-bc2f-48cd-afeb-60ba3b66cef9 tempest-VolumesTransfersV355Test-651766624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d5a18e3-0c59-484f-8d36-b2b3b417a062) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e66177c-6b1e-40e7-be53-dd9f2b381b90', 'volume_name': 'volume-2e66177c-6b1e-40e7-be53-dd9f2b381b90', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:15:09.295422 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-79d41844-bc2f-48cd-afeb-60ba3b66cef9 tempest-VolumesTransfersV355Test-651766624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edb6bb3f-15d3-41cc-bb44-11c669138fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:15:09.301151 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-79d41844-bc2f-48cd-afeb-60ba3b66cef9 tempest-VolumesTransfersV355Test-651766624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edb6bb3f-15d3-41cc-bb44-11c669138fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:15:09.307056 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-79d41844-bc2f-48cd-afeb-60ba3b66cef9 tempest-VolumesTransfersV355Test-651766624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9db49b5-bf92-4710-b187-24a7150584d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:15:09.308682 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-79d41844-bc2f-48cd-afeb-60ba3b66cef9 tempest-VolumesTransfersV355Test-651766624 None] Volume 2e66177c-6b1e-40e7-be53-dd9f2b381b90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e66177c-6b1e-40e7-be53-dd9f2b381b90', 'volume_size': 1} Jun 25 21:15:09.309232 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-79d41844-bc2f-48cd-afeb-60ba3b66cef9 tempest-VolumesTransfersV355Test-651766624 None] creating volume 'volume-2e66177c-6b1e-40e7-be53-dd9f2b381b90' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:15:09.311180 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-79d41844-bc2f-48cd-afeb-60ba3b66cef9 tempest-VolumesTransfersV355Test-651766624 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:15:09.464757 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-79d41844-bc2f-48cd-afeb-60ba3b66cef9 tempest-VolumesTransfersV355Test-651766624 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:15:09.465127 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-79d41844-bc2f-48cd-afeb-60ba3b66cef9 tempest-VolumesTransfersV355Test-651766624 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:15:09.468739 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-79d41844-bc2f-48cd-afeb-60ba3b66cef9 tempest-VolumesTransfersV355Test-651766624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9db49b5-bf92-4710-b187-24a7150584d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e66177c-6b1e-40e7-be53-dd9f2b381b90', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:15:09.473536 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-79d41844-bc2f-48cd-afeb-60ba3b66cef9 tempest-VolumesTransfersV355Test-651766624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59bf8d25-aecf-4901-9a50-062f91a3153a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:15:09.501587 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-79d41844-bc2f-48cd-afeb-60ba3b66cef9 tempest-VolumesTransfersV355Test-651766624 None] Volume volume-2e66177c-6b1e-40e7-be53-dd9f2b381b90 (2e66177c-6b1e-40e7-be53-dd9f2b381b90): created successfully Jun 25 21:15:09.515392 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-79d41844-bc2f-48cd-afeb-60ba3b66cef9 tempest-VolumesTransfersV355Test-651766624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59bf8d25-aecf-4901-9a50-062f91a3153a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:15:09.534829 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-79d41844-bc2f-48cd-afeb-60ba3b66cef9 tempest-VolumesTransfersV355Test-651766624 None] Flow 'volume_create_manager' (71ad8e9f-76af-4ea6-b1a2-099f8f650e79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:15:09.556646 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-79d41844-bc2f-48cd-afeb-60ba3b66cef9 tempest-VolumesTransfersV355Test-651766624 None] Created volume successfully. Jun 25 21:15:11.383159 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-508c2f4c-8af6-4a67-9529-0dab08937ca3 tempest-VolumesTransfersV355Test-210745454 None] Transfer volume completed successfully. Jun 25 21:15:12.205656 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-03d9e10e-dcda-486d-944d-2dea0a14c365 tempest-VolumesTransfersV355Test-1411244353 None] Lock "b'cinder-2e66177c-6b1e-40e7-be53-dd9f2b381b90-delete_volume'" acquired by "delete_volume" :: waited 0.036s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:15:12.288334 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-03d9e10e-dcda-486d-944d-2dea0a14c365 tempest-VolumesTransfersV355Test-1411244353 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:15:12.363595 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-03d9e10e-dcda-486d-944d-2dea0a14c365 tempest-VolumesTransfersV355Test-1411244353 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:15:12.364626 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-03d9e10e-dcda-486d-944d-2dea0a14c365 tempest-VolumesTransfersV355Test-1411244353 None] Volume volume-2e66177c-6b1e-40e7-be53-dd9f2b381b90 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:15:12.376064 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-03d9e10e-dcda-486d-944d-2dea0a14c365 tempest-VolumesTransfersV355Test-1411244353 None] deleting rbd volume volume-2e66177c-6b1e-40e7-be53-dd9f2b381b90 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:15:12.753409 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=66,cinder:UPDATE=27,cinder:INSERT=7 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:12.793762 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-03d9e10e-dcda-486d-944d-2dea0a14c365 tempest-VolumesTransfersV355Test-1411244353 None] Created reservations ['e1a19fbc-6be3-47b1-b01e-438b44b9fea1', '4caee886-ff4f-4bd3-aa9b-58d978854115', '6597fa74-702c-4393-ba8c-0e8433d353c2', '036e5c04-cab3-446c-b90e-4e65160f5d46'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:15:12.877876 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-03d9e10e-dcda-486d-944d-2dea0a14c365 tempest-VolumesTransfersV355Test-1411244353 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:15:12.969780 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-03d9e10e-dcda-486d-944d-2dea0a14c365 tempest-VolumesTransfersV355Test-1411244353 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:15:13.036715 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-03d9e10e-dcda-486d-944d-2dea0a14c365 tempest-VolumesTransfersV355Test-1411244353 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:15:13.041019 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-03d9e10e-dcda-486d-944d-2dea0a14c365 tempest-VolumesTransfersV355Test-1411244353 None] Deleted volume successfully. Jun 25 21:15:13.063920 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-03d9e10e-dcda-486d-944d-2dea0a14c365 tempest-VolumesTransfersV355Test-1411244353 None] Lock "b'cinder-2e66177c-6b1e-40e7-be53-dd9f2b381b90-delete_volume'" released by "delete_volume" :: held 0.862s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:15:14.115861 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d6c914f-4a43-43d6-951f-abbc3857e842 tempest-VolumesTransfersV355Test-651766624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:15:14.172153 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0d6c914f-4a43-43d6-951f-abbc3857e842 tempest-VolumesTransfersV355Test-651766624 None] Flow 'volume_create_manager' (71b75b43-1574-4d1d-8f83-25a9319d70dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:15:14.189001 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0d6c914f-4a43-43d6-951f-abbc3857e842 tempest-VolumesTransfersV355Test-651766624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56fa7e8d-989a-40c6-85fe-9063bc8e288a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:15:14.222742 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0d6c914f-4a43-43d6-951f-abbc3857e842 tempest-VolumesTransfersV355Test-651766624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56fa7e8d-989a-40c6-85fe-9063bc8e288a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:15:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1209104923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ecbc9e03-0dcb-49ba-aa2f-d63d9f14c80c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5618e65880fd442faa4f9c254710ad00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:15:14Z,use_quota=True,user_id='aa7ce089aecd4bb7b9cbf57ec3432605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:15:14.231911 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0d6c914f-4a43-43d6-951f-abbc3857e842 tempest-VolumesTransfersV355Test-651766624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab0c7b29-fe8d-4f0b-9903-1ebcdd26b684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:15:14.247205 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0d6c914f-4a43-43d6-951f-abbc3857e842 tempest-VolumesTransfersV355Test-651766624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab0c7b29-fe8d-4f0b-9903-1ebcdd26b684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:15:14.257590 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0d6c914f-4a43-43d6-951f-abbc3857e842 tempest-VolumesTransfersV355Test-651766624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f8d4475-11db-4d7a-956b-ff495707c74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:15:14.268343 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0d6c914f-4a43-43d6-951f-abbc3857e842 tempest-VolumesTransfersV355Test-651766624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f8d4475-11db-4d7a-956b-ff495707c74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecbc9e03-0dcb-49ba-aa2f-d63d9f14c80c', 'volume_name': 'volume-ecbc9e03-0dcb-49ba-aa2f-d63d9f14c80c', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:15:14.282471 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0d6c914f-4a43-43d6-951f-abbc3857e842 tempest-VolumesTransfersV355Test-651766624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dbf294e-5a97-48c0-9147-c3bfe96a9559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:15:14.292998 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0d6c914f-4a43-43d6-951f-abbc3857e842 tempest-VolumesTransfersV355Test-651766624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dbf294e-5a97-48c0-9147-c3bfe96a9559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:15:14.305691 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0d6c914f-4a43-43d6-951f-abbc3857e842 tempest-VolumesTransfersV355Test-651766624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (160a28a3-f830-4445-a35b-ba0e2b5bf6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:15:14.309831 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-0d6c914f-4a43-43d6-951f-abbc3857e842 tempest-VolumesTransfersV355Test-651766624 None] Volume ecbc9e03-0dcb-49ba-aa2f-d63d9f14c80c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecbc9e03-0dcb-49ba-aa2f-d63d9f14c80c', 'volume_size': 1} Jun 25 21:15:14.310219 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0d6c914f-4a43-43d6-951f-abbc3857e842 tempest-VolumesTransfersV355Test-651766624 None] creating volume 'volume-ecbc9e03-0dcb-49ba-aa2f-d63d9f14c80c' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:15:14.311035 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0d6c914f-4a43-43d6-951f-abbc3857e842 tempest-VolumesTransfersV355Test-651766624 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:15:14.437177 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0d6c914f-4a43-43d6-951f-abbc3857e842 tempest-VolumesTransfersV355Test-651766624 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:15:14.438536 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0d6c914f-4a43-43d6-951f-abbc3857e842 tempest-VolumesTransfersV355Test-651766624 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:15:14.448690 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0d6c914f-4a43-43d6-951f-abbc3857e842 tempest-VolumesTransfersV355Test-651766624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (160a28a3-f830-4445-a35b-ba0e2b5bf6a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecbc9e03-0dcb-49ba-aa2f-d63d9f14c80c', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:15:14.454082 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0d6c914f-4a43-43d6-951f-abbc3857e842 tempest-VolumesTransfersV355Test-651766624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df95ce13-ef90-46b4-bd51-06d091bcce77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:15:14.471373 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-0d6c914f-4a43-43d6-951f-abbc3857e842 tempest-VolumesTransfersV355Test-651766624 None] Volume volume-ecbc9e03-0dcb-49ba-aa2f-d63d9f14c80c (ecbc9e03-0dcb-49ba-aa2f-d63d9f14c80c): created successfully Jun 25 21:15:14.476452 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0d6c914f-4a43-43d6-951f-abbc3857e842 tempest-VolumesTransfersV355Test-651766624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df95ce13-ef90-46b4-bd51-06d091bcce77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:15:14.483285 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0d6c914f-4a43-43d6-951f-abbc3857e842 tempest-VolumesTransfersV355Test-651766624 None] Flow 'volume_create_manager' (71b75b43-1574-4d1d-8f83-25a9319d70dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:15:14.495588 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-0d6c914f-4a43-43d6-951f-abbc3857e842 tempest-VolumesTransfersV355Test-651766624 None] Created volume successfully. Jun 25 21:15:15.741122 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-288b9ebd-bd1a-4094-b8c3-f712d1c10793 tempest-VolumesTransfersV355Test-1411244353 None] Lock "b'cinder-ecbc9e03-0dcb-49ba-aa2f-d63d9f14c80c-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:15:15.787876 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-288b9ebd-bd1a-4094-b8c3-f712d1c10793 tempest-VolumesTransfersV355Test-1411244353 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:15:15.917098 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-288b9ebd-bd1a-4094-b8c3-f712d1c10793 tempest-VolumesTransfersV355Test-1411244353 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:15:15.917779 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-288b9ebd-bd1a-4094-b8c3-f712d1c10793 tempest-VolumesTransfersV355Test-1411244353 None] Volume volume-ecbc9e03-0dcb-49ba-aa2f-d63d9f14c80c is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:15:15.930503 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-288b9ebd-bd1a-4094-b8c3-f712d1c10793 tempest-VolumesTransfersV355Test-1411244353 None] deleting rbd volume volume-ecbc9e03-0dcb-49ba-aa2f-d63d9f14c80c {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:15:16.485825 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-288b9ebd-bd1a-4094-b8c3-f712d1c10793 tempest-VolumesTransfersV355Test-1411244353 None] Created reservations ['1fdf3f5e-4867-4439-b44e-42e93dd334cf', 'f74bdb3e-1dc3-4083-81d8-9b450288e98f', '63c2f9ec-da04-4cbf-9a15-d8518e0fa843', '6302c48e-80db-4f5a-b2a8-bc325cfd0c15'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:15:16.618180 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-288b9ebd-bd1a-4094-b8c3-f712d1c10793 tempest-VolumesTransfersV355Test-1411244353 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:15:16.710004 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-288b9ebd-bd1a-4094-b8c3-f712d1c10793 tempest-VolumesTransfersV355Test-1411244353 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:15:16.804052 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-288b9ebd-bd1a-4094-b8c3-f712d1c10793 tempest-VolumesTransfersV355Test-1411244353 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:15:16.810348 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-288b9ebd-bd1a-4094-b8c3-f712d1c10793 tempest-VolumesTransfersV355Test-1411244353 None] Deleted volume successfully. Jun 25 21:15:16.842778 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-288b9ebd-bd1a-4094-b8c3-f712d1c10793 tempest-VolumesTransfersV355Test-1411244353 None] Lock "b'cinder-ecbc9e03-0dcb-49ba-aa2f-d63d9f14c80c-delete_volume'" released by "delete_volume" :: held 1.103s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:15:17.721914 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-ace65cc8-a567-436d-b1af-a19d98e85f99 tempest-AttachVolumeTestJSON-931041757 None] Lock "b'cinder-3f59969f-4d18-4fe6-8ebe-8f673720b514-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:15:17.848662 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ace65cc8-a567-436d-b1af-a19d98e85f99 tempest-AttachVolumeTestJSON-931041757 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:15:17.952094 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ace65cc8-a567-436d-b1af-a19d98e85f99 tempest-AttachVolumeTestJSON-931041757 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:15:17.952568 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ace65cc8-a567-436d-b1af-a19d98e85f99 tempest-AttachVolumeTestJSON-931041757 None] Volume volume-3f59969f-4d18-4fe6-8ebe-8f673720b514 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:15:17.966171 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ace65cc8-a567-436d-b1af-a19d98e85f99 tempest-AttachVolumeTestJSON-931041757 None] deleting rbd volume volume-3f59969f-4d18-4fe6-8ebe-8f673720b514 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:15:18.535090 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-ace65cc8-a567-436d-b1af-a19d98e85f99 tempest-AttachVolumeTestJSON-931041757 None] Created reservations ['22367a41-4356-48e3-baf4-f14161c93194', '7f6a4b31-7fb2-423a-baaa-c7a1f582159f', '56bd17a8-4a36-4737-920f-52f4f8e064e4', 'c4a0b8f7-0aef-4903-9764-cf5035d14976'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:15:18.638952 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ace65cc8-a567-436d-b1af-a19d98e85f99 tempest-AttachVolumeTestJSON-931041757 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:15:18.728782 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ace65cc8-a567-436d-b1af-a19d98e85f99 tempest-AttachVolumeTestJSON-931041757 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:15:18.796833 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-ace65cc8-a567-436d-b1af-a19d98e85f99 tempest-AttachVolumeTestJSON-931041757 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:15:18.812321 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-ace65cc8-a567-436d-b1af-a19d98e85f99 tempest-AttachVolumeTestJSON-931041757 None] Deleted volume successfully. Jun 25 21:15:18.840540 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-ace65cc8-a567-436d-b1af-a19d98e85f99 tempest-AttachVolumeTestJSON-931041757 None] Lock "b'cinder-3f59969f-4d18-4fe6-8ebe-8f673720b514-delete_volume'" released by "delete_volume" :: held 1.120s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:15:19.032866 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-218df5ff-c680-4bad-9f9b-6db3ebcf1920 tempest-AttachVolumeTestJSON-931041757 None] Lock "b'cinder-2673345e-0e06-4c27-a28f-280fa1677d48-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:15:19.039215 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:UPDATE=38,cinder:SELECT=48,cinder:DELETE=6,cinder:INSERT=8 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:19.190652 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-218df5ff-c680-4bad-9f9b-6db3ebcf1920 tempest-AttachVolumeTestJSON-931041757 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:15:19.298649 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-218df5ff-c680-4bad-9f9b-6db3ebcf1920 tempest-AttachVolumeTestJSON-931041757 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:15:19.299077 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-218df5ff-c680-4bad-9f9b-6db3ebcf1920 tempest-AttachVolumeTestJSON-931041757 None] Volume volume-2673345e-0e06-4c27-a28f-280fa1677d48 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:15:19.315422 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-218df5ff-c680-4bad-9f9b-6db3ebcf1920 tempest-AttachVolumeTestJSON-931041757 None] deleting rbd volume volume-2673345e-0e06-4c27-a28f-280fa1677d48 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:15:19.352859 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-b407b1db-578d-46ea-8989-2122d40fe5eb tempest-VolumeQuotasNegativeTestJSON-776852442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:15:19.395720 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b407b1db-578d-46ea-8989-2122d40fe5eb tempest-VolumeQuotasNegativeTestJSON-776852442 None] Flow 'volume_create_manager' (8a610e18-6120-4f9c-943a-d279d97633f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:15:19.402128 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b407b1db-578d-46ea-8989-2122d40fe5eb tempest-VolumeQuotasNegativeTestJSON-776852442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff0f0418-4576-4100-803b-bb4df2835aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:15:19.441784 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b407b1db-578d-46ea-8989-2122d40fe5eb tempest-VolumeQuotasNegativeTestJSON-776852442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff0f0418-4576-4100-803b-bb4df2835aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2146126904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b0acb87e-568f-4269-9ea1-e81406f674bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a3b3e78330c4082ae1e8659fe8f3282',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:15:19Z,use_quota=True,user_id='395a7f3c67124a738eedb4d4eb834329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:15:19.458159 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b407b1db-578d-46ea-8989-2122d40fe5eb tempest-VolumeQuotasNegativeTestJSON-776852442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea172e4c-316d-4c3a-b081-27c2985f04c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:15:19.462995 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b407b1db-578d-46ea-8989-2122d40fe5eb tempest-VolumeQuotasNegativeTestJSON-776852442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea172e4c-316d-4c3a-b081-27c2985f04c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:15:19.481931 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b407b1db-578d-46ea-8989-2122d40fe5eb tempest-VolumeQuotasNegativeTestJSON-776852442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59eca9ac-eccb-4bb5-a7f9-9e2009426af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:15:19.503348 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b407b1db-578d-46ea-8989-2122d40fe5eb tempest-VolumeQuotasNegativeTestJSON-776852442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59eca9ac-eccb-4bb5-a7f9-9e2009426af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0acb87e-568f-4269-9ea1-e81406f674bb', 'volume_name': 'volume-b0acb87e-568f-4269-9ea1-e81406f674bb', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:15:19.513431 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b407b1db-578d-46ea-8989-2122d40fe5eb tempest-VolumeQuotasNegativeTestJSON-776852442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f86b9c8-c9e2-482a-a4bf-7f73fe19998d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:15:19.522653 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b407b1db-578d-46ea-8989-2122d40fe5eb tempest-VolumeQuotasNegativeTestJSON-776852442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f86b9c8-c9e2-482a-a4bf-7f73fe19998d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:15:19.533756 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b407b1db-578d-46ea-8989-2122d40fe5eb tempest-VolumeQuotasNegativeTestJSON-776852442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceba4bb3-5749-4825-ad2b-db70ae9aa4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:15:19.535894 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-b407b1db-578d-46ea-8989-2122d40fe5eb tempest-VolumeQuotasNegativeTestJSON-776852442 None] Volume b0acb87e-568f-4269-9ea1-e81406f674bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0acb87e-568f-4269-9ea1-e81406f674bb', 'volume_size': 1} Jun 25 21:15:19.536736 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b407b1db-578d-46ea-8989-2122d40fe5eb tempest-VolumeQuotasNegativeTestJSON-776852442 None] creating volume 'volume-b0acb87e-568f-4269-9ea1-e81406f674bb' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:15:19.537838 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b407b1db-578d-46ea-8989-2122d40fe5eb tempest-VolumeQuotasNegativeTestJSON-776852442 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:15:19.662213 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b407b1db-578d-46ea-8989-2122d40fe5eb tempest-VolumeQuotasNegativeTestJSON-776852442 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:15:19.662575 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b407b1db-578d-46ea-8989-2122d40fe5eb tempest-VolumeQuotasNegativeTestJSON-776852442 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:15:19.667040 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b407b1db-578d-46ea-8989-2122d40fe5eb tempest-VolumeQuotasNegativeTestJSON-776852442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceba4bb3-5749-4825-ad2b-db70ae9aa4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0acb87e-568f-4269-9ea1-e81406f674bb', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:15:19.675915 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b407b1db-578d-46ea-8989-2122d40fe5eb tempest-VolumeQuotasNegativeTestJSON-776852442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca7ec693-bb6c-434d-a419-47e6e074c26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:15:19.699970 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-b407b1db-578d-46ea-8989-2122d40fe5eb tempest-VolumeQuotasNegativeTestJSON-776852442 None] Volume volume-b0acb87e-568f-4269-9ea1-e81406f674bb (b0acb87e-568f-4269-9ea1-e81406f674bb): created successfully Jun 25 21:15:19.703773 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b407b1db-578d-46ea-8989-2122d40fe5eb tempest-VolumeQuotasNegativeTestJSON-776852442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca7ec693-bb6c-434d-a419-47e6e074c26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:15:19.714306 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b407b1db-578d-46ea-8989-2122d40fe5eb tempest-VolumeQuotasNegativeTestJSON-776852442 None] Flow 'volume_create_manager' (8a610e18-6120-4f9c-943a-d279d97633f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:15:19.765881 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-b407b1db-578d-46ea-8989-2122d40fe5eb tempest-VolumeQuotasNegativeTestJSON-776852442 None] Created volume successfully. Jun 25 21:15:19.834626 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-218df5ff-c680-4bad-9f9b-6db3ebcf1920 tempest-AttachVolumeTestJSON-931041757 None] Created reservations ['9243978c-c841-4f19-b524-c97cac266931', 'a789a90e-4a8f-489d-abf5-0c4e2022bb59', '3912a2e5-74e9-4c44-a81c-a3cb31eeaa48', 'e4b2f17a-2284-4db9-9337-c0d4d9d223de'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:15:19.919465 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-218df5ff-c680-4bad-9f9b-6db3ebcf1920 tempest-AttachVolumeTestJSON-931041757 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:15:19.969848 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-218df5ff-c680-4bad-9f9b-6db3ebcf1920 tempest-AttachVolumeTestJSON-931041757 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:15:20.031137 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-218df5ff-c680-4bad-9f9b-6db3ebcf1920 tempest-AttachVolumeTestJSON-931041757 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:15:20.035957 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-218df5ff-c680-4bad-9f9b-6db3ebcf1920 tempest-AttachVolumeTestJSON-931041757 None] Deleted volume successfully. Jun 25 21:15:20.054809 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-218df5ff-c680-4bad-9f9b-6db3ebcf1920 tempest-AttachVolumeTestJSON-931041757 None] Lock "b'cinder-2673345e-0e06-4c27-a28f-280fa1677d48-delete_volume'" released by "delete_volume" :: held 1.022s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:15:20.562825 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-64a45baa-db60-462c-85be-af3f85ccfdcb tempest-AttachVolumeTestJSON-931041757 None] Lock "b'cinder-d3c85d3e-4e4f-43ae-8178-accc09ce263b-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:15:20.639472 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-64a45baa-db60-462c-85be-af3f85ccfdcb tempest-AttachVolumeTestJSON-931041757 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:15:20.733577 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-64a45baa-db60-462c-85be-af3f85ccfdcb tempest-AttachVolumeTestJSON-931041757 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:15:20.734357 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-64a45baa-db60-462c-85be-af3f85ccfdcb tempest-AttachVolumeTestJSON-931041757 None] Volume volume-d3c85d3e-4e4f-43ae-8178-accc09ce263b is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:15:20.744227 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-64a45baa-db60-462c-85be-af3f85ccfdcb tempest-AttachVolumeTestJSON-931041757 None] deleting rbd volume volume-d3c85d3e-4e4f-43ae-8178-accc09ce263b {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:15:21.250138 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-64a45baa-db60-462c-85be-af3f85ccfdcb tempest-AttachVolumeTestJSON-931041757 None] Created reservations ['a658186e-15cd-4353-aee9-6b2139d4cb79', 'b9b82fa5-9217-448f-bdaf-cb1816271a24', '944d1233-711b-440d-a3a6-971fb7f0dfa1', '68ae5ca6-8fbb-4155-b6b4-980a0be81ca4'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:15:21.256854 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:UPDATE=34,cinder:SELECT=60,cinder:INSERT=5,cinder:DELETE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:21.422580 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-64a45baa-db60-462c-85be-af3f85ccfdcb tempest-AttachVolumeTestJSON-931041757 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:15:21.553243 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-64a45baa-db60-462c-85be-af3f85ccfdcb tempest-AttachVolumeTestJSON-931041757 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:15:21.618284 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-64a45baa-db60-462c-85be-af3f85ccfdcb tempest-AttachVolumeTestJSON-931041757 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:15:21.623756 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-64a45baa-db60-462c-85be-af3f85ccfdcb tempest-AttachVolumeTestJSON-931041757 None] Deleted volume successfully. Jun 25 21:15:21.646891 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-64a45baa-db60-462c-85be-af3f85ccfdcb tempest-AttachVolumeTestJSON-931041757 None] Lock "b'cinder-d3c85d3e-4e4f-43ae-8178-accc09ce263b-delete_volume'" released by "delete_volume" :: held 1.084s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:15:22.057846 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-228355e4-cd14-4bc1-b6ed-b6324cafb8fa tempest-VolumeQuotasNegativeTestJSON-776852442 None] Lock "b'cinder-b0acb87e-568f-4269-9ea1-e81406f674bb-delete_volume'" acquired by "delete_volume" :: waited 0.050s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:15:22.177927 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-228355e4-cd14-4bc1-b6ed-b6324cafb8fa tempest-VolumeQuotasNegativeTestJSON-776852442 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:15:22.298156 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-228355e4-cd14-4bc1-b6ed-b6324cafb8fa tempest-VolumeQuotasNegativeTestJSON-776852442 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:15:22.298884 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-228355e4-cd14-4bc1-b6ed-b6324cafb8fa tempest-VolumeQuotasNegativeTestJSON-776852442 None] Volume volume-b0acb87e-568f-4269-9ea1-e81406f674bb is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:15:22.313692 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-228355e4-cd14-4bc1-b6ed-b6324cafb8fa tempest-VolumeQuotasNegativeTestJSON-776852442 None] deleting rbd volume volume-b0acb87e-568f-4269-9ea1-e81406f674bb {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:15:22.757519 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-228355e4-cd14-4bc1-b6ed-b6324cafb8fa tempest-VolumeQuotasNegativeTestJSON-776852442 None] Created reservations ['1a73d608-daf3-4458-a67e-26241477ede7', '7b1cc367-cc2a-4433-b6f2-be6cc4bb8ec0', '041fe53d-1540-40f1-bb30-1dd90906926d', '1c8f0415-0ed4-4839-ab23-5945530ad76a'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:15:22.863291 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-228355e4-cd14-4bc1-b6ed-b6324cafb8fa tempest-VolumeQuotasNegativeTestJSON-776852442 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:15:22.938444 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-228355e4-cd14-4bc1-b6ed-b6324cafb8fa tempest-VolumeQuotasNegativeTestJSON-776852442 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:15:23.001149 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-228355e4-cd14-4bc1-b6ed-b6324cafb8fa tempest-VolumeQuotasNegativeTestJSON-776852442 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:15:23.005973 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-228355e4-cd14-4bc1-b6ed-b6324cafb8fa tempest-VolumeQuotasNegativeTestJSON-776852442 None] Deleted volume successfully. Jun 25 21:15:23.029329 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-228355e4-cd14-4bc1-b6ed-b6324cafb8fa tempest-VolumeQuotasNegativeTestJSON-776852442 None] Lock "b'cinder-b0acb87e-568f-4269-9ea1-e81406f674bb-delete_volume'" released by "delete_volume" :: held 0.975s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:15:27.418594 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f477a7b-28ba-45be-94be-667615cd201c tempest-VolumesActionsTest-745630661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:15:27.449058 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2f477a7b-28ba-45be-94be-667615cd201c tempest-VolumesActionsTest-745630661 None] Flow 'volume_create_manager' (b3251cb4-186c-44ea-96d4-3fb424ec2e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:15:27.457571 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2f477a7b-28ba-45be-94be-667615cd201c tempest-VolumesActionsTest-745630661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f47beb4-3d56-4588-ba70-f7665710128e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:15:27.475491 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2f477a7b-28ba-45be-94be-667615cd201c tempest-VolumesActionsTest-745630661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f47beb4-3d56-4588-ba70-f7665710128e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1475026635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=779e9cb0-e1c7-4825-9eb0-fa33a58fef36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='731db346121f4334bd2e30ba916e85be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:15:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:15:27Z,use_quota=True,user_id='83af31935cce49c5b97d9dd2a4774e73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:15:27.484569 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2f477a7b-28ba-45be-94be-667615cd201c tempest-VolumesActionsTest-745630661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc6cf073-8cb0-4d93-bb66-6bf2191db716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:15:27.489691 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2f477a7b-28ba-45be-94be-667615cd201c tempest-VolumesActionsTest-745630661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc6cf073-8cb0-4d93-bb66-6bf2191db716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:15:27.495979 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2f477a7b-28ba-45be-94be-667615cd201c tempest-VolumesActionsTest-745630661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f062893-cbd8-4a32-9307-b44ae43216b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:15:27.500167 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2f477a7b-28ba-45be-94be-667615cd201c tempest-VolumesActionsTest-745630661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f062893-cbd8-4a32-9307-b44ae43216b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '779e9cb0-e1c7-4825-9eb0-fa33a58fef36', 'volume_name': 'volume-779e9cb0-e1c7-4825-9eb0-fa33a58fef36', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:15:27.505033 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2f477a7b-28ba-45be-94be-667615cd201c tempest-VolumesActionsTest-745630661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b9ee50e-3ac2-4ce4-9120-2fcdac12c381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:15:27.509152 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2f477a7b-28ba-45be-94be-667615cd201c tempest-VolumesActionsTest-745630661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b9ee50e-3ac2-4ce4-9120-2fcdac12c381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:15:27.514983 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2f477a7b-28ba-45be-94be-667615cd201c tempest-VolumesActionsTest-745630661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1234d414-fa51-48da-8cb7-ca01eadaae61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:15:27.516693 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-2f477a7b-28ba-45be-94be-667615cd201c tempest-VolumesActionsTest-745630661 None] Volume 779e9cb0-e1c7-4825-9eb0-fa33a58fef36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-779e9cb0-e1c7-4825-9eb0-fa33a58fef36', 'volume_size': 1} Jun 25 21:15:27.516906 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2f477a7b-28ba-45be-94be-667615cd201c tempest-VolumesActionsTest-745630661 None] creating volume 'volume-779e9cb0-e1c7-4825-9eb0-fa33a58fef36' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:15:27.517679 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2f477a7b-28ba-45be-94be-667615cd201c tempest-VolumesActionsTest-745630661 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:15:27.610641 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2f477a7b-28ba-45be-94be-667615cd201c tempest-VolumesActionsTest-745630661 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:15:27.610999 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2f477a7b-28ba-45be-94be-667615cd201c tempest-VolumesActionsTest-745630661 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:15:27.615370 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2f477a7b-28ba-45be-94be-667615cd201c tempest-VolumesActionsTest-745630661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1234d414-fa51-48da-8cb7-ca01eadaae61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-779e9cb0-e1c7-4825-9eb0-fa33a58fef36', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:15:27.624222 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2f477a7b-28ba-45be-94be-667615cd201c tempest-VolumesActionsTest-745630661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d39c3ca1-c360-4495-b90d-3b39c201c315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:15:27.637103 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-2f477a7b-28ba-45be-94be-667615cd201c tempest-VolumesActionsTest-745630661 None] Volume volume-779e9cb0-e1c7-4825-9eb0-fa33a58fef36 (779e9cb0-e1c7-4825-9eb0-fa33a58fef36): created successfully Jun 25 21:15:27.642100 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2f477a7b-28ba-45be-94be-667615cd201c tempest-VolumesActionsTest-745630661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d39c3ca1-c360-4495-b90d-3b39c201c315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:15:27.651030 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2f477a7b-28ba-45be-94be-667615cd201c tempest-VolumesActionsTest-745630661 None] Flow 'volume_create_manager' (b3251cb4-186c-44ea-96d4-3fb424ec2e4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:15:27.662289 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-2f477a7b-28ba-45be-94be-667615cd201c tempest-VolumesActionsTest-745630661 None] Created volume successfully. Jun 25 21:15:30.444749 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4d11374-e02a-4fc6-bd1e-fa0d0b54964a tempest-VolumeRetypeWithoutMigrationTest-1125677651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:15:30.472209 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c4d11374-e02a-4fc6-bd1e-fa0d0b54964a tempest-VolumeRetypeWithoutMigrationTest-1125677651 None] Flow 'volume_create_manager' (fc2db08e-e664-4c5b-8065-14bc9c8ae9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:15:30.487374 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c4d11374-e02a-4fc6-bd1e-fa0d0b54964a tempest-VolumeRetypeWithoutMigrationTest-1125677651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45b6ea37-4be2-412f-8ab0-8d2dc80882b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:15:30.512256 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c4d11374-e02a-4fc6-bd1e-fa0d0b54964a tempest-VolumeRetypeWithoutMigrationTest-1125677651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45b6ea37-4be2-412f-8ab0-8d2dc80882b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1978718755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=68b2340d-4001-48a2-bce1-5a32f335f896,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a802a9436b9b434983af9ea0e92d58e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:15:30Z,use_quota=True,user_id='b9a310bcaa2b4cc7a6497858b7e6d552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76f41bcf-5b07-498f-8cc0-e9f391e4bfe9),volume_type_id=76f41bcf-5b07-498f-8cc0-e9f391e4bfe9)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:15:30.547373 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c4d11374-e02a-4fc6-bd1e-fa0d0b54964a tempest-VolumeRetypeWithoutMigrationTest-1125677651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0cd9f55-94c4-4b9c-8a86-0d6170ddd82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:15:30.555973 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c4d11374-e02a-4fc6-bd1e-fa0d0b54964a tempest-VolumeRetypeWithoutMigrationTest-1125677651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0cd9f55-94c4-4b9c-8a86-0d6170ddd82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:15:30.563994 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c4d11374-e02a-4fc6-bd1e-fa0d0b54964a tempest-VolumeRetypeWithoutMigrationTest-1125677651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0df27a4b-5a27-4ebb-8264-13dc3c7a1fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:15:30.570007 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c4d11374-e02a-4fc6-bd1e-fa0d0b54964a tempest-VolumeRetypeWithoutMigrationTest-1125677651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0df27a4b-5a27-4ebb-8264-13dc3c7a1fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68b2340d-4001-48a2-bce1-5a32f335f896', 'volume_name': 'volume-68b2340d-4001-48a2-bce1-5a32f335f896', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:15:30.576369 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c4d11374-e02a-4fc6-bd1e-fa0d0b54964a tempest-VolumeRetypeWithoutMigrationTest-1125677651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97367441-be6d-47ee-afb2-9940a86959a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:15:30.580533 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c4d11374-e02a-4fc6-bd1e-fa0d0b54964a tempest-VolumeRetypeWithoutMigrationTest-1125677651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97367441-be6d-47ee-afb2-9940a86959a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:15:30.586489 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c4d11374-e02a-4fc6-bd1e-fa0d0b54964a tempest-VolumeRetypeWithoutMigrationTest-1125677651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ac8ac80-8032-4d41-9e43-ed36c761bfe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:15:30.588046 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-c4d11374-e02a-4fc6-bd1e-fa0d0b54964a tempest-VolumeRetypeWithoutMigrationTest-1125677651 None] Volume 68b2340d-4001-48a2-bce1-5a32f335f896: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68b2340d-4001-48a2-bce1-5a32f335f896', 'volume_size': 1} Jun 25 21:15:30.588712 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c4d11374-e02a-4fc6-bd1e-fa0d0b54964a tempest-VolumeRetypeWithoutMigrationTest-1125677651 None] creating volume 'volume-68b2340d-4001-48a2-bce1-5a32f335f896' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:15:30.589588 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c4d11374-e02a-4fc6-bd1e-fa0d0b54964a tempest-VolumeRetypeWithoutMigrationTest-1125677651 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:15:30.735288 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c4d11374-e02a-4fc6-bd1e-fa0d0b54964a tempest-VolumeRetypeWithoutMigrationTest-1125677651 None] extra_specs: {} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:15:30.735659 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c4d11374-e02a-4fc6-bd1e-fa0d0b54964a tempest-VolumeRetypeWithoutMigrationTest-1125677651 None] extra_specs: {} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:15:30.739314 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c4d11374-e02a-4fc6-bd1e-fa0d0b54964a tempest-VolumeRetypeWithoutMigrationTest-1125677651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ac8ac80-8032-4d41-9e43-ed36c761bfe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68b2340d-4001-48a2-bce1-5a32f335f896', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:15:30.743854 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c4d11374-e02a-4fc6-bd1e-fa0d0b54964a tempest-VolumeRetypeWithoutMigrationTest-1125677651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b5f02f9-499d-46a4-95b0-e38bd92c0fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:15:30.767019 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-c4d11374-e02a-4fc6-bd1e-fa0d0b54964a tempest-VolumeRetypeWithoutMigrationTest-1125677651 None] Volume volume-68b2340d-4001-48a2-bce1-5a32f335f896 (68b2340d-4001-48a2-bce1-5a32f335f896): created successfully Jun 25 21:15:30.770795 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c4d11374-e02a-4fc6-bd1e-fa0d0b54964a tempest-VolumeRetypeWithoutMigrationTest-1125677651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b5f02f9-499d-46a4-95b0-e38bd92c0fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:15:30.786822 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c4d11374-e02a-4fc6-bd1e-fa0d0b54964a tempest-VolumeRetypeWithoutMigrationTest-1125677651 None] Flow 'volume_create_manager' (fc2db08e-e664-4c5b-8065-14bc9c8ae9af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:15:30.815181 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-c4d11374-e02a-4fc6-bd1e-fa0d0b54964a tempest-VolumeRetypeWithoutMigrationTest-1125677651 None] Created volume successfully. Jun 25 21:15:32.699704 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=60,cinder:UPDATE=30,cinder:DELETE=3,cinder:INSERT=7 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:32.753677 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2f2c7756-7469-4037-8f71-2308549e96f0 tempest-VolumeRetypeWithoutMigrationTest-1125677651 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:15:32.845341 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2f2c7756-7469-4037-8f71-2308549e96f0 tempest-VolumeRetypeWithoutMigrationTest-1125677651 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:15:32.897286 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-2f2c7756-7469-4037-8f71-2308549e96f0 tempest-VolumeRetypeWithoutMigrationTest-1125677651 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:15:32.905113 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-2f2c7756-7469-4037-8f71-2308549e96f0 tempest-VolumeRetypeWithoutMigrationTest-1125677651 None] Retype volume completed successfully. Jun 25 21:15:34.115371 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-3ff26c07-9ccf-4a17-a6e1-3ccb89e4f1dd tempest-VolumeRetypeWithoutMigrationTest-1125677651 None] Lock "b'cinder-68b2340d-4001-48a2-bce1-5a32f335f896-delete_volume'" acquired by "delete_volume" :: waited 0.039s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:15:34.193221 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3ff26c07-9ccf-4a17-a6e1-3ccb89e4f1dd tempest-VolumeRetypeWithoutMigrationTest-1125677651 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:15:34.323120 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3ff26c07-9ccf-4a17-a6e1-3ccb89e4f1dd tempest-VolumeRetypeWithoutMigrationTest-1125677651 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:15:34.323893 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3ff26c07-9ccf-4a17-a6e1-3ccb89e4f1dd tempest-VolumeRetypeWithoutMigrationTest-1125677651 None] Volume volume-68b2340d-4001-48a2-bce1-5a32f335f896 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:15:34.345230 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3ff26c07-9ccf-4a17-a6e1-3ccb89e4f1dd tempest-VolumeRetypeWithoutMigrationTest-1125677651 None] deleting rbd volume volume-68b2340d-4001-48a2-bce1-5a32f335f896 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:15:34.878646 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-3ff26c07-9ccf-4a17-a6e1-3ccb89e4f1dd tempest-VolumeRetypeWithoutMigrationTest-1125677651 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 25 21:15:34.879478 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-3ff26c07-9ccf-4a17-a6e1-3ccb89e4f1dd tempest-VolumeRetypeWithoutMigrationTest-1125677651 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 25 21:15:34.950282 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-3ff26c07-9ccf-4a17-a6e1-3ccb89e4f1dd tempest-VolumeRetypeWithoutMigrationTest-1125677651 None] Created reservations ['17c45621-4c10-4eb0-a3bf-eb31dc597559', '21090246-6585-4f80-8f7e-45e9b196b31f', 'a6a6b91a-caab-4015-8166-d01a5064e5f2', 'f48a9306-ea53-4c31-8bcf-29255f4fb4eb'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:15:35.118578 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3ff26c07-9ccf-4a17-a6e1-3ccb89e4f1dd tempest-VolumeRetypeWithoutMigrationTest-1125677651 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:15:35.253833 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3ff26c07-9ccf-4a17-a6e1-3ccb89e4f1dd tempest-VolumeRetypeWithoutMigrationTest-1125677651 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:15:35.338339 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-3ff26c07-9ccf-4a17-a6e1-3ccb89e4f1dd tempest-VolumeRetypeWithoutMigrationTest-1125677651 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:15:35.342554 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-3ff26c07-9ccf-4a17-a6e1-3ccb89e4f1dd tempest-VolumeRetypeWithoutMigrationTest-1125677651 None] Deleted volume successfully. Jun 25 21:15:35.362983 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-3ff26c07-9ccf-4a17-a6e1-3ccb89e4f1dd tempest-VolumeRetypeWithoutMigrationTest-1125677651 None] Lock "b'cinder-68b2340d-4001-48a2-bce1-5a32f335f896-delete_volume'" released by "delete_volume" :: held 1.248s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:15:44.050871 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:UPDATE=37,cinder:SELECT=53,cinder:INSERT=8,cinder:DELETE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:45.464516 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-b63f5108-6234-4cba-93e9-81bf64e4587d tempest-VolumeTypesAccessTest-556948104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:15:45.489290 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b63f5108-6234-4cba-93e9-81bf64e4587d tempest-VolumeTypesAccessTest-556948104 None] Flow 'volume_create_manager' (cddd4b50-cdd8-4266-a4d8-2f0be5309d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:15:45.495973 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b63f5108-6234-4cba-93e9-81bf64e4587d tempest-VolumeTypesAccessTest-556948104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eefd0327-d1f6-46b7-a5d8-2077dcf45855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:15:45.514681 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b63f5108-6234-4cba-93e9-81bf64e4587d tempest-VolumeTypesAccessTest-556948104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eefd0327-d1f6-46b7-a5d8-2077dcf45855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1143850911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e35009e8-13cc-4f7f-82b7-8df5d4631bc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a98586487afa4caf9bfcc3b2f9ec6b1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:15:45Z,use_quota=True,user_id='7589db7eb2f14d0ca2c0292f6e3c1ee7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ddc70b0-fa74-49e6-9668-9dd0d46dda38),volume_type_id=2ddc70b0-fa74-49e6-9668-9dd0d46dda38)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:15:45.523161 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b63f5108-6234-4cba-93e9-81bf64e4587d tempest-VolumeTypesAccessTest-556948104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07a7f098-f129-4490-ae96-417301d5f544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:15:45.540252 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b63f5108-6234-4cba-93e9-81bf64e4587d tempest-VolumeTypesAccessTest-556948104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07a7f098-f129-4490-ae96-417301d5f544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:15:45.546240 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b63f5108-6234-4cba-93e9-81bf64e4587d tempest-VolumeTypesAccessTest-556948104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc35c33b-b8e0-4570-a269-cea81261e86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:15:45.554018 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b63f5108-6234-4cba-93e9-81bf64e4587d tempest-VolumeTypesAccessTest-556948104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc35c33b-b8e0-4570-a269-cea81261e86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e35009e8-13cc-4f7f-82b7-8df5d4631bc0', 'volume_name': 'volume-e35009e8-13cc-4f7f-82b7-8df5d4631bc0', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:15:45.565973 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b63f5108-6234-4cba-93e9-81bf64e4587d tempest-VolumeTypesAccessTest-556948104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18edf36c-a75d-41ba-8349-9e6e3593ce4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:15:45.572888 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b63f5108-6234-4cba-93e9-81bf64e4587d tempest-VolumeTypesAccessTest-556948104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18edf36c-a75d-41ba-8349-9e6e3593ce4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:15:45.578776 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b63f5108-6234-4cba-93e9-81bf64e4587d tempest-VolumeTypesAccessTest-556948104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbe6d85a-f898-4be3-b0ce-795935de3527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:15:45.580079 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-b63f5108-6234-4cba-93e9-81bf64e4587d tempest-VolumeTypesAccessTest-556948104 None] Volume e35009e8-13cc-4f7f-82b7-8df5d4631bc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e35009e8-13cc-4f7f-82b7-8df5d4631bc0', 'volume_size': 1} Jun 25 21:15:45.580740 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b63f5108-6234-4cba-93e9-81bf64e4587d tempest-VolumeTypesAccessTest-556948104 None] creating volume 'volume-e35009e8-13cc-4f7f-82b7-8df5d4631bc0' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:15:45.584281 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b63f5108-6234-4cba-93e9-81bf64e4587d tempest-VolumeTypesAccessTest-556948104 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:15:45.700166 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b63f5108-6234-4cba-93e9-81bf64e4587d tempest-VolumeTypesAccessTest-556948104 None] extra_specs: {} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:15:45.701277 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b63f5108-6234-4cba-93e9-81bf64e4587d tempest-VolumeTypesAccessTest-556948104 None] extra_specs: {} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:15:45.712997 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b63f5108-6234-4cba-93e9-81bf64e4587d tempest-VolumeTypesAccessTest-556948104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbe6d85a-f898-4be3-b0ce-795935de3527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e35009e8-13cc-4f7f-82b7-8df5d4631bc0', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:15:45.718370 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b63f5108-6234-4cba-93e9-81bf64e4587d tempest-VolumeTypesAccessTest-556948104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (750c655e-33cb-4f71-8173-1d2666e11a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:15:45.743768 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-b63f5108-6234-4cba-93e9-81bf64e4587d tempest-VolumeTypesAccessTest-556948104 None] Volume volume-e35009e8-13cc-4f7f-82b7-8df5d4631bc0 (e35009e8-13cc-4f7f-82b7-8df5d4631bc0): created successfully Jun 25 21:15:45.751007 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b63f5108-6234-4cba-93e9-81bf64e4587d tempest-VolumeTypesAccessTest-556948104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (750c655e-33cb-4f71-8173-1d2666e11a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:15:45.759258 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b63f5108-6234-4cba-93e9-81bf64e4587d tempest-VolumeTypesAccessTest-556948104 None] Flow 'volume_create_manager' (cddd4b50-cdd8-4266-a4d8-2f0be5309d6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:15:45.776844 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-b63f5108-6234-4cba-93e9-81bf64e4587d tempest-VolumeTypesAccessTest-556948104 None] Created volume successfully. Jun 25 21:15:47.181364 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-7dd2ea67-c8ac-4d9b-b78a-f2848ae636fd tempest-VolumeTypesAccessTest-556948104 None] Lock "b'cinder-e35009e8-13cc-4f7f-82b7-8df5d4631bc0-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:15:47.286605 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7dd2ea67-c8ac-4d9b-b78a-f2848ae636fd tempest-VolumeTypesAccessTest-556948104 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:15:47.399879 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7dd2ea67-c8ac-4d9b-b78a-f2848ae636fd tempest-VolumeTypesAccessTest-556948104 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:15:47.400297 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7dd2ea67-c8ac-4d9b-b78a-f2848ae636fd tempest-VolumeTypesAccessTest-556948104 None] Volume volume-e35009e8-13cc-4f7f-82b7-8df5d4631bc0 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:15:47.420646 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7dd2ea67-c8ac-4d9b-b78a-f2848ae636fd tempest-VolumeTypesAccessTest-556948104 None] deleting rbd volume volume-e35009e8-13cc-4f7f-82b7-8df5d4631bc0 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:15:47.966939 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-7dd2ea67-c8ac-4d9b-b78a-f2848ae636fd tempest-VolumeTypesAccessTest-556948104 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-577595886 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-577595886, it is now deprecated. Please use the default quota class for default quota. Jun 25 21:15:47.968094 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-7dd2ea67-c8ac-4d9b-b78a-f2848ae636fd tempest-VolumeTypesAccessTest-556948104 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-577595886 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-577595886, it is now deprecated. Please use the default quota class for default quota. Jun 25 21:15:48.007195 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-7dd2ea67-c8ac-4d9b-b78a-f2848ae636fd tempest-VolumeTypesAccessTest-556948104 None] Created reservations ['6a84c3b7-d649-4ac3-a65c-23ca41b810c9', '78c12017-04bb-44ef-864e-e21abfb291f3', '7ad498fb-e22c-45ee-9648-68e18e2f0e80', '3cd1c46f-cabc-408c-bbe6-29bd661abbe8'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:15:48.095507 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7dd2ea67-c8ac-4d9b-b78a-f2848ae636fd tempest-VolumeTypesAccessTest-556948104 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:15:48.171225 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7dd2ea67-c8ac-4d9b-b78a-f2848ae636fd tempest-VolumeTypesAccessTest-556948104 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:15:48.234042 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-7dd2ea67-c8ac-4d9b-b78a-f2848ae636fd tempest-VolumeTypesAccessTest-556948104 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:15:48.245640 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-7dd2ea67-c8ac-4d9b-b78a-f2848ae636fd tempest-VolumeTypesAccessTest-556948104 None] Deleted volume successfully. Jun 25 21:15:48.277658 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-7dd2ea67-c8ac-4d9b-b78a-f2848ae636fd tempest-VolumeTypesAccessTest-556948104 None] Lock "b'cinder-e35009e8-13cc-4f7f-82b7-8df5d4631bc0-delete_volume'" released by "delete_volume" :: held 1.096s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:15:52.146339 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:15:52.147174 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:15:52.213494 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:15:52.323285 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:15:57.546024 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-50d2fe07-07b7-4720-b59d-4ab5b7fad1e5 tempest-SnapshotMetadataTestJSON-1403759209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:15:57.571773 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-50d2fe07-07b7-4720-b59d-4ab5b7fad1e5 tempest-SnapshotMetadataTestJSON-1403759209 None] Flow 'volume_create_manager' (e991aa79-d79b-41fe-8891-c3a76c9c3bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:15:57.597286 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-50d2fe07-07b7-4720-b59d-4ab5b7fad1e5 tempest-SnapshotMetadataTestJSON-1403759209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e35f51e2-6681-4bf6-9321-598990fb34fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:15:57.628663 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-50d2fe07-07b7-4720-b59d-4ab5b7fad1e5 tempest-SnapshotMetadataTestJSON-1403759209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e35f51e2-6681-4bf6-9321-598990fb34fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-994860383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=929d3d17-9c4c-4e3a-9dd6-e9e7a2b38ca0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6caa4b4f47e642d1829351aabc3013ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:15:57Z,use_quota=True,user_id='9a039cb4e66f4397b9248c3a40407b9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:15:57.634678 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-50d2fe07-07b7-4720-b59d-4ab5b7fad1e5 tempest-SnapshotMetadataTestJSON-1403759209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64869783-cdaf-42f7-9a1a-5868ea6e004b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:15:57.645649 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-50d2fe07-07b7-4720-b59d-4ab5b7fad1e5 tempest-SnapshotMetadataTestJSON-1403759209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64869783-cdaf-42f7-9a1a-5868ea6e004b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:15:57.651489 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-50d2fe07-07b7-4720-b59d-4ab5b7fad1e5 tempest-SnapshotMetadataTestJSON-1403759209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bd53d7c-75d8-4fcd-8f17-9655fc8c7a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:15:57.658655 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-50d2fe07-07b7-4720-b59d-4ab5b7fad1e5 tempest-SnapshotMetadataTestJSON-1403759209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bd53d7c-75d8-4fcd-8f17-9655fc8c7a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '929d3d17-9c4c-4e3a-9dd6-e9e7a2b38ca0', 'volume_name': 'volume-929d3d17-9c4c-4e3a-9dd6-e9e7a2b38ca0', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:15:57.666480 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-50d2fe07-07b7-4720-b59d-4ab5b7fad1e5 tempest-SnapshotMetadataTestJSON-1403759209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87463d2e-5176-4f8e-8c9e-1a44257d23b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:15:57.671601 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-50d2fe07-07b7-4720-b59d-4ab5b7fad1e5 tempest-SnapshotMetadataTestJSON-1403759209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87463d2e-5176-4f8e-8c9e-1a44257d23b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:15:57.681107 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-50d2fe07-07b7-4720-b59d-4ab5b7fad1e5 tempest-SnapshotMetadataTestJSON-1403759209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f45c59c-19ce-4bb3-a6b2-4a8792090e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:15:57.682483 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-50d2fe07-07b7-4720-b59d-4ab5b7fad1e5 tempest-SnapshotMetadataTestJSON-1403759209 None] Volume 929d3d17-9c4c-4e3a-9dd6-e9e7a2b38ca0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-929d3d17-9c4c-4e3a-9dd6-e9e7a2b38ca0', 'volume_size': 1} Jun 25 21:15:57.683073 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-50d2fe07-07b7-4720-b59d-4ab5b7fad1e5 tempest-SnapshotMetadataTestJSON-1403759209 None] creating volume 'volume-929d3d17-9c4c-4e3a-9dd6-e9e7a2b38ca0' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:15:57.684193 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-50d2fe07-07b7-4720-b59d-4ab5b7fad1e5 tempest-SnapshotMetadataTestJSON-1403759209 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:15:57.854738 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-50d2fe07-07b7-4720-b59d-4ab5b7fad1e5 tempest-SnapshotMetadataTestJSON-1403759209 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:15:57.855478 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-50d2fe07-07b7-4720-b59d-4ab5b7fad1e5 tempest-SnapshotMetadataTestJSON-1403759209 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:15:57.878181 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-50d2fe07-07b7-4720-b59d-4ab5b7fad1e5 tempest-SnapshotMetadataTestJSON-1403759209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f45c59c-19ce-4bb3-a6b2-4a8792090e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-929d3d17-9c4c-4e3a-9dd6-e9e7a2b38ca0', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:15:57.892563 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-50d2fe07-07b7-4720-b59d-4ab5b7fad1e5 tempest-SnapshotMetadataTestJSON-1403759209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (220b4db7-7b18-4d14-8941-e348531323df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:15:57.923970 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-50d2fe07-07b7-4720-b59d-4ab5b7fad1e5 tempest-SnapshotMetadataTestJSON-1403759209 None] Volume volume-929d3d17-9c4c-4e3a-9dd6-e9e7a2b38ca0 (929d3d17-9c4c-4e3a-9dd6-e9e7a2b38ca0): created successfully Jun 25 21:15:57.927666 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-50d2fe07-07b7-4720-b59d-4ab5b7fad1e5 tempest-SnapshotMetadataTestJSON-1403759209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (220b4db7-7b18-4d14-8941-e348531323df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:15:57.936861 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-50d2fe07-07b7-4720-b59d-4ab5b7fad1e5 tempest-SnapshotMetadataTestJSON-1403759209 None] Flow 'volume_create_manager' (e991aa79-d79b-41fe-8891-c3a76c9c3bbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:15:57.959601 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-50d2fe07-07b7-4720-b59d-4ab5b7fad1e5 tempest-SnapshotMetadataTestJSON-1403759209 None] Created volume successfully. Jun 25 21:15:58.991658 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7da6a60e-f069-45ff-a34e-f44d2187eda6 tempest-SnapshotMetadataTestJSON-1403759209 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:15:59.500653 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-7da6a60e-f069-45ff-a34e-f44d2187eda6 tempest-SnapshotMetadataTestJSON-1403759209 None] Create snapshot completed successfully Jun 25 21:16:00.927407 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-15326213-5653-4520-bddd-17247387d6ad tempest-SnapshotMetadataTestJSON-1403759209 None] Lock "b'cinder-de067e3d-3dbc-418b-bc44-31c6e62467ff-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.016s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:16:00.930855 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-15326213-5653-4520-bddd-17247387d6ad tempest-SnapshotMetadataTestJSON-1403759209 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:16:01.144416 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-642c1c96-4cff-4577-91da-2ea2b20343e7 tempest-VolumesActionsTest-745630661 None] Lock "b'cinder-779e9cb0-e1c7-4825-9eb0-fa33a58fef36'" acquired by "attach_volume" :: waited 0.009s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:16:01.197846 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-642c1c96-4cff-4577-91da-2ea2b20343e7 tempest-VolumesActionsTest-745630661 None] Attaching volume 779e9cb0-e1c7-4825-9eb0-fa33a58fef36 to instance 4a172d8f-2ddd-4e08-9981-7bb893f7576f at mountpoint /dev/sdb on host None. Jun 25 21:16:01.233703 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-642c1c96-4cff-4577-91da-2ea2b20343e7 tempest-VolumesActionsTest-745630661 None] Attach volume completed successfully. Jun 25 21:16:01.240373 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-642c1c96-4cff-4577-91da-2ea2b20343e7 tempest-VolumesActionsTest-745630661 None] Lock "b'cinder-779e9cb0-e1c7-4825-9eb0-fa33a58fef36'" released by "attach_volume" :: held 0.105s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:16:01.380938 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-971b76a4-9f01-4d7e-8073-53c816660619 tempest-VolumesActionsTest-745630661 None] Lock "b'cinder-779e9cb0-e1c7-4825-9eb0-fa33a58fef36-detach_volume'" acquired by "detach_volume" :: waited 0.017s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:16:01.381925 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-971b76a4-9f01-4d7e-8073-53c816660619 tempest-VolumesActionsTest-745630661 None] Detaching volume 779e9cb0-e1c7-4825-9eb0-fa33a58fef36 from instance 4a172d8f-2ddd-4e08-9981-7bb893f7576f. Jun 25 21:16:01.447079 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-971b76a4-9f01-4d7e-8073-53c816660619 tempest-VolumesActionsTest-745630661 None] Detach volume completed successfully. Jun 25 21:16:01.453638 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-971b76a4-9f01-4d7e-8073-53c816660619 tempest-VolumesActionsTest-745630661 None] Lock "b'cinder-779e9cb0-e1c7-4825-9eb0-fa33a58fef36-detach_volume'" released by "detach_volume" :: held 0.073s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:16:01.475240 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-15326213-5653-4520-bddd-17247387d6ad tempest-SnapshotMetadataTestJSON-1403759209 None] Created reservations ['26d73211-9ae8-4d0e-8575-f41b1f80caa6', '243c304b-7ceb-4fd4-a688-07573f77b290', 'bbabef2e-a46b-4a69-966e-edd851c3297f', '2a627104-5da1-46f7-acee-b59acfdd1cb4'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:16:01.526007 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-15326213-5653-4520-bddd-17247387d6ad tempest-SnapshotMetadataTestJSON-1403759209 None] Delete snapshot completed successfully. Jun 25 21:16:01.532885 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-15326213-5653-4520-bddd-17247387d6ad tempest-SnapshotMetadataTestJSON-1403759209 None] Lock "b'cinder-de067e3d-3dbc-418b-bc44-31c6e62467ff-delete_snapshot'" released by "delete_snapshot" :: held 0.606s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:16:02.106748 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-4327234e-d4e2-459a-90f0-9bea4d5d7834 tempest-SnapshotMetadataTestJSON-1403759209 None] Lock "b'cinder-929d3d17-9c4c-4e3a-9dd6-e9e7a2b38ca0-delete_volume'" acquired by "delete_volume" :: waited 0.026s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:16:02.190215 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4327234e-d4e2-459a-90f0-9bea4d5d7834 tempest-SnapshotMetadataTestJSON-1403759209 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:16:02.260546 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4327234e-d4e2-459a-90f0-9bea4d5d7834 tempest-SnapshotMetadataTestJSON-1403759209 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:16:02.261038 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4327234e-d4e2-459a-90f0-9bea4d5d7834 tempest-SnapshotMetadataTestJSON-1403759209 None] Volume volume-929d3d17-9c4c-4e3a-9dd6-e9e7a2b38ca0 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:16:02.274747 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4327234e-d4e2-459a-90f0-9bea4d5d7834 tempest-SnapshotMetadataTestJSON-1403759209 None] deleting rbd volume volume-929d3d17-9c4c-4e3a-9dd6-e9e7a2b38ca0 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:16:02.572036 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=60,cinder:UPDATE=30,cinder:DELETE=3,cinder:INSERT=7 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:02.591270 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-4327234e-d4e2-459a-90f0-9bea4d5d7834 tempest-SnapshotMetadataTestJSON-1403759209 None] Created reservations ['ba777573-0447-479d-91f6-f4446d194f52', '05d79c00-c8a1-496d-93b4-7d17b4e90f08', 'f1daf136-8977-4e30-aa1c-b5b472197936', '636a2f00-d4a2-4fc9-b7f4-314b0afc80d3'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:16:02.636412 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=65,cinder:UPDATE=26,cinder:INSERT=7,cinder:DELETE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:02.651450 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4327234e-d4e2-459a-90f0-9bea4d5d7834 tempest-SnapshotMetadataTestJSON-1403759209 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:16:02.709008 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4327234e-d4e2-459a-90f0-9bea4d5d7834 tempest-SnapshotMetadataTestJSON-1403759209 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:16:02.748860 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-4327234e-d4e2-459a-90f0-9bea4d5d7834 tempest-SnapshotMetadataTestJSON-1403759209 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:16:02.759420 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-4327234e-d4e2-459a-90f0-9bea4d5d7834 tempest-SnapshotMetadataTestJSON-1403759209 None] Deleted volume successfully. Jun 25 21:16:02.773222 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-4327234e-d4e2-459a-90f0-9bea4d5d7834 tempest-SnapshotMetadataTestJSON-1403759209 None] Lock "b'cinder-929d3d17-9c4c-4e3a-9dd6-e9e7a2b38ca0-delete_volume'" released by "delete_volume" :: held 0.666s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:16:08.486521 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-a704eb92-dc2d-4625-80a7-48013f04b22a tempest-AbsoluteLimitsTests-241451152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:16:08.527899 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a704eb92-dc2d-4625-80a7-48013f04b22a tempest-AbsoluteLimitsTests-241451152 None] Flow 'volume_create_manager' (3162cba9-8aa5-4030-b3dd-08b3227ae0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:16:08.534294 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a704eb92-dc2d-4625-80a7-48013f04b22a tempest-AbsoluteLimitsTests-241451152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28bca3aa-050d-4108-b106-869aa537804a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:08.555197 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a704eb92-dc2d-4625-80a7-48013f04b22a tempest-AbsoluteLimitsTests-241451152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28bca3aa-050d-4108-b106-869aa537804a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:16:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-940234552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5dfe5d81-3e28-4858-a8a9-c2873d5d44bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc7e7c9bc65542bc9e14b330b2f19358',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:16:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:16:08Z,use_quota=True,user_id='69eb803c29c14eff8177149538c8e4ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:08.561172 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a704eb92-dc2d-4625-80a7-48013f04b22a tempest-AbsoluteLimitsTests-241451152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0371e66d-bfe7-4262-a18c-d7e4cbd5b0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:08.565473 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a704eb92-dc2d-4625-80a7-48013f04b22a tempest-AbsoluteLimitsTests-241451152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0371e66d-bfe7-4262-a18c-d7e4cbd5b0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:08.570833 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a704eb92-dc2d-4625-80a7-48013f04b22a tempest-AbsoluteLimitsTests-241451152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b85dcf9d-24c3-44c0-b632-ffec2c1d286a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:08.575076 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a704eb92-dc2d-4625-80a7-48013f04b22a tempest-AbsoluteLimitsTests-241451152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b85dcf9d-24c3-44c0-b632-ffec2c1d286a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dfe5d81-3e28-4858-a8a9-c2873d5d44bf', 'volume_name': 'volume-5dfe5d81-3e28-4858-a8a9-c2873d5d44bf', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:08.580222 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a704eb92-dc2d-4625-80a7-48013f04b22a tempest-AbsoluteLimitsTests-241451152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cc8be69-c930-4d8c-9009-768b8a4d8594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:08.584791 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a704eb92-dc2d-4625-80a7-48013f04b22a tempest-AbsoluteLimitsTests-241451152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cc8be69-c930-4d8c-9009-768b8a4d8594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:08.589707 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a704eb92-dc2d-4625-80a7-48013f04b22a tempest-AbsoluteLimitsTests-241451152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a6263c5-8a3e-4048-abd4-f5a97ce621f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:08.591601 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-a704eb92-dc2d-4625-80a7-48013f04b22a tempest-AbsoluteLimitsTests-241451152 None] Volume 5dfe5d81-3e28-4858-a8a9-c2873d5d44bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dfe5d81-3e28-4858-a8a9-c2873d5d44bf', 'volume_size': 1} Jun 25 21:16:08.591930 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a704eb92-dc2d-4625-80a7-48013f04b22a tempest-AbsoluteLimitsTests-241451152 None] creating volume 'volume-5dfe5d81-3e28-4858-a8a9-c2873d5d44bf' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:16:08.592905 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a704eb92-dc2d-4625-80a7-48013f04b22a tempest-AbsoluteLimitsTests-241451152 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:16:08.678533 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a704eb92-dc2d-4625-80a7-48013f04b22a tempest-AbsoluteLimitsTests-241451152 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:16:08.679152 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a704eb92-dc2d-4625-80a7-48013f04b22a tempest-AbsoluteLimitsTests-241451152 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:16:08.682797 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a704eb92-dc2d-4625-80a7-48013f04b22a tempest-AbsoluteLimitsTests-241451152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a6263c5-8a3e-4048-abd4-f5a97ce621f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dfe5d81-3e28-4858-a8a9-c2873d5d44bf', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:08.687266 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a704eb92-dc2d-4625-80a7-48013f04b22a tempest-AbsoluteLimitsTests-241451152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84c2c3f4-e269-43a8-a04e-d809019920a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:08.697749 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-a704eb92-dc2d-4625-80a7-48013f04b22a tempest-AbsoluteLimitsTests-241451152 None] Volume volume-5dfe5d81-3e28-4858-a8a9-c2873d5d44bf (5dfe5d81-3e28-4858-a8a9-c2873d5d44bf): created successfully Jun 25 21:16:08.701445 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a704eb92-dc2d-4625-80a7-48013f04b22a tempest-AbsoluteLimitsTests-241451152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84c2c3f4-e269-43a8-a04e-d809019920a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:08.706712 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a704eb92-dc2d-4625-80a7-48013f04b22a tempest-AbsoluteLimitsTests-241451152 None] Flow 'volume_create_manager' (3162cba9-8aa5-4030-b3dd-08b3227ae0af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:16:08.715811 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-a704eb92-dc2d-4625-80a7-48013f04b22a tempest-AbsoluteLimitsTests-241451152 None] Created volume successfully. Jun 25 21:16:09.587209 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-758c2c82-26d8-4a64-a16e-8cc866a92c41 tempest-AbsoluteLimitsTests-241451152 None] Lock "b'cinder-5dfe5d81-3e28-4858-a8a9-c2873d5d44bf-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:16:09.636613 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-758c2c82-26d8-4a64-a16e-8cc866a92c41 tempest-AbsoluteLimitsTests-241451152 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:16:09.721203 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-758c2c82-26d8-4a64-a16e-8cc866a92c41 tempest-AbsoluteLimitsTests-241451152 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:16:09.721630 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-758c2c82-26d8-4a64-a16e-8cc866a92c41 tempest-AbsoluteLimitsTests-241451152 None] Volume volume-5dfe5d81-3e28-4858-a8a9-c2873d5d44bf is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:16:09.728768 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-758c2c82-26d8-4a64-a16e-8cc866a92c41 tempest-AbsoluteLimitsTests-241451152 None] deleting rbd volume volume-5dfe5d81-3e28-4858-a8a9-c2873d5d44bf {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:16:10.118053 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-758c2c82-26d8-4a64-a16e-8cc866a92c41 tempest-AbsoluteLimitsTests-241451152 None] Created reservations ['d18328a5-6d64-4b42-bb42-038f81f95281', '08b6e33c-01b4-498a-a538-c5345ffe83a4', '3fd77e8e-4ab4-4141-afdc-41859c276b95', '69e087e3-da96-4731-8519-1ce0693c9f41'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:16:10.209186 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-758c2c82-26d8-4a64-a16e-8cc866a92c41 tempest-AbsoluteLimitsTests-241451152 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:16:10.273865 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-758c2c82-26d8-4a64-a16e-8cc866a92c41 tempest-AbsoluteLimitsTests-241451152 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:16:10.321768 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-758c2c82-26d8-4a64-a16e-8cc866a92c41 tempest-AbsoluteLimitsTests-241451152 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:16:10.326737 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-758c2c82-26d8-4a64-a16e-8cc866a92c41 tempest-AbsoluteLimitsTests-241451152 None] Deleted volume successfully. Jun 25 21:16:10.343514 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-758c2c82-26d8-4a64-a16e-8cc866a92c41 tempest-AbsoluteLimitsTests-241451152 None] Lock "b'cinder-5dfe5d81-3e28-4858-a8a9-c2873d5d44bf-delete_volume'" released by "delete_volume" :: held 0.757s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:16:15.133832 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9108963-a04a-4100-88d2-2d9d130c2e10 tempest-VolumesGetTest-498629272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:16:15.157975 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a9108963-a04a-4100-88d2-2d9d130c2e10 tempest-VolumesGetTest-498629272 None] Flow 'volume_create_manager' (2432f2be-6a36-44d5-abca-7292446d1b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:16:15.166180 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a9108963-a04a-4100-88d2-2d9d130c2e10 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84a8ab8e-4989-4c27-a486-eb5ec4adab15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:15.183030 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a9108963-a04a-4100-88d2-2d9d130c2e10 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84a8ab8e-4989-4c27-a486-eb5ec4adab15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-708052653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=63bafbb7-0521-4750-a2eb-a996b9652dc3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7af7ae98dd68466f9721e6cbbf0c6197',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:16:15Z,use_quota=True,user_id='4785c7cebb344c5a97ad6f701cbc3acb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:15.188257 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a9108963-a04a-4100-88d2-2d9d130c2e10 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20233c72-6c50-4c10-9988-23babf207972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:15.192294 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a9108963-a04a-4100-88d2-2d9d130c2e10 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20233c72-6c50-4c10-9988-23babf207972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:15.197669 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a9108963-a04a-4100-88d2-2d9d130c2e10 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20b37a24-cb90-4e43-ac85-71ba1f787ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:15.201733 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a9108963-a04a-4100-88d2-2d9d130c2e10 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20b37a24-cb90-4e43-ac85-71ba1f787ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63bafbb7-0521-4750-a2eb-a996b9652dc3', 'volume_name': 'volume-63bafbb7-0521-4750-a2eb-a996b9652dc3', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:15.206803 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a9108963-a04a-4100-88d2-2d9d130c2e10 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4224c0b6-7668-470c-adbb-e1b07d2016ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:15.211558 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a9108963-a04a-4100-88d2-2d9d130c2e10 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4224c0b6-7668-470c-adbb-e1b07d2016ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:15.216222 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a9108963-a04a-4100-88d2-2d9d130c2e10 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe54e5a4-89c3-4e35-95dc-7ba315bf0c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:15.217413 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-a9108963-a04a-4100-88d2-2d9d130c2e10 tempest-VolumesGetTest-498629272 None] Volume 63bafbb7-0521-4750-a2eb-a996b9652dc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63bafbb7-0521-4750-a2eb-a996b9652dc3', 'volume_size': 1} Jun 25 21:16:15.217980 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a9108963-a04a-4100-88d2-2d9d130c2e10 tempest-VolumesGetTest-498629272 None] creating volume 'volume-63bafbb7-0521-4750-a2eb-a996b9652dc3' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:16:15.218759 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a9108963-a04a-4100-88d2-2d9d130c2e10 tempest-VolumesGetTest-498629272 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:16:15.323210 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a9108963-a04a-4100-88d2-2d9d130c2e10 tempest-VolumesGetTest-498629272 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:16:15.323597 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a9108963-a04a-4100-88d2-2d9d130c2e10 tempest-VolumesGetTest-498629272 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:16:15.331813 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a9108963-a04a-4100-88d2-2d9d130c2e10 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe54e5a4-89c3-4e35-95dc-7ba315bf0c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63bafbb7-0521-4750-a2eb-a996b9652dc3', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:15.338083 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a9108963-a04a-4100-88d2-2d9d130c2e10 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbeb07f6-ed52-45e8-8a1e-843857ebe1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:15.357037 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-a9108963-a04a-4100-88d2-2d9d130c2e10 tempest-VolumesGetTest-498629272 None] Volume volume-63bafbb7-0521-4750-a2eb-a996b9652dc3 (63bafbb7-0521-4750-a2eb-a996b9652dc3): created successfully Jun 25 21:16:15.365596 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a9108963-a04a-4100-88d2-2d9d130c2e10 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbeb07f6-ed52-45e8-8a1e-843857ebe1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:15.371720 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a9108963-a04a-4100-88d2-2d9d130c2e10 tempest-VolumesGetTest-498629272 None] Flow 'volume_create_manager' (2432f2be-6a36-44d5-abca-7292446d1b9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:16:15.383103 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-a9108963-a04a-4100-88d2-2d9d130c2e10 tempest-VolumesGetTest-498629272 None] Created volume successfully. Jun 25 21:16:16.840059 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-11d0a3da-4e65-4ba1-928a-8a4fcba382c3 tempest-VolumesGetTest-498629272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:16:16.860626 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-11d0a3da-4e65-4ba1-928a-8a4fcba382c3 tempest-VolumesGetTest-498629272 None] Flow 'volume_create_manager' (d6969c6e-3fd3-4be2-b3c3-a24cf9da707a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:16:16.867450 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-11d0a3da-4e65-4ba1-928a-8a4fcba382c3 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d565c7cd-c5cc-4aaa-9a6e-2326a6ed9a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:16.885838 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-11d0a3da-4e65-4ba1-928a-8a4fcba382c3 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d565c7cd-c5cc-4aaa-9a6e-2326a6ed9a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:16:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-17785655',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=933cd5fe-0e0b-486e-950a-7bcef476d929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7af7ae98dd68466f9721e6cbbf0c6197',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:16:17Z,use_quota=True,user_id='4785c7cebb344c5a97ad6f701cbc3acb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:16.890952 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-11d0a3da-4e65-4ba1-928a-8a4fcba382c3 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3bc9d5f-91a0-4e91-a692-84b584dd8ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:16.895037 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-11d0a3da-4e65-4ba1-928a-8a4fcba382c3 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3bc9d5f-91a0-4e91-a692-84b584dd8ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:16.900155 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-11d0a3da-4e65-4ba1-928a-8a4fcba382c3 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb1c62fb-d844-4579-8035-9b810bc7acb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:16.904307 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-11d0a3da-4e65-4ba1-928a-8a4fcba382c3 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb1c62fb-d844-4579-8035-9b810bc7acb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '933cd5fe-0e0b-486e-950a-7bcef476d929', 'volume_name': 'volume-933cd5fe-0e0b-486e-950a-7bcef476d929', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:16.909121 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-11d0a3da-4e65-4ba1-928a-8a4fcba382c3 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (421c988a-3d5f-4b2e-98cc-27dce1d28eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:16.914223 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-11d0a3da-4e65-4ba1-928a-8a4fcba382c3 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (421c988a-3d5f-4b2e-98cc-27dce1d28eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:16.925480 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-11d0a3da-4e65-4ba1-928a-8a4fcba382c3 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a03f3c6c-28cc-48f9-a557-a137a0c9f6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:16.927007 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-11d0a3da-4e65-4ba1-928a-8a4fcba382c3 tempest-VolumesGetTest-498629272 None] Volume 933cd5fe-0e0b-486e-950a-7bcef476d929: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-933cd5fe-0e0b-486e-950a-7bcef476d929', 'volume_size': 1} Jun 25 21:16:16.927401 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-11d0a3da-4e65-4ba1-928a-8a4fcba382c3 tempest-VolumesGetTest-498629272 None] creating volume 'volume-933cd5fe-0e0b-486e-950a-7bcef476d929' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:16:16.928053 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-11d0a3da-4e65-4ba1-928a-8a4fcba382c3 tempest-VolumesGetTest-498629272 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:16:17.039549 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-11d0a3da-4e65-4ba1-928a-8a4fcba382c3 tempest-VolumesGetTest-498629272 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:16:17.039915 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-11d0a3da-4e65-4ba1-928a-8a4fcba382c3 tempest-VolumesGetTest-498629272 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:16:17.045174 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-11d0a3da-4e65-4ba1-928a-8a4fcba382c3 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a03f3c6c-28cc-48f9-a557-a137a0c9f6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-933cd5fe-0e0b-486e-950a-7bcef476d929', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:17.057171 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-11d0a3da-4e65-4ba1-928a-8a4fcba382c3 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7348a07d-375d-4c23-83e5-dc70c9deca6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:17.069713 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-11d0a3da-4e65-4ba1-928a-8a4fcba382c3 tempest-VolumesGetTest-498629272 None] Volume volume-933cd5fe-0e0b-486e-950a-7bcef476d929 (933cd5fe-0e0b-486e-950a-7bcef476d929): created successfully Jun 25 21:16:17.074615 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-11d0a3da-4e65-4ba1-928a-8a4fcba382c3 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7348a07d-375d-4c23-83e5-dc70c9deca6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:17.087110 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-11d0a3da-4e65-4ba1-928a-8a4fcba382c3 tempest-VolumesGetTest-498629272 None] Flow 'volume_create_manager' (d6969c6e-3fd3-4be2-b3c3-a24cf9da707a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:16:17.103911 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-11d0a3da-4e65-4ba1-928a-8a4fcba382c3 tempest-VolumesGetTest-498629272 None] Created volume successfully. Jun 25 21:16:18.004642 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-aab28bab-c333-4607-917f-bf4ce6b29763 tempest-VolumesGetTest-498629272 None] Lock "b'cinder-933cd5fe-0e0b-486e-950a-7bcef476d929-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:16:18.071565 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-aab28bab-c333-4607-917f-bf4ce6b29763 tempest-VolumesGetTest-498629272 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:16:18.139304 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-aab28bab-c333-4607-917f-bf4ce6b29763 tempest-VolumesGetTest-498629272 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:16:18.139912 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-aab28bab-c333-4607-917f-bf4ce6b29763 tempest-VolumesGetTest-498629272 None] Volume volume-933cd5fe-0e0b-486e-950a-7bcef476d929 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:16:18.156931 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-aab28bab-c333-4607-917f-bf4ce6b29763 tempest-VolumesGetTest-498629272 None] deleting rbd volume volume-933cd5fe-0e0b-486e-950a-7bcef476d929 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:16:18.622388 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-aab28bab-c333-4607-917f-bf4ce6b29763 tempest-VolumesGetTest-498629272 None] Created reservations ['2fd3471a-72aa-41ef-9c7a-46740876658b', 'f932f7b7-193e-4cf4-af0a-d9bdd8f105fd', '4dfb5fe9-ecc3-4ae2-9476-f054c9d8126e', '8d974f9a-28de-4141-9c38-433ea999bbb8'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:16:18.685031 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-aab28bab-c333-4607-917f-bf4ce6b29763 tempest-VolumesGetTest-498629272 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:16:18.753265 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-aab28bab-c333-4607-917f-bf4ce6b29763 tempest-VolumesGetTest-498629272 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:16:18.803618 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-aab28bab-c333-4607-917f-bf4ce6b29763 tempest-VolumesGetTest-498629272 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:16:18.809979 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-aab28bab-c333-4607-917f-bf4ce6b29763 tempest-VolumesGetTest-498629272 None] Deleted volume successfully. Jun 25 21:16:18.833167 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-aab28bab-c333-4607-917f-bf4ce6b29763 tempest-VolumesGetTest-498629272 None] Lock "b'cinder-933cd5fe-0e0b-486e-950a-7bcef476d929-delete_volume'" released by "delete_volume" :: held 0.829s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:16:19.209569 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-387d7a8d-1392-4299-809a-150827e146b7 tempest-VolumesGetTest-498629272 None] Lock "b'cinder-63bafbb7-0521-4750-a2eb-a996b9652dc3-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:16:19.301377 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-387d7a8d-1392-4299-809a-150827e146b7 tempest-VolumesGetTest-498629272 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:16:19.380113 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-387d7a8d-1392-4299-809a-150827e146b7 tempest-VolumesGetTest-498629272 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:16:19.380594 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-387d7a8d-1392-4299-809a-150827e146b7 tempest-VolumesGetTest-498629272 None] Volume volume-63bafbb7-0521-4750-a2eb-a996b9652dc3 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:16:19.393118 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-387d7a8d-1392-4299-809a-150827e146b7 tempest-VolumesGetTest-498629272 None] deleting rbd volume volume-63bafbb7-0521-4750-a2eb-a996b9652dc3 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:16:19.808366 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-387d7a8d-1392-4299-809a-150827e146b7 tempest-VolumesGetTest-498629272 None] Created reservations ['2ff39c8c-ced5-4a9c-b3fc-ead73c25b1de', 'ce2388c4-511b-4406-9bb4-9ad0a3420961', '5de59890-804e-46b1-a27c-ff7b21e1263b', 'd753e963-ef07-4e2a-801c-c7812915d041'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:16:19.879151 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:UPDATE=36,cinder:SELECT=55,cinder:DELETE=3,cinder:INSERT=6 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:19.888201 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-387d7a8d-1392-4299-809a-150827e146b7 tempest-VolumesGetTest-498629272 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:16:19.923660 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-387d7a8d-1392-4299-809a-150827e146b7 tempest-VolumesGetTest-498629272 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:16:19.955917 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-387d7a8d-1392-4299-809a-150827e146b7 tempest-VolumesGetTest-498629272 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:16:19.969649 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-387d7a8d-1392-4299-809a-150827e146b7 tempest-VolumesGetTest-498629272 None] Deleted volume successfully. Jun 25 21:16:19.989319 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-387d7a8d-1392-4299-809a-150827e146b7 tempest-VolumesGetTest-498629272 None] Lock "b'cinder-63bafbb7-0521-4750-a2eb-a996b9652dc3-delete_volume'" released by "delete_volume" :: held 0.780s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:16:20.734460 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-848524db-a10a-44bc-8d3c-c3ec74477920 tempest-VolumesGetTest-498629272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:16:20.760185 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-848524db-a10a-44bc-8d3c-c3ec74477920 tempest-VolumesGetTest-498629272 None] Flow 'volume_create_manager' (5dc44a35-e14a-4c79-a47c-c04f45e7ee20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:16:20.766778 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-848524db-a10a-44bc-8d3c-c3ec74477920 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80790817-018e-4043-a86f-4987b81968a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:20.784498 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-848524db-a10a-44bc-8d3c-c3ec74477920 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80790817-018e-4043-a86f-4987b81968a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1010310049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b2bf833c-bcc1-48e3-a21e-87c8d2d66a42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7af7ae98dd68466f9721e6cbbf0c6197',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:16:21Z,use_quota=True,user_id='4785c7cebb344c5a97ad6f701cbc3acb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:20.790735 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-848524db-a10a-44bc-8d3c-c3ec74477920 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1f464b3-5989-4f30-b608-2c692f0dd38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:20.795451 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-848524db-a10a-44bc-8d3c-c3ec74477920 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1f464b3-5989-4f30-b608-2c692f0dd38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:20.800900 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-848524db-a10a-44bc-8d3c-c3ec74477920 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eab1ff8-2ee4-4a10-931b-58cc4646db83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:20.808718 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-848524db-a10a-44bc-8d3c-c3ec74477920 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eab1ff8-2ee4-4a10-931b-58cc4646db83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2bf833c-bcc1-48e3-a21e-87c8d2d66a42', 'volume_name': 'volume-b2bf833c-bcc1-48e3-a21e-87c8d2d66a42', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:20.818504 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-848524db-a10a-44bc-8d3c-c3ec74477920 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4344d190-9cf7-413d-9487-55fcbbed72a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:20.823598 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-848524db-a10a-44bc-8d3c-c3ec74477920 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4344d190-9cf7-413d-9487-55fcbbed72a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:20.830205 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-848524db-a10a-44bc-8d3c-c3ec74477920 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d66685c-280e-467a-aed5-9d7ac8282853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:20.831523 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-848524db-a10a-44bc-8d3c-c3ec74477920 tempest-VolumesGetTest-498629272 None] Volume b2bf833c-bcc1-48e3-a21e-87c8d2d66a42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2bf833c-bcc1-48e3-a21e-87c8d2d66a42', 'volume_size': 1} Jun 25 21:16:20.832196 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-848524db-a10a-44bc-8d3c-c3ec74477920 tempest-VolumesGetTest-498629272 None] creating volume 'volume-b2bf833c-bcc1-48e3-a21e-87c8d2d66a42' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:16:20.833195 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-848524db-a10a-44bc-8d3c-c3ec74477920 tempest-VolumesGetTest-498629272 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:16:20.997774 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-848524db-a10a-44bc-8d3c-c3ec74477920 tempest-VolumesGetTest-498629272 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:16:20.998051 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-848524db-a10a-44bc-8d3c-c3ec74477920 tempest-VolumesGetTest-498629272 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:16:21.002028 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-848524db-a10a-44bc-8d3c-c3ec74477920 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d66685c-280e-467a-aed5-9d7ac8282853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2bf833c-bcc1-48e3-a21e-87c8d2d66a42', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:21.009957 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-848524db-a10a-44bc-8d3c-c3ec74477920 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94e4e654-cbc0-4cab-a989-36f8d03faa1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:21.029258 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-848524db-a10a-44bc-8d3c-c3ec74477920 tempest-VolumesGetTest-498629272 None] Volume volume-b2bf833c-bcc1-48e3-a21e-87c8d2d66a42 (b2bf833c-bcc1-48e3-a21e-87c8d2d66a42): created successfully Jun 25 21:16:21.033042 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-848524db-a10a-44bc-8d3c-c3ec74477920 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94e4e654-cbc0-4cab-a989-36f8d03faa1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:21.039156 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-848524db-a10a-44bc-8d3c-c3ec74477920 tempest-VolumesGetTest-498629272 None] Flow 'volume_create_manager' (5dc44a35-e14a-4c79-a47c-c04f45e7ee20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:16:21.053503 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-848524db-a10a-44bc-8d3c-c3ec74477920 tempest-VolumesGetTest-498629272 None] Created volume successfully. Jun 25 21:16:22.053227 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-15b6712a-1fb4-439b-8b8d-9958e7ddfbfa tempest-VolumesGetTest-498629272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:16:22.085482 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-15b6712a-1fb4-439b-8b8d-9958e7ddfbfa tempest-VolumesGetTest-498629272 None] Flow 'volume_create_manager' (1d5c4a2d-102b-4ec5-bc96-b4dabbe0c9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:16:22.091686 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-15b6712a-1fb4-439b-8b8d-9958e7ddfbfa tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0db5335-5871-4c49-840c-0aca02e7cb1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:22.111396 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-15b6712a-1fb4-439b-8b8d-9958e7ddfbfa tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0db5335-5871-4c49-840c-0aca02e7cb1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1512455771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f96e149f-5eb7-42d2-8670-a6b349b477cc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7af7ae98dd68466f9721e6cbbf0c6197',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=b2bf833c-bcc1-48e3-a21e-87c8d2d66a42,status='creating',terminated_at=None,updated_at=2022-06-25T21:16:22Z,use_quota=True,user_id='4785c7cebb344c5a97ad6f701cbc3acb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:22.117024 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-15b6712a-1fb4-439b-8b8d-9958e7ddfbfa tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (405c46df-b582-45ab-83ca-5da593b667ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:22.121131 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-15b6712a-1fb4-439b-8b8d-9958e7ddfbfa tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (405c46df-b582-45ab-83ca-5da593b667ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:22.126216 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-15b6712a-1fb4-439b-8b8d-9958e7ddfbfa tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2420de01-9e3e-44e3-a3c8-215dd6e04645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:22.131131 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=57,cinder:UPDATE=32,cinder:DELETE=5,cinder:INSERT=6 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:22.143790 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-15b6712a-1fb4-439b-8b8d-9958e7ddfbfa tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2420de01-9e3e-44e3-a3c8-215dd6e04645) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f96e149f-5eb7-42d2-8670-a6b349b477cc', 'volume_name': 'volume-f96e149f-5eb7-42d2-8670-a6b349b477cc', 'volume_size': 1, 'source_volid': 'b2bf833c-bcc1-48e3-a21e-87c8d2d66a42', 'source_volstatus': 'available'}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:22.149079 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-15b6712a-1fb4-439b-8b8d-9958e7ddfbfa tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39607dfc-1163-4cc9-93eb-8047be1f1468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:22.153206 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-15b6712a-1fb4-439b-8b8d-9958e7ddfbfa tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39607dfc-1163-4cc9-93eb-8047be1f1468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:22.158033 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-15b6712a-1fb4-439b-8b8d-9958e7ddfbfa tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7790c402-d4cb-4709-b371-15b1a4184a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:22.159119 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-15b6712a-1fb4-439b-8b8d-9958e7ddfbfa tempest-VolumesGetTest-498629272 None] Volume f96e149f-5eb7-42d2-8670-a6b349b477cc: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f96e149f-5eb7-42d2-8670-a6b349b477cc', 'volume_size': 1, 'source_volid': 'b2bf833c-bcc1-48e3-a21e-87c8d2d66a42', 'source_volstatus': 'available'} Jun 25 21:16:22.177315 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-15b6712a-1fb4-439b-8b8d-9958e7ddfbfa tempest-VolumesGetTest-498629272 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:16:22.233159 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-15b6712a-1fb4-439b-8b8d-9958e7ddfbfa tempest-VolumesGetTest-498629272 None] creating snapshot='volume-f96e149f-5eb7-42d2-8670-a6b349b477cc.clone_snap' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jun 25 21:16:23.252243 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-15b6712a-1fb4-439b-8b8d-9958e7ddfbfa tempest-VolumesGetTest-498629272 None] cloning 'volume-b2bf833c-bcc1-48e3-a21e-87c8d2d66a42@volume-f96e149f-5eb7-42d2-8670-a6b349b477cc.clone_snap' to 'volume-f96e149f-5eb7-42d2-8670-a6b349b477cc' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jun 25 21:16:23.358223 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-15b6712a-1fb4-439b-8b8d-9958e7ddfbfa tempest-VolumesGetTest-498629272 None] Volume volume-b2bf833c-bcc1-48e3-a21e-87c8d2d66a42 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:16:23.359326 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-15b6712a-1fb4-439b-8b8d-9958e7ddfbfa tempest-VolumesGetTest-498629272 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:16:23.359696 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-15b6712a-1fb4-439b-8b8d-9958e7ddfbfa tempest-VolumesGetTest-498629272 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:16:23.385762 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-15b6712a-1fb4-439b-8b8d-9958e7ddfbfa tempest-VolumesGetTest-498629272 None] clone created successfully {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jun 25 21:16:23.389757 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-15b6712a-1fb4-439b-8b8d-9958e7ddfbfa tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7790c402-d4cb-4709-b371-15b1a4184a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f96e149f-5eb7-42d2-8670-a6b349b477cc', 'volume_size': 1, 'source_volid': 'b2bf833c-bcc1-48e3-a21e-87c8d2d66a42', 'source_volstatus': 'available'}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:23.394212 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-15b6712a-1fb4-439b-8b8d-9958e7ddfbfa tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9290ab2b-c805-4e0f-8575-06feacc0b9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:23.405403 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-15b6712a-1fb4-439b-8b8d-9958e7ddfbfa tempest-VolumesGetTest-498629272 None] Volume volume-f96e149f-5eb7-42d2-8670-a6b349b477cc (f96e149f-5eb7-42d2-8670-a6b349b477cc): created successfully Jun 25 21:16:23.409086 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-15b6712a-1fb4-439b-8b8d-9958e7ddfbfa tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9290ab2b-c805-4e0f-8575-06feacc0b9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:23.414683 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-15b6712a-1fb4-439b-8b8d-9958e7ddfbfa tempest-VolumesGetTest-498629272 None] Flow 'volume_create_manager' (1d5c4a2d-102b-4ec5-bc96-b4dabbe0c9be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:16:23.431946 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-15b6712a-1fb4-439b-8b8d-9958e7ddfbfa tempest-VolumesGetTest-498629272 None] Created volume successfully. Jun 25 21:16:24.023375 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-1f0725a7-c2d1-4965-92b8-511250d674d4 tempest-VolumesActionsTest-745630661 None] Lock "b'cinder-779e9cb0-e1c7-4825-9eb0-fa33a58fef36'" acquired by "attach_volume" :: waited 0.014s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:16:24.066719 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-1f0725a7-c2d1-4965-92b8-511250d674d4 tempest-VolumesActionsTest-745630661 None] Attaching volume 779e9cb0-e1c7-4825-9eb0-fa33a58fef36 to instance 3e9ce77c-fdfb-46ed-910d-03495c91712b at mountpoint /dev/sdb on host None. Jun 25 21:16:24.095023 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-1f0725a7-c2d1-4965-92b8-511250d674d4 tempest-VolumesActionsTest-745630661 None] Attach volume completed successfully. Jun 25 21:16:24.100116 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-1f0725a7-c2d1-4965-92b8-511250d674d4 tempest-VolumesActionsTest-745630661 None] Lock "b'cinder-779e9cb0-e1c7-4825-9eb0-fa33a58fef36'" released by "attach_volume" :: held 0.077s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:16:24.282633 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-7db97803-8cc4-4725-ac11-f619830abcd0 tempest-VolumesActionsTest-745630661 None] Lock "b'cinder-779e9cb0-e1c7-4825-9eb0-fa33a58fef36-detach_volume'" acquired by "detach_volume" :: waited 0.011s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:16:24.283300 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-7db97803-8cc4-4725-ac11-f619830abcd0 tempest-VolumesActionsTest-745630661 None] Detaching volume 779e9cb0-e1c7-4825-9eb0-fa33a58fef36 from instance 3e9ce77c-fdfb-46ed-910d-03495c91712b. Jun 25 21:16:24.324266 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-7db97803-8cc4-4725-ac11-f619830abcd0 tempest-VolumesActionsTest-745630661 None] Detach volume completed successfully. Jun 25 21:16:24.328849 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-7db97803-8cc4-4725-ac11-f619830abcd0 tempest-VolumesActionsTest-745630661 None] Lock "b'cinder-779e9cb0-e1c7-4825-9eb0-fa33a58fef36-detach_volume'" released by "detach_volume" :: held 0.047s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:16:24.847841 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-43c6cff7-c788-43bd-b2a1-44f20893180f tempest-VolumesGetTest-498629272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:16:24.868502 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-43c6cff7-c788-43bd-b2a1-44f20893180f tempest-VolumesGetTest-498629272 None] Flow 'volume_create_manager' (c18dd107-22a5-4897-9dd7-bee33188056e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:16:24.874744 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-43c6cff7-c788-43bd-b2a1-44f20893180f tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (320943ec-f357-4c5b-b504-1e2735d15089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:24.891245 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-43c6cff7-c788-43bd-b2a1-44f20893180f tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (320943ec-f357-4c5b-b504-1e2735d15089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:16:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-486851674',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a0a6ceb4-e95d-4ce6-9679-96722617e31f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7af7ae98dd68466f9721e6cbbf0c6197',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:16:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:16:25Z,use_quota=True,user_id='4785c7cebb344c5a97ad6f701cbc3acb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:24.896613 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-43c6cff7-c788-43bd-b2a1-44f20893180f tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ce992da-ed9c-4d52-b621-13e430d9de1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:24.900692 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-43c6cff7-c788-43bd-b2a1-44f20893180f tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ce992da-ed9c-4d52-b621-13e430d9de1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:24.905757 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-43c6cff7-c788-43bd-b2a1-44f20893180f tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (695775ae-b096-4f8c-b194-17cf8e73aba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:24.910120 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-43c6cff7-c788-43bd-b2a1-44f20893180f tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (695775ae-b096-4f8c-b194-17cf8e73aba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0a6ceb4-e95d-4ce6-9679-96722617e31f', 'volume_name': 'volume-a0a6ceb4-e95d-4ce6-9679-96722617e31f', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:24.914924 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-43c6cff7-c788-43bd-b2a1-44f20893180f tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6954b1d5-9878-45ad-8374-7287a2dd8ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:24.918736 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-43c6cff7-c788-43bd-b2a1-44f20893180f tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6954b1d5-9878-45ad-8374-7287a2dd8ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:24.923301 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-43c6cff7-c788-43bd-b2a1-44f20893180f tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d104ea2-4d49-4cc2-bb13-a90c209386b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:24.924322 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-43c6cff7-c788-43bd-b2a1-44f20893180f tempest-VolumesGetTest-498629272 None] Volume a0a6ceb4-e95d-4ce6-9679-96722617e31f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0a6ceb4-e95d-4ce6-9679-96722617e31f', 'volume_size': 1} Jun 25 21:16:24.924841 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-43c6cff7-c788-43bd-b2a1-44f20893180f tempest-VolumesGetTest-498629272 None] creating volume 'volume-a0a6ceb4-e95d-4ce6-9679-96722617e31f' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:16:24.925366 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-43c6cff7-c788-43bd-b2a1-44f20893180f tempest-VolumesGetTest-498629272 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:16:24.984109 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-43c6cff7-c788-43bd-b2a1-44f20893180f tempest-VolumesGetTest-498629272 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:16:24.984525 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-43c6cff7-c788-43bd-b2a1-44f20893180f tempest-VolumesGetTest-498629272 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:16:24.988222 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-43c6cff7-c788-43bd-b2a1-44f20893180f tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d104ea2-4d49-4cc2-bb13-a90c209386b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0a6ceb4-e95d-4ce6-9679-96722617e31f', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:24.992727 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-43c6cff7-c788-43bd-b2a1-44f20893180f tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fdb171f-1840-49df-bcec-87b2731b57a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:25.002864 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-43c6cff7-c788-43bd-b2a1-44f20893180f tempest-VolumesGetTest-498629272 None] Volume volume-a0a6ceb4-e95d-4ce6-9679-96722617e31f (a0a6ceb4-e95d-4ce6-9679-96722617e31f): created successfully Jun 25 21:16:25.006765 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-43c6cff7-c788-43bd-b2a1-44f20893180f tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fdb171f-1840-49df-bcec-87b2731b57a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:25.012275 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-43c6cff7-c788-43bd-b2a1-44f20893180f tempest-VolumesGetTest-498629272 None] Flow 'volume_create_manager' (c18dd107-22a5-4897-9dd7-bee33188056e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:16:25.022766 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-43c6cff7-c788-43bd-b2a1-44f20893180f tempest-VolumesGetTest-498629272 None] Created volume successfully. Jun 25 21:16:25.960136 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-f20bbcc2-9467-45f6-b074-3292ab2528eb tempest-VolumesGetTest-498629272 None] Lock "b'cinder-a0a6ceb4-e95d-4ce6-9679-96722617e31f-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:16:26.010597 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f20bbcc2-9467-45f6-b074-3292ab2528eb tempest-VolumesGetTest-498629272 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:16:26.059568 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f20bbcc2-9467-45f6-b074-3292ab2528eb tempest-VolumesGetTest-498629272 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:16:26.060103 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f20bbcc2-9467-45f6-b074-3292ab2528eb tempest-VolumesGetTest-498629272 None] Volume volume-a0a6ceb4-e95d-4ce6-9679-96722617e31f is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:16:26.066398 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f20bbcc2-9467-45f6-b074-3292ab2528eb tempest-VolumesGetTest-498629272 None] deleting rbd volume volume-a0a6ceb4-e95d-4ce6-9679-96722617e31f {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:16:26.336469 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-f20bbcc2-9467-45f6-b074-3292ab2528eb tempest-VolumesGetTest-498629272 None] Created reservations ['acd55598-1bb8-4524-aed8-8e3d8e748e2a', 'a48e6dea-097f-42d6-be2f-37f3b0cf04c4', 'f2b57463-dc33-45ed-b9dd-eba975c7ac98', '37b5d539-e668-44b6-abfc-f70b420c5221'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:16:26.384655 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f20bbcc2-9467-45f6-b074-3292ab2528eb tempest-VolumesGetTest-498629272 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:16:26.411387 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f20bbcc2-9467-45f6-b074-3292ab2528eb tempest-VolumesGetTest-498629272 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:16:26.436464 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-f20bbcc2-9467-45f6-b074-3292ab2528eb tempest-VolumesGetTest-498629272 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:16:26.441455 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-f20bbcc2-9467-45f6-b074-3292ab2528eb tempest-VolumesGetTest-498629272 None] Deleted volume successfully. Jun 25 21:16:26.453895 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-f20bbcc2-9467-45f6-b074-3292ab2528eb tempest-VolumesGetTest-498629272 None] Lock "b'cinder-a0a6ceb4-e95d-4ce6-9679-96722617e31f-delete_volume'" released by "delete_volume" :: held 0.496s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:16:27.158753 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-074d7ec9-49f0-41e5-a3db-0410371477c5 tempest-VolumesGetTest-498629272 None] Lock "b'cinder-f96e149f-5eb7-42d2-8670-a6b349b477cc-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:16:27.221301 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-074d7ec9-49f0-41e5-a3db-0410371477c5 tempest-VolumesGetTest-498629272 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:16:27.292039 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-074d7ec9-49f0-41e5-a3db-0410371477c5 tempest-VolumesGetTest-498629272 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:16:27.301156 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-074d7ec9-49f0-41e5-a3db-0410371477c5 tempest-VolumesGetTest-498629272 None] deleting rbd volume volume-f96e149f-5eb7-42d2-8670-a6b349b477cc {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:16:27.494910 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-074d7ec9-49f0-41e5-a3db-0410371477c5 tempest-VolumesGetTest-498629272 None] volume is a clone so cleaning references {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jun 25 21:16:27.513973 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-074d7ec9-49f0-41e5-a3db-0410371477c5 tempest-VolumesGetTest-498629272 None] Volume volume-b2bf833c-bcc1-48e3-a21e-87c8d2d66a42 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:16:27.514480 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-074d7ec9-49f0-41e5-a3db-0410371477c5 tempest-VolumesGetTest-498629272 None] deleting parent snapshot volume-f96e149f-5eb7-42d2-8670-a6b349b477cc.clone_snap {{(pid=130674) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jun 25 21:16:28.390603 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-074d7ec9-49f0-41e5-a3db-0410371477c5 tempest-VolumesGetTest-498629272 None] Created reservations ['c148fced-cf9f-4e80-8556-7dc95ebe2bc9', '1277fcb2-3d50-4ec6-a5c3-de8e106e4df1', '6a71dd64-d3a1-492d-81d0-f5675a60035d', 'dab3bd85-e907-4f19-8ad5-eede5675c265'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:16:28.445926 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-074d7ec9-49f0-41e5-a3db-0410371477c5 tempest-VolumesGetTest-498629272 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:16:28.480706 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-074d7ec9-49f0-41e5-a3db-0410371477c5 tempest-VolumesGetTest-498629272 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:16:28.526602 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-074d7ec9-49f0-41e5-a3db-0410371477c5 tempest-VolumesGetTest-498629272 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:16:28.532567 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-074d7ec9-49f0-41e5-a3db-0410371477c5 tempest-VolumesGetTest-498629272 None] Deleted volume successfully. Jun 25 21:16:28.545665 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-074d7ec9-49f0-41e5-a3db-0410371477c5 tempest-VolumesGetTest-498629272 None] Lock "b'cinder-f96e149f-5eb7-42d2-8670-a6b349b477cc-delete_volume'" released by "delete_volume" :: held 1.388s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:16:29.199641 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-10701bb0-4a81-45bd-9ef4-c77b1b5ead1d tempest-VolumesActionsTest-745630661 None] Running cmd (subprocess): rbd export --pool volumes volume-779e9cb0-e1c7-4825-9eb0-fa33a58fef36 /opt/stack/data/cinder/conversion/volume-779e9cb0-e1c7-4825-9eb0-fa33a58fef36-564e7811-5fe6-4eba-9eae-58a0c341f98d --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 21:16:30.059053 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ece0e75-80dd-4340-80d5-6e062dd27440 tempest-VolumesGetTest-498629272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:16:30.081076 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3ece0e75-80dd-4340-80d5-6e062dd27440 tempest-VolumesGetTest-498629272 None] Flow 'volume_create_manager' (1d068720-b0f6-4ec8-887f-c8721e32e0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:16:30.089059 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3ece0e75-80dd-4340-80d5-6e062dd27440 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f5f756f-d2ee-436e-8e57-71ad03b2021d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:30.111297 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3ece0e75-80dd-4340-80d5-6e062dd27440 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f5f756f-d2ee-436e-8e57-71ad03b2021d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1241444428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f879ea7e-48e5-4050-a601-66386b329d34,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7af7ae98dd68466f9721e6cbbf0c6197',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:16:30Z,use_quota=True,user_id='4785c7cebb344c5a97ad6f701cbc3acb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:30.118414 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3ece0e75-80dd-4340-80d5-6e062dd27440 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (081009c1-86ae-47cb-b26f-d0c0c2b28dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:30.122698 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3ece0e75-80dd-4340-80d5-6e062dd27440 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (081009c1-86ae-47cb-b26f-d0c0c2b28dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:30.127853 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3ece0e75-80dd-4340-80d5-6e062dd27440 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c7c925b-f754-4c69-9a3b-4a727e7136fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:30.301714 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-10701bb0-4a81-45bd-9ef4-c77b1b5ead1d tempest-VolumesActionsTest-745630661 None] CMD "rbd export --pool volumes volume-779e9cb0-e1c7-4825-9eb0-fa33a58fef36 /opt/stack/data/cinder/conversion/volume-779e9cb0-e1c7-4825-9eb0-fa33a58fef36-564e7811-5fe6-4eba-9eae-58a0c341f98d --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.102s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 21:16:30.327231 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3ece0e75-80dd-4340-80d5-6e062dd27440 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c7c925b-f754-4c69-9a3b-4a727e7136fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f879ea7e-48e5-4050-a601-66386b329d34', 'volume_name': 'volume-f879ea7e-48e5-4050-a601-66386b329d34', 'volume_size': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d98522b7634403f83ff66fd72edfd9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'created_at': datetime.datetime(2022, 6, 25, 20, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5741eca-b932-4865-b29a-bd2a12a73795/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:30.332705 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3ece0e75-80dd-4340-80d5-6e062dd27440 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7dc3a13-8005-4fb8-bd8f-a7e105127caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:30.337067 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3ece0e75-80dd-4340-80d5-6e062dd27440 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7dc3a13-8005-4fb8-bd8f-a7e105127caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:30.341584 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3ece0e75-80dd-4340-80d5-6e062dd27440 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a8a61bd-0cae-4730-b045-46bdffd71346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:30.342702 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-3ece0e75-80dd-4340-80d5-6e062dd27440 tempest-VolumesGetTest-498629272 None] Volume f879ea7e-48e5-4050-a601-66386b329d34: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f879ea7e-48e5-4050-a601-66386b329d34', 'volume_size': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d98522b7634403f83ff66fd72edfd9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'created_at': datetime.datetime(2022, 6, 25, 20, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5741eca-b932-4865-b29a-bd2a12a73795/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 25 21:16:30.343338 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ece0e75-80dd-4340-80d5-6e062dd27440 tempest-VolumesGetTest-498629272 None] Cloning f879ea7e-48e5-4050-a601-66386b329d34 from image c5741eca-b932-4865-b29a-bd2a12a73795 at location (None, None). {{(pid=130674) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1062}} Jun 25 21:16:30.349745 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.image_utils [None req-10701bb0-4a81-45bd-9ef4-c77b1b5ead1d tempest-VolumesActionsTest-745630661 None] 564e7811-5fe6-4eba-9eae-58a0c341f98d was raw, no need to convert to raw {{(pid=130674) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:851}} Jun 25 21:16:30.359266 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-3ece0e75-80dd-4340-80d5-6e062dd27440 tempest-VolumesGetTest-498629272 None] Lock "b'cinder-c5741eca-b932-4865-b29a-bd2a12a73795'" acquired by "_prepare_image_cache_entry" :: waited 0.015s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:16:30.374548 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-3ece0e75-80dd-4340-80d5-6e062dd27440 tempest-VolumesGetTest-498629272 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'volume_id': 'c8878629-87cd-43d0-b2bd-d32c807cd322', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53), 'last_used': datetime.datetime(2022, 6, 25, 21, 16, 30, 366645)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 25 21:16:30.375161 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-3ece0e75-80dd-4340-80d5-6e062dd27440 tempest-VolumesGetTest-498629272 None] Image-volume cache entry image_update_at = 2022-06-25 20:42:53+00:00, requested image updated_at = 2022-06-25 20:42:53+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 25 21:16:30.375676 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ece0e75-80dd-4340-80d5-6e062dd27440 tempest-VolumesGetTest-498629272 None] Found cache entry for image = c5741eca-b932-4865-b29a-bd2a12a73795 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:877}} Jun 25 21:16:30.383160 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-3ece0e75-80dd-4340-80d5-6e062dd27440 tempest-VolumesGetTest-498629272 None] Lock "b'cinder-c5741eca-b932-4865-b29a-bd2a12a73795'" released by "_prepare_image_cache_entry" :: held 0.024s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:16:30.383988 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ece0e75-80dd-4340-80d5-6e062dd27440 tempest-VolumesGetTest-498629272 None] Attempting to retrieve cache entry for image = c5741eca-b932-4865-b29a-bd2a12a73795 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:818}} Jun 25 21:16:30.391854 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-3ece0e75-80dd-4340-80d5-6e062dd27440 tempest-VolumesGetTest-498629272 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'volume_id': 'c8878629-87cd-43d0-b2bd-d32c807cd322', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53), 'last_used': datetime.datetime(2022, 6, 25, 21, 16, 30, 388460)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 25 21:16:30.392456 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-3ece0e75-80dd-4340-80d5-6e062dd27440 tempest-VolumesGetTest-498629272 None] Image-volume cache entry image_update_at = 2022-06-25 20:42:53+00:00, requested image updated_at = 2022-06-25 20:42:53+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 25 21:16:30.392974 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ece0e75-80dd-4340-80d5-6e062dd27440 tempest-VolumesGetTest-498629272 None] Creating from source image-volume c8878629-87cd-43d0-b2bd-d32c807cd322 {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:832}} Jun 25 21:16:30.408121 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3ece0e75-80dd-4340-80d5-6e062dd27440 tempest-VolumesGetTest-498629272 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:16:30.502354 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3ece0e75-80dd-4340-80d5-6e062dd27440 tempest-VolumesGetTest-498629272 None] creating snapshot='volume-f879ea7e-48e5-4050-a601-66386b329d34.clone_snap' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jun 25 21:16:31.364963 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3ece0e75-80dd-4340-80d5-6e062dd27440 tempest-VolumesGetTest-498629272 None] cloning 'volume-c8878629-87cd-43d0-b2bd-d32c807cd322@volume-f879ea7e-48e5-4050-a601-66386b329d34.clone_snap' to 'volume-f879ea7e-48e5-4050-a601-66386b329d34' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jun 25 21:16:31.529400 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3ece0e75-80dd-4340-80d5-6e062dd27440 tempest-VolumesGetTest-498629272 None] Volume volume-74f093be-e96a-4a80-ad38-abd3f5585611.deleted is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:16:31.531509 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3ece0e75-80dd-4340-80d5-6e062dd27440 tempest-VolumesGetTest-498629272 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:16:31.531957 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3ece0e75-80dd-4340-80d5-6e062dd27440 tempest-VolumesGetTest-498629272 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:16:31.552926 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3ece0e75-80dd-4340-80d5-6e062dd27440 tempest-VolumesGetTest-498629272 None] clone created successfully {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jun 25 21:16:31.553892 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.volume_utils [None req-3ece0e75-80dd-4340-80d5-6e062dd27440 tempest-VolumesGetTest-498629272 None] Marking volume f879ea7e-48e5-4050-a601-66386b329d34 as bootable. {{(pid=130674) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 25 21:16:31.577193 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ece0e75-80dd-4340-80d5-6e062dd27440 tempest-VolumesGetTest-498629272 None] Copying metadata from image c5741eca-b932-4865-b29a-bd2a12a73795 to f879ea7e-48e5-4050-a601-66386b329d34. {{(pid=130674) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jun 25 21:16:31.577623 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ece0e75-80dd-4340-80d5-6e062dd27440 tempest-VolumesGetTest-498629272 None] Creating volume glance metadata for volume f879ea7e-48e5-4050-a601-66386b329d34 backed by image c5741eca-b932-4865-b29a-bd2a12a73795 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=130674) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:674}} Jun 25 21:16:31.619561 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=67,cinder:UPDATE=22,cinder:INSERT=9,cinder:DELETE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:31.632053 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=58,cinder:UPDATE=28,cinder:DELETE=2,cinder:INSERT=12 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:31.646036 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3ece0e75-80dd-4340-80d5-6e062dd27440 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a8a61bd-0cae-4730-b045-46bdffd71346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f879ea7e-48e5-4050-a601-66386b329d34', 'volume_size': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d98522b7634403f83ff66fd72edfd9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'created_at': datetime.datetime(2022, 6, 25, 20, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5741eca-b932-4865-b29a-bd2a12a73795/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:31.650543 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3ece0e75-80dd-4340-80d5-6e062dd27440 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaeb12f5-3600-44cd-b2ed-5354a7f2520f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:31.675481 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-3ece0e75-80dd-4340-80d5-6e062dd27440 tempest-VolumesGetTest-498629272 None] Volume volume-f879ea7e-48e5-4050-a601-66386b329d34 (f879ea7e-48e5-4050-a601-66386b329d34): created successfully Jun 25 21:16:31.680467 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3ece0e75-80dd-4340-80d5-6e062dd27440 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaeb12f5-3600-44cd-b2ed-5354a7f2520f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:31.686084 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3ece0e75-80dd-4340-80d5-6e062dd27440 tempest-VolumesGetTest-498629272 None] Flow 'volume_create_manager' (1d068720-b0f6-4ec8-887f-c8721e32e0cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:16:31.698829 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-3ece0e75-80dd-4340-80d5-6e062dd27440 tempest-VolumesGetTest-498629272 None] Created volume successfully. Jun 25 21:16:32.966418 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-1121422b-3131-4222-924d-e4e5be284178 tempest-VolumesGetTest-498629272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:16:32.996813 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1121422b-3131-4222-924d-e4e5be284178 tempest-VolumesGetTest-498629272 None] Flow 'volume_create_manager' (c707aeff-c587-45b2-853e-dc26eb79732a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:16:33.003199 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1121422b-3131-4222-924d-e4e5be284178 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dd93d79-cfca-4cb5-bb1d-7ae8b005ff4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:33.020266 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1121422b-3131-4222-924d-e4e5be284178 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dd93d79-cfca-4cb5-bb1d-7ae8b005ff4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:16:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1185095076',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=496f4d50-a39e-4c9f-b277-da81342ce4a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7af7ae98dd68466f9721e6cbbf0c6197',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:16:33Z,use_quota=True,user_id='4785c7cebb344c5a97ad6f701cbc3acb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:33.025708 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1121422b-3131-4222-924d-e4e5be284178 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b9b0517-719e-4e1a-8886-b0b4d3964ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:33.029803 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1121422b-3131-4222-924d-e4e5be284178 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b9b0517-719e-4e1a-8886-b0b4d3964ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:33.034925 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1121422b-3131-4222-924d-e4e5be284178 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c18a23e-889b-43bc-a488-cb16688b403d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:33.039033 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1121422b-3131-4222-924d-e4e5be284178 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c18a23e-889b-43bc-a488-cb16688b403d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '496f4d50-a39e-4c9f-b277-da81342ce4a9', 'volume_name': 'volume-496f4d50-a39e-4c9f-b277-da81342ce4a9', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:33.044118 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1121422b-3131-4222-924d-e4e5be284178 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a783accd-9416-4c46-a623-72e0a367086a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:33.047990 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1121422b-3131-4222-924d-e4e5be284178 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a783accd-9416-4c46-a623-72e0a367086a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:33.052680 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1121422b-3131-4222-924d-e4e5be284178 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e38b0bd-3aa5-4909-97b3-27933e223964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:33.053897 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-1121422b-3131-4222-924d-e4e5be284178 tempest-VolumesGetTest-498629272 None] Volume 496f4d50-a39e-4c9f-b277-da81342ce4a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-496f4d50-a39e-4c9f-b277-da81342ce4a9', 'volume_size': 1} Jun 25 21:16:33.054357 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1121422b-3131-4222-924d-e4e5be284178 tempest-VolumesGetTest-498629272 None] creating volume 'volume-496f4d50-a39e-4c9f-b277-da81342ce4a9' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:16:33.055211 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1121422b-3131-4222-924d-e4e5be284178 tempest-VolumesGetTest-498629272 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:16:33.158582 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1121422b-3131-4222-924d-e4e5be284178 tempest-VolumesGetTest-498629272 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:16:33.159139 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1121422b-3131-4222-924d-e4e5be284178 tempest-VolumesGetTest-498629272 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:16:33.165306 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1121422b-3131-4222-924d-e4e5be284178 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e38b0bd-3aa5-4909-97b3-27933e223964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-496f4d50-a39e-4c9f-b277-da81342ce4a9', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:33.170603 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1121422b-3131-4222-924d-e4e5be284178 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ac20867-f503-4cc7-88e8-8f9bba92aa63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:33.185271 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-1121422b-3131-4222-924d-e4e5be284178 tempest-VolumesGetTest-498629272 None] Volume volume-496f4d50-a39e-4c9f-b277-da81342ce4a9 (496f4d50-a39e-4c9f-b277-da81342ce4a9): created successfully Jun 25 21:16:33.190984 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1121422b-3131-4222-924d-e4e5be284178 tempest-VolumesGetTest-498629272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ac20867-f503-4cc7-88e8-8f9bba92aa63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:33.198440 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1121422b-3131-4222-924d-e4e5be284178 tempest-VolumesGetTest-498629272 None] Flow 'volume_create_manager' (c707aeff-c587-45b2-853e-dc26eb79732a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:16:33.216240 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-1121422b-3131-4222-924d-e4e5be284178 tempest-VolumesGetTest-498629272 None] Created volume successfully. Jun 25 21:16:34.065168 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-24dd4367-d2b5-4cf8-8904-e5e4aeec1f59 tempest-VolumesGetTest-498629272 None] Lock "b'cinder-496f4d50-a39e-4c9f-b277-da81342ce4a9-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:16:34.113942 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-24dd4367-d2b5-4cf8-8904-e5e4aeec1f59 tempest-VolumesGetTest-498629272 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:16:34.181120 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-24dd4367-d2b5-4cf8-8904-e5e4aeec1f59 tempest-VolumesGetTest-498629272 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:16:34.181822 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-24dd4367-d2b5-4cf8-8904-e5e4aeec1f59 tempest-VolumesGetTest-498629272 None] Volume volume-496f4d50-a39e-4c9f-b277-da81342ce4a9 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:16:34.188180 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-24dd4367-d2b5-4cf8-8904-e5e4aeec1f59 tempest-VolumesGetTest-498629272 None] deleting rbd volume volume-496f4d50-a39e-4c9f-b277-da81342ce4a9 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:16:34.446226 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-24dd4367-d2b5-4cf8-8904-e5e4aeec1f59 tempest-VolumesGetTest-498629272 None] Created reservations ['fbd73f7e-3e59-49e6-8e6b-bd71f7487398', '20fb3461-2e79-454e-8bcb-76b1b8235442', 'c126feb7-62b2-4f25-83cd-7e90b1cd7b3e', 'fe546f78-963c-4ab3-a5c9-38a774028815'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:16:34.505333 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-24dd4367-d2b5-4cf8-8904-e5e4aeec1f59 tempest-VolumesGetTest-498629272 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:16:34.532041 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-24dd4367-d2b5-4cf8-8904-e5e4aeec1f59 tempest-VolumesGetTest-498629272 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:16:34.561267 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-24dd4367-d2b5-4cf8-8904-e5e4aeec1f59 tempest-VolumesGetTest-498629272 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:16:34.572351 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-24dd4367-d2b5-4cf8-8904-e5e4aeec1f59 tempest-VolumesGetTest-498629272 None] Deleted volume successfully. Jun 25 21:16:34.593553 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-24dd4367-d2b5-4cf8-8904-e5e4aeec1f59 tempest-VolumesGetTest-498629272 None] Lock "b'cinder-496f4d50-a39e-4c9f-b277-da81342ce4a9-delete_volume'" released by "delete_volume" :: held 0.530s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:16:35.241933 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-348731ec-2a3b-423c-8382-01422eb068cb tempest-VolumesGetTest-498629272 None] Lock "b'cinder-f879ea7e-48e5-4050-a601-66386b329d34-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:16:35.287688 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-348731ec-2a3b-423c-8382-01422eb068cb tempest-VolumesGetTest-498629272 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:16:35.401153 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-348731ec-2a3b-423c-8382-01422eb068cb tempest-VolumesGetTest-498629272 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:16:35.410816 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-348731ec-2a3b-423c-8382-01422eb068cb tempest-VolumesGetTest-498629272 None] deleting rbd volume volume-f879ea7e-48e5-4050-a601-66386b329d34 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:16:35.702058 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-348731ec-2a3b-423c-8382-01422eb068cb tempest-VolumesGetTest-498629272 None] volume is a clone so cleaning references {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jun 25 21:16:35.735227 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-348731ec-2a3b-423c-8382-01422eb068cb tempest-VolumesGetTest-498629272 None] deleting parent snapshot volume-f879ea7e-48e5-4050-a601-66386b329d34.clone_snap {{(pid=130674) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jun 25 21:16:36.650078 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-348731ec-2a3b-423c-8382-01422eb068cb tempest-VolumesGetTest-498629272 None] Created reservations ['38e7adc1-afb8-4003-8a31-37d43959d4e8', '6463b517-45bb-4f5e-a499-6f5eeba6f016', '61e55c5c-ddee-4b10-a7ba-81c6a83da71c', '9cf2688e-3bc2-4692-bbf9-78fe2952c116'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:16:36.717141 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-348731ec-2a3b-423c-8382-01422eb068cb tempest-VolumesGetTest-498629272 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:16:36.742375 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-348731ec-2a3b-423c-8382-01422eb068cb tempest-VolumesGetTest-498629272 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:16:36.767301 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-348731ec-2a3b-423c-8382-01422eb068cb tempest-VolumesGetTest-498629272 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:16:36.772469 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-348731ec-2a3b-423c-8382-01422eb068cb tempest-VolumesGetTest-498629272 None] Deleted volume successfully. Jun 25 21:16:36.786698 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-348731ec-2a3b-423c-8382-01422eb068cb tempest-VolumesGetTest-498629272 None] Lock "b'cinder-f879ea7e-48e5-4050-a601-66386b329d34-delete_volume'" released by "delete_volume" :: held 1.545s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:16:37.495776 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-df0268cb-ed81-4c4c-8652-e3daf764e2a0 tempest-VolumesGetTest-498629272 None] Lock "b'cinder-b2bf833c-bcc1-48e3-a21e-87c8d2d66a42-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:16:37.544182 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-df0268cb-ed81-4c4c-8652-e3daf764e2a0 tempest-VolumesGetTest-498629272 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:16:37.596596 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-df0268cb-ed81-4c4c-8652-e3daf764e2a0 tempest-VolumesGetTest-498629272 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:16:37.597166 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-df0268cb-ed81-4c4c-8652-e3daf764e2a0 tempest-VolumesGetTest-498629272 None] Volume volume-b2bf833c-bcc1-48e3-a21e-87c8d2d66a42 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:16:37.604059 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-df0268cb-ed81-4c4c-8652-e3daf764e2a0 tempest-VolumesGetTest-498629272 None] deleting rbd volume volume-b2bf833c-bcc1-48e3-a21e-87c8d2d66a42 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:16:37.967197 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-df0268cb-ed81-4c4c-8652-e3daf764e2a0 tempest-VolumesGetTest-498629272 None] Created reservations ['48cea08f-e916-4b87-b78b-2e12c4e7449a', 'f76467b2-7570-48a3-adea-f8baf174fb68', 'e04d6a35-a917-4e2a-9a64-a0c00065ae37', 'b55650de-c7a8-419f-8ab0-cdbd28264a5b'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:16:38.023775 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-df0268cb-ed81-4c4c-8652-e3daf764e2a0 tempest-VolumesGetTest-498629272 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:16:38.050655 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-df0268cb-ed81-4c4c-8652-e3daf764e2a0 tempest-VolumesGetTest-498629272 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:16:38.079232 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-df0268cb-ed81-4c4c-8652-e3daf764e2a0 tempest-VolumesGetTest-498629272 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:16:38.084967 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-df0268cb-ed81-4c4c-8652-e3daf764e2a0 tempest-VolumesGetTest-498629272 None] Deleted volume successfully. Jun 25 21:16:38.106513 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-df0268cb-ed81-4c4c-8652-e3daf764e2a0 tempest-VolumesGetTest-498629272 None] Lock "b'cinder-b2bf833c-bcc1-48e3-a21e-87c8d2d66a42-delete_volume'" released by "delete_volume" :: held 0.611s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:16:41.401375 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-97b02628-3b5e-4464-a098-6cb116194f4b tempest-VolumesNegativeTest-1153177309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:16:41.439550 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97b02628-3b5e-4464-a098-6cb116194f4b tempest-VolumesNegativeTest-1153177309 None] Flow 'volume_create_manager' (356aeb29-40ff-45ff-b7f2-47f164d6df74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:16:41.450280 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97b02628-3b5e-4464-a098-6cb116194f4b tempest-VolumesNegativeTest-1153177309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71effb49-27f1-4232-8d9e-afa4e5b47b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:41.474624 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97b02628-3b5e-4464-a098-6cb116194f4b tempest-VolumesNegativeTest-1153177309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71effb49-27f1-4232-8d9e-afa4e5b47b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:16:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-987775152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=655c857a-1e5f-4df7-a4bc-23e0b1493ec4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15f9fd4b47d743aa9ba0081392ed3fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:16:41Z,use_quota=True,user_id='f6d2a50d421e4b28a78565f06bb6d3a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:41.483519 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97b02628-3b5e-4464-a098-6cb116194f4b tempest-VolumesNegativeTest-1153177309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc0d0a42-bad7-4421-81ff-babc524fc947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:41.488055 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97b02628-3b5e-4464-a098-6cb116194f4b tempest-VolumesNegativeTest-1153177309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc0d0a42-bad7-4421-81ff-babc524fc947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:41.494170 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97b02628-3b5e-4464-a098-6cb116194f4b tempest-VolumesNegativeTest-1153177309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c2d400d-e4b9-46e1-a2be-e226743411f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:41.501394 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97b02628-3b5e-4464-a098-6cb116194f4b tempest-VolumesNegativeTest-1153177309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c2d400d-e4b9-46e1-a2be-e226743411f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '655c857a-1e5f-4df7-a4bc-23e0b1493ec4', 'volume_name': 'volume-655c857a-1e5f-4df7-a4bc-23e0b1493ec4', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:41.509069 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97b02628-3b5e-4464-a098-6cb116194f4b tempest-VolumesNegativeTest-1153177309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65f72091-d37c-4641-8dbf-6e91859706a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:41.513825 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97b02628-3b5e-4464-a098-6cb116194f4b tempest-VolumesNegativeTest-1153177309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65f72091-d37c-4641-8dbf-6e91859706a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:41.520514 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97b02628-3b5e-4464-a098-6cb116194f4b tempest-VolumesNegativeTest-1153177309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (222be601-1cdb-4195-b72a-32ccca3269b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:41.522687 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-97b02628-3b5e-4464-a098-6cb116194f4b tempest-VolumesNegativeTest-1153177309 None] Volume 655c857a-1e5f-4df7-a4bc-23e0b1493ec4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-655c857a-1e5f-4df7-a4bc-23e0b1493ec4', 'volume_size': 1} Jun 25 21:16:41.523561 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-97b02628-3b5e-4464-a098-6cb116194f4b tempest-VolumesNegativeTest-1153177309 None] creating volume 'volume-655c857a-1e5f-4df7-a4bc-23e0b1493ec4' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:16:41.524617 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-97b02628-3b5e-4464-a098-6cb116194f4b tempest-VolumesNegativeTest-1153177309 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:16:41.643377 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-97b02628-3b5e-4464-a098-6cb116194f4b tempest-VolumesNegativeTest-1153177309 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:16:41.643977 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-97b02628-3b5e-4464-a098-6cb116194f4b tempest-VolumesNegativeTest-1153177309 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:16:41.651808 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97b02628-3b5e-4464-a098-6cb116194f4b tempest-VolumesNegativeTest-1153177309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (222be601-1cdb-4195-b72a-32ccca3269b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-655c857a-1e5f-4df7-a4bc-23e0b1493ec4', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:41.659304 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97b02628-3b5e-4464-a098-6cb116194f4b tempest-VolumesNegativeTest-1153177309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30f143b5-23ee-43c9-a5fb-fe371cb987ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:41.673706 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-97b02628-3b5e-4464-a098-6cb116194f4b tempest-VolumesNegativeTest-1153177309 None] Volume volume-655c857a-1e5f-4df7-a4bc-23e0b1493ec4 (655c857a-1e5f-4df7-a4bc-23e0b1493ec4): created successfully Jun 25 21:16:41.677888 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97b02628-3b5e-4464-a098-6cb116194f4b tempest-VolumesNegativeTest-1153177309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30f143b5-23ee-43c9-a5fb-fe371cb987ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:41.684752 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-97b02628-3b5e-4464-a098-6cb116194f4b tempest-VolumesNegativeTest-1153177309 None] Flow 'volume_create_manager' (356aeb29-40ff-45ff-b7f2-47f164d6df74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:16:41.699173 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-97b02628-3b5e-4464-a098-6cb116194f4b tempest-VolumesNegativeTest-1153177309 None] Created volume successfully. Jun 25 21:16:52.155463 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:16:52.155463 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:16:52.243580 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:16:52.333569 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:16:54.045045 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:DELETE=4,cinder:SELECT=48,cinder:UPDATE=23,cinder:INSERT=6 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:54.636992 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-10701bb0-4a81-45bd-9ef4-c77b1b5ead1d tempest-VolumesActionsTest-745630661 None] Uploaded volume to glance image-id: 564e7811-5fe6-4eba-9eae-58a0c341f98d. {{(pid=130674) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1751}} Jun 25 21:16:54.657135 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-10701bb0-4a81-45bd-9ef4-c77b1b5ead1d tempest-VolumesActionsTest-745630661 None] Copy volume to image completed successfully. Jun 25 21:16:55.091186 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:INSERT=7,cinder:SELECT=54,cinder:UPDATE=37,cinder:DELETE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:55.132062 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-b764b3e3-efa7-48c9-8077-3d296c66c17a tempest-AttachVolumeNegativeTest-2001135405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:16:55.178566 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b764b3e3-efa7-48c9-8077-3d296c66c17a tempest-AttachVolumeNegativeTest-2001135405 None] Flow 'volume_create_manager' (aa03ba30-4a77-41c9-b553-f50b9244cc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:16:55.187170 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b764b3e3-efa7-48c9-8077-3d296c66c17a tempest-AttachVolumeNegativeTest-2001135405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (285715f2-95cf-42f9-9bb4-a873e5701b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:55.208795 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b764b3e3-efa7-48c9-8077-3d296c66c17a tempest-AttachVolumeNegativeTest-2001135405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (285715f2-95cf-42f9-9bb4-a873e5701b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1132415909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5ebdd798-3bf7-43ca-a95f-02a861d932e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d32f25e6afd2425db488a9387869da19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:16:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:16:55Z,use_quota=True,user_id='3648405427d14f91a4bb44bd81f2195b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:55.214672 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b764b3e3-efa7-48c9-8077-3d296c66c17a tempest-AttachVolumeNegativeTest-2001135405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd3fac1a-0265-438b-bfce-b6fdc315e0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:55.218645 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b764b3e3-efa7-48c9-8077-3d296c66c17a tempest-AttachVolumeNegativeTest-2001135405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd3fac1a-0265-438b-bfce-b6fdc315e0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:55.223580 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b764b3e3-efa7-48c9-8077-3d296c66c17a tempest-AttachVolumeNegativeTest-2001135405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dc5d00d-b3a5-4506-937d-237186e43cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:55.228160 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b764b3e3-efa7-48c9-8077-3d296c66c17a tempest-AttachVolumeNegativeTest-2001135405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dc5d00d-b3a5-4506-937d-237186e43cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ebdd798-3bf7-43ca-a95f-02a861d932e8', 'volume_name': 'volume-5ebdd798-3bf7-43ca-a95f-02a861d932e8', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:55.234766 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b764b3e3-efa7-48c9-8077-3d296c66c17a tempest-AttachVolumeNegativeTest-2001135405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (817b6549-4d6e-47de-bc5e-57411ab5277c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:55.239117 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b764b3e3-efa7-48c9-8077-3d296c66c17a tempest-AttachVolumeNegativeTest-2001135405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (817b6549-4d6e-47de-bc5e-57411ab5277c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:55.244249 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b764b3e3-efa7-48c9-8077-3d296c66c17a tempest-AttachVolumeNegativeTest-2001135405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab091820-9773-4d86-8a1f-412d1057fcc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:55.245403 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-b764b3e3-efa7-48c9-8077-3d296c66c17a tempest-AttachVolumeNegativeTest-2001135405 None] Volume 5ebdd798-3bf7-43ca-a95f-02a861d932e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ebdd798-3bf7-43ca-a95f-02a861d932e8', 'volume_size': 1} Jun 25 21:16:55.245860 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b764b3e3-efa7-48c9-8077-3d296c66c17a tempest-AttachVolumeNegativeTest-2001135405 None] creating volume 'volume-5ebdd798-3bf7-43ca-a95f-02a861d932e8' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:16:55.246654 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b764b3e3-efa7-48c9-8077-3d296c66c17a tempest-AttachVolumeNegativeTest-2001135405 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:16:55.341350 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b764b3e3-efa7-48c9-8077-3d296c66c17a tempest-AttachVolumeNegativeTest-2001135405 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:16:55.342709 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b764b3e3-efa7-48c9-8077-3d296c66c17a tempest-AttachVolumeNegativeTest-2001135405 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:16:55.347947 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b764b3e3-efa7-48c9-8077-3d296c66c17a tempest-AttachVolumeNegativeTest-2001135405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab091820-9773-4d86-8a1f-412d1057fcc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ebdd798-3bf7-43ca-a95f-02a861d932e8', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:55.353432 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b764b3e3-efa7-48c9-8077-3d296c66c17a tempest-AttachVolumeNegativeTest-2001135405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a651507-442a-4274-93e5-d9d687aa21fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:55.367071 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-b764b3e3-efa7-48c9-8077-3d296c66c17a tempest-AttachVolumeNegativeTest-2001135405 None] Volume volume-5ebdd798-3bf7-43ca-a95f-02a861d932e8 (5ebdd798-3bf7-43ca-a95f-02a861d932e8): created successfully Jun 25 21:16:55.380249 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b764b3e3-efa7-48c9-8077-3d296c66c17a tempest-AttachVolumeNegativeTest-2001135405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a651507-442a-4274-93e5-d9d687aa21fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:55.385933 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b764b3e3-efa7-48c9-8077-3d296c66c17a tempest-AttachVolumeNegativeTest-2001135405 None] Flow 'volume_create_manager' (aa03ba30-4a77-41c9-b553-f50b9244cc70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:16:55.398635 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-b764b3e3-efa7-48c9-8077-3d296c66c17a tempest-AttachVolumeNegativeTest-2001135405 None] Created volume successfully. Jun 25 21:16:55.882391 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-9edf3fba-d346-4f3e-94a9-8ae1a1c4921c tempest-VolumesActionsTest-745630661 None] Lock "b'cinder-779e9cb0-e1c7-4825-9eb0-fa33a58fef36-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:16:55.921499 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9edf3fba-d346-4f3e-94a9-8ae1a1c4921c tempest-VolumesActionsTest-745630661 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:16:55.961601 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9edf3fba-d346-4f3e-94a9-8ae1a1c4921c tempest-VolumesActionsTest-745630661 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:16:55.962024 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9edf3fba-d346-4f3e-94a9-8ae1a1c4921c tempest-VolumesActionsTest-745630661 None] Volume volume-779e9cb0-e1c7-4825-9eb0-fa33a58fef36 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:16:55.966128 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9edf3fba-d346-4f3e-94a9-8ae1a1c4921c tempest-VolumesActionsTest-745630661 None] deleting rbd volume volume-779e9cb0-e1c7-4825-9eb0-fa33a58fef36 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:16:56.201826 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-9edf3fba-d346-4f3e-94a9-8ae1a1c4921c tempest-VolumesActionsTest-745630661 None] Created reservations ['e3a2d1e0-2f2a-4760-81d2-0d5ce808416b', '683e46db-6811-475e-86d3-be248f0afcb5', '149e5924-bb41-48a7-95a9-0571eaef35af', 'ee90545a-289b-494d-ad25-16044eb6f5bd'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:16:56.257786 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9edf3fba-d346-4f3e-94a9-8ae1a1c4921c tempest-VolumesActionsTest-745630661 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:16:56.298307 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9edf3fba-d346-4f3e-94a9-8ae1a1c4921c tempest-VolumesActionsTest-745630661 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:16:56.336132 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-9edf3fba-d346-4f3e-94a9-8ae1a1c4921c tempest-VolumesActionsTest-745630661 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:16:56.343013 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-9edf3fba-d346-4f3e-94a9-8ae1a1c4921c tempest-VolumesActionsTest-745630661 None] Deleted volume successfully. Jun 25 21:16:56.358437 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-9edf3fba-d346-4f3e-94a9-8ae1a1c4921c tempest-VolumesActionsTest-745630661 None] Lock "b'cinder-779e9cb0-e1c7-4825-9eb0-fa33a58fef36-delete_volume'" released by "delete_volume" :: held 0.476s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:16:56.655569 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-763ba4f9-8219-4897-a239-7a0a199d545f req-1154449f-79d8-40f8-b958-09afe97ecc7f tempest-AttachVolumeNegativeTest-2001135405 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 21:16:57.543756 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-763ba4f9-8219-4897-a239-7a0a199d545f req-1154449f-79d8-40f8-b958-09afe97ecc7f tempest-AttachVolumeNegativeTest-2001135405 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.888s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 21:16:57.544737 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-763ba4f9-8219-4897-a239-7a0a199d545f req-1154449f-79d8-40f8-b958-09afe97ecc7f tempest-AttachVolumeNegativeTest-2001135405 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-5ebdd798-3bf7-43ca-a95f-02a861d932e8', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': '5ebdd798-3bf7-43ca-a95f-02a861d932e8', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 21:16:57.598525 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-763ba4f9-8219-4897-a239-7a0a199d545f req-1154449f-79d8-40f8-b958-09afe97ecc7f tempest-AttachVolumeNegativeTest-2001135405 None] Connection info returned from driver {'name': 'volumes/volume-5ebdd798-3bf7-43ca-a95f-02a861d932e8', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '5ebdd798-3bf7-43ca-a95f-02a861d932e8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f7602843-66f5-4523-b6a6-82022c1b62c2'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 25 21:16:57.658802 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-763ba4f9-8219-4897-a239-7a0a199d545f req-1154449f-79d8-40f8-b958-09afe97ecc7f tempest-AttachVolumeNegativeTest-2001135405 None] attachment_update completed successfully. Jun 25 21:16:59.596345 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2e12b07-a605-4bb7-a2a5-ef88922f38f3 tempest-VolumesExtendTest-1429053437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:16:59.618785 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-d2e12b07-a605-4bb7-a2a5-ef88922f38f3 tempest-VolumesExtendTest-1429053437 None] Flow 'volume_create_manager' (a8a50f78-e07f-40f7-8a20-bcbc597e9ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:16:59.625299 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-d2e12b07-a605-4bb7-a2a5-ef88922f38f3 tempest-VolumesExtendTest-1429053437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f80f7056-edc0-4776-85a0-3869a54fe0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:59.641315 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-d2e12b07-a605-4bb7-a2a5-ef88922f38f3 tempest-VolumesExtendTest-1429053437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f80f7056-edc0-4776-85a0-3869a54fe0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-936221668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=be2d8ae9-731d-424b-be14-7e95c2bc3c3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1852fd4df3a24542bbd8ecb990222b0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:17:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:17:00Z,use_quota=True,user_id='44144ee1bc6c4013a4f2097b46b3ac39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:59.646654 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-d2e12b07-a605-4bb7-a2a5-ef88922f38f3 tempest-VolumesExtendTest-1429053437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60359a02-6d08-4513-802a-56edb5b27734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:59.650839 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-d2e12b07-a605-4bb7-a2a5-ef88922f38f3 tempest-VolumesExtendTest-1429053437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60359a02-6d08-4513-802a-56edb5b27734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:59.656058 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-d2e12b07-a605-4bb7-a2a5-ef88922f38f3 tempest-VolumesExtendTest-1429053437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec7c2737-1fb6-4c21-b42d-0080682250a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:59.769610 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-d2e12b07-a605-4bb7-a2a5-ef88922f38f3 tempest-VolumesExtendTest-1429053437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec7c2737-1fb6-4c21-b42d-0080682250a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'be2d8ae9-731d-424b-be14-7e95c2bc3c3d', 'volume_name': 'volume-be2d8ae9-731d-424b-be14-7e95c2bc3c3d', 'volume_size': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d98522b7634403f83ff66fd72edfd9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'created_at': datetime.datetime(2022, 6, 25, 20, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5741eca-b932-4865-b29a-bd2a12a73795/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:59.776406 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-d2e12b07-a605-4bb7-a2a5-ef88922f38f3 tempest-VolumesExtendTest-1429053437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c2e4279-7b01-4d34-813f-ed09553ebb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:59.781911 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-d2e12b07-a605-4bb7-a2a5-ef88922f38f3 tempest-VolumesExtendTest-1429053437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c2e4279-7b01-4d34-813f-ed09553ebb39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:16:59.787693 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-d2e12b07-a605-4bb7-a2a5-ef88922f38f3 tempest-VolumesExtendTest-1429053437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (603fce24-ad2f-4507-9942-31ca95fa3e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:16:59.789147 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-d2e12b07-a605-4bb7-a2a5-ef88922f38f3 tempest-VolumesExtendTest-1429053437 None] Volume be2d8ae9-731d-424b-be14-7e95c2bc3c3d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-be2d8ae9-731d-424b-be14-7e95c2bc3c3d', 'volume_size': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d98522b7634403f83ff66fd72edfd9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'created_at': datetime.datetime(2022, 6, 25, 20, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5741eca-b932-4865-b29a-bd2a12a73795/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 25 21:16:59.789922 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2e12b07-a605-4bb7-a2a5-ef88922f38f3 tempest-VolumesExtendTest-1429053437 None] Cloning be2d8ae9-731d-424b-be14-7e95c2bc3c3d from image c5741eca-b932-4865-b29a-bd2a12a73795 at location (None, None). {{(pid=130674) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1062}} Jun 25 21:16:59.801209 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-d2e12b07-a605-4bb7-a2a5-ef88922f38f3 tempest-VolumesExtendTest-1429053437 None] Lock "b'cinder-c5741eca-b932-4865-b29a-bd2a12a73795'" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:16:59.814082 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-d2e12b07-a605-4bb7-a2a5-ef88922f38f3 tempest-VolumesExtendTest-1429053437 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'volume_id': 'c8878629-87cd-43d0-b2bd-d32c807cd322', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53), 'last_used': datetime.datetime(2022, 6, 25, 21, 16, 59, 806994)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 25 21:16:59.814741 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-d2e12b07-a605-4bb7-a2a5-ef88922f38f3 tempest-VolumesExtendTest-1429053437 None] Image-volume cache entry image_update_at = 2022-06-25 20:42:53+00:00, requested image updated_at = 2022-06-25 20:42:53+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 25 21:16:59.815264 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2e12b07-a605-4bb7-a2a5-ef88922f38f3 tempest-VolumesExtendTest-1429053437 None] Found cache entry for image = c5741eca-b932-4865-b29a-bd2a12a73795 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:877}} Jun 25 21:16:59.820915 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-d2e12b07-a605-4bb7-a2a5-ef88922f38f3 tempest-VolumesExtendTest-1429053437 None] Lock "b'cinder-c5741eca-b932-4865-b29a-bd2a12a73795'" released by "_prepare_image_cache_entry" :: held 0.020s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:16:59.821859 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2e12b07-a605-4bb7-a2a5-ef88922f38f3 tempest-VolumesExtendTest-1429053437 None] Attempting to retrieve cache entry for image = c5741eca-b932-4865-b29a-bd2a12a73795 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:818}} Jun 25 21:16:59.828588 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-d2e12b07-a605-4bb7-a2a5-ef88922f38f3 tempest-VolumesExtendTest-1429053437 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'volume_id': 'c8878629-87cd-43d0-b2bd-d32c807cd322', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53), 'last_used': datetime.datetime(2022, 6, 25, 21, 16, 59, 825930)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 25 21:16:59.829035 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-d2e12b07-a605-4bb7-a2a5-ef88922f38f3 tempest-VolumesExtendTest-1429053437 None] Image-volume cache entry image_update_at = 2022-06-25 20:42:53+00:00, requested image updated_at = 2022-06-25 20:42:53+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 25 21:16:59.829416 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2e12b07-a605-4bb7-a2a5-ef88922f38f3 tempest-VolumesExtendTest-1429053437 None] Creating from source image-volume c8878629-87cd-43d0-b2bd-d32c807cd322 {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:832}} Jun 25 21:16:59.842152 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d2e12b07-a605-4bb7-a2a5-ef88922f38f3 tempest-VolumesExtendTest-1429053437 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:16:59.896106 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d2e12b07-a605-4bb7-a2a5-ef88922f38f3 tempest-VolumesExtendTest-1429053437 None] creating snapshot='volume-be2d8ae9-731d-424b-be14-7e95c2bc3c3d.clone_snap' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jun 25 21:17:00.286145 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d2e12b07-a605-4bb7-a2a5-ef88922f38f3 tempest-VolumesExtendTest-1429053437 None] cloning 'volume-c8878629-87cd-43d0-b2bd-d32c807cd322@volume-be2d8ae9-731d-424b-be14-7e95c2bc3c3d.clone_snap' to 'volume-be2d8ae9-731d-424b-be14-7e95c2bc3c3d' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jun 25 21:17:00.419819 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d2e12b07-a605-4bb7-a2a5-ef88922f38f3 tempest-VolumesExtendTest-1429053437 None] Volume volume-74f093be-e96a-4a80-ad38-abd3f5585611.deleted is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:17:00.420994 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d2e12b07-a605-4bb7-a2a5-ef88922f38f3 tempest-VolumesExtendTest-1429053437 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:17:00.421441 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d2e12b07-a605-4bb7-a2a5-ef88922f38f3 tempest-VolumesExtendTest-1429053437 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:17:00.444101 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d2e12b07-a605-4bb7-a2a5-ef88922f38f3 tempest-VolumesExtendTest-1429053437 None] clone created successfully {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jun 25 21:17:00.444817 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.volume_utils [None req-d2e12b07-a605-4bb7-a2a5-ef88922f38f3 tempest-VolumesExtendTest-1429053437 None] Marking volume be2d8ae9-731d-424b-be14-7e95c2bc3c3d as bootable. {{(pid=130674) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 25 21:17:00.453863 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2e12b07-a605-4bb7-a2a5-ef88922f38f3 tempest-VolumesExtendTest-1429053437 None] Copying metadata from image c5741eca-b932-4865-b29a-bd2a12a73795 to be2d8ae9-731d-424b-be14-7e95c2bc3c3d. {{(pid=130674) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jun 25 21:17:00.454328 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2e12b07-a605-4bb7-a2a5-ef88922f38f3 tempest-VolumesExtendTest-1429053437 None] Creating volume glance metadata for volume be2d8ae9-731d-424b-be14-7e95c2bc3c3d backed by image c5741eca-b932-4865-b29a-bd2a12a73795 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=130674) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:674}} Jun 25 21:17:00.510580 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-d2e12b07-a605-4bb7-a2a5-ef88922f38f3 tempest-VolumesExtendTest-1429053437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (603fce24-ad2f-4507-9942-31ca95fa3e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be2d8ae9-731d-424b-be14-7e95c2bc3c3d', 'volume_size': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d98522b7634403f83ff66fd72edfd9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'created_at': datetime.datetime(2022, 6, 25, 20, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5741eca-b932-4865-b29a-bd2a12a73795/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:17:00.517528 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-d2e12b07-a605-4bb7-a2a5-ef88922f38f3 tempest-VolumesExtendTest-1429053437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c22d877-b851-4bd0-940d-5e2c2a291166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:17:00.528943 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-d2e12b07-a605-4bb7-a2a5-ef88922f38f3 tempest-VolumesExtendTest-1429053437 None] Volume volume-be2d8ae9-731d-424b-be14-7e95c2bc3c3d (be2d8ae9-731d-424b-be14-7e95c2bc3c3d): created successfully Jun 25 21:17:00.532359 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-d2e12b07-a605-4bb7-a2a5-ef88922f38f3 tempest-VolumesExtendTest-1429053437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c22d877-b851-4bd0-940d-5e2c2a291166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:17:00.538483 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-d2e12b07-a605-4bb7-a2a5-ef88922f38f3 tempest-VolumesExtendTest-1429053437 None] Flow 'volume_create_manager' (a8a50f78-e07f-40f7-8a20-bcbc597e9ab2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:17:00.548191 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-d2e12b07-a605-4bb7-a2a5-ef88922f38f3 tempest-VolumesExtendTest-1429053437 None] Created volume successfully. Jun 25 21:17:00.749043 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-afd09d07-f37f-4972-98be-fda640e28f1e tempest-VolumesExtendTest-1429053437 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:17:00.929390 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-afd09d07-f37f-4972-98be-fda640e28f1e tempest-VolumesExtendTest-1429053437 None] Extend volume from 1 GB to 2 GB. {{(pid=130674) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1878}} Jun 25 21:17:00.964133 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-afd09d07-f37f-4972-98be-fda640e28f1e tempest-VolumesExtendTest-1429053437 None] Extend volume completed successfully. Jun 25 21:17:02.463227 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a785110-2069-4a88-967a-850fb7411cd9 tempest-VolumesExtendTest-1429053437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:17:02.485458 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6a785110-2069-4a88-967a-850fb7411cd9 tempest-VolumesExtendTest-1429053437 None] Flow 'volume_create_manager' (87aa7ffd-578b-489f-94e8-ec45cb0d166e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:17:02.492483 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6a785110-2069-4a88-967a-850fb7411cd9 tempest-VolumesExtendTest-1429053437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3db223d3-f7a6-44e6-bedd-c07e0562c5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:17:02.514158 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6a785110-2069-4a88-967a-850fb7411cd9 tempest-VolumesExtendTest-1429053437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3db223d3-f7a6-44e6-bedd-c07e0562c5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:17:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-972194724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6d117baf-f5d7-471a-9643-adfde03fe892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1852fd4df3a24542bbd8ecb990222b0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:17:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:17:02Z,use_quota=True,user_id='44144ee1bc6c4013a4f2097b46b3ac39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:17:02.520131 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6a785110-2069-4a88-967a-850fb7411cd9 tempest-VolumesExtendTest-1429053437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92930db1-fc95-48b1-a27b-2d4eb0d9e203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:17:02.526084 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6a785110-2069-4a88-967a-850fb7411cd9 tempest-VolumesExtendTest-1429053437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92930db1-fc95-48b1-a27b-2d4eb0d9e203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:17:02.538163 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6a785110-2069-4a88-967a-850fb7411cd9 tempest-VolumesExtendTest-1429053437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f287379b-1eec-4dea-ae6e-2d2749e8cd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:17:02.557007 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6a785110-2069-4a88-967a-850fb7411cd9 tempest-VolumesExtendTest-1429053437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f287379b-1eec-4dea-ae6e-2d2749e8cd95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d117baf-f5d7-471a-9643-adfde03fe892', 'volume_name': 'volume-6d117baf-f5d7-471a-9643-adfde03fe892', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:17:02.564753 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6a785110-2069-4a88-967a-850fb7411cd9 tempest-VolumesExtendTest-1429053437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c890c23-1849-49c2-8c87-48b66fff431e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:17:02.574759 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6a785110-2069-4a88-967a-850fb7411cd9 tempest-VolumesExtendTest-1429053437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c890c23-1849-49c2-8c87-48b66fff431e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:17:02.588022 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6a785110-2069-4a88-967a-850fb7411cd9 tempest-VolumesExtendTest-1429053437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72844b2f-97be-4d35-8063-dc424c6308a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:17:02.589235 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-6a785110-2069-4a88-967a-850fb7411cd9 tempest-VolumesExtendTest-1429053437 None] Volume 6d117baf-f5d7-471a-9643-adfde03fe892: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d117baf-f5d7-471a-9643-adfde03fe892', 'volume_size': 1} Jun 25 21:17:02.589633 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6a785110-2069-4a88-967a-850fb7411cd9 tempest-VolumesExtendTest-1429053437 None] creating volume 'volume-6d117baf-f5d7-471a-9643-adfde03fe892' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:17:02.590628 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6a785110-2069-4a88-967a-850fb7411cd9 tempest-VolumesExtendTest-1429053437 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:17:02.699510 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6a785110-2069-4a88-967a-850fb7411cd9 tempest-VolumesExtendTest-1429053437 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:17:02.699959 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6a785110-2069-4a88-967a-850fb7411cd9 tempest-VolumesExtendTest-1429053437 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:17:02.705006 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6a785110-2069-4a88-967a-850fb7411cd9 tempest-VolumesExtendTest-1429053437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72844b2f-97be-4d35-8063-dc424c6308a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d117baf-f5d7-471a-9643-adfde03fe892', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:17:02.710913 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6a785110-2069-4a88-967a-850fb7411cd9 tempest-VolumesExtendTest-1429053437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddd87eaf-47b3-490d-94e9-0c1408a912bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:17:02.725377 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-6a785110-2069-4a88-967a-850fb7411cd9 tempest-VolumesExtendTest-1429053437 None] Volume volume-6d117baf-f5d7-471a-9643-adfde03fe892 (6d117baf-f5d7-471a-9643-adfde03fe892): created successfully Jun 25 21:17:02.738643 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6a785110-2069-4a88-967a-850fb7411cd9 tempest-VolumesExtendTest-1429053437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddd87eaf-47b3-490d-94e9-0c1408a912bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:17:02.767442 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6a785110-2069-4a88-967a-850fb7411cd9 tempest-VolumesExtendTest-1429053437 None] Flow 'volume_create_manager' (87aa7ffd-578b-489f-94e8-ec45cb0d166e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:17:02.799758 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-6a785110-2069-4a88-967a-850fb7411cd9 tempest-VolumesExtendTest-1429053437 None] Created volume successfully. Jun 25 21:17:03.861277 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-710ff924-04af-4305-bc38-08efb53ed072 tempest-VolumesExtendTest-1429053437 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:17:04.530957 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-aa108645-8cf2-4472-9c48-8ea4e0376ae6 tempest-VolumesNegativeTest-1153177309 None] Lock "b'cinder-655c857a-1e5f-4df7-a4bc-23e0b1493ec4-delete_volume'" acquired by "delete_volume" :: waited 0.027s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:17:04.595441 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-aa108645-8cf2-4472-9c48-8ea4e0376ae6 tempest-VolumesNegativeTest-1153177309 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:17:04.698744 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-aa108645-8cf2-4472-9c48-8ea4e0376ae6 tempest-VolumesNegativeTest-1153177309 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:17:04.699273 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-aa108645-8cf2-4472-9c48-8ea4e0376ae6 tempest-VolumesNegativeTest-1153177309 None] Volume volume-655c857a-1e5f-4df7-a4bc-23e0b1493ec4 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:17:04.709325 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-aa108645-8cf2-4472-9c48-8ea4e0376ae6 tempest-VolumesNegativeTest-1153177309 None] deleting rbd volume volume-655c857a-1e5f-4df7-a4bc-23e0b1493ec4 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:17:04.790322 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-710ff924-04af-4305-bc38-08efb53ed072 tempest-VolumesExtendTest-1429053437 None] Create snapshot completed successfully Jun 25 21:17:04.984356 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=66,cinder:UPDATE=23,cinder:DELETE=4,cinder:INSERT=7 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:05.014063 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-aa108645-8cf2-4472-9c48-8ea4e0376ae6 tempest-VolumesNegativeTest-1153177309 None] Created reservations ['d6e10328-5bba-4a18-8258-626bebc79fa7', '7bfed472-1854-4dfe-a2b5-0f4f8731893e', '416c5d0c-2ca5-4551-976d-3765092ff6e1', '4deda96f-e7b6-4b91-813a-cb1236329c53'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:17:05.053382 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=62,cinder:UPDATE=24,cinder:INSERT=13,cinder:DELETE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:05.063944 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-aa108645-8cf2-4472-9c48-8ea4e0376ae6 tempest-VolumesNegativeTest-1153177309 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:17:05.092270 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-aa108645-8cf2-4472-9c48-8ea4e0376ae6 tempest-VolumesNegativeTest-1153177309 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:17:05.119240 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-aa108645-8cf2-4472-9c48-8ea4e0376ae6 tempest-VolumesNegativeTest-1153177309 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:17:05.125350 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-aa108645-8cf2-4472-9c48-8ea4e0376ae6 tempest-VolumesNegativeTest-1153177309 None] Deleted volume successfully. Jun 25 21:17:05.139629 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-aa108645-8cf2-4472-9c48-8ea4e0376ae6 tempest-VolumesNegativeTest-1153177309 None] Lock "b'cinder-655c857a-1e5f-4df7-a4bc-23e0b1493ec4-delete_volume'" released by "delete_volume" :: held 0.609s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:17:06.039404 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-569a6867-80bd-4102-97c5-80724166b2d1 tempest-VolumesExtendTest-1429053437 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:17:06.219140 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-569a6867-80bd-4102-97c5-80724166b2d1 tempest-VolumesExtendTest-1429053437 None] Extend volume from 1 GB to 2 GB. {{(pid=130674) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1878}} Jun 25 21:17:06.272094 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-569a6867-80bd-4102-97c5-80724166b2d1 tempest-VolumesExtendTest-1429053437 None] Extend volume completed successfully. Jun 25 21:17:07.323305 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-50c0b797-2f85-4e79-a518-d824fac911ad tempest-VolumesExtendTest-1429053437 None] Lock "b'cinder-61322fd6-c6e7-410f-8bc7-6366ef48bf9a-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.017s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:17:07.330333 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-50c0b797-2f85-4e79-a518-d824fac911ad tempest-VolumesExtendTest-1429053437 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:17:08.421282 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-50c0b797-2f85-4e79-a518-d824fac911ad tempest-VolumesExtendTest-1429053437 None] Created reservations ['db7861a6-8479-4eff-8078-63ca43a56f68', 'e08e0350-27d5-4ea7-9a05-2829363f967e', '1c359db4-1967-4c45-934d-55d64e296d30', '020b80e6-d364-4396-a87f-1a50e372ffcb'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:17:08.517919 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-50c0b797-2f85-4e79-a518-d824fac911ad tempest-VolumesExtendTest-1429053437 None] Delete snapshot completed successfully. Jun 25 21:17:08.523414 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-50c0b797-2f85-4e79-a518-d824fac911ad tempest-VolumesExtendTest-1429053437 None] Lock "b'cinder-61322fd6-c6e7-410f-8bc7-6366ef48bf9a-delete_snapshot'" released by "delete_snapshot" :: held 1.200s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:17:09.513120 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-3bbee6e3-5ccd-4d19-94de-ecd7b80ab9f3 tempest-VolumesExtendTest-1429053437 None] Lock "b'cinder-6d117baf-f5d7-471a-9643-adfde03fe892-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:17:09.573813 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3bbee6e3-5ccd-4d19-94de-ecd7b80ab9f3 tempest-VolumesExtendTest-1429053437 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:17:09.652994 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3bbee6e3-5ccd-4d19-94de-ecd7b80ab9f3 tempest-VolumesExtendTest-1429053437 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:17:09.666938 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3bbee6e3-5ccd-4d19-94de-ecd7b80ab9f3 tempest-VolumesExtendTest-1429053437 None] Volume volume-6d117baf-f5d7-471a-9643-adfde03fe892 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:17:09.684483 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3bbee6e3-5ccd-4d19-94de-ecd7b80ab9f3 tempest-VolumesExtendTest-1429053437 None] deleting rbd volume volume-6d117baf-f5d7-471a-9643-adfde03fe892 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:17:09.998278 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-3bbee6e3-5ccd-4d19-94de-ecd7b80ab9f3 tempest-VolumesExtendTest-1429053437 None] Created reservations ['9876b853-477f-461c-9c7f-0025bc4139d4', 'fedd9156-9902-45fa-a955-acdfa6843f77', 'c74bb83a-b86f-435b-a700-6a136ab389d8', '0f9dd709-1d80-46d8-a73b-26fc9b08a814'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:17:10.050500 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3bbee6e3-5ccd-4d19-94de-ecd7b80ab9f3 tempest-VolumesExtendTest-1429053437 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:17:10.112672 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3bbee6e3-5ccd-4d19-94de-ecd7b80ab9f3 tempest-VolumesExtendTest-1429053437 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:17:10.157641 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-3bbee6e3-5ccd-4d19-94de-ecd7b80ab9f3 tempest-VolumesExtendTest-1429053437 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:17:10.165360 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-3bbee6e3-5ccd-4d19-94de-ecd7b80ab9f3 tempest-VolumesExtendTest-1429053437 None] Deleted volume successfully. Jun 25 21:17:10.181083 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-3bbee6e3-5ccd-4d19-94de-ecd7b80ab9f3 tempest-VolumesExtendTest-1429053437 None] Lock "b'cinder-6d117baf-f5d7-471a-9643-adfde03fe892-delete_volume'" released by "delete_volume" :: held 0.668s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:17:10.730151 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-4c4c7d81-ecdf-4327-be5d-9b63146b2697 tempest-VolumesExtendTest-1429053437 None] Lock "b'cinder-be2d8ae9-731d-424b-be14-7e95c2bc3c3d-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:17:10.823631 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4c4c7d81-ecdf-4327-be5d-9b63146b2697 tempest-VolumesExtendTest-1429053437 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:17:10.977934 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4c4c7d81-ecdf-4327-be5d-9b63146b2697 tempest-VolumesExtendTest-1429053437 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:17:10.992723 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4c4c7d81-ecdf-4327-be5d-9b63146b2697 tempest-VolumesExtendTest-1429053437 None] deleting rbd volume volume-be2d8ae9-731d-424b-be14-7e95c2bc3c3d {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:17:11.298966 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4c4c7d81-ecdf-4327-be5d-9b63146b2697 tempest-VolumesExtendTest-1429053437 None] volume is a clone so cleaning references {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jun 25 21:17:11.346185 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4c4c7d81-ecdf-4327-be5d-9b63146b2697 tempest-VolumesExtendTest-1429053437 None] deleting parent snapshot volume-be2d8ae9-731d-424b-be14-7e95c2bc3c3d.clone_snap {{(pid=130674) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jun 25 21:17:11.592122 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-80dad199-640a-4dcb-8f16-19e5fcc8bd5f tempest-VolumesSnapshotTestJSON-558272145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:17:11.612011 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-80dad199-640a-4dcb-8f16-19e5fcc8bd5f tempest-VolumesSnapshotTestJSON-558272145 None] Flow 'volume_create_manager' (d2a86757-27b7-4848-9e89-fccfdd87e6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:17:11.618527 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-80dad199-640a-4dcb-8f16-19e5fcc8bd5f tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8605b94-01f4-4112-a615-4a3add56728e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:17:11.646408 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-80dad199-640a-4dcb-8f16-19e5fcc8bd5f tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8605b94-01f4-4112-a615-4a3add56728e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-171443089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c02e587f-1a09-4c9f-a6d5-e94a0b4adf15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a7efe5a3d7f4380b6e1ee40d4628ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:17:12Z,use_quota=True,user_id='871c269a6b15425d8b79a6c653c56402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:17:11.653033 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-80dad199-640a-4dcb-8f16-19e5fcc8bd5f tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7f850f4-af00-47a5-98a2-1a198c232397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:17:11.659478 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-80dad199-640a-4dcb-8f16-19e5fcc8bd5f tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7f850f4-af00-47a5-98a2-1a198c232397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:17:11.665304 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-80dad199-640a-4dcb-8f16-19e5fcc8bd5f tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60d57cf9-6c02-4a12-b771-1687f921a1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:17:11.669847 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-80dad199-640a-4dcb-8f16-19e5fcc8bd5f tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60d57cf9-6c02-4a12-b771-1687f921a1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c02e587f-1a09-4c9f-a6d5-e94a0b4adf15', 'volume_name': 'volume-c02e587f-1a09-4c9f-a6d5-e94a0b4adf15', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:17:11.675408 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-80dad199-640a-4dcb-8f16-19e5fcc8bd5f tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aa27d98-56e2-49ac-80ad-c8f9813b8332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:17:11.684051 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-80dad199-640a-4dcb-8f16-19e5fcc8bd5f tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aa27d98-56e2-49ac-80ad-c8f9813b8332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:17:11.688721 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-80dad199-640a-4dcb-8f16-19e5fcc8bd5f tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01319600-1b65-4b18-8ee8-c3e9be249d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:17:11.690173 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-80dad199-640a-4dcb-8f16-19e5fcc8bd5f tempest-VolumesSnapshotTestJSON-558272145 None] Volume c02e587f-1a09-4c9f-a6d5-e94a0b4adf15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c02e587f-1a09-4c9f-a6d5-e94a0b4adf15', 'volume_size': 1} Jun 25 21:17:11.691906 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-80dad199-640a-4dcb-8f16-19e5fcc8bd5f tempest-VolumesSnapshotTestJSON-558272145 None] creating volume 'volume-c02e587f-1a09-4c9f-a6d5-e94a0b4adf15' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:17:11.693506 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-80dad199-640a-4dcb-8f16-19e5fcc8bd5f tempest-VolumesSnapshotTestJSON-558272145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:17:11.752576 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-4c4c7d81-ecdf-4327-be5d-9b63146b2697 tempest-VolumesExtendTest-1429053437 None] Created reservations ['d38064a6-11ef-4913-8c15-dc9f17b27bc5', 'e1e9f5ae-8161-419b-ae21-892298ca3066', 'c89f5017-415d-4717-8a0d-ebb9edf7c694', 'a00eb739-d867-463f-b90a-8ab389c2af99'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:17:11.829186 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-80dad199-640a-4dcb-8f16-19e5fcc8bd5f tempest-VolumesSnapshotTestJSON-558272145 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:17:11.833095 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-80dad199-640a-4dcb-8f16-19e5fcc8bd5f tempest-VolumesSnapshotTestJSON-558272145 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:17:11.846591 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-80dad199-640a-4dcb-8f16-19e5fcc8bd5f tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01319600-1b65-4b18-8ee8-c3e9be249d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c02e587f-1a09-4c9f-a6d5-e94a0b4adf15', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:17:11.856298 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-80dad199-640a-4dcb-8f16-19e5fcc8bd5f tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84d3f8bd-3e23-4057-ad56-5a8ea0c88876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:17:11.885103 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4c4c7d81-ecdf-4327-be5d-9b63146b2697 tempest-VolumesExtendTest-1429053437 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:17:12.000939 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4c4c7d81-ecdf-4327-be5d-9b63146b2697 tempest-VolumesExtendTest-1429053437 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:17:12.084175 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-4c4c7d81-ecdf-4327-be5d-9b63146b2697 tempest-VolumesExtendTest-1429053437 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:17:12.090739 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-80dad199-640a-4dcb-8f16-19e5fcc8bd5f tempest-VolumesSnapshotTestJSON-558272145 None] Volume volume-c02e587f-1a09-4c9f-a6d5-e94a0b4adf15 (c02e587f-1a09-4c9f-a6d5-e94a0b4adf15): created successfully Jun 25 21:17:12.111958 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-80dad199-640a-4dcb-8f16-19e5fcc8bd5f tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84d3f8bd-3e23-4057-ad56-5a8ea0c88876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:17:12.134228 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-80dad199-640a-4dcb-8f16-19e5fcc8bd5f tempest-VolumesSnapshotTestJSON-558272145 None] Flow 'volume_create_manager' (d2a86757-27b7-4848-9e89-fccfdd87e6f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:17:12.146680 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-4c4c7d81-ecdf-4327-be5d-9b63146b2697 tempest-VolumesExtendTest-1429053437 None] Deleted volume successfully. Jun 25 21:17:12.158267 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-80dad199-640a-4dcb-8f16-19e5fcc8bd5f tempest-VolumesSnapshotTestJSON-558272145 None] Created volume successfully. Jun 25 21:17:12.176842 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-4c4c7d81-ecdf-4327-be5d-9b63146b2697 tempest-VolumesExtendTest-1429053437 None] Lock "b'cinder-be2d8ae9-731d-424b-be14-7e95c2bc3c3d-delete_volume'" released by "delete_volume" :: held 1.447s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:17:13.025541 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1c8518bf-f5ef-46d0-afef-514a92d0a520 tempest-VolumesSnapshotTestJSON-558272145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:17:13.595799 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-1c8518bf-f5ef-46d0-afef-514a92d0a520 tempest-VolumesSnapshotTestJSON-558272145 None] Create snapshot completed successfully Jun 25 21:17:14.043439 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:UPDATE=46,cinder:SELECT=43,cinder:DELETE=4,cinder:INSERT=7 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:14.400686 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.driver [None req-a0afd1a7-1b3d-48c1-9bd3-0ba521b847b1 tempest-VolumesSnapshotTestJSON-558272145 None] Creating a new backup for volume volume-c02e587f-1a09-4c9f-a6d5-e94a0b4adf15. {{(pid=130674) _get_backup_volume_temp_volume /opt/stack/cinder/cinder/volume/driver.py:1213}} Jun 25 21:17:14.440859 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a0afd1a7-1b3d-48c1-9bd3-0ba521b847b1 tempest-VolumesSnapshotTestJSON-558272145 None] cloning volumes/volume-c02e587f-1a09-4c9f-a6d5-e94a0b4adf15@snapshot-264e4834-b428-436e-af60-51d728f36b53 to volume-5b0716f2-5cb9-4c11-a26c-622128df3b4a {{(pid=130674) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1094}} Jun 25 21:17:14.441506 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a0afd1a7-1b3d-48c1-9bd3-0ba521b847b1 tempest-VolumesSnapshotTestJSON-558272145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:17:14.514462 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a0afd1a7-1b3d-48c1-9bd3-0ba521b847b1 tempest-VolumesSnapshotTestJSON-558272145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:17:14.684881 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a0afd1a7-1b3d-48c1-9bd3-0ba521b847b1 tempest-VolumesSnapshotTestJSON-558272145 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:17:14.685263 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a0afd1a7-1b3d-48c1-9bd3-0ba521b847b1 tempest-VolumesSnapshotTestJSON-558272145 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:17:14.691930 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a0afd1a7-1b3d-48c1-9bd3-0ba521b847b1 tempest-VolumesSnapshotTestJSON-558272145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:17:14.791358 ncdv-master-1 cinder-volume[130674]: WARNING cinder.volume.drivers.rbd [None req-a0afd1a7-1b3d-48c1-9bd3-0ba521b847b1 tempest-VolumesSnapshotTestJSON-558272145 None] Not using v2 clone API, please upgrade to mimic+ and set the OSD minimum client compat version to mimic for better performance, fewer deletion issues Jun 25 21:17:14.831598 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-a0afd1a7-1b3d-48c1-9bd3-0ba521b847b1 tempest-VolumesSnapshotTestJSON-558272145 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-06-25T21:17:14Z,data_timestamp=2022-06-25T21:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Backup-224409764',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=cecdf6b3-71a8-4711-8d9e-c32d0de10e02,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='5a7efe5a3d7f4380b6e1ee40d4628ea8',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id='264e4834-b428-436e-af60-51d728f36b53',status='creating',temp_snapshot_id=None,temp_volume_id='5b0716f2-5cb9-4c11-a26c-622128df3b4a',updated_at=None,user_id='871c269a6b15425d8b79a6c653c56402',volume_id=c02e587f-1a09-4c9f-a6d5-e94a0b4adf15) Jun 25 21:17:14.833131 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.backup.rpcapi [None req-a0afd1a7-1b3d-48c1-9bd3-0ba521b847b1 tempest-VolumesSnapshotTestJSON-558272145 None] continue_backup in rpcapi backup_id cecdf6b3-71a8-4711-8d9e-c32d0de10e02 {{(pid=130674) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Jun 25 21:17:15.208709 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-a0afd1a7-1b3d-48c1-9bd3-0ba521b847b1 tempest-VolumesSnapshotTestJSON-558272145 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 21:17:15.526179 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce473453-8ad7-4490-b00a-66d459685b3b tempest-VolumesSnapshotNegativeTestJSON-1656388664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:17:15.554853 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ce473453-8ad7-4490-b00a-66d459685b3b tempest-VolumesSnapshotNegativeTestJSON-1656388664 None] Flow 'volume_create_manager' (4814625a-e7cb-466c-a2c0-d6c6bca74604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:17:15.562193 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ce473453-8ad7-4490-b00a-66d459685b3b tempest-VolumesSnapshotNegativeTestJSON-1656388664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df923ad5-3b6d-4c18-b820-f4df9c507011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:17:15.584174 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ce473453-8ad7-4490-b00a-66d459685b3b tempest-VolumesSnapshotNegativeTestJSON-1656388664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df923ad5-3b6d-4c18-b820-f4df9c507011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1699815369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=67fe06b4-ded9-4303-8c15-a0b57006bedd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f38a9584ed44c0d99279ad9953e4f4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:17:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:17:15Z,use_quota=True,user_id='ea017638ef5b4335bbb2ef657217d7bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:17:15.589514 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ce473453-8ad7-4490-b00a-66d459685b3b tempest-VolumesSnapshotNegativeTestJSON-1656388664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6de126b4-51f3-464e-a760-fd832bb14164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:17:15.594234 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ce473453-8ad7-4490-b00a-66d459685b3b tempest-VolumesSnapshotNegativeTestJSON-1656388664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6de126b4-51f3-464e-a760-fd832bb14164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:17:15.599749 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ce473453-8ad7-4490-b00a-66d459685b3b tempest-VolumesSnapshotNegativeTestJSON-1656388664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abaa5335-6626-4069-bbf2-abe9f4e57baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:17:15.605013 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ce473453-8ad7-4490-b00a-66d459685b3b tempest-VolumesSnapshotNegativeTestJSON-1656388664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abaa5335-6626-4069-bbf2-abe9f4e57baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67fe06b4-ded9-4303-8c15-a0b57006bedd', 'volume_name': 'volume-67fe06b4-ded9-4303-8c15-a0b57006bedd', 'volume_size': 2}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:17:15.615147 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ce473453-8ad7-4490-b00a-66d459685b3b tempest-VolumesSnapshotNegativeTestJSON-1656388664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c1fba19-c489-4042-987f-7f1c4cf55132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:17:15.619251 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ce473453-8ad7-4490-b00a-66d459685b3b tempest-VolumesSnapshotNegativeTestJSON-1656388664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c1fba19-c489-4042-987f-7f1c4cf55132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:17:15.624569 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ce473453-8ad7-4490-b00a-66d459685b3b tempest-VolumesSnapshotNegativeTestJSON-1656388664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e132009a-2d32-44e4-b745-64ad0ee68e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:17:15.626032 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-ce473453-8ad7-4490-b00a-66d459685b3b tempest-VolumesSnapshotNegativeTestJSON-1656388664 None] Volume 67fe06b4-ded9-4303-8c15-a0b57006bedd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67fe06b4-ded9-4303-8c15-a0b57006bedd', 'volume_size': 2} Jun 25 21:17:15.626607 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ce473453-8ad7-4490-b00a-66d459685b3b tempest-VolumesSnapshotNegativeTestJSON-1656388664 None] creating volume 'volume-67fe06b4-ded9-4303-8c15-a0b57006bedd' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:17:15.627964 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ce473453-8ad7-4490-b00a-66d459685b3b tempest-VolumesSnapshotNegativeTestJSON-1656388664 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:17:15.731046 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ce473453-8ad7-4490-b00a-66d459685b3b tempest-VolumesSnapshotNegativeTestJSON-1656388664 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:17:15.731856 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ce473453-8ad7-4490-b00a-66d459685b3b tempest-VolumesSnapshotNegativeTestJSON-1656388664 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:17:15.740310 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ce473453-8ad7-4490-b00a-66d459685b3b tempest-VolumesSnapshotNegativeTestJSON-1656388664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e132009a-2d32-44e4-b745-64ad0ee68e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67fe06b4-ded9-4303-8c15-a0b57006bedd', 'volume_size': 2}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:17:15.748286 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ce473453-8ad7-4490-b00a-66d459685b3b tempest-VolumesSnapshotNegativeTestJSON-1656388664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (774c7684-dbef-45ae-92e1-7264dedd63c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:17:15.770285 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-ce473453-8ad7-4490-b00a-66d459685b3b tempest-VolumesSnapshotNegativeTestJSON-1656388664 None] Volume volume-67fe06b4-ded9-4303-8c15-a0b57006bedd (67fe06b4-ded9-4303-8c15-a0b57006bedd): created successfully Jun 25 21:17:15.774746 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ce473453-8ad7-4490-b00a-66d459685b3b tempest-VolumesSnapshotNegativeTestJSON-1656388664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (774c7684-dbef-45ae-92e1-7264dedd63c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:17:15.786510 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ce473453-8ad7-4490-b00a-66d459685b3b tempest-VolumesSnapshotNegativeTestJSON-1656388664 None] Flow 'volume_create_manager' (4814625a-e7cb-466c-a2c0-d6c6bca74604) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:17:15.807810 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-ce473453-8ad7-4490-b00a-66d459685b3b tempest-VolumesSnapshotNegativeTestJSON-1656388664 None] Created volume successfully. Jun 25 21:17:16.527798 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-a0afd1a7-1b3d-48c1-9bd3-0ba521b847b1 tempest-VolumesSnapshotTestJSON-558272145 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.318s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 21:17:16.530211 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a0afd1a7-1b3d-48c1-9bd3-0ba521b847b1 tempest-VolumesSnapshotTestJSON-558272145 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-5b0716f2-5cb9-4c11-a26c-622128df3b4a', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': '5b0716f2-5cb9-4c11-a26c-622128df3b4a', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 21:17:16.552689 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-a0afd1a7-1b3d-48c1-9bd3-0ba521b847b1 tempest-VolumesSnapshotTestJSON-558272145 None] Initialize volume connection completed successfully. Jun 25 21:17:16.963075 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-03637863-9f30-4568-8e48-82f83ad26e01 tempest-VolumesSnapshotNegativeTestJSON-1656388664 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:17:17.411983 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-03637863-9f30-4568-8e48-82f83ad26e01 tempest-VolumesSnapshotNegativeTestJSON-1656388664 None] Create snapshot completed successfully Jun 25 21:17:18.280307 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-d5dd81b9-b6b0-445b-a15c-7ec7d42fda05 tempest-VolumesSnapshotNegativeTestJSON-1656388664 None] Lock "b'cinder-3d9872dd-3ed4-4d2c-914a-aa0965cce461-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.013s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:17:18.282185 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d5dd81b9-b6b0-445b-a15c-7ec7d42fda05 tempest-VolumesSnapshotNegativeTestJSON-1656388664 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:17:19.540655 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=72,cinder:UPDATE=19,cinder:INSERT=7,cinder:DELETE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:19.550344 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-d5dd81b9-b6b0-445b-a15c-7ec7d42fda05 tempest-VolumesSnapshotNegativeTestJSON-1656388664 None] Created reservations ['5eb163a3-ee2b-4912-8b3b-f8d5f91fd1eb', '870957ec-bd39-4501-b193-562b048cd88b', 'f12140f6-fe23-48e2-83cb-db366cb6640a', 'b706f555-f167-4aa4-8162-33c38a422b65'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:17:19.603500 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-d5dd81b9-b6b0-445b-a15c-7ec7d42fda05 tempest-VolumesSnapshotNegativeTestJSON-1656388664 None] Delete snapshot completed successfully. Jun 25 21:17:19.612668 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-d5dd81b9-b6b0-445b-a15c-7ec7d42fda05 tempest-VolumesSnapshotNegativeTestJSON-1656388664 None] Lock "b'cinder-3d9872dd-3ed4-4d2c-914a-aa0965cce461-delete_snapshot'" released by "delete_snapshot" :: held 1.334s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:17:20.533675 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-673b806e-4108-4ccf-8871-2a2df931410f tempest-VolumesSnapshotNegativeTestJSON-1656388664 None] Lock "b'cinder-67fe06b4-ded9-4303-8c15-a0b57006bedd-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:17:20.654981 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-673b806e-4108-4ccf-8871-2a2df931410f tempest-VolumesSnapshotNegativeTestJSON-1656388664 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:17:20.845706 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-673b806e-4108-4ccf-8871-2a2df931410f tempest-VolumesSnapshotNegativeTestJSON-1656388664 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:17:20.846320 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-673b806e-4108-4ccf-8871-2a2df931410f tempest-VolumesSnapshotNegativeTestJSON-1656388664 None] Volume volume-67fe06b4-ded9-4303-8c15-a0b57006bedd is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:17:20.898721 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-673b806e-4108-4ccf-8871-2a2df931410f tempest-VolumesSnapshotNegativeTestJSON-1656388664 None] deleting rbd volume volume-67fe06b4-ded9-4303-8c15-a0b57006bedd {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:17:21.403363 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-673b806e-4108-4ccf-8871-2a2df931410f tempest-VolumesSnapshotNegativeTestJSON-1656388664 None] Created reservations ['e384eede-05af-4218-bca8-2e03a8822613', 'd4ff6a37-6b67-4833-937e-7c521be4efa5', 'e091d00a-62f4-4ed3-a125-9f8427f71bc7', 'c8d6f67a-89ed-4e29-bee9-2cc5e9bcdc24'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:17:21.452478 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-673b806e-4108-4ccf-8871-2a2df931410f tempest-VolumesSnapshotNegativeTestJSON-1656388664 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:17:21.523806 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-673b806e-4108-4ccf-8871-2a2df931410f tempest-VolumesSnapshotNegativeTestJSON-1656388664 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:17:21.592848 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-673b806e-4108-4ccf-8871-2a2df931410f tempest-VolumesSnapshotNegativeTestJSON-1656388664 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:17:21.609744 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-673b806e-4108-4ccf-8871-2a2df931410f tempest-VolumesSnapshotNegativeTestJSON-1656388664 None] Deleted volume successfully. Jun 25 21:17:21.649078 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-673b806e-4108-4ccf-8871-2a2df931410f tempest-VolumesSnapshotNegativeTestJSON-1656388664 None] Lock "b'cinder-67fe06b4-ded9-4303-8c15-a0b57006bedd-delete_volume'" released by "delete_volume" :: held 1.113s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:17:28.959184 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-a0afd1a7-1b3d-48c1-9bd3-0ba521b847b1 tempest-VolumesSnapshotTestJSON-558272145 None] Terminate volume connection completed successfully. Jun 25 21:17:28.989163 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-a0afd1a7-1b3d-48c1-9bd3-0ba521b847b1 tempest-VolumesSnapshotTestJSON-558272145 None] Remove volume export completed successfully. Jun 25 21:17:29.035655 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-a0afd1a7-1b3d-48c1-9bd3-0ba521b847b1 tempest-VolumesSnapshotTestJSON-558272145 None] Lock "b'cinder-5b0716f2-5cb9-4c11-a26c-622128df3b4a-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:17:29.053285 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a0afd1a7-1b3d-48c1-9bd3-0ba521b847b1 tempest-VolumesSnapshotTestJSON-558272145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:17:29.140556 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a0afd1a7-1b3d-48c1-9bd3-0ba521b847b1 tempest-VolumesSnapshotTestJSON-558272145 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:17:29.151307 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a0afd1a7-1b3d-48c1-9bd3-0ba521b847b1 tempest-VolumesSnapshotTestJSON-558272145 None] deleting rbd volume volume-5b0716f2-5cb9-4c11-a26c-622128df3b4a {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:17:29.463136 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-a0afd1a7-1b3d-48c1-9bd3-0ba521b847b1 tempest-VolumesSnapshotTestJSON-558272145 None] Deleted volume successfully. Jun 25 21:17:29.469770 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-a0afd1a7-1b3d-48c1-9bd3-0ba521b847b1 tempest-VolumesSnapshotTestJSON-558272145 None] Lock "b'cinder-5b0716f2-5cb9-4c11-a26c-622128df3b4a-delete_volume'" released by "delete_volume" :: held 0.434s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:17:35.789297 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-6153c1e5-4211-4cbf-ac99-535e0d4aa7ab tempest-AttachVolumeShelveTestJSON-967589539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:17:35.813372 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6153c1e5-4211-4cbf-ac99-535e0d4aa7ab tempest-AttachVolumeShelveTestJSON-967589539 None] Flow 'volume_create_manager' (ee06a2dc-bbeb-41cb-a7ef-31e751d4d283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:17:35.823364 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6153c1e5-4211-4cbf-ac99-535e0d4aa7ab tempest-AttachVolumeShelveTestJSON-967589539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (363dd4ca-f9c1-49b5-872e-acf750e0b604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:17:35.840561 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6153c1e5-4211-4cbf-ac99-535e0d4aa7ab tempest-AttachVolumeShelveTestJSON-967589539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (363dd4ca-f9c1-49b5-872e-acf750e0b604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:17:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-301077908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d0d28785-d076-4b06-b8c8-1d55430a8bed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='041615c7a84b47f88e21c6a4e19dd7ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:17:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:17:36Z,use_quota=True,user_id='c845f86f1b6244f7a53996329294f2cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:17:35.846406 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6153c1e5-4211-4cbf-ac99-535e0d4aa7ab tempest-AttachVolumeShelveTestJSON-967589539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22dc71d4-0d21-40d2-9640-d0f27cf6ed5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:17:35.850769 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6153c1e5-4211-4cbf-ac99-535e0d4aa7ab tempest-AttachVolumeShelveTestJSON-967589539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22dc71d4-0d21-40d2-9640-d0f27cf6ed5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:17:35.855964 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6153c1e5-4211-4cbf-ac99-535e0d4aa7ab tempest-AttachVolumeShelveTestJSON-967589539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85af2f33-1d85-486f-8df7-58b366383fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:17:35.861301 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6153c1e5-4211-4cbf-ac99-535e0d4aa7ab tempest-AttachVolumeShelveTestJSON-967589539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85af2f33-1d85-486f-8df7-58b366383fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0d28785-d076-4b06-b8c8-1d55430a8bed', 'volume_name': 'volume-d0d28785-d076-4b06-b8c8-1d55430a8bed', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:17:35.866714 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6153c1e5-4211-4cbf-ac99-535e0d4aa7ab tempest-AttachVolumeShelveTestJSON-967589539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a764230-d05a-4b7b-bf15-1751bf1b267d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:17:35.870928 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6153c1e5-4211-4cbf-ac99-535e0d4aa7ab tempest-AttachVolumeShelveTestJSON-967589539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a764230-d05a-4b7b-bf15-1751bf1b267d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:17:35.875535 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6153c1e5-4211-4cbf-ac99-535e0d4aa7ab tempest-AttachVolumeShelveTestJSON-967589539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8d3e4b8-a94c-4984-aff2-5c2d2945d595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:17:35.877033 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-6153c1e5-4211-4cbf-ac99-535e0d4aa7ab tempest-AttachVolumeShelveTestJSON-967589539 None] Volume d0d28785-d076-4b06-b8c8-1d55430a8bed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0d28785-d076-4b06-b8c8-1d55430a8bed', 'volume_size': 1} Jun 25 21:17:35.877649 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6153c1e5-4211-4cbf-ac99-535e0d4aa7ab tempest-AttachVolumeShelveTestJSON-967589539 None] creating volume 'volume-d0d28785-d076-4b06-b8c8-1d55430a8bed' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:17:35.878599 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6153c1e5-4211-4cbf-ac99-535e0d4aa7ab tempest-AttachVolumeShelveTestJSON-967589539 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:17:35.973239 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6153c1e5-4211-4cbf-ac99-535e0d4aa7ab tempest-AttachVolumeShelveTestJSON-967589539 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:17:35.973833 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6153c1e5-4211-4cbf-ac99-535e0d4aa7ab tempest-AttachVolumeShelveTestJSON-967589539 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:17:35.977835 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6153c1e5-4211-4cbf-ac99-535e0d4aa7ab tempest-AttachVolumeShelveTestJSON-967589539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8d3e4b8-a94c-4984-aff2-5c2d2945d595) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0d28785-d076-4b06-b8c8-1d55430a8bed', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:17:35.983757 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6153c1e5-4211-4cbf-ac99-535e0d4aa7ab tempest-AttachVolumeShelveTestJSON-967589539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f4c1ce4-00c4-48c9-bf3f-f1ef5250b85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:17:35.994916 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-6153c1e5-4211-4cbf-ac99-535e0d4aa7ab tempest-AttachVolumeShelveTestJSON-967589539 None] Volume volume-d0d28785-d076-4b06-b8c8-1d55430a8bed (d0d28785-d076-4b06-b8c8-1d55430a8bed): created successfully Jun 25 21:17:36.002712 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6153c1e5-4211-4cbf-ac99-535e0d4aa7ab tempest-AttachVolumeShelveTestJSON-967589539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f4c1ce4-00c4-48c9-bf3f-f1ef5250b85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:17:36.014429 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-6153c1e5-4211-4cbf-ac99-535e0d4aa7ab tempest-AttachVolumeShelveTestJSON-967589539 None] Flow 'volume_create_manager' (ee06a2dc-bbeb-41cb-a7ef-31e751d4d283) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:17:36.029192 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-6153c1e5-4211-4cbf-ac99-535e0d4aa7ab tempest-AttachVolumeShelveTestJSON-967589539 None] Created volume successfully. Jun 25 21:17:47.318188 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=54,cinder:INSERT=6,cinder:UPDATE=23,cinder:DELETE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:47.338157 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-cae3b049-75f8-4199-b206-6092580eb482 tempest-VolumesSnapshotTestJSON-558272145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:17:47.359150 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cae3b049-75f8-4199-b206-6092580eb482 tempest-VolumesSnapshotTestJSON-558272145 None] Flow 'volume_create_manager' (a2a9a24c-d396-4ceb-a098-bbc851a46592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:17:47.366019 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cae3b049-75f8-4199-b206-6092580eb482 tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (048640d2-69bf-44f2-a233-dcafebaa52b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:17:47.384595 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cae3b049-75f8-4199-b206-6092580eb482 tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (048640d2-69bf-44f2-a233-dcafebaa52b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2065837769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1b95a180-0d11-4045-88c2-16d087818925,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a7efe5a3d7f4380b6e1ee40d4628ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:17:47Z,use_quota=True,user_id='871c269a6b15425d8b79a6c653c56402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:17:47.389964 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cae3b049-75f8-4199-b206-6092580eb482 tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbbf5071-6193-4892-8452-f4a61339b195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:17:47.394289 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cae3b049-75f8-4199-b206-6092580eb482 tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbbf5071-6193-4892-8452-f4a61339b195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:17:47.399689 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cae3b049-75f8-4199-b206-6092580eb482 tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d11eaca-080d-4873-979d-a0df37bf1db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:17:47.491506 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cae3b049-75f8-4199-b206-6092580eb482 tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d11eaca-080d-4873-979d-a0df37bf1db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1b95a180-0d11-4045-88c2-16d087818925', 'volume_name': 'volume-1b95a180-0d11-4045-88c2-16d087818925', 'volume_size': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d98522b7634403f83ff66fd72edfd9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'created_at': datetime.datetime(2022, 6, 25, 20, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5741eca-b932-4865-b29a-bd2a12a73795/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:17:47.503142 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cae3b049-75f8-4199-b206-6092580eb482 tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c45a28d3-0ebb-437c-92b7-0c88ab488a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:17:47.508082 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cae3b049-75f8-4199-b206-6092580eb482 tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c45a28d3-0ebb-437c-92b7-0c88ab488a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:17:47.512883 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cae3b049-75f8-4199-b206-6092580eb482 tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeeff450-5532-425a-af3d-b8668f479b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:17:47.514001 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-cae3b049-75f8-4199-b206-6092580eb482 tempest-VolumesSnapshotTestJSON-558272145 None] Volume 1b95a180-0d11-4045-88c2-16d087818925: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1b95a180-0d11-4045-88c2-16d087818925', 'volume_size': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d98522b7634403f83ff66fd72edfd9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'created_at': datetime.datetime(2022, 6, 25, 20, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5741eca-b932-4865-b29a-bd2a12a73795/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 25 21:17:47.514571 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-cae3b049-75f8-4199-b206-6092580eb482 tempest-VolumesSnapshotTestJSON-558272145 None] Cloning 1b95a180-0d11-4045-88c2-16d087818925 from image c5741eca-b932-4865-b29a-bd2a12a73795 at location (None, None). {{(pid=130674) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1062}} Jun 25 21:17:47.540501 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-cae3b049-75f8-4199-b206-6092580eb482 tempest-VolumesSnapshotTestJSON-558272145 None] Lock "b'cinder-c5741eca-b932-4865-b29a-bd2a12a73795'" acquired by "_prepare_image_cache_entry" :: waited 0.025s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:17:47.550538 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-cae3b049-75f8-4199-b206-6092580eb482 tempest-VolumesSnapshotTestJSON-558272145 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'volume_id': 'c8878629-87cd-43d0-b2bd-d32c807cd322', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53), 'last_used': datetime.datetime(2022, 6, 25, 21, 17, 47, 545161)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 25 21:17:47.551133 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-cae3b049-75f8-4199-b206-6092580eb482 tempest-VolumesSnapshotTestJSON-558272145 None] Image-volume cache entry image_update_at = 2022-06-25 20:42:53+00:00, requested image updated_at = 2022-06-25 20:42:53+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 25 21:17:47.551527 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-cae3b049-75f8-4199-b206-6092580eb482 tempest-VolumesSnapshotTestJSON-558272145 None] Found cache entry for image = c5741eca-b932-4865-b29a-bd2a12a73795 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:877}} Jun 25 21:17:47.555436 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-cae3b049-75f8-4199-b206-6092580eb482 tempest-VolumesSnapshotTestJSON-558272145 None] Lock "b'cinder-c5741eca-b932-4865-b29a-bd2a12a73795'" released by "_prepare_image_cache_entry" :: held 0.015s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:17:47.556451 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-cae3b049-75f8-4199-b206-6092580eb482 tempest-VolumesSnapshotTestJSON-558272145 None] Attempting to retrieve cache entry for image = c5741eca-b932-4865-b29a-bd2a12a73795 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:818}} Jun 25 21:17:47.562054 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-cae3b049-75f8-4199-b206-6092580eb482 tempest-VolumesSnapshotTestJSON-558272145 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'volume_id': 'c8878629-87cd-43d0-b2bd-d32c807cd322', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53), 'last_used': datetime.datetime(2022, 6, 25, 21, 17, 47, 559760)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 25 21:17:47.562441 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-cae3b049-75f8-4199-b206-6092580eb482 tempest-VolumesSnapshotTestJSON-558272145 None] Image-volume cache entry image_update_at = 2022-06-25 20:42:53+00:00, requested image updated_at = 2022-06-25 20:42:53+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 25 21:17:47.562833 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-cae3b049-75f8-4199-b206-6092580eb482 tempest-VolumesSnapshotTestJSON-558272145 None] Creating from source image-volume c8878629-87cd-43d0-b2bd-d32c807cd322 {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:832}} Jun 25 21:17:47.576872 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cae3b049-75f8-4199-b206-6092580eb482 tempest-VolumesSnapshotTestJSON-558272145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:17:47.630681 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cae3b049-75f8-4199-b206-6092580eb482 tempest-VolumesSnapshotTestJSON-558272145 None] creating snapshot='volume-1b95a180-0d11-4045-88c2-16d087818925.clone_snap' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jun 25 21:17:48.366250 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cae3b049-75f8-4199-b206-6092580eb482 tempest-VolumesSnapshotTestJSON-558272145 None] cloning 'volume-c8878629-87cd-43d0-b2bd-d32c807cd322@volume-1b95a180-0d11-4045-88c2-16d087818925.clone_snap' to 'volume-1b95a180-0d11-4045-88c2-16d087818925' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jun 25 21:17:48.499321 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cae3b049-75f8-4199-b206-6092580eb482 tempest-VolumesSnapshotTestJSON-558272145 None] Volume volume-74f093be-e96a-4a80-ad38-abd3f5585611.deleted is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:17:48.500439 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cae3b049-75f8-4199-b206-6092580eb482 tempest-VolumesSnapshotTestJSON-558272145 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:17:48.500818 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cae3b049-75f8-4199-b206-6092580eb482 tempest-VolumesSnapshotTestJSON-558272145 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:17:48.524293 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cae3b049-75f8-4199-b206-6092580eb482 tempest-VolumesSnapshotTestJSON-558272145 None] clone created successfully {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jun 25 21:17:48.524857 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.volume_utils [None req-cae3b049-75f8-4199-b206-6092580eb482 tempest-VolumesSnapshotTestJSON-558272145 None] Marking volume 1b95a180-0d11-4045-88c2-16d087818925 as bootable. {{(pid=130674) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 25 21:17:48.533651 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-cae3b049-75f8-4199-b206-6092580eb482 tempest-VolumesSnapshotTestJSON-558272145 None] Copying metadata from image c5741eca-b932-4865-b29a-bd2a12a73795 to 1b95a180-0d11-4045-88c2-16d087818925. {{(pid=130674) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jun 25 21:17:48.534081 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-cae3b049-75f8-4199-b206-6092580eb482 tempest-VolumesSnapshotTestJSON-558272145 None] Creating volume glance metadata for volume 1b95a180-0d11-4045-88c2-16d087818925 backed by image c5741eca-b932-4865-b29a-bd2a12a73795 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=130674) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:674}} Jun 25 21:17:48.585487 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cae3b049-75f8-4199-b206-6092580eb482 tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeeff450-5532-425a-af3d-b8668f479b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b95a180-0d11-4045-88c2-16d087818925', 'volume_size': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d98522b7634403f83ff66fd72edfd9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'created_at': datetime.datetime(2022, 6, 25, 20, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5741eca-b932-4865-b29a-bd2a12a73795/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:17:48.590128 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cae3b049-75f8-4199-b206-6092580eb482 tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04068321-0299-4fdb-ac2a-6ef4d5c34dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:17:48.599456 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-cae3b049-75f8-4199-b206-6092580eb482 tempest-VolumesSnapshotTestJSON-558272145 None] Volume volume-1b95a180-0d11-4045-88c2-16d087818925 (1b95a180-0d11-4045-88c2-16d087818925): created successfully Jun 25 21:17:48.603083 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cae3b049-75f8-4199-b206-6092580eb482 tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04068321-0299-4fdb-ac2a-6ef4d5c34dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:17:48.608893 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cae3b049-75f8-4199-b206-6092580eb482 tempest-VolumesSnapshotTestJSON-558272145 None] Flow 'volume_create_manager' (a2a9a24c-d396-4ceb-a098-bbc851a46592) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:17:48.617582 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-cae3b049-75f8-4199-b206-6092580eb482 tempest-VolumesSnapshotTestJSON-558272145 None] Created volume successfully. Jun 25 21:17:50.067724 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-8c4008e7-b210-47a3-a0ab-54c96da75a97 req-9042cece-b170-4342-9ec4-ae19cf7a99a7 tempest-VolumesSnapshotTestJSON-558272145 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 21:17:50.809776 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-8c4008e7-b210-47a3-a0ab-54c96da75a97 req-9042cece-b170-4342-9ec4-ae19cf7a99a7 tempest-VolumesSnapshotTestJSON-558272145 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.742s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 21:17:50.810627 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-8c4008e7-b210-47a3-a0ab-54c96da75a97 req-9042cece-b170-4342-9ec4-ae19cf7a99a7 tempest-VolumesSnapshotTestJSON-558272145 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1b95a180-0d11-4045-88c2-16d087818925', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': '1b95a180-0d11-4045-88c2-16d087818925', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 21:17:50.816923 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=41,cinder:UPDATE=24,cinder:INSERT=9,cinder:DELETE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:50.847919 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-8c4008e7-b210-47a3-a0ab-54c96da75a97 req-9042cece-b170-4342-9ec4-ae19cf7a99a7 tempest-VolumesSnapshotTestJSON-558272145 None] Connection info returned from driver {'name': 'volumes/volume-1b95a180-0d11-4045-88c2-16d087818925', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1b95a180-0d11-4045-88c2-16d087818925', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '7dbc10cf-8fa1-4b02-b32c-024c4efb5923'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 25 21:17:50.896135 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-8c4008e7-b210-47a3-a0ab-54c96da75a97 req-9042cece-b170-4342-9ec4-ae19cf7a99a7 tempest-VolumesSnapshotTestJSON-558272145 None] attachment_update completed successfully. Jun 25 21:17:52.150988 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:17:52.152761 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:17:52.204562 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:17:52.240396 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:17:54.448708 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ba227804-eee9-45cc-91ce-681f8091004d tempest-VolumesSnapshotTestJSON-558272145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:17:55.690137 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-ba227804-eee9-45cc-91ce-681f8091004d tempest-VolumesSnapshotTestJSON-558272145 None] Create snapshot completed successfully Jun 25 21:17:56.720335 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d466c885-85d8-4113-95da-18473ba74467 tempest-VolumesSnapshotTestJSON-558272145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:17:57.714995 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-d466c885-85d8-4113-95da-18473ba74467 tempest-VolumesSnapshotTestJSON-558272145 None] Create snapshot completed successfully Jun 25 21:17:59.169901 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f08bd1e1-8e5e-4b59-95a2-b7c6e8d32794 tempest-VolumesSnapshotTestJSON-558272145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:17:59.864254 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-f08bd1e1-8e5e-4b59-95a2-b7c6e8d32794 tempest-VolumesSnapshotTestJSON-558272145 None] Create snapshot completed successfully Jun 25 21:18:00.288871 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-5536e5fd-6b8c-474d-a6a1-273ab19821a3 tempest-VolumesSnapshotTestJSON-558272145 None] Lock "b'cinder-12ce494e-03fe-45f5-82e2-273d3885a77d-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.016s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:18:00.291214 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5536e5fd-6b8c-474d-a6a1-273ab19821a3 tempest-VolumesSnapshotTestJSON-558272145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:18:09.374596 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-54a3b70e-a9fe-4da3-806a-701c67a2b194 req-0829e332-3bbc-4a6c-ba5d-f090aed93206 tempest-AttachVolumeNegativeTest-2001135405 None] Terminate volume connection completed successfully. Jun 25 21:18:09.377243 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-54a3b70e-a9fe-4da3-806a-701c67a2b194 req-0829e332-3bbc-4a6c-ba5d-f090aed93206 tempest-AttachVolumeNegativeTest-2001135405 None] Deleting attachment f7602843-66f5-4523-b6a6-82022c1b62c2. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 25 21:18:18.713891 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=62,cinder:UPDATE=11,cinder:INSERT=24,cinder:DELETE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:18.723878 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-f9695ccd-6e23-45e8-8204-3f2ceba93499 req-6ce6b8c6-9927-4fc0-ad8c-27040955369a tempest-AttachVolumeShelveTestJSON-967589539 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 21:18:19.697820 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-f9695ccd-6e23-45e8-8204-3f2ceba93499 req-6ce6b8c6-9927-4fc0-ad8c-27040955369a tempest-AttachVolumeShelveTestJSON-967589539 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.974s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 21:18:19.698714 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-f9695ccd-6e23-45e8-8204-3f2ceba93499 req-6ce6b8c6-9927-4fc0-ad8c-27040955369a tempest-AttachVolumeShelveTestJSON-967589539 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d0d28785-d076-4b06-b8c8-1d55430a8bed', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': 'd0d28785-d076-4b06-b8c8-1d55430a8bed', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 21:18:19.728316 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-f9695ccd-6e23-45e8-8204-3f2ceba93499 req-6ce6b8c6-9927-4fc0-ad8c-27040955369a tempest-AttachVolumeShelveTestJSON-967589539 None] Connection info returned from driver {'name': 'volumes/volume-d0d28785-d076-4b06-b8c8-1d55430a8bed', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd0d28785-d076-4b06-b8c8-1d55430a8bed', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '13dca793-accb-4f46-9a1e-308893a13061'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 25 21:18:19.829505 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-f9695ccd-6e23-45e8-8204-3f2ceba93499 req-6ce6b8c6-9927-4fc0-ad8c-27040955369a tempest-AttachVolumeShelveTestJSON-967589539 None] attachment_update completed successfully. Jun 25 21:18:24.046594 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:UPDATE=5,cinder:SELECT=46,cinder:INSERT=17,cinder:DELETE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:30.607582 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-5536e5fd-6b8c-474d-a6a1-273ab19821a3 tempest-VolumesSnapshotTestJSON-558272145 None] Created reservations ['9373e017-17db-4fee-8c69-d7f05fb2857a', '6ce67b07-6fc5-4740-9134-2e9e12c2351e', '8edfba5d-18cf-49f0-8e1a-4bb0d9200c1a', '1aed2477-131d-4883-a36e-407bc8bf17f3'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:18:30.685308 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-5536e5fd-6b8c-474d-a6a1-273ab19821a3 tempest-VolumesSnapshotTestJSON-558272145 None] Delete snapshot completed successfully. Jun 25 21:18:30.691877 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-5536e5fd-6b8c-474d-a6a1-273ab19821a3 tempest-VolumesSnapshotTestJSON-558272145 None] Lock "b'cinder-12ce494e-03fe-45f5-82e2-273d3885a77d-delete_snapshot'" released by "delete_snapshot" :: held 30.403s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:18:31.025789 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-e9168f51-2710-4771-8ecc-12108da0b9b8 tempest-VolumesSnapshotTestJSON-558272145 None] Lock "b'cinder-ce6df970-cf45-4f31-9c4c-826cd8239a1e-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.021s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:18:31.028025 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e9168f51-2710-4771-8ecc-12108da0b9b8 tempest-VolumesSnapshotTestJSON-558272145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:18:52.156180 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:18:52.157566 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:18:52.222213 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:18:52.303048 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:18:54.055076 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=23,cinder:UPDATE=4,cinder:INSERT=4 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:55.475804 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=16,cinder:UPDATE=13 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:55.492065 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-34f5f0d9-4edf-4b10-84b0-9d93fe9a7478 tempest-VolumesTestJSON-1491296260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:18:55.512914 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-34f5f0d9-4edf-4b10-84b0-9d93fe9a7478 tempest-VolumesTestJSON-1491296260 None] Flow 'volume_create_manager' (cf7921ff-4314-4929-9159-98af79429e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:18:55.519133 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-34f5f0d9-4edf-4b10-84b0-9d93fe9a7478 tempest-VolumesTestJSON-1491296260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0121a6a0-ed2d-4c7c-8a88-e04e5a915b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:18:55.535949 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-34f5f0d9-4edf-4b10-84b0-9d93fe9a7478 tempest-VolumesTestJSON-1491296260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0121a6a0-ed2d-4c7c-8a88-e04e5a915b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1025077278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3b8fadb5-427f-48f5-bb04-af450db01a04,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='675ab7469dbb421eb3a598e7439bca65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:18:55Z,use_quota=True,user_id='579aac7a3fbe41fea6323681f07e8fc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:18:55.541227 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-34f5f0d9-4edf-4b10-84b0-9d93fe9a7478 tempest-VolumesTestJSON-1491296260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (804dde14-6e6c-4a49-9eae-da4c60b9b977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:18:55.545805 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-34f5f0d9-4edf-4b10-84b0-9d93fe9a7478 tempest-VolumesTestJSON-1491296260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (804dde14-6e6c-4a49-9eae-da4c60b9b977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:18:55.551169 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-34f5f0d9-4edf-4b10-84b0-9d93fe9a7478 tempest-VolumesTestJSON-1491296260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64eca4a9-7206-4f96-84d9-8a8cb2124503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:18:55.555207 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-34f5f0d9-4edf-4b10-84b0-9d93fe9a7478 tempest-VolumesTestJSON-1491296260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64eca4a9-7206-4f96-84d9-8a8cb2124503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b8fadb5-427f-48f5-bb04-af450db01a04', 'volume_name': 'volume-3b8fadb5-427f-48f5-bb04-af450db01a04', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:18:55.561854 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-34f5f0d9-4edf-4b10-84b0-9d93fe9a7478 tempest-VolumesTestJSON-1491296260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af15518e-f2cb-4867-8a71-91fbb72f16ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:18:55.565670 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-34f5f0d9-4edf-4b10-84b0-9d93fe9a7478 tempest-VolumesTestJSON-1491296260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af15518e-f2cb-4867-8a71-91fbb72f16ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:18:55.571558 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-34f5f0d9-4edf-4b10-84b0-9d93fe9a7478 tempest-VolumesTestJSON-1491296260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7bbe91e-fd61-4739-8e10-c7f0571468c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:18:55.572698 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-34f5f0d9-4edf-4b10-84b0-9d93fe9a7478 tempest-VolumesTestJSON-1491296260 None] Volume 3b8fadb5-427f-48f5-bb04-af450db01a04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b8fadb5-427f-48f5-bb04-af450db01a04', 'volume_size': 1} Jun 25 21:18:55.573102 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-34f5f0d9-4edf-4b10-84b0-9d93fe9a7478 tempest-VolumesTestJSON-1491296260 None] creating volume 'volume-3b8fadb5-427f-48f5-bb04-af450db01a04' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:18:55.573882 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-34f5f0d9-4edf-4b10-84b0-9d93fe9a7478 tempest-VolumesTestJSON-1491296260 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:18:55.646072 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-34f5f0d9-4edf-4b10-84b0-9d93fe9a7478 tempest-VolumesTestJSON-1491296260 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:18:55.646422 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-34f5f0d9-4edf-4b10-84b0-9d93fe9a7478 tempest-VolumesTestJSON-1491296260 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:18:55.651049 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-34f5f0d9-4edf-4b10-84b0-9d93fe9a7478 tempest-VolumesTestJSON-1491296260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7bbe91e-fd61-4739-8e10-c7f0571468c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b8fadb5-427f-48f5-bb04-af450db01a04', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:18:55.656202 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-34f5f0d9-4edf-4b10-84b0-9d93fe9a7478 tempest-VolumesTestJSON-1491296260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aa9157e-f9d5-4ad5-9ccb-d8aab3e1f088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:18:55.667107 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-34f5f0d9-4edf-4b10-84b0-9d93fe9a7478 tempest-VolumesTestJSON-1491296260 None] Volume volume-3b8fadb5-427f-48f5-bb04-af450db01a04 (3b8fadb5-427f-48f5-bb04-af450db01a04): created successfully Jun 25 21:18:55.674414 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-34f5f0d9-4edf-4b10-84b0-9d93fe9a7478 tempest-VolumesTestJSON-1491296260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aa9157e-f9d5-4ad5-9ccb-d8aab3e1f088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:18:55.681816 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-34f5f0d9-4edf-4b10-84b0-9d93fe9a7478 tempest-VolumesTestJSON-1491296260 None] Flow 'volume_create_manager' (cf7921ff-4314-4929-9159-98af79429e0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:18:55.694966 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-34f5f0d9-4edf-4b10-84b0-9d93fe9a7478 tempest-VolumesTestJSON-1491296260 None] Created volume successfully. Jun 25 21:18:56.894589 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f7ccfdc-d8eb-4d94-a82d-ee7c95374ae3 tempest-VolumesTestJSON-1491296260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:18:56.915002 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4f7ccfdc-d8eb-4d94-a82d-ee7c95374ae3 tempest-VolumesTestJSON-1491296260 None] Flow 'volume_create_manager' (bea46a41-6a27-42ff-bfbe-93c5810f2c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:18:56.921381 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4f7ccfdc-d8eb-4d94-a82d-ee7c95374ae3 tempest-VolumesTestJSON-1491296260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4918ff1b-ed11-47a1-a548-2dab8b9c361e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:18:56.937183 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4f7ccfdc-d8eb-4d94-a82d-ee7c95374ae3 tempest-VolumesTestJSON-1491296260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4918ff1b-ed11-47a1-a548-2dab8b9c361e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:18:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1016851338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a89176e1-ef45-4930-aa7a-196aa62bcf51,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='675ab7469dbb421eb3a598e7439bca65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:18:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:18:57Z,use_quota=True,user_id='579aac7a3fbe41fea6323681f07e8fc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:18:56.942456 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4f7ccfdc-d8eb-4d94-a82d-ee7c95374ae3 tempest-VolumesTestJSON-1491296260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b96d6d1-0a9a-4238-bf48-854f4b3f566d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:18:56.946409 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4f7ccfdc-d8eb-4d94-a82d-ee7c95374ae3 tempest-VolumesTestJSON-1491296260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b96d6d1-0a9a-4238-bf48-854f4b3f566d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:18:56.951452 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4f7ccfdc-d8eb-4d94-a82d-ee7c95374ae3 tempest-VolumesTestJSON-1491296260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee09195a-e562-4bbf-8e70-3097b5d27ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:18:56.955574 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4f7ccfdc-d8eb-4d94-a82d-ee7c95374ae3 tempest-VolumesTestJSON-1491296260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee09195a-e562-4bbf-8e70-3097b5d27ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a89176e1-ef45-4930-aa7a-196aa62bcf51', 'volume_name': 'volume-a89176e1-ef45-4930-aa7a-196aa62bcf51', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:18:56.960744 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4f7ccfdc-d8eb-4d94-a82d-ee7c95374ae3 tempest-VolumesTestJSON-1491296260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edddead1-f042-4f00-96b9-75d60d85ae1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:18:56.964473 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4f7ccfdc-d8eb-4d94-a82d-ee7c95374ae3 tempest-VolumesTestJSON-1491296260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edddead1-f042-4f00-96b9-75d60d85ae1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:18:56.969172 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4f7ccfdc-d8eb-4d94-a82d-ee7c95374ae3 tempest-VolumesTestJSON-1491296260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04f17aa0-683b-471c-afc5-a1d3888dace9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:18:56.970241 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-4f7ccfdc-d8eb-4d94-a82d-ee7c95374ae3 tempest-VolumesTestJSON-1491296260 None] Volume a89176e1-ef45-4930-aa7a-196aa62bcf51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a89176e1-ef45-4930-aa7a-196aa62bcf51', 'volume_size': 1} Jun 25 21:18:56.970599 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4f7ccfdc-d8eb-4d94-a82d-ee7c95374ae3 tempest-VolumesTestJSON-1491296260 None] creating volume 'volume-a89176e1-ef45-4930-aa7a-196aa62bcf51' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:18:56.971199 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4f7ccfdc-d8eb-4d94-a82d-ee7c95374ae3 tempest-VolumesTestJSON-1491296260 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:18:57.027108 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4f7ccfdc-d8eb-4d94-a82d-ee7c95374ae3 tempest-VolumesTestJSON-1491296260 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:18:57.027478 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4f7ccfdc-d8eb-4d94-a82d-ee7c95374ae3 tempest-VolumesTestJSON-1491296260 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:18:57.031198 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4f7ccfdc-d8eb-4d94-a82d-ee7c95374ae3 tempest-VolumesTestJSON-1491296260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04f17aa0-683b-471c-afc5-a1d3888dace9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a89176e1-ef45-4930-aa7a-196aa62bcf51', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:18:57.036028 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4f7ccfdc-d8eb-4d94-a82d-ee7c95374ae3 tempest-VolumesTestJSON-1491296260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e451a48-1693-42a4-a258-72685c596bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:18:57.046557 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-4f7ccfdc-d8eb-4d94-a82d-ee7c95374ae3 tempest-VolumesTestJSON-1491296260 None] Volume volume-a89176e1-ef45-4930-aa7a-196aa62bcf51 (a89176e1-ef45-4930-aa7a-196aa62bcf51): created successfully Jun 25 21:18:57.050524 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4f7ccfdc-d8eb-4d94-a82d-ee7c95374ae3 tempest-VolumesTestJSON-1491296260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e451a48-1693-42a4-a258-72685c596bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:18:57.056132 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4f7ccfdc-d8eb-4d94-a82d-ee7c95374ae3 tempest-VolumesTestJSON-1491296260 None] Flow 'volume_create_manager' (bea46a41-6a27-42ff-bfbe-93c5810f2c12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:18:57.064716 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-4f7ccfdc-d8eb-4d94-a82d-ee7c95374ae3 tempest-VolumesTestJSON-1491296260 None] Created volume successfully. Jun 25 21:18:58.320098 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-30de8e90-c4a8-4de1-b189-f427504ca360 tempest-VolumesTestJSON-1491296260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:18:58.339359 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-30de8e90-c4a8-4de1-b189-f427504ca360 tempest-VolumesTestJSON-1491296260 None] Flow 'volume_create_manager' (d1c07d5c-f1e6-4b30-a292-f711ed341273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:18:58.345932 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-30de8e90-c4a8-4de1-b189-f427504ca360 tempest-VolumesTestJSON-1491296260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7205b46-a863-47f1-9f5b-8f3232e06af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:18:58.363390 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-30de8e90-c4a8-4de1-b189-f427504ca360 tempest-VolumesTestJSON-1491296260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7205b46-a863-47f1-9f5b-8f3232e06af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-713647384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3c7182f2-6037-4351-86ae-b60e1b1e25f2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='675ab7469dbb421eb3a598e7439bca65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:18:58Z,use_quota=True,user_id='579aac7a3fbe41fea6323681f07e8fc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:18:58.368923 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-30de8e90-c4a8-4de1-b189-f427504ca360 tempest-VolumesTestJSON-1491296260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7923e27-ed06-4ed1-a433-f2fbc7549473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:18:58.373067 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-30de8e90-c4a8-4de1-b189-f427504ca360 tempest-VolumesTestJSON-1491296260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7923e27-ed06-4ed1-a433-f2fbc7549473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:18:58.378049 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-30de8e90-c4a8-4de1-b189-f427504ca360 tempest-VolumesTestJSON-1491296260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ffcfb04-44d0-4e05-abcf-b91fc0177ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:18:58.382563 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-30de8e90-c4a8-4de1-b189-f427504ca360 tempest-VolumesTestJSON-1491296260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ffcfb04-44d0-4e05-abcf-b91fc0177ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c7182f2-6037-4351-86ae-b60e1b1e25f2', 'volume_name': 'volume-3c7182f2-6037-4351-86ae-b60e1b1e25f2', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:18:58.387872 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-30de8e90-c4a8-4de1-b189-f427504ca360 tempest-VolumesTestJSON-1491296260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eab71470-1002-4361-9be2-14dd7679a19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:18:58.391923 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-30de8e90-c4a8-4de1-b189-f427504ca360 tempest-VolumesTestJSON-1491296260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eab71470-1002-4361-9be2-14dd7679a19b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:18:58.397009 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-30de8e90-c4a8-4de1-b189-f427504ca360 tempest-VolumesTestJSON-1491296260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9bbb22a-e57a-40c4-a955-c6add126347a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:18:58.398289 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-30de8e90-c4a8-4de1-b189-f427504ca360 tempest-VolumesTestJSON-1491296260 None] Volume 3c7182f2-6037-4351-86ae-b60e1b1e25f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c7182f2-6037-4351-86ae-b60e1b1e25f2', 'volume_size': 1} Jun 25 21:18:58.398596 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-30de8e90-c4a8-4de1-b189-f427504ca360 tempest-VolumesTestJSON-1491296260 None] creating volume 'volume-3c7182f2-6037-4351-86ae-b60e1b1e25f2' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:18:58.399520 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-30de8e90-c4a8-4de1-b189-f427504ca360 tempest-VolumesTestJSON-1491296260 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:18:58.464643 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-30de8e90-c4a8-4de1-b189-f427504ca360 tempest-VolumesTestJSON-1491296260 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:18:58.465014 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-30de8e90-c4a8-4de1-b189-f427504ca360 tempest-VolumesTestJSON-1491296260 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:18:58.468740 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-30de8e90-c4a8-4de1-b189-f427504ca360 tempest-VolumesTestJSON-1491296260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9bbb22a-e57a-40c4-a955-c6add126347a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c7182f2-6037-4351-86ae-b60e1b1e25f2', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:18:58.473247 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-30de8e90-c4a8-4de1-b189-f427504ca360 tempest-VolumesTestJSON-1491296260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdfcdec4-7586-4f3d-ba15-7a8e67226ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:18:58.482551 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-30de8e90-c4a8-4de1-b189-f427504ca360 tempest-VolumesTestJSON-1491296260 None] Volume volume-3c7182f2-6037-4351-86ae-b60e1b1e25f2 (3c7182f2-6037-4351-86ae-b60e1b1e25f2): created successfully Jun 25 21:18:58.486131 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-30de8e90-c4a8-4de1-b189-f427504ca360 tempest-VolumesTestJSON-1491296260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdfcdec4-7586-4f3d-ba15-7a8e67226ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:18:58.491503 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-30de8e90-c4a8-4de1-b189-f427504ca360 tempest-VolumesTestJSON-1491296260 None] Flow 'volume_create_manager' (d1c07d5c-f1e6-4b30-a292-f711ed341273) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:18:58.500399 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-30de8e90-c4a8-4de1-b189-f427504ca360 tempest-VolumesTestJSON-1491296260 None] Created volume successfully. Jun 25 21:19:00.255718 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-6a8ae70b-eb37-49d6-a184-be51e5ef71cb tempest-VolumesTestJSON-1491296260 None] Lock "b'cinder-3c7182f2-6037-4351-86ae-b60e1b1e25f2-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:19:00.291417 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6a8ae70b-eb37-49d6-a184-be51e5ef71cb tempest-VolumesTestJSON-1491296260 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:19:00.336305 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6a8ae70b-eb37-49d6-a184-be51e5ef71cb tempest-VolumesTestJSON-1491296260 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:19:00.340108 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6a8ae70b-eb37-49d6-a184-be51e5ef71cb tempest-VolumesTestJSON-1491296260 None] Volume volume-3c7182f2-6037-4351-86ae-b60e1b1e25f2 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:19:00.348900 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6a8ae70b-eb37-49d6-a184-be51e5ef71cb tempest-VolumesTestJSON-1491296260 None] deleting rbd volume volume-3c7182f2-6037-4351-86ae-b60e1b1e25f2 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:19:00.589926 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-6a8ae70b-eb37-49d6-a184-be51e5ef71cb tempest-VolumesTestJSON-1491296260 None] Created reservations ['ba6a7ccb-798b-4d54-a3ff-a3a99967f240', '95140014-d08a-484d-8f7b-1e9a40d3eca1', 'c6b4abae-7e64-4594-8cdc-78421d545105', '1c387498-6958-4fc1-b977-f00d2c13d3d7'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:19:00.645892 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6a8ae70b-eb37-49d6-a184-be51e5ef71cb tempest-VolumesTestJSON-1491296260 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:19:00.673479 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6a8ae70b-eb37-49d6-a184-be51e5ef71cb tempest-VolumesTestJSON-1491296260 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:19:00.698588 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-6a8ae70b-eb37-49d6-a184-be51e5ef71cb tempest-VolumesTestJSON-1491296260 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:19:00.702983 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-6a8ae70b-eb37-49d6-a184-be51e5ef71cb tempest-VolumesTestJSON-1491296260 None] Deleted volume successfully. Jun 25 21:19:00.716617 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-6a8ae70b-eb37-49d6-a184-be51e5ef71cb tempest-VolumesTestJSON-1491296260 None] Lock "b'cinder-3c7182f2-6037-4351-86ae-b60e1b1e25f2-delete_volume'" released by "delete_volume" :: held 0.461s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:19:01.316264 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-e9168f51-2710-4771-8ecc-12108da0b9b8 tempest-VolumesSnapshotTestJSON-558272145 None] Created reservations ['9169fbcb-e5c8-454b-9408-fba47c87f20e', 'a04ee0b9-2302-4658-86a1-9b36a7edbdea', '5697b026-ab68-4f92-865f-66bfec7f057a', 'd95d4b9d-2582-4f27-8791-f6a6566aaf62'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:19:01.372530 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-e9168f51-2710-4771-8ecc-12108da0b9b8 tempest-VolumesSnapshotTestJSON-558272145 None] Delete snapshot completed successfully. Jun 25 21:19:01.379453 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-e9168f51-2710-4771-8ecc-12108da0b9b8 tempest-VolumesSnapshotTestJSON-558272145 None] Lock "b'cinder-ce6df970-cf45-4f31-9c4c-826cd8239a1e-delete_snapshot'" released by "delete_snapshot" :: held 30.354s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:19:01.412340 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-a0e26abf-330b-4f6f-a8a1-bb8122e11cf6 tempest-VolumesTestJSON-1491296260 None] Lock "b'cinder-a89176e1-ef45-4930-aa7a-196aa62bcf51-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:19:01.456388 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a0e26abf-330b-4f6f-a8a1-bb8122e11cf6 tempest-VolumesTestJSON-1491296260 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:19:01.510178 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a0e26abf-330b-4f6f-a8a1-bb8122e11cf6 tempest-VolumesTestJSON-1491296260 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:19:01.510674 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a0e26abf-330b-4f6f-a8a1-bb8122e11cf6 tempest-VolumesTestJSON-1491296260 None] Volume volume-a89176e1-ef45-4930-aa7a-196aa62bcf51 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:19:01.521269 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a0e26abf-330b-4f6f-a8a1-bb8122e11cf6 tempest-VolumesTestJSON-1491296260 None] deleting rbd volume volume-a89176e1-ef45-4930-aa7a-196aa62bcf51 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:19:01.763161 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-a0e26abf-330b-4f6f-a8a1-bb8122e11cf6 tempest-VolumesTestJSON-1491296260 None] Created reservations ['d9358a23-6979-43d9-8f96-bbbe398bb776', '4e3c1294-df9d-41f6-83b8-f74d59e65ea2', '968e657b-6ab8-42c3-a0c2-7f30429e57cd', '1e9e35c6-c6bd-4538-bf0e-7dd595f92e16'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:19:01.820259 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a0e26abf-330b-4f6f-a8a1-bb8122e11cf6 tempest-VolumesTestJSON-1491296260 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:19:01.868915 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a0e26abf-330b-4f6f-a8a1-bb8122e11cf6 tempest-VolumesTestJSON-1491296260 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:19:01.903420 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-a0e26abf-330b-4f6f-a8a1-bb8122e11cf6 tempest-VolumesTestJSON-1491296260 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:19:01.911408 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-a0e26abf-330b-4f6f-a8a1-bb8122e11cf6 tempest-VolumesTestJSON-1491296260 None] Deleted volume successfully. Jun 25 21:19:01.930752 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-a0e26abf-330b-4f6f-a8a1-bb8122e11cf6 tempest-VolumesTestJSON-1491296260 None] Lock "b'cinder-a89176e1-ef45-4930-aa7a-196aa62bcf51-delete_volume'" released by "delete_volume" :: held 0.518s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:19:02.473839 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-123316b8-09eb-4096-9aaa-103c21e23c9c tempest-VolumesSnapshotTestJSON-558272145 None] Lock "b'cinder-1e9f27e7-733a-410a-9128-75dc8621a361-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.026s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:19:02.479061 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-123316b8-09eb-4096-9aaa-103c21e23c9c tempest-VolumesSnapshotTestJSON-558272145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:19:02.592863 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-5df87f3b-f7fa-40f8-aa7c-b15a72a6ee65 tempest-VolumesTestJSON-1491296260 None] Lock "b'cinder-3b8fadb5-427f-48f5-bb04-af450db01a04-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:19:02.637988 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5df87f3b-f7fa-40f8-aa7c-b15a72a6ee65 tempest-VolumesTestJSON-1491296260 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:19:02.685753 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5df87f3b-f7fa-40f8-aa7c-b15a72a6ee65 tempest-VolumesTestJSON-1491296260 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:19:02.686183 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5df87f3b-f7fa-40f8-aa7c-b15a72a6ee65 tempest-VolumesTestJSON-1491296260 None] Volume volume-3b8fadb5-427f-48f5-bb04-af450db01a04 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:19:02.695466 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5df87f3b-f7fa-40f8-aa7c-b15a72a6ee65 tempest-VolumesTestJSON-1491296260 None] deleting rbd volume volume-3b8fadb5-427f-48f5-bb04-af450db01a04 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:19:02.926383 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-5df87f3b-f7fa-40f8-aa7c-b15a72a6ee65 tempest-VolumesTestJSON-1491296260 None] Created reservations ['25d1675f-8d0f-43f1-ba76-0daeb9cfe8df', 'd9fac1b0-295c-46d4-9b8a-84c559e2966b', '313b7f9c-5964-4f5f-8a87-4c96ba2f5098', 'ebef0a3d-b8a0-4b55-8cbf-67ec121e8ca2'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:19:02.935534 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=63,cinder:UPDATE=26,cinder:DELETE=3,cinder:INSERT=8 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:02.977368 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5df87f3b-f7fa-40f8-aa7c-b15a72a6ee65 tempest-VolumesTestJSON-1491296260 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:19:03.001995 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5df87f3b-f7fa-40f8-aa7c-b15a72a6ee65 tempest-VolumesTestJSON-1491296260 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:19:03.026449 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-5df87f3b-f7fa-40f8-aa7c-b15a72a6ee65 tempest-VolumesTestJSON-1491296260 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:19:03.030377 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-5df87f3b-f7fa-40f8-aa7c-b15a72a6ee65 tempest-VolumesTestJSON-1491296260 None] Deleted volume successfully. Jun 25 21:19:03.045857 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-5df87f3b-f7fa-40f8-aa7c-b15a72a6ee65 tempest-VolumesTestJSON-1491296260 None] Lock "b'cinder-3b8fadb5-427f-48f5-bb04-af450db01a04-delete_volume'" released by "delete_volume" :: held 0.453s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:19:04.051886 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=48,cinder:UPDATE=41,cinder:DELETE=3,cinder:INSERT=8 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:12.801266 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff0201c2-12c8-47f0-a251-46494e8507ea tempest-AttachVolumeNegativeTest-2001135405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:19:12.835706 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ff0201c2-12c8-47f0-a251-46494e8507ea tempest-AttachVolumeNegativeTest-2001135405 None] Flow 'volume_create_manager' (2b2b7bd3-6803-4b60-84df-9f4036e6455c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:19:12.842523 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ff0201c2-12c8-47f0-a251-46494e8507ea tempest-AttachVolumeNegativeTest-2001135405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94708b87-1f0a-43d2-a12d-7ce8f28e254a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:19:12.859118 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ff0201c2-12c8-47f0-a251-46494e8507ea tempest-AttachVolumeNegativeTest-2001135405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94708b87-1f0a-43d2-a12d-7ce8f28e254a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1783895323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c6c6bbb3-c0fb-4f1e-92ee-a93662d20633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d32f25e6afd2425db488a9387869da19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:19:13Z,use_quota=True,user_id='3648405427d14f91a4bb44bd81f2195b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:19:12.864671 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ff0201c2-12c8-47f0-a251-46494e8507ea tempest-AttachVolumeNegativeTest-2001135405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (771274e1-bedd-4e6a-b13c-32f5d9d4b966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:19:12.869285 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ff0201c2-12c8-47f0-a251-46494e8507ea tempest-AttachVolumeNegativeTest-2001135405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (771274e1-bedd-4e6a-b13c-32f5d9d4b966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:19:12.874428 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ff0201c2-12c8-47f0-a251-46494e8507ea tempest-AttachVolumeNegativeTest-2001135405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fba0310d-06ef-429a-be72-f043ebe25efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:19:12.878465 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ff0201c2-12c8-47f0-a251-46494e8507ea tempest-AttachVolumeNegativeTest-2001135405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fba0310d-06ef-429a-be72-f043ebe25efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6c6bbb3-c0fb-4f1e-92ee-a93662d20633', 'volume_name': 'volume-c6c6bbb3-c0fb-4f1e-92ee-a93662d20633', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:19:12.883548 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ff0201c2-12c8-47f0-a251-46494e8507ea tempest-AttachVolumeNegativeTest-2001135405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (506e274a-b1f3-4fec-ac9d-c7df735305f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:19:12.887452 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ff0201c2-12c8-47f0-a251-46494e8507ea tempest-AttachVolumeNegativeTest-2001135405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (506e274a-b1f3-4fec-ac9d-c7df735305f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:19:12.892016 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ff0201c2-12c8-47f0-a251-46494e8507ea tempest-AttachVolumeNegativeTest-2001135405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1d5bac7-89e4-41e5-bb7b-d91f06c26b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:19:12.893859 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-ff0201c2-12c8-47f0-a251-46494e8507ea tempest-AttachVolumeNegativeTest-2001135405 None] Volume c6c6bbb3-c0fb-4f1e-92ee-a93662d20633: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6c6bbb3-c0fb-4f1e-92ee-a93662d20633', 'volume_size': 1} Jun 25 21:19:12.893859 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ff0201c2-12c8-47f0-a251-46494e8507ea tempest-AttachVolumeNegativeTest-2001135405 None] creating volume 'volume-c6c6bbb3-c0fb-4f1e-92ee-a93662d20633' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:19:12.894340 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ff0201c2-12c8-47f0-a251-46494e8507ea tempest-AttachVolumeNegativeTest-2001135405 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:19:12.966658 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ff0201c2-12c8-47f0-a251-46494e8507ea tempest-AttachVolumeNegativeTest-2001135405 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:19:12.967404 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ff0201c2-12c8-47f0-a251-46494e8507ea tempest-AttachVolumeNegativeTest-2001135405 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:19:12.971382 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ff0201c2-12c8-47f0-a251-46494e8507ea tempest-AttachVolumeNegativeTest-2001135405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1d5bac7-89e4-41e5-bb7b-d91f06c26b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6c6bbb3-c0fb-4f1e-92ee-a93662d20633', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:19:12.976677 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ff0201c2-12c8-47f0-a251-46494e8507ea tempest-AttachVolumeNegativeTest-2001135405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c57916f-f3b7-49bc-82de-3a076310fe85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:19:12.987094 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-ff0201c2-12c8-47f0-a251-46494e8507ea tempest-AttachVolumeNegativeTest-2001135405 None] Volume volume-c6c6bbb3-c0fb-4f1e-92ee-a93662d20633 (c6c6bbb3-c0fb-4f1e-92ee-a93662d20633): created successfully Jun 25 21:19:12.992081 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ff0201c2-12c8-47f0-a251-46494e8507ea tempest-AttachVolumeNegativeTest-2001135405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c57916f-f3b7-49bc-82de-3a076310fe85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:19:12.998204 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ff0201c2-12c8-47f0-a251-46494e8507ea tempest-AttachVolumeNegativeTest-2001135405 None] Flow 'volume_create_manager' (2b2b7bd3-6803-4b60-84df-9f4036e6455c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:19:13.008269 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-ff0201c2-12c8-47f0-a251-46494e8507ea tempest-AttachVolumeNegativeTest-2001135405 None] Created volume successfully. Jun 25 21:19:14.472383 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-69ee599d-5bd1-481b-9693-fdb2e4eb15c3 req-810280ed-99dd-4a15-ad89-1965f7ec7fa9 tempest-AttachVolumeNegativeTest-2001135405 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 21:19:15.530144 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-69ee599d-5bd1-481b-9693-fdb2e4eb15c3 req-810280ed-99dd-4a15-ad89-1965f7ec7fa9 tempest-AttachVolumeNegativeTest-2001135405 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.057s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 21:19:15.531003 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-69ee599d-5bd1-481b-9693-fdb2e4eb15c3 req-810280ed-99dd-4a15-ad89-1965f7ec7fa9 tempest-AttachVolumeNegativeTest-2001135405 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c6c6bbb3-c0fb-4f1e-92ee-a93662d20633', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': 'c6c6bbb3-c0fb-4f1e-92ee-a93662d20633', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 21:19:15.581942 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-69ee599d-5bd1-481b-9693-fdb2e4eb15c3 req-810280ed-99dd-4a15-ad89-1965f7ec7fa9 tempest-AttachVolumeNegativeTest-2001135405 None] Connection info returned from driver {'name': 'volumes/volume-c6c6bbb3-c0fb-4f1e-92ee-a93662d20633', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'c6c6bbb3-c0fb-4f1e-92ee-a93662d20633', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '39fe7918-30e0-4c69-9008-d75584efd719'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 25 21:19:15.674198 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-69ee599d-5bd1-481b-9693-fdb2e4eb15c3 req-810280ed-99dd-4a15-ad89-1965f7ec7fa9 tempest-AttachVolumeNegativeTest-2001135405 None] attachment_update completed successfully. Jun 25 21:19:19.145717 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-d5d0b9a3-5631-4245-9f9d-61b0aee03ca1 req-4be30561-1ef8-4139-91fb-04bc85a9d549 tempest-AttachVolumeNegativeTest-2001135405 None] Terminate volume connection completed successfully. Jun 25 21:19:19.146364 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-d5d0b9a3-5631-4245-9f9d-61b0aee03ca1 req-4be30561-1ef8-4139-91fb-04bc85a9d549 tempest-AttachVolumeNegativeTest-2001135405 None] Deleting attachment 39fe7918-30e0-4c69-9008-d75584efd719. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 25 21:19:23.500108 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-ec024b3d-561a-4f42-9422-b4093b226a3e req-61482902-2a75-425c-b83c-bdd1cb2e1cdb tempest-AttachVolumeShelveTestJSON-967589539 None] Terminate volume connection completed successfully. Jun 25 21:19:23.500784 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-ec024b3d-561a-4f42-9422-b4093b226a3e req-61482902-2a75-425c-b83c-bdd1cb2e1cdb tempest-AttachVolumeShelveTestJSON-967589539 None] Deleting attachment 13dca793-accb-4f46-9a1e-308893a13061. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 25 21:19:32.739856 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-123316b8-09eb-4096-9aaa-103c21e23c9c tempest-VolumesSnapshotTestJSON-558272145 None] Created reservations ['dc549661-ecf1-4e9a-9612-501327ab6d1a', '55dfdb1d-be35-47db-abf9-4763600ffbec', '0286c770-69e0-4cce-a32a-889f06586684', 'fb2a50b3-f2c9-4ff9-9876-82ee2b99b28b'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:19:32.788272 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-123316b8-09eb-4096-9aaa-103c21e23c9c tempest-VolumesSnapshotTestJSON-558272145 None] Delete snapshot completed successfully. Jun 25 21:19:32.795901 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-123316b8-09eb-4096-9aaa-103c21e23c9c tempest-VolumesSnapshotTestJSON-558272145 None] Lock "b'cinder-1e9f27e7-733a-410a-9128-75dc8621a361-delete_snapshot'" released by "delete_snapshot" :: held 30.322s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:19:34.054567 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=33,cinder:UPDATE=10 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:34.071163 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=36,cinder:UPDATE=11,cinder:DELETE=1,cinder:INSERT=4 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:36.566293 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-f0ef9ac5-2e65-48f7-a8dd-3fc50e0b37cf req-e53a5c94-5483-4769-a523-19a519ba9c9b tempest-VolumesSnapshotTestJSON-558272145 None] Terminate volume connection completed successfully. Jun 25 21:19:36.567866 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-f0ef9ac5-2e65-48f7-a8dd-3fc50e0b37cf req-e53a5c94-5483-4769-a523-19a519ba9c9b tempest-VolumesSnapshotTestJSON-558272145 None] Deleting attachment 7dbc10cf-8fa1-4b02-b32c-024c4efb5923. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 25 21:19:43.544796 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-bd8405ec-e35f-421a-8e48-1b7b61ae2bbe tempest-VolumesSnapshotTestJSON-558272145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:19:43.808617 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-bd8405ec-e35f-421a-8e48-1b7b61ae2bbe tempest-VolumesSnapshotTestJSON-558272145 None] Create snapshot completed successfully Jun 25 21:19:44.789743 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-4ae1eb09-585c-4e4c-b710-6d0d6d3f65e9 tempest-VolumesSnapshotTestJSON-558272145 None] Lock "b'cinder-6e63a690-45b2-4f12-8faf-0f6feff5b726-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.017s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:19:44.792501 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4ae1eb09-585c-4e4c-b710-6d0d6d3f65e9 tempest-VolumesSnapshotTestJSON-558272145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:19:45.905692 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-4ae1eb09-585c-4e4c-b710-6d0d6d3f65e9 tempest-VolumesSnapshotTestJSON-558272145 None] Created reservations ['0efad6f1-b8fb-4df6-b568-615dfc7570a6', '8e326543-b167-4bae-8cfd-7541b9356e3c', 'ec222277-fb35-4f28-9906-a0b7bcfabdcc', 'd308cdaf-4d03-4316-a202-bd1004d6abb4'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:19:45.954509 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-4ae1eb09-585c-4e4c-b710-6d0d6d3f65e9 tempest-VolumesSnapshotTestJSON-558272145 None] Delete snapshot completed successfully. Jun 25 21:19:45.961102 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-4ae1eb09-585c-4e4c-b710-6d0d6d3f65e9 tempest-VolumesSnapshotTestJSON-558272145 None] Lock "b'cinder-6e63a690-45b2-4f12-8faf-0f6feff5b726-delete_snapshot'" released by "delete_snapshot" :: held 1.171s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:19:47.146268 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e2943eb2-40e0-4b23-a00c-dd23d6c81f00 tempest-VolumesSnapshotTestJSON-558272145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:19:47.905043 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-e2943eb2-40e0-4b23-a00c-dd23d6c81f00 tempest-VolumesSnapshotTestJSON-558272145 None] Create snapshot completed successfully Jun 25 21:19:52.152164 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:19:52.153875 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:19:52.230677 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:19:52.314858 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:20:03.089339 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe24dafe-ffe6-45a6-b10e-b12ec1ff8430 tempest-VolumesBackupsAdminTest-1318980882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:20:03.109953 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-fe24dafe-ffe6-45a6-b10e-b12ec1ff8430 tempest-VolumesBackupsAdminTest-1318980882 None] Flow 'volume_create_manager' (4aaee972-54b1-4f2f-b5a1-a9c69fe03d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:20:03.116866 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-fe24dafe-ffe6-45a6-b10e-b12ec1ff8430 tempest-VolumesBackupsAdminTest-1318980882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e52cc607-6bd9-4f28-85ff-970ac1429ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:20:03.133907 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-fe24dafe-ffe6-45a6-b10e-b12ec1ff8430 tempest-VolumesBackupsAdminTest-1318980882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e52cc607-6bd9-4f28-85ff-970ac1429ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-364007291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=053aa06f-7a8a-404c-9d24-3061c8256367,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4767a1106504455b84fa02a9da1f7576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:20:03Z,use_quota=True,user_id='8a382ca2e5a447d8917c352461e70c36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:20:03.139208 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-fe24dafe-ffe6-45a6-b10e-b12ec1ff8430 tempest-VolumesBackupsAdminTest-1318980882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00ac25f-2763-4867-94b2-b447dba81055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:20:03.143227 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-fe24dafe-ffe6-45a6-b10e-b12ec1ff8430 tempest-VolumesBackupsAdminTest-1318980882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00ac25f-2763-4867-94b2-b447dba81055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:20:03.148125 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-fe24dafe-ffe6-45a6-b10e-b12ec1ff8430 tempest-VolumesBackupsAdminTest-1318980882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fc17465-8a75-402c-ab4c-3140130e51ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:20:03.152079 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-fe24dafe-ffe6-45a6-b10e-b12ec1ff8430 tempest-VolumesBackupsAdminTest-1318980882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fc17465-8a75-402c-ab4c-3140130e51ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '053aa06f-7a8a-404c-9d24-3061c8256367', 'volume_name': 'volume-053aa06f-7a8a-404c-9d24-3061c8256367', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:20:03.156815 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-fe24dafe-ffe6-45a6-b10e-b12ec1ff8430 tempest-VolumesBackupsAdminTest-1318980882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1320137-531d-45d9-8cd0-fc061e164806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:20:03.161324 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-fe24dafe-ffe6-45a6-b10e-b12ec1ff8430 tempest-VolumesBackupsAdminTest-1318980882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1320137-531d-45d9-8cd0-fc061e164806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:20:03.165855 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-fe24dafe-ffe6-45a6-b10e-b12ec1ff8430 tempest-VolumesBackupsAdminTest-1318980882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (339bff40-1744-4417-bc2f-f6dfab0642a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:20:03.166920 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-fe24dafe-ffe6-45a6-b10e-b12ec1ff8430 tempest-VolumesBackupsAdminTest-1318980882 None] Volume 053aa06f-7a8a-404c-9d24-3061c8256367: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-053aa06f-7a8a-404c-9d24-3061c8256367', 'volume_size': 1} Jun 25 21:20:03.167315 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-fe24dafe-ffe6-45a6-b10e-b12ec1ff8430 tempest-VolumesBackupsAdminTest-1318980882 None] creating volume 'volume-053aa06f-7a8a-404c-9d24-3061c8256367' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:20:03.168088 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-fe24dafe-ffe6-45a6-b10e-b12ec1ff8430 tempest-VolumesBackupsAdminTest-1318980882 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:20:03.224811 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-fe24dafe-ffe6-45a6-b10e-b12ec1ff8430 tempest-VolumesBackupsAdminTest-1318980882 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:20:03.225184 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-fe24dafe-ffe6-45a6-b10e-b12ec1ff8430 tempest-VolumesBackupsAdminTest-1318980882 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:20:03.228839 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-fe24dafe-ffe6-45a6-b10e-b12ec1ff8430 tempest-VolumesBackupsAdminTest-1318980882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (339bff40-1744-4417-bc2f-f6dfab0642a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-053aa06f-7a8a-404c-9d24-3061c8256367', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:20:03.233307 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-fe24dafe-ffe6-45a6-b10e-b12ec1ff8430 tempest-VolumesBackupsAdminTest-1318980882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2360a43e-6fe6-4b8e-8f58-f55d90f732c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:20:03.243317 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-fe24dafe-ffe6-45a6-b10e-b12ec1ff8430 tempest-VolumesBackupsAdminTest-1318980882 None] Volume volume-053aa06f-7a8a-404c-9d24-3061c8256367 (053aa06f-7a8a-404c-9d24-3061c8256367): created successfully Jun 25 21:20:03.247002 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-fe24dafe-ffe6-45a6-b10e-b12ec1ff8430 tempest-VolumesBackupsAdminTest-1318980882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2360a43e-6fe6-4b8e-8f58-f55d90f732c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:20:03.252044 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-fe24dafe-ffe6-45a6-b10e-b12ec1ff8430 tempest-VolumesBackupsAdminTest-1318980882 None] Flow 'volume_create_manager' (4aaee972-54b1-4f2f-b5a1-a9c69fe03d23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:20:03.261872 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-fe24dafe-ffe6-45a6-b10e-b12ec1ff8430 tempest-VolumesBackupsAdminTest-1318980882 None] Created volume successfully. Jun 25 21:20:04.280964 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:UPDATE=11,cinder:SELECT=33,cinder:DELETE=3,cinder:INSERT=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:20:04.281594 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=26,cinder:UPDATE=11,cinder:INSERT=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:20:04.290925 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-fd3ed7ad-17a1-4b99-828c-7414428a9310 tempest-VolumesBackupsAdminTest-1318980882 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-06-25T21:20:04Z,data_timestamp=2022-06-25T21:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-865263974',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=86aaf890-72ad-4574-8b7a-10503725f0f6,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='4767a1106504455b84fa02a9da1f7576',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='8a382ca2e5a447d8917c352461e70c36',volume_id=053aa06f-7a8a-404c-9d24-3061c8256367) Jun 25 21:20:04.291872 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.backup.rpcapi [None req-fd3ed7ad-17a1-4b99-828c-7414428a9310 tempest-VolumesBackupsAdminTest-1318980882 None] continue_backup in rpcapi backup_id 86aaf890-72ad-4574-8b7a-10503725f0f6 {{(pid=130674) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Jun 25 21:20:04.457301 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-fd3ed7ad-17a1-4b99-828c-7414428a9310 tempest-VolumesBackupsAdminTest-1318980882 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 21:20:05.423452 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-fd3ed7ad-17a1-4b99-828c-7414428a9310 tempest-VolumesBackupsAdminTest-1318980882 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.966s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 21:20:05.424728 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-fd3ed7ad-17a1-4b99-828c-7414428a9310 tempest-VolumesBackupsAdminTest-1318980882 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-053aa06f-7a8a-404c-9d24-3061c8256367', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': '053aa06f-7a8a-404c-9d24-3061c8256367', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 21:20:05.441720 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-fd3ed7ad-17a1-4b99-828c-7414428a9310 tempest-VolumesBackupsAdminTest-1318980882 None] Initialize volume connection completed successfully. Jun 25 21:20:08.050218 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-fd3ed7ad-17a1-4b99-828c-7414428a9310 tempest-VolumesBackupsAdminTest-1318980882 None] Terminate volume connection completed successfully. Jun 25 21:20:08.072035 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-fd3ed7ad-17a1-4b99-828c-7414428a9310 tempest-VolumesBackupsAdminTest-1318980882 None] Remove volume export completed successfully. Jun 25 21:20:08.643014 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-86e2244a-db24-4dd7-8391-067b6b281ebe req-b2f33706-4dc9-4895-916d-19dcede99f2e tempest-VolumesSnapshotTestJSON-558272145 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 21:20:09.619312 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-86e2244a-db24-4dd7-8391-067b6b281ebe req-b2f33706-4dc9-4895-916d-19dcede99f2e tempest-VolumesSnapshotTestJSON-558272145 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.976s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 21:20:09.620148 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-86e2244a-db24-4dd7-8391-067b6b281ebe req-b2f33706-4dc9-4895-916d-19dcede99f2e tempest-VolumesSnapshotTestJSON-558272145 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c02e587f-1a09-4c9f-a6d5-e94a0b4adf15', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': 'c02e587f-1a09-4c9f-a6d5-e94a0b4adf15', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 21:20:09.667049 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-86e2244a-db24-4dd7-8391-067b6b281ebe req-b2f33706-4dc9-4895-916d-19dcede99f2e tempest-VolumesSnapshotTestJSON-558272145 None] Connection info returned from driver {'name': 'volumes/volume-c02e587f-1a09-4c9f-a6d5-e94a0b4adf15', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'c02e587f-1a09-4c9f-a6d5-e94a0b4adf15', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ebde4e6f-5b64-4677-96cc-f0a3f75df242'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 25 21:20:09.731175 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-86e2244a-db24-4dd7-8391-067b6b281ebe req-b2f33706-4dc9-4895-916d-19dcede99f2e tempest-VolumesSnapshotTestJSON-558272145 None] attachment_update completed successfully. Jun 25 21:20:10.332141 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bad95b3-fb76-4977-b1b2-3054f04a9146 tempest-VolumesBackupsAdminTest-1318980882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:20:10.353746 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3bad95b3-fb76-4977-b1b2-3054f04a9146 tempest-VolumesBackupsAdminTest-1318980882 None] Flow 'volume_create_manager' (8669b067-4307-43db-ab0c-678aedeb0691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:20:10.360901 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3bad95b3-fb76-4977-b1b2-3054f04a9146 tempest-VolumesBackupsAdminTest-1318980882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03330b73-a7b5-4c1c-94a7-8d5e6d531a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:20:10.377573 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3bad95b3-fb76-4977-b1b2-3054f04a9146 tempest-VolumesBackupsAdminTest-1318980882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03330b73-a7b5-4c1c-94a7-8d5e6d531a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:20:10Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_86aaf890-72ad-4574-8b7a-10503725f0f6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=cd035207-ef35-48c7-afed-b123adaf6772,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4767a1106504455b84fa02a9da1f7576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:20:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:20:10Z,use_quota=True,user_id='8a382ca2e5a447d8917c352461e70c36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:20:10.383040 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3bad95b3-fb76-4977-b1b2-3054f04a9146 tempest-VolumesBackupsAdminTest-1318980882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2432b89d-4c83-4eaa-a752-c067bd24c678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:20:10.387335 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3bad95b3-fb76-4977-b1b2-3054f04a9146 tempest-VolumesBackupsAdminTest-1318980882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2432b89d-4c83-4eaa-a752-c067bd24c678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:20:10.392737 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3bad95b3-fb76-4977-b1b2-3054f04a9146 tempest-VolumesBackupsAdminTest-1318980882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aba99ea-7525-4b85-aa3c-ce17857dc7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:20:10.400146 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3bad95b3-fb76-4977-b1b2-3054f04a9146 tempest-VolumesBackupsAdminTest-1318980882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aba99ea-7525-4b85-aa3c-ce17857dc7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd035207-ef35-48c7-afed-b123adaf6772', 'volume_name': 'volume-cd035207-ef35-48c7-afed-b123adaf6772', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:20:10.405283 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3bad95b3-fb76-4977-b1b2-3054f04a9146 tempest-VolumesBackupsAdminTest-1318980882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6017e06e-fa53-4b7d-8ac9-f6811ddf7b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:20:10.410175 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3bad95b3-fb76-4977-b1b2-3054f04a9146 tempest-VolumesBackupsAdminTest-1318980882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6017e06e-fa53-4b7d-8ac9-f6811ddf7b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:20:10.416184 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3bad95b3-fb76-4977-b1b2-3054f04a9146 tempest-VolumesBackupsAdminTest-1318980882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fc4884b-fd3f-4751-949a-9c6928dc17e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:20:10.417344 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-3bad95b3-fb76-4977-b1b2-3054f04a9146 tempest-VolumesBackupsAdminTest-1318980882 None] Volume cd035207-ef35-48c7-afed-b123adaf6772: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd035207-ef35-48c7-afed-b123adaf6772', 'volume_size': 1} Jun 25 21:20:10.417762 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3bad95b3-fb76-4977-b1b2-3054f04a9146 tempest-VolumesBackupsAdminTest-1318980882 None] creating volume 'volume-cd035207-ef35-48c7-afed-b123adaf6772' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:20:10.419011 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3bad95b3-fb76-4977-b1b2-3054f04a9146 tempest-VolumesBackupsAdminTest-1318980882 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:20:10.490635 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3bad95b3-fb76-4977-b1b2-3054f04a9146 tempest-VolumesBackupsAdminTest-1318980882 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:20:10.491009 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3bad95b3-fb76-4977-b1b2-3054f04a9146 tempest-VolumesBackupsAdminTest-1318980882 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:20:10.494633 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3bad95b3-fb76-4977-b1b2-3054f04a9146 tempest-VolumesBackupsAdminTest-1318980882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fc4884b-fd3f-4751-949a-9c6928dc17e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd035207-ef35-48c7-afed-b123adaf6772', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:20:10.499324 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3bad95b3-fb76-4977-b1b2-3054f04a9146 tempest-VolumesBackupsAdminTest-1318980882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3db5a585-2046-4fb4-917c-5854274830c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:20:10.509461 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-3bad95b3-fb76-4977-b1b2-3054f04a9146 tempest-VolumesBackupsAdminTest-1318980882 None] Volume volume-cd035207-ef35-48c7-afed-b123adaf6772 (cd035207-ef35-48c7-afed-b123adaf6772): created successfully Jun 25 21:20:10.515188 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3bad95b3-fb76-4977-b1b2-3054f04a9146 tempest-VolumesBackupsAdminTest-1318980882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3db5a585-2046-4fb4-917c-5854274830c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:20:10.523205 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-3bad95b3-fb76-4977-b1b2-3054f04a9146 tempest-VolumesBackupsAdminTest-1318980882 None] Flow 'volume_create_manager' (8669b067-4307-43db-ab0c-678aedeb0691) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:20:10.533128 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-3bad95b3-fb76-4977-b1b2-3054f04a9146 tempest-VolumesBackupsAdminTest-1318980882 None] Created volume successfully. Jun 25 21:20:11.416860 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-3bad95b3-fb76-4977-b1b2-3054f04a9146 tempest-VolumesBackupsAdminTest-1318980882 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 21:20:12.140458 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-08ef8fa9-a157-467f-ab57-4c1a1816ef58 tempest-VolumesSnapshotTestJSON-558272145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:20:12.514110 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-3bad95b3-fb76-4977-b1b2-3054f04a9146 tempest-VolumesBackupsAdminTest-1318980882 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.097s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 21:20:12.514757 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3bad95b3-fb76-4977-b1b2-3054f04a9146 tempest-VolumesBackupsAdminTest-1318980882 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-cd035207-ef35-48c7-afed-b123adaf6772', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': 'cd035207-ef35-48c7-afed-b123adaf6772', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 21:20:12.535895 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-3bad95b3-fb76-4977-b1b2-3054f04a9146 tempest-VolumesBackupsAdminTest-1318980882 None] Initialize volume connection completed successfully. Jun 25 21:20:12.939868 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-08ef8fa9-a157-467f-ab57-4c1a1816ef58 tempest-VolumesSnapshotTestJSON-558272145 None] Create snapshot completed successfully Jun 25 21:20:13.543729 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-59ff8513-092c-4f1e-8d5f-6554341a4a05 tempest-VolumesSnapshotTestJSON-558272145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:20:13.992866 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-59ff8513-092c-4f1e-8d5f-6554341a4a05 tempest-VolumesSnapshotTestJSON-558272145 None] Create snapshot completed successfully Jun 25 21:20:14.249046 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-3bad95b3-fb76-4977-b1b2-3054f04a9146 tempest-VolumesBackupsAdminTest-1318980882 None] Terminate volume connection completed successfully. Jun 25 21:20:14.277378 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-3bad95b3-fb76-4977-b1b2-3054f04a9146 tempest-VolumesBackupsAdminTest-1318980882 None] Remove volume export completed successfully. Jun 25 21:20:14.692565 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-5b819d31-85b3-44f0-88eb-b1a4f28e0207 tempest-VolumesSnapshotTestJSON-558272145 None] Lock "b'cinder-bd3cef14-797f-4348-87c9-0bf8ac789470-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.017s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:20:14.699121 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5b819d31-85b3-44f0-88eb-b1a4f28e0207 tempest-VolumesSnapshotTestJSON-558272145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:20:14.840141 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-64732860-5774-4662-8d40-a224d6a4e775 tempest-VolumesBackupsAdminTest-1318980882 None] Lock "b'cinder-cd035207-ef35-48c7-afed-b123adaf6772-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:20:14.912692 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-64732860-5774-4662-8d40-a224d6a4e775 tempest-VolumesBackupsAdminTest-1318980882 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:20:15.993713 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-64732860-5774-4662-8d40-a224d6a4e775 tempest-VolumesBackupsAdminTest-1318980882 None] Volume volume-cd035207-ef35-48c7-afed-b123adaf6772 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:20:16.022730 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-64732860-5774-4662-8d40-a224d6a4e775 tempest-VolumesBackupsAdminTest-1318980882 None] deleting rbd volume volume-cd035207-ef35-48c7-afed-b123adaf6772 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:20:16.500596 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-64732860-5774-4662-8d40-a224d6a4e775 tempest-VolumesBackupsAdminTest-1318980882 None] Created reservations ['2e9ed16c-3718-43ec-a8ce-16592918a671', '60f2c23d-5acb-486a-b9b0-d82f373e6e80', 'f2785f31-3e01-483f-8e55-192e431731db', '2983586c-c2e0-44fa-8428-740a05fa6d15'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:20:16.605765 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-64732860-5774-4662-8d40-a224d6a4e775 tempest-VolumesBackupsAdminTest-1318980882 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:20:16.670716 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-64732860-5774-4662-8d40-a224d6a4e775 tempest-VolumesBackupsAdminTest-1318980882 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:20:16.729282 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-64732860-5774-4662-8d40-a224d6a4e775 tempest-VolumesBackupsAdminTest-1318980882 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:20:16.739165 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-64732860-5774-4662-8d40-a224d6a4e775 tempest-VolumesBackupsAdminTest-1318980882 None] Deleted volume successfully. Jun 25 21:20:16.773174 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-64732860-5774-4662-8d40-a224d6a4e775 tempest-VolumesBackupsAdminTest-1318980882 None] Lock "b'cinder-cd035207-ef35-48c7-afed-b123adaf6772-delete_volume'" released by "delete_volume" :: held 1.933s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:20:18.941739 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd6b8df8-d21f-409c-8866-8125aaf12559 tempest-VolumesBackupsAdminTest-1318980882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:20:18.984188 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-bd6b8df8-d21f-409c-8866-8125aaf12559 tempest-VolumesBackupsAdminTest-1318980882 None] Flow 'volume_create_manager' (66263d74-c53e-4eb6-a313-d8059082e291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:20:18.994369 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-bd6b8df8-d21f-409c-8866-8125aaf12559 tempest-VolumesBackupsAdminTest-1318980882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a009527d-7f52-486b-8280-4a7afbc73fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:20:19.023320 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-bd6b8df8-d21f-409c-8866-8125aaf12559 tempest-VolumesBackupsAdminTest-1318980882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a009527d-7f52-486b-8280-4a7afbc73fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-1979757698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8c60543f-0b8c-4bd2-9d7e-4e84bd75c8f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4767a1106504455b84fa02a9da1f7576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:20:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:20:19Z,use_quota=True,user_id='8a382ca2e5a447d8917c352461e70c36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:20:19.028888 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-bd6b8df8-d21f-409c-8866-8125aaf12559 tempest-VolumesBackupsAdminTest-1318980882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8e44528-2775-4774-b237-64ef884ff432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:20:19.033098 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-bd6b8df8-d21f-409c-8866-8125aaf12559 tempest-VolumesBackupsAdminTest-1318980882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8e44528-2775-4774-b237-64ef884ff432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:20:19.038527 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-bd6b8df8-d21f-409c-8866-8125aaf12559 tempest-VolumesBackupsAdminTest-1318980882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7991a9f3-7d95-4738-80bf-2d824d96453e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:20:19.042694 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-bd6b8df8-d21f-409c-8866-8125aaf12559 tempest-VolumesBackupsAdminTest-1318980882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7991a9f3-7d95-4738-80bf-2d824d96453e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c60543f-0b8c-4bd2-9d7e-4e84bd75c8f3', 'volume_name': 'volume-8c60543f-0b8c-4bd2-9d7e-4e84bd75c8f3', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:20:19.047906 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-bd6b8df8-d21f-409c-8866-8125aaf12559 tempest-VolumesBackupsAdminTest-1318980882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dbb16d7-d0d0-436d-977c-b8784b221223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:20:19.052071 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-bd6b8df8-d21f-409c-8866-8125aaf12559 tempest-VolumesBackupsAdminTest-1318980882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dbb16d7-d0d0-436d-977c-b8784b221223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:20:19.057333 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-bd6b8df8-d21f-409c-8866-8125aaf12559 tempest-VolumesBackupsAdminTest-1318980882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6894adcd-7000-4725-ad80-bffe4d0f2dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:20:19.058497 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-bd6b8df8-d21f-409c-8866-8125aaf12559 tempest-VolumesBackupsAdminTest-1318980882 None] Volume 8c60543f-0b8c-4bd2-9d7e-4e84bd75c8f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c60543f-0b8c-4bd2-9d7e-4e84bd75c8f3', 'volume_size': 1} Jun 25 21:20:19.059096 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-bd6b8df8-d21f-409c-8866-8125aaf12559 tempest-VolumesBackupsAdminTest-1318980882 None] creating volume 'volume-8c60543f-0b8c-4bd2-9d7e-4e84bd75c8f3' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:20:19.060072 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-bd6b8df8-d21f-409c-8866-8125aaf12559 tempest-VolumesBackupsAdminTest-1318980882 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:20:19.134418 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-bd6b8df8-d21f-409c-8866-8125aaf12559 tempest-VolumesBackupsAdminTest-1318980882 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:20:19.134837 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-bd6b8df8-d21f-409c-8866-8125aaf12559 tempest-VolumesBackupsAdminTest-1318980882 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:20:19.138963 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-bd6b8df8-d21f-409c-8866-8125aaf12559 tempest-VolumesBackupsAdminTest-1318980882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6894adcd-7000-4725-ad80-bffe4d0f2dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c60543f-0b8c-4bd2-9d7e-4e84bd75c8f3', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:20:19.144245 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-bd6b8df8-d21f-409c-8866-8125aaf12559 tempest-VolumesBackupsAdminTest-1318980882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3da9b097-a798-4e37-a714-c0bd3ecd27e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:20:19.158429 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-bd6b8df8-d21f-409c-8866-8125aaf12559 tempest-VolumesBackupsAdminTest-1318980882 None] Volume volume-8c60543f-0b8c-4bd2-9d7e-4e84bd75c8f3 (8c60543f-0b8c-4bd2-9d7e-4e84bd75c8f3): created successfully Jun 25 21:20:19.162558 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-bd6b8df8-d21f-409c-8866-8125aaf12559 tempest-VolumesBackupsAdminTest-1318980882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3da9b097-a798-4e37-a714-c0bd3ecd27e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:20:19.170208 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-bd6b8df8-d21f-409c-8866-8125aaf12559 tempest-VolumesBackupsAdminTest-1318980882 None] Flow 'volume_create_manager' (66263d74-c53e-4eb6-a313-d8059082e291) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:20:19.187256 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-bd6b8df8-d21f-409c-8866-8125aaf12559 tempest-VolumesBackupsAdminTest-1318980882 None] Created volume successfully. Jun 25 21:20:20.139156 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-f6cda02c-b195-4d7a-949c-2261f99cb12a tempest-VolumesBackupsAdminTest-1318980882 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-06-25T21:20:19Z,data_timestamp=2022-06-25T21:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-1480567716',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=77481a5e-17ee-4326-ada1-49fc8e6e49c8,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='4767a1106504455b84fa02a9da1f7576',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='8a382ca2e5a447d8917c352461e70c36',volume_id=8c60543f-0b8c-4bd2-9d7e-4e84bd75c8f3) Jun 25 21:20:20.141927 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.backup.rpcapi [None req-f6cda02c-b195-4d7a-949c-2261f99cb12a tempest-VolumesBackupsAdminTest-1318980882 None] continue_backup in rpcapi backup_id 77481a5e-17ee-4326-ada1-49fc8e6e49c8 {{(pid=130674) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Jun 25 21:20:20.461347 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-f6cda02c-b195-4d7a-949c-2261f99cb12a tempest-VolumesBackupsAdminTest-1318980882 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 21:20:21.445111 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-f6cda02c-b195-4d7a-949c-2261f99cb12a tempest-VolumesBackupsAdminTest-1318980882 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.983s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 21:20:21.446100 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f6cda02c-b195-4d7a-949c-2261f99cb12a tempest-VolumesBackupsAdminTest-1318980882 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-8c60543f-0b8c-4bd2-9d7e-4e84bd75c8f3', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': '8c60543f-0b8c-4bd2-9d7e-4e84bd75c8f3', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 21:20:21.463221 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-f6cda02c-b195-4d7a-949c-2261f99cb12a tempest-VolumesBackupsAdminTest-1318980882 None] Initialize volume connection completed successfully. Jun 25 21:20:22.678411 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-f6cda02c-b195-4d7a-949c-2261f99cb12a tempest-VolumesBackupsAdminTest-1318980882 None] Terminate volume connection completed successfully. Jun 25 21:20:22.701100 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-f6cda02c-b195-4d7a-949c-2261f99cb12a tempest-VolumesBackupsAdminTest-1318980882 None] Remove volume export completed successfully. Jun 25 21:20:24.535582 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-53e9cf55-e8c7-4895-80a4-ef00060c8c25 tempest-VolumesBackupsAdminTest-1318980882 None] Lock "b'cinder-8c60543f-0b8c-4bd2-9d7e-4e84bd75c8f3-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:20:24.581440 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-53e9cf55-e8c7-4895-80a4-ef00060c8c25 tempest-VolumesBackupsAdminTest-1318980882 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:20:25.063121 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-53e9cf55-e8c7-4895-80a4-ef00060c8c25 tempest-VolumesBackupsAdminTest-1318980882 None] Volume volume-8c60543f-0b8c-4bd2-9d7e-4e84bd75c8f3 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:20:25.073921 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-53e9cf55-e8c7-4895-80a4-ef00060c8c25 tempest-VolumesBackupsAdminTest-1318980882 None] deleting rbd volume volume-8c60543f-0b8c-4bd2-9d7e-4e84bd75c8f3 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:20:25.258324 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-53e9cf55-e8c7-4895-80a4-ef00060c8c25 tempest-VolumesBackupsAdminTest-1318980882 None] Created reservations ['cef2ba22-11a8-431d-baa9-ad20a835a1fd', 'a3924870-d415-446d-a004-6f2e408dc7e8', '2c9e2f85-c3fd-4670-b457-99e5762831bc', '6556060c-2e46-4773-96b7-c3f0f8941c56'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:20:25.272455 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=74,cinder:UPDATE=17,cinder:DELETE=3,cinder:INSERT=6 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:20:25.315178 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-53e9cf55-e8c7-4895-80a4-ef00060c8c25 tempest-VolumesBackupsAdminTest-1318980882 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:20:25.341091 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-53e9cf55-e8c7-4895-80a4-ef00060c8c25 tempest-VolumesBackupsAdminTest-1318980882 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:20:25.366019 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-53e9cf55-e8c7-4895-80a4-ef00060c8c25 tempest-VolumesBackupsAdminTest-1318980882 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:20:25.370251 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-53e9cf55-e8c7-4895-80a4-ef00060c8c25 tempest-VolumesBackupsAdminTest-1318980882 None] Deleted volume successfully. Jun 25 21:20:25.383011 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-53e9cf55-e8c7-4895-80a4-ef00060c8c25 tempest-VolumesBackupsAdminTest-1318980882 None] Lock "b'cinder-8c60543f-0b8c-4bd2-9d7e-4e84bd75c8f3-delete_volume'" released by "delete_volume" :: held 0.848s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:20:25.680679 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-a1e4aca6-1797-40a1-9251-f0b499ab8ec3 tempest-VolumesBackupsAdminTest-1318980882 None] Lock "b'cinder-053aa06f-7a8a-404c-9d24-3061c8256367-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:20:25.683359 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=68,cinder:UPDATE=27,cinder:DELETE=3,cinder:INSERT=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:20:25.731108 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a1e4aca6-1797-40a1-9251-f0b499ab8ec3 tempest-VolumesBackupsAdminTest-1318980882 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:20:26.078378 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a1e4aca6-1797-40a1-9251-f0b499ab8ec3 tempest-VolumesBackupsAdminTest-1318980882 None] Volume volume-053aa06f-7a8a-404c-9d24-3061c8256367 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:20:26.087900 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a1e4aca6-1797-40a1-9251-f0b499ab8ec3 tempest-VolumesBackupsAdminTest-1318980882 None] deleting rbd volume volume-053aa06f-7a8a-404c-9d24-3061c8256367 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:20:26.327988 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-a1e4aca6-1797-40a1-9251-f0b499ab8ec3 tempest-VolumesBackupsAdminTest-1318980882 None] Created reservations ['9291e99d-6005-4b49-8cb2-a5d03cf18df2', '65240b42-1549-4825-8cd9-972a05328b1e', 'd4e417c9-63f4-40ad-b0de-97eeec41a72c', '602d283f-dac7-4a44-83b6-e779a619a88a'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:20:26.380057 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a1e4aca6-1797-40a1-9251-f0b499ab8ec3 tempest-VolumesBackupsAdminTest-1318980882 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:20:26.422606 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a1e4aca6-1797-40a1-9251-f0b499ab8ec3 tempest-VolumesBackupsAdminTest-1318980882 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:20:26.481666 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-a1e4aca6-1797-40a1-9251-f0b499ab8ec3 tempest-VolumesBackupsAdminTest-1318980882 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:20:26.487543 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-a1e4aca6-1797-40a1-9251-f0b499ab8ec3 tempest-VolumesBackupsAdminTest-1318980882 None] Deleted volume successfully. Jun 25 21:20:26.501902 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-a1e4aca6-1797-40a1-9251-f0b499ab8ec3 tempest-VolumesBackupsAdminTest-1318980882 None] Lock "b'cinder-053aa06f-7a8a-404c-9d24-3061c8256367-delete_volume'" released by "delete_volume" :: held 0.821s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:20:27.308004 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8a16796-992b-47b0-bbcf-ab152658de0c tempest-AttachVolumeShelveTestJSON-967589539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:20:27.332574 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b8a16796-992b-47b0-bbcf-ab152658de0c tempest-AttachVolumeShelveTestJSON-967589539 None] Flow 'volume_create_manager' (f2908905-5866-45de-8f7c-22f96ce2ca26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:20:27.340812 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b8a16796-992b-47b0-bbcf-ab152658de0c tempest-AttachVolumeShelveTestJSON-967589539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (896936f8-96bb-4387-8aa2-afe905492e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:20:27.357033 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b8a16796-992b-47b0-bbcf-ab152658de0c tempest-AttachVolumeShelveTestJSON-967589539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (896936f8-96bb-4387-8aa2-afe905492e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-214920677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6ea084b5-50f4-4ac2-a042-fe961b762368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='041615c7a84b47f88e21c6a4e19dd7ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:20:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:20:27Z,use_quota=True,user_id='c845f86f1b6244f7a53996329294f2cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:20:27.369186 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b8a16796-992b-47b0-bbcf-ab152658de0c tempest-AttachVolumeShelveTestJSON-967589539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4287149-c2eb-49a2-bba9-5668acaad364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:20:27.371185 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b8a16796-992b-47b0-bbcf-ab152658de0c tempest-AttachVolumeShelveTestJSON-967589539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4287149-c2eb-49a2-bba9-5668acaad364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:20:27.376182 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b8a16796-992b-47b0-bbcf-ab152658de0c tempest-AttachVolumeShelveTestJSON-967589539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (611034fb-9214-4171-86f3-e71aeccb3c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:20:27.380553 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b8a16796-992b-47b0-bbcf-ab152658de0c tempest-AttachVolumeShelveTestJSON-967589539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (611034fb-9214-4171-86f3-e71aeccb3c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ea084b5-50f4-4ac2-a042-fe961b762368', 'volume_name': 'volume-6ea084b5-50f4-4ac2-a042-fe961b762368', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:20:27.385398 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b8a16796-992b-47b0-bbcf-ab152658de0c tempest-AttachVolumeShelveTestJSON-967589539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e537f1dc-1045-43e5-9fbe-7e11d19f9763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:20:27.390055 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b8a16796-992b-47b0-bbcf-ab152658de0c tempest-AttachVolumeShelveTestJSON-967589539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e537f1dc-1045-43e5-9fbe-7e11d19f9763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:20:27.395031 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b8a16796-992b-47b0-bbcf-ab152658de0c tempest-AttachVolumeShelveTestJSON-967589539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (794958df-3ef0-4208-88b8-82fc669a5e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:20:27.396272 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-b8a16796-992b-47b0-bbcf-ab152658de0c tempest-AttachVolumeShelveTestJSON-967589539 None] Volume 6ea084b5-50f4-4ac2-a042-fe961b762368: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ea084b5-50f4-4ac2-a042-fe961b762368', 'volume_size': 1} Jun 25 21:20:27.396861 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b8a16796-992b-47b0-bbcf-ab152658de0c tempest-AttachVolumeShelveTestJSON-967589539 None] creating volume 'volume-6ea084b5-50f4-4ac2-a042-fe961b762368' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:20:27.397642 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b8a16796-992b-47b0-bbcf-ab152658de0c tempest-AttachVolumeShelveTestJSON-967589539 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:20:27.474218 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b8a16796-992b-47b0-bbcf-ab152658de0c tempest-AttachVolumeShelveTestJSON-967589539 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:20:27.474663 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b8a16796-992b-47b0-bbcf-ab152658de0c tempest-AttachVolumeShelveTestJSON-967589539 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:20:27.480414 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b8a16796-992b-47b0-bbcf-ab152658de0c tempest-AttachVolumeShelveTestJSON-967589539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (794958df-3ef0-4208-88b8-82fc669a5e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ea084b5-50f4-4ac2-a042-fe961b762368', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:20:27.489507 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b8a16796-992b-47b0-bbcf-ab152658de0c tempest-AttachVolumeShelveTestJSON-967589539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ef5646d-8ee2-41a0-b06d-f0a9ee93887e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:20:27.502221 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-b8a16796-992b-47b0-bbcf-ab152658de0c tempest-AttachVolumeShelveTestJSON-967589539 None] Volume volume-6ea084b5-50f4-4ac2-a042-fe961b762368 (6ea084b5-50f4-4ac2-a042-fe961b762368): created successfully Jun 25 21:20:27.507415 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b8a16796-992b-47b0-bbcf-ab152658de0c tempest-AttachVolumeShelveTestJSON-967589539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ef5646d-8ee2-41a0-b06d-f0a9ee93887e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:20:27.513037 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b8a16796-992b-47b0-bbcf-ab152658de0c tempest-AttachVolumeShelveTestJSON-967589539 None] Flow 'volume_create_manager' (f2908905-5866-45de-8f7c-22f96ce2ca26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:20:27.523063 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-b8a16796-992b-47b0-bbcf-ab152658de0c tempest-AttachVolumeShelveTestJSON-967589539 None] Created volume successfully. Jun 25 21:20:29.778394 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-32db8605-7146-44da-8c76-e66091822d69 tempest-VolumesSnapshotListTestJSON-1343118787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:20:29.798651 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-32db8605-7146-44da-8c76-e66091822d69 tempest-VolumesSnapshotListTestJSON-1343118787 None] Flow 'volume_create_manager' (2ca6eab4-21ee-4233-9c9c-adc26f4e538f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:20:29.812746 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-32db8605-7146-44da-8c76-e66091822d69 tempest-VolumesSnapshotListTestJSON-1343118787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2caf7cb-ff90-4e06-8ed4-5a8fbf19d75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:20:29.842441 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-32db8605-7146-44da-8c76-e66091822d69 tempest-VolumesSnapshotListTestJSON-1343118787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2caf7cb-ff90-4e06-8ed4-5a8fbf19d75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1319687439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=feff7118-8f46-425c-89cf-846aa5fb4fd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1be4fc8c2ab441a866c9a978586757b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:20:30Z,use_quota=True,user_id='286c216433364aeb962724d5933ee244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:20:29.850346 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-32db8605-7146-44da-8c76-e66091822d69 tempest-VolumesSnapshotListTestJSON-1343118787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8bfd2ef-69f7-4f2d-b4cc-67b0cf59fcc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:20:29.854477 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-32db8605-7146-44da-8c76-e66091822d69 tempest-VolumesSnapshotListTestJSON-1343118787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8bfd2ef-69f7-4f2d-b4cc-67b0cf59fcc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:20:29.860058 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-32db8605-7146-44da-8c76-e66091822d69 tempest-VolumesSnapshotListTestJSON-1343118787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6217f198-5834-4b19-b655-d30f6d1124f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:20:29.864393 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-32db8605-7146-44da-8c76-e66091822d69 tempest-VolumesSnapshotListTestJSON-1343118787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6217f198-5834-4b19-b655-d30f6d1124f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'feff7118-8f46-425c-89cf-846aa5fb4fd5', 'volume_name': 'volume-feff7118-8f46-425c-89cf-846aa5fb4fd5', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:20:29.869269 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-32db8605-7146-44da-8c76-e66091822d69 tempest-VolumesSnapshotListTestJSON-1343118787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56be373f-bd2e-4e87-8999-cdd6fb1b62d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:20:29.873162 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-32db8605-7146-44da-8c76-e66091822d69 tempest-VolumesSnapshotListTestJSON-1343118787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56be373f-bd2e-4e87-8999-cdd6fb1b62d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:20:29.877919 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-32db8605-7146-44da-8c76-e66091822d69 tempest-VolumesSnapshotListTestJSON-1343118787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b3c24a6-5020-49b4-936d-24253bfd0765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:20:29.879231 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-32db8605-7146-44da-8c76-e66091822d69 tempest-VolumesSnapshotListTestJSON-1343118787 None] Volume feff7118-8f46-425c-89cf-846aa5fb4fd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-feff7118-8f46-425c-89cf-846aa5fb4fd5', 'volume_size': 1} Jun 25 21:20:29.879774 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-32db8605-7146-44da-8c76-e66091822d69 tempest-VolumesSnapshotListTestJSON-1343118787 None] creating volume 'volume-feff7118-8f46-425c-89cf-846aa5fb4fd5' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:20:29.880674 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-32db8605-7146-44da-8c76-e66091822d69 tempest-VolumesSnapshotListTestJSON-1343118787 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:20:29.952342 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-32db8605-7146-44da-8c76-e66091822d69 tempest-VolumesSnapshotListTestJSON-1343118787 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:20:29.952868 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-32db8605-7146-44da-8c76-e66091822d69 tempest-VolumesSnapshotListTestJSON-1343118787 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:20:29.959904 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-32db8605-7146-44da-8c76-e66091822d69 tempest-VolumesSnapshotListTestJSON-1343118787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b3c24a6-5020-49b4-936d-24253bfd0765) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-feff7118-8f46-425c-89cf-846aa5fb4fd5', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:20:29.966243 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-32db8605-7146-44da-8c76-e66091822d69 tempest-VolumesSnapshotListTestJSON-1343118787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acfe217d-4f22-43ca-bff7-2835f5086932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:20:29.979816 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-32db8605-7146-44da-8c76-e66091822d69 tempest-VolumesSnapshotListTestJSON-1343118787 None] Volume volume-feff7118-8f46-425c-89cf-846aa5fb4fd5 (feff7118-8f46-425c-89cf-846aa5fb4fd5): created successfully Jun 25 21:20:29.987525 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-32db8605-7146-44da-8c76-e66091822d69 tempest-VolumesSnapshotListTestJSON-1343118787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acfe217d-4f22-43ca-bff7-2835f5086932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:20:29.998415 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-32db8605-7146-44da-8c76-e66091822d69 tempest-VolumesSnapshotListTestJSON-1343118787 None] Flow 'volume_create_manager' (2ca6eab4-21ee-4233-9c9c-adc26f4e538f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:20:30.008723 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-32db8605-7146-44da-8c76-e66091822d69 tempest-VolumesSnapshotListTestJSON-1343118787 None] Created volume successfully. Jun 25 21:20:31.169431 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-055e98fe-882d-4e14-86cd-a48feb778cc6 tempest-VolumesSnapshotListTestJSON-1343118787 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:20:31.774061 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-055e98fe-882d-4e14-86cd-a48feb778cc6 tempest-VolumesSnapshotListTestJSON-1343118787 None] Create snapshot completed successfully Jun 25 21:20:32.406855 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-998f5d65-8f56-44c5-bb80-2c2113f48148 tempest-VolumesSnapshotListTestJSON-1343118787 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:20:33.595111 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-998f5d65-8f56-44c5-bb80-2c2113f48148 tempest-VolumesSnapshotListTestJSON-1343118787 None] Create snapshot completed successfully Jun 25 21:20:34.700564 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3ddacf41-f3f6-45ec-9f43-3c54ec2bbea9 tempest-VolumesSnapshotListTestJSON-1343118787 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:20:35.645096 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-3ddacf41-f3f6-45ec-9f43-3c54ec2bbea9 tempest-VolumesSnapshotListTestJSON-1343118787 None] Create snapshot completed successfully Jun 25 21:20:36.636835 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-bb8c2395-fee5-41bf-abba-2ced5a3cdf9d tempest-VolumesSnapshotListTestJSON-1343118787 None] Lock "b'cinder-fdd1d5a2-34b3-45d4-8038-2faa43036621-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:20:36.639833 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-bb8c2395-fee5-41bf-abba-2ced5a3cdf9d tempest-VolumesSnapshotListTestJSON-1343118787 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:20:37.671147 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-bb8c2395-fee5-41bf-abba-2ced5a3cdf9d tempest-VolumesSnapshotListTestJSON-1343118787 None] Created reservations ['161f1929-68ac-4799-b512-71a7b2fec68e', 'efe618cc-5fda-4d51-b619-4dd08907776b', 'eed9db96-b43e-42a4-a95b-b565f9a6ce95', 'f9655a0c-cfe7-45ab-984d-951fa3f301e2'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:20:37.720773 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-bb8c2395-fee5-41bf-abba-2ced5a3cdf9d tempest-VolumesSnapshotListTestJSON-1343118787 None] Delete snapshot completed successfully. Jun 25 21:20:37.729748 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-bb8c2395-fee5-41bf-abba-2ced5a3cdf9d tempest-VolumesSnapshotListTestJSON-1343118787 None] Lock "b'cinder-fdd1d5a2-34b3-45d4-8038-2faa43036621-delete_snapshot'" released by "delete_snapshot" :: held 1.096s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:20:38.808912 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-d059191c-7b14-4767-8281-a140abd21e49 tempest-VolumesSnapshotListTestJSON-1343118787 None] Lock "b'cinder-e16521f9-92a2-4e06-a8de-620684485db0-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:20:38.810368 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d059191c-7b14-4767-8281-a140abd21e49 tempest-VolumesSnapshotListTestJSON-1343118787 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:20:39.713389 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-d059191c-7b14-4767-8281-a140abd21e49 tempest-VolumesSnapshotListTestJSON-1343118787 None] Created reservations ['75a97a0c-bbe1-44c2-83c1-133d74f23204', '3a917e33-8c90-4679-96fe-a6701eb3b9e8', '2e65381e-9b6e-48c9-bc85-05928800c994', 'def86786-c7f3-4ea4-a972-a6d3bfddcc5b'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:20:39.763491 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-d059191c-7b14-4767-8281-a140abd21e49 tempest-VolumesSnapshotListTestJSON-1343118787 None] Delete snapshot completed successfully. Jun 25 21:20:39.774330 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-d059191c-7b14-4767-8281-a140abd21e49 tempest-VolumesSnapshotListTestJSON-1343118787 None] Lock "b'cinder-e16521f9-92a2-4e06-a8de-620684485db0-delete_snapshot'" released by "delete_snapshot" :: held 0.966s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:20:39.937916 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-55ed2ebb-1a95-4a6c-a50c-1f7df3f27cc6 tempest-VolumesSnapshotListTestJSON-1343118787 None] Lock "b'cinder-5f2fe39c-4f89-4746-a8db-21c223926866-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.017s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:20:39.941554 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-55ed2ebb-1a95-4a6c-a50c-1f7df3f27cc6 tempest-VolumesSnapshotListTestJSON-1343118787 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:20:40.733702 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-55ed2ebb-1a95-4a6c-a50c-1f7df3f27cc6 tempest-VolumesSnapshotListTestJSON-1343118787 None] Created reservations ['967dc659-eeaf-4acb-ae39-00f1326a10f4', '695a1a57-2339-4b70-b073-b309de7719b3', 'ddaaaf9b-bc81-49b2-a005-da4c7c8ab9b2', 'f5b8ba37-2bd7-400b-9079-284daf70f7ec'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:20:40.748026 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=61,cinder:INSERT=8,cinder:UPDATE=27,cinder:DELETE=4 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:20:40.755156 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:UPDATE=30,cinder:SELECT=60,cinder:INSERT=8,cinder:DELETE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:20:40.782589 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-55ed2ebb-1a95-4a6c-a50c-1f7df3f27cc6 tempest-VolumesSnapshotListTestJSON-1343118787 None] Delete snapshot completed successfully. Jun 25 21:20:40.787866 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-55ed2ebb-1a95-4a6c-a50c-1f7df3f27cc6 tempest-VolumesSnapshotListTestJSON-1343118787 None] Lock "b'cinder-5f2fe39c-4f89-4746-a8db-21c223926866-delete_snapshot'" released by "delete_snapshot" :: held 0.850s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:20:41.083467 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-3277e12c-d714-461a-8d92-cad0bd1542ad tempest-VolumesSnapshotListTestJSON-1343118787 None] Lock "b'cinder-feff7118-8f46-425c-89cf-846aa5fb4fd5-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:20:41.119689 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3277e12c-d714-461a-8d92-cad0bd1542ad tempest-VolumesSnapshotListTestJSON-1343118787 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:20:41.163465 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3277e12c-d714-461a-8d92-cad0bd1542ad tempest-VolumesSnapshotListTestJSON-1343118787 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:20:41.163813 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3277e12c-d714-461a-8d92-cad0bd1542ad tempest-VolumesSnapshotListTestJSON-1343118787 None] Volume volume-feff7118-8f46-425c-89cf-846aa5fb4fd5 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:20:41.171770 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3277e12c-d714-461a-8d92-cad0bd1542ad tempest-VolumesSnapshotListTestJSON-1343118787 None] deleting rbd volume volume-feff7118-8f46-425c-89cf-846aa5fb4fd5 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:20:41.370898 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-3277e12c-d714-461a-8d92-cad0bd1542ad tempest-VolumesSnapshotListTestJSON-1343118787 None] Created reservations ['8e88a31a-dd17-4fdd-ac62-833d4e4c1263', '83d1bdf8-4251-4889-b494-57fb343d3668', '513da1d0-65d7-4c43-9315-98efaaf321f1', '987f5e5d-0ce3-4dc0-b4f2-3913f6362f31'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:20:41.424615 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3277e12c-d714-461a-8d92-cad0bd1542ad tempest-VolumesSnapshotListTestJSON-1343118787 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:20:41.465316 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3277e12c-d714-461a-8d92-cad0bd1542ad tempest-VolumesSnapshotListTestJSON-1343118787 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:20:41.507439 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-3277e12c-d714-461a-8d92-cad0bd1542ad tempest-VolumesSnapshotListTestJSON-1343118787 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:20:41.511762 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-3277e12c-d714-461a-8d92-cad0bd1542ad tempest-VolumesSnapshotListTestJSON-1343118787 None] Deleted volume successfully. Jun 25 21:20:41.531247 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-3277e12c-d714-461a-8d92-cad0bd1542ad tempest-VolumesSnapshotListTestJSON-1343118787 None] Lock "b'cinder-feff7118-8f46-425c-89cf-846aa5fb4fd5-delete_volume'" released by "delete_volume" :: held 0.448s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:20:45.017594 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-5b819d31-85b3-44f0-88eb-b1a4f28e0207 tempest-VolumesSnapshotTestJSON-558272145 None] Created reservations ['a5145cf3-475b-4b2d-b90f-9f66564ff35d', '36982707-59df-438c-8961-db00ebddd73b', '2e09b9b8-bdd0-447a-879a-268e25473832', 'fb748f22-94e1-4efc-acb9-32111ef1cd5a'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:20:45.089025 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-5b819d31-85b3-44f0-88eb-b1a4f28e0207 tempest-VolumesSnapshotTestJSON-558272145 None] Delete snapshot completed successfully. Jun 25 21:20:45.097683 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-5b819d31-85b3-44f0-88eb-b1a4f28e0207 tempest-VolumesSnapshotTestJSON-558272145 None] Lock "b'cinder-bd3cef14-797f-4348-87c9-0bf8ac789470-delete_snapshot'" released by "delete_snapshot" :: held 30.405s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:20:46.058084 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-b1e9416d-9819-4074-9a89-d691ba6cc8f3 tempest-VolumesSnapshotTestJSON-558272145 None] Lock "b'cinder-42194d99-1da1-4125-8c57-744666777f3c-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.013s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:20:46.071178 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b1e9416d-9819-4074-9a89-d691ba6cc8f3 tempest-VolumesSnapshotTestJSON-558272145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:20:52.151249 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:20:52.152052 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:20:52.240374 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:20:52.310821 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:20:55.082004 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=26,cinder:UPDATE=23,cinder:INSERT=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:20:57.698200 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4bde89b-2c80-41bd-9138-54879290f056 tempest-AttachVolumeNegativeTest-2001135405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:20:57.741437 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c4bde89b-2c80-41bd-9138-54879290f056 tempest-AttachVolumeNegativeTest-2001135405 None] Flow 'volume_create_manager' (27f398b6-69a7-4c29-82bd-6ff385267168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:20:57.796032 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c4bde89b-2c80-41bd-9138-54879290f056 tempest-AttachVolumeNegativeTest-2001135405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d643e5a6-8130-4a9f-89b8-8de62e9109fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:20:57.882456 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c4bde89b-2c80-41bd-9138-54879290f056 tempest-AttachVolumeNegativeTest-2001135405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d643e5a6-8130-4a9f-89b8-8de62e9109fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:20:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1500969235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=184c4f9a-38f6-4599-92b2-25ca10393308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d32f25e6afd2425db488a9387869da19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:20:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:20:58Z,use_quota=True,user_id='3648405427d14f91a4bb44bd81f2195b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:20:57.889424 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c4bde89b-2c80-41bd-9138-54879290f056 tempest-AttachVolumeNegativeTest-2001135405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d1855a0-2000-4932-873f-404b0a0177fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:20:57.901221 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c4bde89b-2c80-41bd-9138-54879290f056 tempest-AttachVolumeNegativeTest-2001135405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d1855a0-2000-4932-873f-404b0a0177fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:20:57.916289 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c4bde89b-2c80-41bd-9138-54879290f056 tempest-AttachVolumeNegativeTest-2001135405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82d116ec-5d93-493a-8d28-4b8c40ed0781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:20:57.935269 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c4bde89b-2c80-41bd-9138-54879290f056 tempest-AttachVolumeNegativeTest-2001135405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82d116ec-5d93-493a-8d28-4b8c40ed0781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '184c4f9a-38f6-4599-92b2-25ca10393308', 'volume_name': 'volume-184c4f9a-38f6-4599-92b2-25ca10393308', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:20:57.940978 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c4bde89b-2c80-41bd-9138-54879290f056 tempest-AttachVolumeNegativeTest-2001135405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f5c1c0d-e9e5-407d-942c-92b5cfaf2301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:20:57.957484 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c4bde89b-2c80-41bd-9138-54879290f056 tempest-AttachVolumeNegativeTest-2001135405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f5c1c0d-e9e5-407d-942c-92b5cfaf2301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:20:57.966575 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c4bde89b-2c80-41bd-9138-54879290f056 tempest-AttachVolumeNegativeTest-2001135405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2a3d738-b192-4cfb-869b-f7842d14a42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:20:57.974034 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-c4bde89b-2c80-41bd-9138-54879290f056 tempest-AttachVolumeNegativeTest-2001135405 None] Volume 184c4f9a-38f6-4599-92b2-25ca10393308: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-184c4f9a-38f6-4599-92b2-25ca10393308', 'volume_size': 1} Jun 25 21:20:57.974703 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c4bde89b-2c80-41bd-9138-54879290f056 tempest-AttachVolumeNegativeTest-2001135405 None] creating volume 'volume-184c4f9a-38f6-4599-92b2-25ca10393308' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:20:57.975653 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c4bde89b-2c80-41bd-9138-54879290f056 tempest-AttachVolumeNegativeTest-2001135405 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:20:58.121848 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c4bde89b-2c80-41bd-9138-54879290f056 tempest-AttachVolumeNegativeTest-2001135405 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:20:58.123087 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c4bde89b-2c80-41bd-9138-54879290f056 tempest-AttachVolumeNegativeTest-2001135405 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:20:58.127065 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c4bde89b-2c80-41bd-9138-54879290f056 tempest-AttachVolumeNegativeTest-2001135405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2a3d738-b192-4cfb-869b-f7842d14a42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-184c4f9a-38f6-4599-92b2-25ca10393308', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:20:58.140289 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c4bde89b-2c80-41bd-9138-54879290f056 tempest-AttachVolumeNegativeTest-2001135405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2f588d3-5876-43a6-818c-ba380d711b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:20:58.153517 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-c4bde89b-2c80-41bd-9138-54879290f056 tempest-AttachVolumeNegativeTest-2001135405 None] Volume volume-184c4f9a-38f6-4599-92b2-25ca10393308 (184c4f9a-38f6-4599-92b2-25ca10393308): created successfully Jun 25 21:20:58.160693 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c4bde89b-2c80-41bd-9138-54879290f056 tempest-AttachVolumeNegativeTest-2001135405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2f588d3-5876-43a6-818c-ba380d711b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:20:58.167457 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-c4bde89b-2c80-41bd-9138-54879290f056 tempest-AttachVolumeNegativeTest-2001135405 None] Flow 'volume_create_manager' (27f398b6-69a7-4c29-82bd-6ff385267168) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:20:58.184300 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-c4bde89b-2c80-41bd-9138-54879290f056 tempest-AttachVolumeNegativeTest-2001135405 None] Created volume successfully. Jun 25 21:20:59.771201 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-f737147a-0725-4f46-bda6-a58c685e66fb req-b8cd4a0a-0bf6-4783-9e1f-e9c40f4d42c6 tempest-AttachVolumeNegativeTest-2001135405 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 21:21:01.712656 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-f737147a-0725-4f46-bda6-a58c685e66fb req-b8cd4a0a-0bf6-4783-9e1f-e9c40f4d42c6 tempest-AttachVolumeNegativeTest-2001135405 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.941s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 21:21:01.713609 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-f737147a-0725-4f46-bda6-a58c685e66fb req-b8cd4a0a-0bf6-4783-9e1f-e9c40f4d42c6 tempest-AttachVolumeNegativeTest-2001135405 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-184c4f9a-38f6-4599-92b2-25ca10393308', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': '184c4f9a-38f6-4599-92b2-25ca10393308', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 21:21:01.889429 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-f737147a-0725-4f46-bda6-a58c685e66fb req-b8cd4a0a-0bf6-4783-9e1f-e9c40f4d42c6 tempest-AttachVolumeNegativeTest-2001135405 None] Connection info returned from driver {'name': 'volumes/volume-184c4f9a-38f6-4599-92b2-25ca10393308', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '184c4f9a-38f6-4599-92b2-25ca10393308', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '354ce62f-2110-4605-a8ec-1c138b698e06'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 25 21:21:02.008277 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-f737147a-0725-4f46-bda6-a58c685e66fb req-b8cd4a0a-0bf6-4783-9e1f-e9c40f4d42c6 tempest-AttachVolumeNegativeTest-2001135405 None] attachment_update completed successfully. Jun 25 21:21:05.097814 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-d82fc84e-e689-4bc3-abed-5ad528a3ef7e req-9cef817d-229c-4ed5-b3ca-7a388ab3ee68 tempest-AttachVolumeNegativeTest-2001135405 None] Terminate volume connection completed successfully. Jun 25 21:21:05.098522 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-d82fc84e-e689-4bc3-abed-5ad528a3ef7e req-9cef817d-229c-4ed5-b3ca-7a388ab3ee68 tempest-AttachVolumeNegativeTest-2001135405 None] Deleting attachment 354ce62f-2110-4605-a8ec-1c138b698e06. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 25 21:21:07.294914 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-563bc5ab-5126-468c-9a86-2e1db2ce169f req-248476fd-de13-4c93-8b8a-e2a488cf5920 tempest-AttachVolumeShelveTestJSON-967589539 None] No connector for attachment 30b17b10-9513-4fed-a9f0-3a4ec7f33a7c; skipping storage backend terminate_connection call. {{(pid=130674) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4913}} Jun 25 21:21:07.300008 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-563bc5ab-5126-468c-9a86-2e1db2ce169f req-248476fd-de13-4c93-8b8a-e2a488cf5920 tempest-AttachVolumeShelveTestJSON-967589539 None] Deleting attachment 30b17b10-9513-4fed-a9f0-3a4ec7f33a7c. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 25 21:21:13.719842 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-b3221cce-cd26-40b1-a51b-4994371238fb tempest-AttachVolumeNegativeTest-2001135405 None] Lock "b'cinder-184c4f9a-38f6-4599-92b2-25ca10393308-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:21:13.724786 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=50,cinder:INSERT=5,cinder:UPDATE=17,cinder:DELETE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:13.770980 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b3221cce-cd26-40b1-a51b-4994371238fb tempest-AttachVolumeNegativeTest-2001135405 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:21:13.844132 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b3221cce-cd26-40b1-a51b-4994371238fb tempest-AttachVolumeNegativeTest-2001135405 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:21:13.844882 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b3221cce-cd26-40b1-a51b-4994371238fb tempest-AttachVolumeNegativeTest-2001135405 None] Volume volume-184c4f9a-38f6-4599-92b2-25ca10393308 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:21:13.853203 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b3221cce-cd26-40b1-a51b-4994371238fb tempest-AttachVolumeNegativeTest-2001135405 None] deleting rbd volume volume-184c4f9a-38f6-4599-92b2-25ca10393308 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:21:14.207294 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-b3221cce-cd26-40b1-a51b-4994371238fb tempest-AttachVolumeNegativeTest-2001135405 None] Created reservations ['5db8a285-be88-4f51-8045-1244af205682', '2bf49a2a-69ad-4bcd-86cb-3013c4b472b4', 'e74ea90e-e107-4137-b4e9-a53cd92e8052', '1ed0e91d-94ac-4287-866f-43f29361a509'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:21:14.332004 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b3221cce-cd26-40b1-a51b-4994371238fb tempest-AttachVolumeNegativeTest-2001135405 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:21:14.410603 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b3221cce-cd26-40b1-a51b-4994371238fb tempest-AttachVolumeNegativeTest-2001135405 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:21:14.480873 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-b3221cce-cd26-40b1-a51b-4994371238fb tempest-AttachVolumeNegativeTest-2001135405 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:21:14.487033 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-b3221cce-cd26-40b1-a51b-4994371238fb tempest-AttachVolumeNegativeTest-2001135405 None] Deleted volume successfully. Jun 25 21:21:14.505212 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-b3221cce-cd26-40b1-a51b-4994371238fb tempest-AttachVolumeNegativeTest-2001135405 None] Lock "b'cinder-184c4f9a-38f6-4599-92b2-25ca10393308-delete_volume'" released by "delete_volume" :: held 0.785s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:21:15.083292 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-f2e24e0d-ae94-4cfb-94c6-b03eba9c43f5 tempest-AttachVolumeNegativeTest-2001135405 None] Lock "b'cinder-c6c6bbb3-c0fb-4f1e-92ee-a93662d20633-delete_volume'" acquired by "delete_volume" :: waited 0.026s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:21:15.181173 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f2e24e0d-ae94-4cfb-94c6-b03eba9c43f5 tempest-AttachVolumeNegativeTest-2001135405 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:21:15.258032 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f2e24e0d-ae94-4cfb-94c6-b03eba9c43f5 tempest-AttachVolumeNegativeTest-2001135405 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:21:15.258660 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f2e24e0d-ae94-4cfb-94c6-b03eba9c43f5 tempest-AttachVolumeNegativeTest-2001135405 None] Volume volume-c6c6bbb3-c0fb-4f1e-92ee-a93662d20633 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:21:15.266221 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f2e24e0d-ae94-4cfb-94c6-b03eba9c43f5 tempest-AttachVolumeNegativeTest-2001135405 None] deleting rbd volume volume-c6c6bbb3-c0fb-4f1e-92ee-a93662d20633 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:21:15.596258 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-f2e24e0d-ae94-4cfb-94c6-b03eba9c43f5 tempest-AttachVolumeNegativeTest-2001135405 None] Created reservations ['f1e53663-0780-4363-aee2-1fffb1b89a70', 'ddb8dfcb-90d6-4e55-b2bc-277d9bc5a722', 'cdce2848-ac2f-4c15-b5c6-8cf08cee27bd', 'd93dbfb0-595b-4830-99f6-ec98fe518d66'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:21:15.691930 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f2e24e0d-ae94-4cfb-94c6-b03eba9c43f5 tempest-AttachVolumeNegativeTest-2001135405 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:21:15.784248 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f2e24e0d-ae94-4cfb-94c6-b03eba9c43f5 tempest-AttachVolumeNegativeTest-2001135405 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:21:15.850868 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-f2e24e0d-ae94-4cfb-94c6-b03eba9c43f5 tempest-AttachVolumeNegativeTest-2001135405 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:21:15.858364 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-f2e24e0d-ae94-4cfb-94c6-b03eba9c43f5 tempest-AttachVolumeNegativeTest-2001135405 None] Deleted volume successfully. Jun 25 21:21:15.880904 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-f2e24e0d-ae94-4cfb-94c6-b03eba9c43f5 tempest-AttachVolumeNegativeTest-2001135405 None] Lock "b'cinder-c6c6bbb3-c0fb-4f1e-92ee-a93662d20633-delete_volume'" released by "delete_volume" :: held 0.797s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:21:16.375163 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-b1e9416d-9819-4074-9a89-d691ba6cc8f3 tempest-VolumesSnapshotTestJSON-558272145 None] Created reservations ['d7b5ce93-090f-4ce0-ae10-555a2deefb25', 'deb22491-61b1-4cf0-89ca-60733210cdea', '9ca6aca5-78d9-4b05-87d2-b200b891d6d1', '15d28f96-97b4-4649-b62b-54f3e4470efb'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:21:16.463845 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=59,cinder:UPDATE=37,cinder:DELETE=1,cinder:INSERT=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:16.470231 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-b1e9416d-9819-4074-9a89-d691ba6cc8f3 tempest-VolumesSnapshotTestJSON-558272145 None] Delete snapshot completed successfully. Jun 25 21:21:16.476784 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-b1e9416d-9819-4074-9a89-d691ba6cc8f3 tempest-VolumesSnapshotTestJSON-558272145 None] Lock "b'cinder-42194d99-1da1-4125-8c57-744666777f3c-delete_snapshot'" released by "delete_snapshot" :: held 30.426s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:21:16.782708 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-3b6fa908-4c9a-4ce2-9593-9a5a20048e75 tempest-AttachVolumeNegativeTest-2001135405 None] Lock "b'cinder-5ebdd798-3bf7-43ca-a95f-02a861d932e8-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:21:16.866997 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3b6fa908-4c9a-4ce2-9593-9a5a20048e75 tempest-AttachVolumeNegativeTest-2001135405 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:21:16.988735 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3b6fa908-4c9a-4ce2-9593-9a5a20048e75 tempest-AttachVolumeNegativeTest-2001135405 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:21:16.989167 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3b6fa908-4c9a-4ce2-9593-9a5a20048e75 tempest-AttachVolumeNegativeTest-2001135405 None] Volume volume-5ebdd798-3bf7-43ca-a95f-02a861d932e8 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:21:17.012873 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3b6fa908-4c9a-4ce2-9593-9a5a20048e75 tempest-AttachVolumeNegativeTest-2001135405 None] deleting rbd volume volume-5ebdd798-3bf7-43ca-a95f-02a861d932e8 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:21:17.014836 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-3975bb8c-c131-43fe-b936-9aafd0157dbb tempest-VolumesSnapshotTestJSON-558272145 None] Lock "b'cinder-aac2ba28-29fa-4e80-b9ec-0c806f889314-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.181s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:21:17.016750 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3975bb8c-c131-43fe-b936-9aafd0157dbb tempest-VolumesSnapshotTestJSON-558272145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:21:17.498415 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-3b6fa908-4c9a-4ce2-9593-9a5a20048e75 tempest-AttachVolumeNegativeTest-2001135405 None] Created reservations ['f94a5993-2856-4932-bcae-d0b0b7945bc8', 'e50010f5-c1af-46d8-a023-e32205c805c4', '9cbf850a-65a2-49bd-bcd9-212578e79cb5', '40debc66-8381-4f64-b21c-6f9cc9ddddeb'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:21:17.651622 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3b6fa908-4c9a-4ce2-9593-9a5a20048e75 tempest-AttachVolumeNegativeTest-2001135405 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:21:17.755049 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-3b6fa908-4c9a-4ce2-9593-9a5a20048e75 tempest-AttachVolumeNegativeTest-2001135405 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:21:17.834825 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-3b6fa908-4c9a-4ce2-9593-9a5a20048e75 tempest-AttachVolumeNegativeTest-2001135405 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:21:17.841328 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-3b6fa908-4c9a-4ce2-9593-9a5a20048e75 tempest-AttachVolumeNegativeTest-2001135405 None] Deleted volume successfully. Jun 25 21:21:17.861056 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-3b6fa908-4c9a-4ce2-9593-9a5a20048e75 tempest-AttachVolumeNegativeTest-2001135405 None] Lock "b'cinder-5ebdd798-3bf7-43ca-a95f-02a861d932e8-delete_volume'" released by "delete_volume" :: held 1.078s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:21:34.092852 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=36,cinder:INSERT=11,cinder:UPDATE=16,cinder:DELETE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:47.219353 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=22,cinder:UPDATE=13,cinder:INSERT=2,cinder:DELETE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:47.262580 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-3975bb8c-c131-43fe-b936-9aafd0157dbb tempest-VolumesSnapshotTestJSON-558272145 None] Created reservations ['81b73bf8-3b81-4a26-a5ea-fca0d8a96d37', '393db3d7-3c38-4e42-bb4f-d64a8c646942', '47b17f1c-ebe5-45e3-a874-c58360175465', '04559ca1-3d5c-4e80-bc42-df733cc2b90a'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:21:47.314588 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-3975bb8c-c131-43fe-b936-9aafd0157dbb tempest-VolumesSnapshotTestJSON-558272145 None] Delete snapshot completed successfully. Jun 25 21:21:47.321371 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-3975bb8c-c131-43fe-b936-9aafd0157dbb tempest-VolumesSnapshotTestJSON-558272145 None] Lock "b'cinder-aac2ba28-29fa-4e80-b9ec-0c806f889314-delete_snapshot'" released by "delete_snapshot" :: held 30.306s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:21:48.393796 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-3914f83e-cfbc-4dbd-ae25-d0df33b52ac8 req-83074d35-61b5-487e-be98-5ce1592d7991 tempest-VolumesSnapshotTestJSON-558272145 None] Terminate volume connection completed successfully. Jun 25 21:21:48.394938 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-3914f83e-cfbc-4dbd-ae25-d0df33b52ac8 req-83074d35-61b5-487e-be98-5ce1592d7991 tempest-VolumesSnapshotTestJSON-558272145 None] Deleting attachment ebde4e6f-5b64-4677-96cc-f0a3f75df242. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 25 21:21:52.156956 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:21:52.157855 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:21:52.197478 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:21:52.236504 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:21:53.707224 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee126161-f897-46ae-8374-7d679b54cbea tempest-VolumesSnapshotTestJSON-558272145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:21:53.742880 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ee126161-f897-46ae-8374-7d679b54cbea tempest-VolumesSnapshotTestJSON-558272145 None] Flow 'volume_create_manager' (56a158ee-fd66-4c4b-9f62-7a2954034303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:21:53.757146 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ee126161-f897-46ae-8374-7d679b54cbea tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f0ea469-dff7-4ab7-946e-685297798a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:21:53.793185 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ee126161-f897-46ae-8374-7d679b54cbea tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f0ea469-dff7-4ab7-946e-685297798a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1040742589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c44b40f6-3bab-428a-aec9-01da18522d4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a7efe5a3d7f4380b6e1ee40d4628ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:21:54Z,use_quota=True,user_id='871c269a6b15425d8b79a6c653c56402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:21:53.813886 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ee126161-f897-46ae-8374-7d679b54cbea tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a120d59-f4da-4f56-b4b4-4219381ffa55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:21:53.818502 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ee126161-f897-46ae-8374-7d679b54cbea tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a120d59-f4da-4f56-b4b4-4219381ffa55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:21:53.829659 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ee126161-f897-46ae-8374-7d679b54cbea tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eabf924b-9883-4249-a3a8-85457688825f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:21:53.833808 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ee126161-f897-46ae-8374-7d679b54cbea tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eabf924b-9883-4249-a3a8-85457688825f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c44b40f6-3bab-428a-aec9-01da18522d4a', 'volume_name': 'volume-c44b40f6-3bab-428a-aec9-01da18522d4a', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:21:53.854638 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ee126161-f897-46ae-8374-7d679b54cbea tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aef522d-842b-44f9-b988-2e0abd827213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:21:53.858992 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ee126161-f897-46ae-8374-7d679b54cbea tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aef522d-842b-44f9-b988-2e0abd827213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:21:53.863743 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ee126161-f897-46ae-8374-7d679b54cbea tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91ccf8f7-a37d-4229-afb7-0f4a971919d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:21:53.864932 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-ee126161-f897-46ae-8374-7d679b54cbea tempest-VolumesSnapshotTestJSON-558272145 None] Volume c44b40f6-3bab-428a-aec9-01da18522d4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c44b40f6-3bab-428a-aec9-01da18522d4a', 'volume_size': 1} Jun 25 21:21:53.865339 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ee126161-f897-46ae-8374-7d679b54cbea tempest-VolumesSnapshotTestJSON-558272145 None] creating volume 'volume-c44b40f6-3bab-428a-aec9-01da18522d4a' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:21:53.866152 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ee126161-f897-46ae-8374-7d679b54cbea tempest-VolumesSnapshotTestJSON-558272145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:21:53.943299 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ee126161-f897-46ae-8374-7d679b54cbea tempest-VolumesSnapshotTestJSON-558272145 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:21:53.943664 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ee126161-f897-46ae-8374-7d679b54cbea tempest-VolumesSnapshotTestJSON-558272145 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:21:53.947829 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ee126161-f897-46ae-8374-7d679b54cbea tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91ccf8f7-a37d-4229-afb7-0f4a971919d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c44b40f6-3bab-428a-aec9-01da18522d4a', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:21:53.952559 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ee126161-f897-46ae-8374-7d679b54cbea tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09d8d441-5866-405b-827e-54a5165d99d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:21:53.968030 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-ee126161-f897-46ae-8374-7d679b54cbea tempest-VolumesSnapshotTestJSON-558272145 None] Volume volume-c44b40f6-3bab-428a-aec9-01da18522d4a (c44b40f6-3bab-428a-aec9-01da18522d4a): created successfully Jun 25 21:21:53.972332 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ee126161-f897-46ae-8374-7d679b54cbea tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09d8d441-5866-405b-827e-54a5165d99d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:21:53.984840 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ee126161-f897-46ae-8374-7d679b54cbea tempest-VolumesSnapshotTestJSON-558272145 None] Flow 'volume_create_manager' (56a158ee-fd66-4c4b-9f62-7a2954034303) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:21:53.996088 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-ee126161-f897-46ae-8374-7d679b54cbea tempest-VolumesSnapshotTestJSON-558272145 None] Created volume successfully. Jun 25 21:21:54.961594 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a86a9726-df17-473f-895d-96aff49eb280 tempest-VolumesSnapshotTestJSON-558272145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:21:56.035210 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-a86a9726-df17-473f-895d-96aff49eb280 tempest-VolumesSnapshotTestJSON-558272145 None] Create snapshot completed successfully Jun 25 21:21:57.596372 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-32112f15-8cd8-44bd-9c24-5f0c4a27f80c tempest-VolumesSnapshotTestJSON-558272145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:21:57.661480 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-32112f15-8cd8-44bd-9c24-5f0c4a27f80c tempest-VolumesSnapshotTestJSON-558272145 None] Flow 'volume_create_manager' (be5fef49-cfbc-4915-b359-eb24410092c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:21:57.668753 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-32112f15-8cd8-44bd-9c24-5f0c4a27f80c tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9e0525e-e755-4817-9505-c39762731904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:21:57.697719 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-32112f15-8cd8-44bd-9c24-5f0c4a27f80c tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9e0525e-e755-4817-9505-c39762731904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1478273495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b526c005-ed95-423b-be1a-e5c0fd708d2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a7efe5a3d7f4380b6e1ee40d4628ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:21:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=2fedd752-e27a-48fb-a5c4-cb801a7b189f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:21:58Z,use_quota=True,user_id='871c269a6b15425d8b79a6c653c56402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:21:57.704513 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-32112f15-8cd8-44bd-9c24-5f0c4a27f80c tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdc8dbb8-0058-4a4b-894a-5009d26fc50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:21:57.708541 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-32112f15-8cd8-44bd-9c24-5f0c4a27f80c tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdc8dbb8-0058-4a4b-894a-5009d26fc50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:21:57.714460 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-32112f15-8cd8-44bd-9c24-5f0c4a27f80c tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcef5faf-7926-4f34-8bd0-17affdaf9aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:21:57.718716 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-32112f15-8cd8-44bd-9c24-5f0c4a27f80c tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcef5faf-7926-4f34-8bd0-17affdaf9aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b526c005-ed95-423b-be1a-e5c0fd708d2f', 'volume_name': 'volume-b526c005-ed95-423b-be1a-e5c0fd708d2f', 'volume_size': 2, 'snapshot_id': '2fedd752-e27a-48fb-a5c4-cb801a7b189f'}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:21:57.724362 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-32112f15-8cd8-44bd-9c24-5f0c4a27f80c tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5150b2c7-0243-46e9-a1d3-bb2d6d23412c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:21:57.728392 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-32112f15-8cd8-44bd-9c24-5f0c4a27f80c tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5150b2c7-0243-46e9-a1d3-bb2d6d23412c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:21:57.733553 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-32112f15-8cd8-44bd-9c24-5f0c4a27f80c tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04ea3087-16f9-47da-91f1-2fb09963b2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:21:57.734853 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-32112f15-8cd8-44bd-9c24-5f0c4a27f80c tempest-VolumesSnapshotTestJSON-558272145 None] Volume b526c005-ed95-423b-be1a-e5c0fd708d2f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b526c005-ed95-423b-be1a-e5c0fd708d2f', 'volume_size': 2, 'snapshot_id': '2fedd752-e27a-48fb-a5c4-cb801a7b189f'} Jun 25 21:21:57.785571 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-32112f15-8cd8-44bd-9c24-5f0c4a27f80c tempest-VolumesSnapshotTestJSON-558272145 None] cloning volumes/volume-c44b40f6-3bab-428a-aec9-01da18522d4a@snapshot-2fedd752-e27a-48fb-a5c4-cb801a7b189f to volume-b526c005-ed95-423b-be1a-e5c0fd708d2f {{(pid=130674) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1094}} Jun 25 21:21:57.786537 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-32112f15-8cd8-44bd-9c24-5f0c4a27f80c tempest-VolumesSnapshotTestJSON-558272145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:21:57.882379 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-32112f15-8cd8-44bd-9c24-5f0c4a27f80c tempest-VolumesSnapshotTestJSON-558272145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:21:58.078983 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-32112f15-8cd8-44bd-9c24-5f0c4a27f80c tempest-VolumesSnapshotTestJSON-558272145 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:21:58.079776 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-32112f15-8cd8-44bd-9c24-5f0c4a27f80c tempest-VolumesSnapshotTestJSON-558272145 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:21:58.090252 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-32112f15-8cd8-44bd-9c24-5f0c4a27f80c tempest-VolumesSnapshotTestJSON-558272145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:21:58.260099 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-32112f15-8cd8-44bd-9c24-5f0c4a27f80c tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04ea3087-16f9-47da-91f1-2fb09963b2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b526c005-ed95-423b-be1a-e5c0fd708d2f', 'volume_size': 2, 'snapshot_id': '2fedd752-e27a-48fb-a5c4-cb801a7b189f'}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:21:58.265637 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-32112f15-8cd8-44bd-9c24-5f0c4a27f80c tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9cd7a5b-7740-4aec-82bb-cfe86afcf748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:21:58.278977 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-32112f15-8cd8-44bd-9c24-5f0c4a27f80c tempest-VolumesSnapshotTestJSON-558272145 None] Volume volume-b526c005-ed95-423b-be1a-e5c0fd708d2f (b526c005-ed95-423b-be1a-e5c0fd708d2f): created successfully Jun 25 21:21:58.283459 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-32112f15-8cd8-44bd-9c24-5f0c4a27f80c tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9cd7a5b-7740-4aec-82bb-cfe86afcf748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:21:58.290577 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-32112f15-8cd8-44bd-9c24-5f0c4a27f80c tempest-VolumesSnapshotTestJSON-558272145 None] Flow 'volume_create_manager' (be5fef49-cfbc-4915-b359-eb24410092c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:21:58.309223 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-32112f15-8cd8-44bd-9c24-5f0c4a27f80c tempest-VolumesSnapshotTestJSON-558272145 None] Created volume successfully. Jun 25 21:21:58.752916 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-8f419e75-67ad-4b75-9b92-29bb657e5c07 tempest-VolumesSnapshotTestJSON-558272145 None] Lock "b'cinder-b526c005-ed95-423b-be1a-e5c0fd708d2f-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:21:58.799112 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8f419e75-67ad-4b75-9b92-29bb657e5c07 tempest-VolumesSnapshotTestJSON-558272145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:21:58.909118 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8f419e75-67ad-4b75-9b92-29bb657e5c07 tempest-VolumesSnapshotTestJSON-558272145 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:21:58.918531 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8f419e75-67ad-4b75-9b92-29bb657e5c07 tempest-VolumesSnapshotTestJSON-558272145 None] deleting rbd volume volume-b526c005-ed95-423b-be1a-e5c0fd708d2f {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:21:59.204026 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-8f419e75-67ad-4b75-9b92-29bb657e5c07 tempest-VolumesSnapshotTestJSON-558272145 None] Created reservations ['6252a53d-9b74-4279-8a14-40f22e5ca1d4', 'a800c99c-e070-433f-b492-8c9237fbcc21', '36976eb6-eb12-42b6-87c0-64d40f199b43', '129ff6cb-d78a-4ef3-a77b-a98cf4636ef5'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:21:59.276536 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8f419e75-67ad-4b75-9b92-29bb657e5c07 tempest-VolumesSnapshotTestJSON-558272145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:21:59.306376 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8f419e75-67ad-4b75-9b92-29bb657e5c07 tempest-VolumesSnapshotTestJSON-558272145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:21:59.359884 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-8f419e75-67ad-4b75-9b92-29bb657e5c07 tempest-VolumesSnapshotTestJSON-558272145 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:21:59.364288 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-8f419e75-67ad-4b75-9b92-29bb657e5c07 tempest-VolumesSnapshotTestJSON-558272145 None] Deleted volume successfully. Jun 25 21:21:59.385564 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-8f419e75-67ad-4b75-9b92-29bb657e5c07 tempest-VolumesSnapshotTestJSON-558272145 None] Lock "b'cinder-b526c005-ed95-423b-be1a-e5c0fd708d2f-delete_volume'" released by "delete_volume" :: held 0.633s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:22:00.362631 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-08f49f27-4c35-4df2-9773-1970daec0002 tempest-VolumesSnapshotTestJSON-558272145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:22:00.387004 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-08f49f27-4c35-4df2-9773-1970daec0002 tempest-VolumesSnapshotTestJSON-558272145 None] Flow 'volume_create_manager' (1cf930f9-4472-4613-8fb1-777d366cdad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:22:00.394311 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-08f49f27-4c35-4df2-9773-1970daec0002 tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cb332cc-815c-485b-811e-41e365b62e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:22:00.412442 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-08f49f27-4c35-4df2-9773-1970daec0002 tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cb332cc-815c-485b-811e-41e365b62e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-75773641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=550bf129-2b0e-45b1-a96d-9be45bfb2598,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a7efe5a3d7f4380b6e1ee40d4628ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:22:00Z,use_quota=True,user_id='871c269a6b15425d8b79a6c653c56402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:22:00.424245 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-08f49f27-4c35-4df2-9773-1970daec0002 tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85294654-3214-48e9-b60c-917479b00a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:22:00.429896 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-08f49f27-4c35-4df2-9773-1970daec0002 tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85294654-3214-48e9-b60c-917479b00a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:22:00.434928 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-08f49f27-4c35-4df2-9773-1970daec0002 tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f72cbeca-fa2b-4a75-bbd0-54e5e35b3490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:22:00.439245 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-08f49f27-4c35-4df2-9773-1970daec0002 tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f72cbeca-fa2b-4a75-bbd0-54e5e35b3490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '550bf129-2b0e-45b1-a96d-9be45bfb2598', 'volume_name': 'volume-550bf129-2b0e-45b1-a96d-9be45bfb2598', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:22:00.444240 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-08f49f27-4c35-4df2-9773-1970daec0002 tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e8bc4c7-b9f5-4d17-bd83-acd23fb57c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:22:00.448089 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-08f49f27-4c35-4df2-9773-1970daec0002 tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e8bc4c7-b9f5-4d17-bd83-acd23fb57c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:22:00.452923 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-08f49f27-4c35-4df2-9773-1970daec0002 tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (903689b3-d2a3-4277-9b94-bbcf11bab162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:22:00.454562 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-08f49f27-4c35-4df2-9773-1970daec0002 tempest-VolumesSnapshotTestJSON-558272145 None] Volume 550bf129-2b0e-45b1-a96d-9be45bfb2598: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-550bf129-2b0e-45b1-a96d-9be45bfb2598', 'volume_size': 1} Jun 25 21:22:00.455131 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-08f49f27-4c35-4df2-9773-1970daec0002 tempest-VolumesSnapshotTestJSON-558272145 None] creating volume 'volume-550bf129-2b0e-45b1-a96d-9be45bfb2598' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:22:00.456055 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-08f49f27-4c35-4df2-9773-1970daec0002 tempest-VolumesSnapshotTestJSON-558272145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:22:00.515348 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-08f49f27-4c35-4df2-9773-1970daec0002 tempest-VolumesSnapshotTestJSON-558272145 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:22:00.515993 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-08f49f27-4c35-4df2-9773-1970daec0002 tempest-VolumesSnapshotTestJSON-558272145 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:22:00.520098 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-08f49f27-4c35-4df2-9773-1970daec0002 tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (903689b3-d2a3-4277-9b94-bbcf11bab162) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-550bf129-2b0e-45b1-a96d-9be45bfb2598', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:22:00.524906 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-08f49f27-4c35-4df2-9773-1970daec0002 tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efbcb42d-9a60-4386-a791-e82723b597e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:22:00.535425 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-08f49f27-4c35-4df2-9773-1970daec0002 tempest-VolumesSnapshotTestJSON-558272145 None] Volume volume-550bf129-2b0e-45b1-a96d-9be45bfb2598 (550bf129-2b0e-45b1-a96d-9be45bfb2598): created successfully Jun 25 21:22:00.539458 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-08f49f27-4c35-4df2-9773-1970daec0002 tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efbcb42d-9a60-4386-a791-e82723b597e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:22:00.545014 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-08f49f27-4c35-4df2-9773-1970daec0002 tempest-VolumesSnapshotTestJSON-558272145 None] Flow 'volume_create_manager' (1cf930f9-4472-4613-8fb1-777d366cdad3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:22:00.557001 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-08f49f27-4c35-4df2-9773-1970daec0002 tempest-VolumesSnapshotTestJSON-558272145 None] Created volume successfully. Jun 25 21:22:01.794618 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c4c656a7-78d7-4974-8760-b538a6aef5e6 tempest-VolumesSnapshotTestJSON-558272145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:22:02.175878 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-c4c656a7-78d7-4974-8760-b538a6aef5e6 tempest-VolumesSnapshotTestJSON-558272145 None] Create snapshot completed successfully Jun 25 21:22:03.372624 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c5d8028-e816-46fe-a5f2-82acb79c3361 tempest-VolumesSnapshotTestJSON-558272145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:22:03.419495 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2c5d8028-e816-46fe-a5f2-82acb79c3361 tempest-VolumesSnapshotTestJSON-558272145 None] Flow 'volume_create_manager' (9cede84e-c47b-4356-898c-d454ead2fbaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:22:03.425958 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2c5d8028-e816-46fe-a5f2-82acb79c3361 tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bfcc730-49c5-4525-aa94-d1c9a07adabd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:22:03.443492 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2c5d8028-e816-46fe-a5f2-82acb79c3361 tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bfcc730-49c5-4525-aa94-d1c9a07adabd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-176883602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=24942df7-6225-4255-bdeb-8307a3bc7a4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a7efe5a3d7f4380b6e1ee40d4628ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=80f9e859-ce54-4869-95cf-b2d0e417ac01,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:22:03Z,use_quota=True,user_id='871c269a6b15425d8b79a6c653c56402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:22:03.449365 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2c5d8028-e816-46fe-a5f2-82acb79c3361 tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (023a139c-741d-4bd6-8995-7bae77bbf928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:22:03.455919 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2c5d8028-e816-46fe-a5f2-82acb79c3361 tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (023a139c-741d-4bd6-8995-7bae77bbf928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:22:03.462428 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2c5d8028-e816-46fe-a5f2-82acb79c3361 tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc075e25-1f6d-4f1c-85ae-0f697db223f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:22:03.467809 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2c5d8028-e816-46fe-a5f2-82acb79c3361 tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc075e25-1f6d-4f1c-85ae-0f697db223f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '24942df7-6225-4255-bdeb-8307a3bc7a4c', 'volume_name': 'volume-24942df7-6225-4255-bdeb-8307a3bc7a4c', 'volume_size': 1, 'snapshot_id': '80f9e859-ce54-4869-95cf-b2d0e417ac01'}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:22:03.474963 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2c5d8028-e816-46fe-a5f2-82acb79c3361 tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8da9c0f8-3a16-4ef3-b1fe-a5962ee04711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:22:03.480905 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2c5d8028-e816-46fe-a5f2-82acb79c3361 tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8da9c0f8-3a16-4ef3-b1fe-a5962ee04711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:22:03.486331 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2c5d8028-e816-46fe-a5f2-82acb79c3361 tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d279a23-eecc-46c1-b9a5-31799b0ba8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:22:03.487769 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-2c5d8028-e816-46fe-a5f2-82acb79c3361 tempest-VolumesSnapshotTestJSON-558272145 None] Volume 24942df7-6225-4255-bdeb-8307a3bc7a4c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-24942df7-6225-4255-bdeb-8307a3bc7a4c', 'volume_size': 1, 'snapshot_id': '80f9e859-ce54-4869-95cf-b2d0e417ac01'} Jun 25 21:22:03.514395 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2c5d8028-e816-46fe-a5f2-82acb79c3361 tempest-VolumesSnapshotTestJSON-558272145 None] cloning volumes/volume-550bf129-2b0e-45b1-a96d-9be45bfb2598@snapshot-80f9e859-ce54-4869-95cf-b2d0e417ac01 to volume-24942df7-6225-4255-bdeb-8307a3bc7a4c {{(pid=130674) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1094}} Jun 25 21:22:03.515503 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2c5d8028-e816-46fe-a5f2-82acb79c3361 tempest-VolumesSnapshotTestJSON-558272145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:22:03.618402 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2c5d8028-e816-46fe-a5f2-82acb79c3361 tempest-VolumesSnapshotTestJSON-558272145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:22:03.830675 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2c5d8028-e816-46fe-a5f2-82acb79c3361 tempest-VolumesSnapshotTestJSON-558272145 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:22:03.831407 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2c5d8028-e816-46fe-a5f2-82acb79c3361 tempest-VolumesSnapshotTestJSON-558272145 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:22:03.872477 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2c5d8028-e816-46fe-a5f2-82acb79c3361 tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d279a23-eecc-46c1-b9a5-31799b0ba8ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24942df7-6225-4255-bdeb-8307a3bc7a4c', 'volume_size': 1, 'snapshot_id': '80f9e859-ce54-4869-95cf-b2d0e417ac01'}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:22:03.898361 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2c5d8028-e816-46fe-a5f2-82acb79c3361 tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82b212d8-d2a0-405f-9406-b2648aa346ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:22:03.927851 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-2c5d8028-e816-46fe-a5f2-82acb79c3361 tempest-VolumesSnapshotTestJSON-558272145 None] Volume volume-24942df7-6225-4255-bdeb-8307a3bc7a4c (24942df7-6225-4255-bdeb-8307a3bc7a4c): created successfully Jun 25 21:22:03.932209 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2c5d8028-e816-46fe-a5f2-82acb79c3361 tempest-VolumesSnapshotTestJSON-558272145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82b212d8-d2a0-405f-9406-b2648aa346ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:22:03.937671 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-2c5d8028-e816-46fe-a5f2-82acb79c3361 tempest-VolumesSnapshotTestJSON-558272145 None] Flow 'volume_create_manager' (9cede84e-c47b-4356-898c-d454ead2fbaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:22:03.982591 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-2c5d8028-e816-46fe-a5f2-82acb79c3361 tempest-VolumesSnapshotTestJSON-558272145 None] Created volume successfully. Jun 25 21:22:04.598344 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-1732892c-31e3-4a7c-a23a-d291a6f53e0e tempest-VolumesSnapshotTestJSON-558272145 None] Lock "b'cinder-24942df7-6225-4255-bdeb-8307a3bc7a4c-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:22:04.600655 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=59,cinder:UPDATE=22,cinder:INSERT=6,cinder:DELETE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:04.695177 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1732892c-31e3-4a7c-a23a-d291a6f53e0e tempest-VolumesSnapshotTestJSON-558272145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:22:04.841537 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1732892c-31e3-4a7c-a23a-d291a6f53e0e tempest-VolumesSnapshotTestJSON-558272145 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:22:04.851935 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1732892c-31e3-4a7c-a23a-d291a6f53e0e tempest-VolumesSnapshotTestJSON-558272145 None] deleting rbd volume volume-24942df7-6225-4255-bdeb-8307a3bc7a4c {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:22:05.260309 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-1732892c-31e3-4a7c-a23a-d291a6f53e0e tempest-VolumesSnapshotTestJSON-558272145 None] Created reservations ['1ae40c0e-3b87-49dc-bd96-f05a12a13d8c', '756dcce6-5145-4359-8274-d61a5038a2f5', '58866ed2-b906-4b24-af6a-aeed1ac000a6', 'c5c95fff-818f-4943-8a89-b7cbf9e075e2'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:22:05.272082 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=63,cinder:UPDATE=26,cinder:DELETE=6,cinder:INSERT=5 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:05.327508 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1732892c-31e3-4a7c-a23a-d291a6f53e0e tempest-VolumesSnapshotTestJSON-558272145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:22:05.397898 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1732892c-31e3-4a7c-a23a-d291a6f53e0e tempest-VolumesSnapshotTestJSON-558272145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:22:05.500546 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-1732892c-31e3-4a7c-a23a-d291a6f53e0e tempest-VolumesSnapshotTestJSON-558272145 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:22:05.510934 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-1732892c-31e3-4a7c-a23a-d291a6f53e0e tempest-VolumesSnapshotTestJSON-558272145 None] Deleted volume successfully. Jun 25 21:22:05.536674 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-1732892c-31e3-4a7c-a23a-d291a6f53e0e tempest-VolumesSnapshotTestJSON-558272145 None] Lock "b'cinder-24942df7-6225-4255-bdeb-8307a3bc7a4c-delete_volume'" released by "delete_volume" :: held 0.938s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:22:05.934095 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-7eef149d-189d-4fea-8698-a654af848679 tempest-VolumesSnapshotTestJSON-558272145 None] Lock "b'cinder-80f9e859-ce54-4869-95cf-b2d0e417ac01-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.017s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:22:05.936590 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7eef149d-189d-4fea-8698-a654af848679 tempest-VolumesSnapshotTestJSON-558272145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:22:07.293082 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-7eef149d-189d-4fea-8698-a654af848679 tempest-VolumesSnapshotTestJSON-558272145 None] Created reservations ['8a2e616d-4975-4c61-ac3e-dcdff2d276cb', '6aabbd06-cc79-4c7d-b8aa-46f59459c29b', '855fdae6-85b5-456e-8c70-8e2d8f2c87ff', '07f024ac-13fa-494d-a8a7-b10bfed5f7d7'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:22:07.372268 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-7eef149d-189d-4fea-8698-a654af848679 tempest-VolumesSnapshotTestJSON-558272145 None] Delete snapshot completed successfully. Jun 25 21:22:07.379821 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-7eef149d-189d-4fea-8698-a654af848679 tempest-VolumesSnapshotTestJSON-558272145 None] Lock "b'cinder-80f9e859-ce54-4869-95cf-b2d0e417ac01-delete_snapshot'" released by "delete_snapshot" :: held 1.446s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:22:08.221581 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-187a5326-50d8-41b1-b230-adcad003006f tempest-VolumesSnapshotTestJSON-558272145 None] Lock "b'cinder-550bf129-2b0e-45b1-a96d-9be45bfb2598-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:22:08.376061 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-187a5326-50d8-41b1-b230-adcad003006f tempest-VolumesSnapshotTestJSON-558272145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:22:08.498446 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-187a5326-50d8-41b1-b230-adcad003006f tempest-VolumesSnapshotTestJSON-558272145 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:22:08.499154 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-187a5326-50d8-41b1-b230-adcad003006f tempest-VolumesSnapshotTestJSON-558272145 None] Volume volume-550bf129-2b0e-45b1-a96d-9be45bfb2598 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:22:08.507298 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-187a5326-50d8-41b1-b230-adcad003006f tempest-VolumesSnapshotTestJSON-558272145 None] deleting rbd volume volume-550bf129-2b0e-45b1-a96d-9be45bfb2598 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:22:08.908317 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-187a5326-50d8-41b1-b230-adcad003006f tempest-VolumesSnapshotTestJSON-558272145 None] Created reservations ['c33407b3-1c14-464f-845c-a3e99f32b9d2', '85badd2a-73e9-4808-ab04-288b68db1377', 'd9f3c46b-5b2b-4662-8958-9cd02664366e', '79651b4c-4073-41a4-81d6-e28fa1d5ac4e'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:22:09.021376 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-187a5326-50d8-41b1-b230-adcad003006f tempest-VolumesSnapshotTestJSON-558272145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:22:09.083532 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-187a5326-50d8-41b1-b230-adcad003006f tempest-VolumesSnapshotTestJSON-558272145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:22:09.129627 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-187a5326-50d8-41b1-b230-adcad003006f tempest-VolumesSnapshotTestJSON-558272145 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:22:09.137087 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-187a5326-50d8-41b1-b230-adcad003006f tempest-VolumesSnapshotTestJSON-558272145 None] Deleted volume successfully. Jun 25 21:22:09.160265 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-187a5326-50d8-41b1-b230-adcad003006f tempest-VolumesSnapshotTestJSON-558272145 None] Lock "b'cinder-550bf129-2b0e-45b1-a96d-9be45bfb2598-delete_volume'" released by "delete_volume" :: held 0.939s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:22:09.622029 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-5ffda954-037d-4f90-9879-828a75a5787e tempest-VolumesSnapshotTestJSON-558272145 None] Lock "b'cinder-2fedd752-e27a-48fb-a5c4-cb801a7b189f-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.027s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:22:09.627944 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5ffda954-037d-4f90-9879-828a75a5787e tempest-VolumesSnapshotTestJSON-558272145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:22:10.397807 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-5ffda954-037d-4f90-9879-828a75a5787e tempest-VolumesSnapshotTestJSON-558272145 None] Created reservations ['6547c9ce-ceec-4782-9b59-fae0247fca96', '832ad5de-c7ae-48a3-b64c-fbfb25af4cb0', '4ba127e6-7b97-4967-b19b-8e53a161eb86', '086e769e-9bae-4332-a703-80abd20c9ab4'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:22:10.499523 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-5ffda954-037d-4f90-9879-828a75a5787e tempest-VolumesSnapshotTestJSON-558272145 None] Delete snapshot completed successfully. Jun 25 21:22:10.505914 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-5ffda954-037d-4f90-9879-828a75a5787e tempest-VolumesSnapshotTestJSON-558272145 None] Lock "b'cinder-2fedd752-e27a-48fb-a5c4-cb801a7b189f-delete_snapshot'" released by "delete_snapshot" :: held 0.886s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:22:10.769574 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-376ae842-e8fe-4e62-a52c-374c90ca52e5 tempest-VolumesSnapshotTestJSON-558272145 None] Lock "b'cinder-c44b40f6-3bab-428a-aec9-01da18522d4a-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:22:10.872020 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-376ae842-e8fe-4e62-a52c-374c90ca52e5 tempest-VolumesSnapshotTestJSON-558272145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:22:10.996230 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-376ae842-e8fe-4e62-a52c-374c90ca52e5 tempest-VolumesSnapshotTestJSON-558272145 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:22:10.997007 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-376ae842-e8fe-4e62-a52c-374c90ca52e5 tempest-VolumesSnapshotTestJSON-558272145 None] Volume volume-c44b40f6-3bab-428a-aec9-01da18522d4a is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:22:11.013861 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-376ae842-e8fe-4e62-a52c-374c90ca52e5 tempest-VolumesSnapshotTestJSON-558272145 None] deleting rbd volume volume-c44b40f6-3bab-428a-aec9-01da18522d4a {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:22:11.384056 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=53,cinder:INSERT=12,cinder:UPDATE=33,cinder:DELETE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:11.451644 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-376ae842-e8fe-4e62-a52c-374c90ca52e5 tempest-VolumesSnapshotTestJSON-558272145 None] Created reservations ['61b8ed0b-1a57-477f-8def-f0cd75c5f62e', '2daa2a2d-058f-48f4-b4ea-e2df127439c6', '09073d55-d14b-44c5-ad3a-ebe864a427bd', 'f3ff6f24-3223-4d9a-8105-f002e18d5b31'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:22:11.625740 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-376ae842-e8fe-4e62-a52c-374c90ca52e5 tempest-VolumesSnapshotTestJSON-558272145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:22:11.713378 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-376ae842-e8fe-4e62-a52c-374c90ca52e5 tempest-VolumesSnapshotTestJSON-558272145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:22:11.849554 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-376ae842-e8fe-4e62-a52c-374c90ca52e5 tempest-VolumesSnapshotTestJSON-558272145 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:22:11.858388 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-376ae842-e8fe-4e62-a52c-374c90ca52e5 tempest-VolumesSnapshotTestJSON-558272145 None] Deleted volume successfully. Jun 25 21:22:11.887158 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-376ae842-e8fe-4e62-a52c-374c90ca52e5 tempest-VolumesSnapshotTestJSON-558272145 None] Lock "b'cinder-c44b40f6-3bab-428a-aec9-01da18522d4a-delete_volume'" released by "delete_volume" :: held 1.117s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:22:12.907566 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-a16152ed-a7e5-4510-8696-dcf5e67d5711 tempest-VolumesSnapshotTestJSON-558272145 None] Lock "b'cinder-1b95a180-0d11-4045-88c2-16d087818925-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:22:13.000751 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a16152ed-a7e5-4510-8696-dcf5e67d5711 tempest-VolumesSnapshotTestJSON-558272145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:22:13.142056 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a16152ed-a7e5-4510-8696-dcf5e67d5711 tempest-VolumesSnapshotTestJSON-558272145 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:22:13.153826 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a16152ed-a7e5-4510-8696-dcf5e67d5711 tempest-VolumesSnapshotTestJSON-558272145 None] deleting rbd volume volume-1b95a180-0d11-4045-88c2-16d087818925 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:22:13.453515 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a16152ed-a7e5-4510-8696-dcf5e67d5711 tempest-VolumesSnapshotTestJSON-558272145 None] volume is a clone so cleaning references {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jun 25 21:22:13.491166 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a16152ed-a7e5-4510-8696-dcf5e67d5711 tempest-VolumesSnapshotTestJSON-558272145 None] deleting parent snapshot volume-1b95a180-0d11-4045-88c2-16d087818925.clone_snap {{(pid=130674) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jun 25 21:22:14.435297 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-a16152ed-a7e5-4510-8696-dcf5e67d5711 tempest-VolumesSnapshotTestJSON-558272145 None] Created reservations ['b8f71932-0b80-4500-8a4b-48b43366781a', '98b615d4-a4ab-4ff0-8ba1-db4cf84f0660', '80e1a5fc-ccf9-4d60-b675-fdd703c33596', '6072ab13-0906-42ea-9aeb-06ea7dd49178'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:22:14.531588 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a16152ed-a7e5-4510-8696-dcf5e67d5711 tempest-VolumesSnapshotTestJSON-558272145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:22:14.603523 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a16152ed-a7e5-4510-8696-dcf5e67d5711 tempest-VolumesSnapshotTestJSON-558272145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:22:14.711510 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-a16152ed-a7e5-4510-8696-dcf5e67d5711 tempest-VolumesSnapshotTestJSON-558272145 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:22:14.716318 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-a16152ed-a7e5-4510-8696-dcf5e67d5711 tempest-VolumesSnapshotTestJSON-558272145 None] Deleted volume successfully. Jun 25 21:22:14.738164 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-a16152ed-a7e5-4510-8696-dcf5e67d5711 tempest-VolumesSnapshotTestJSON-558272145 None] Lock "b'cinder-1b95a180-0d11-4045-88c2-16d087818925-delete_volume'" released by "delete_volume" :: held 1.831s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:22:15.161603 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-6f262483-0a6e-4d5c-a764-15c1ad4dbe82 tempest-VolumesSnapshotTestJSON-558272145 None] Lock "b'cinder-264e4834-b428-436e-af60-51d728f36b53-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:22:15.165450 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6f262483-0a6e-4d5c-a764-15c1ad4dbe82 tempest-VolumesSnapshotTestJSON-558272145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:22:15.562356 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-6f262483-0a6e-4d5c-a764-15c1ad4dbe82 tempest-VolumesSnapshotTestJSON-558272145 None] Created reservations ['8014576a-764e-4d43-89fa-a16a98a04051', '6aeff9f0-e408-42f8-8a06-0a1cc50f1c2f', 'e46fd7a4-7fb0-4868-807b-b49cfbfff206', '3a9440a4-49da-4201-9158-7903c81796aa'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:22:15.603349 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:UPDATE=35,cinder:SELECT=59,cinder:INSERT=5,cinder:DELETE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:15.622495 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-6f262483-0a6e-4d5c-a764-15c1ad4dbe82 tempest-VolumesSnapshotTestJSON-558272145 None] Delete snapshot completed successfully. Jun 25 21:22:15.630168 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-6f262483-0a6e-4d5c-a764-15c1ad4dbe82 tempest-VolumesSnapshotTestJSON-558272145 None] Lock "b'cinder-264e4834-b428-436e-af60-51d728f36b53-delete_snapshot'" released by "delete_snapshot" :: held 0.469s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:22:16.332335 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-ce012398-2f64-45bd-a6d1-5e3e39489ea2 tempest-VolumesSnapshotTestJSON-558272145 None] Lock "b'cinder-c02e587f-1a09-4c9f-a6d5-e94a0b4adf15-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:22:16.419054 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ce012398-2f64-45bd-a6d1-5e3e39489ea2 tempest-VolumesSnapshotTestJSON-558272145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:22:16.493850 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ce012398-2f64-45bd-a6d1-5e3e39489ea2 tempest-VolumesSnapshotTestJSON-558272145 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:22:16.494629 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ce012398-2f64-45bd-a6d1-5e3e39489ea2 tempest-VolumesSnapshotTestJSON-558272145 None] Volume volume-c02e587f-1a09-4c9f-a6d5-e94a0b4adf15 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:22:16.503150 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ce012398-2f64-45bd-a6d1-5e3e39489ea2 tempest-VolumesSnapshotTestJSON-558272145 None] deleting rbd volume volume-c02e587f-1a09-4c9f-a6d5-e94a0b4adf15 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:22:16.832329 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-ce012398-2f64-45bd-a6d1-5e3e39489ea2 tempest-VolumesSnapshotTestJSON-558272145 None] Created reservations ['a8d3fcd1-8cc7-4bc8-a216-af2f2438b842', '518a4212-a6fc-4c5b-8969-ff04ae6e9cd1', '38f2070e-66d6-483c-9bc5-eb53cdca06ed', 'faf73196-ee5d-4bba-8038-2ec0da190402'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:22:16.908806 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ce012398-2f64-45bd-a6d1-5e3e39489ea2 tempest-VolumesSnapshotTestJSON-558272145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:22:16.983028 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ce012398-2f64-45bd-a6d1-5e3e39489ea2 tempest-VolumesSnapshotTestJSON-558272145 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:22:17.055310 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-ce012398-2f64-45bd-a6d1-5e3e39489ea2 tempest-VolumesSnapshotTestJSON-558272145 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:22:17.060022 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-ce012398-2f64-45bd-a6d1-5e3e39489ea2 tempest-VolumesSnapshotTestJSON-558272145 None] Deleted volume successfully. Jun 25 21:22:17.098645 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-ce012398-2f64-45bd-a6d1-5e3e39489ea2 tempest-VolumesSnapshotTestJSON-558272145 None] Lock "b'cinder-c02e587f-1a09-4c9f-a6d5-e94a0b4adf15-delete_volume'" released by "delete_volume" :: held 0.748s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:22:34.377803 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=14,cinder:UPDATE=8 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:34.386276 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=49,cinder:INSERT=12,cinder:UPDATE=37,cinder:DELETE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:46.036527 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-d05ba0d3-93b1-40ee-a6db-4ed107f448da tempest-AttachVolumeShelveTestJSON-967589539 None] Lock "b'cinder-6ea084b5-50f4-4ac2-a042-fe961b762368-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:22:46.078393 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d05ba0d3-93b1-40ee-a6db-4ed107f448da tempest-AttachVolumeShelveTestJSON-967589539 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:22:46.163649 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d05ba0d3-93b1-40ee-a6db-4ed107f448da tempest-AttachVolumeShelveTestJSON-967589539 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:22:46.164310 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d05ba0d3-93b1-40ee-a6db-4ed107f448da tempest-AttachVolumeShelveTestJSON-967589539 None] Volume volume-6ea084b5-50f4-4ac2-a042-fe961b762368 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:22:46.172072 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d05ba0d3-93b1-40ee-a6db-4ed107f448da tempest-AttachVolumeShelveTestJSON-967589539 None] deleting rbd volume volume-6ea084b5-50f4-4ac2-a042-fe961b762368 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:22:46.456673 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-d05ba0d3-93b1-40ee-a6db-4ed107f448da tempest-AttachVolumeShelveTestJSON-967589539 None] Created reservations ['92a4bc63-43d9-40a9-ba68-3094291ad644', '2d029203-5310-4649-9068-fe7bd5f2e3ee', 'debcf4ba-fd04-4f26-bb31-df11cd2840bb', 'fe40c456-9810-41ca-afb0-50ccf73064a1'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:22:46.510547 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d05ba0d3-93b1-40ee-a6db-4ed107f448da tempest-AttachVolumeShelveTestJSON-967589539 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:22:46.575667 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d05ba0d3-93b1-40ee-a6db-4ed107f448da tempest-AttachVolumeShelveTestJSON-967589539 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:22:46.646048 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d05ba0d3-93b1-40ee-a6db-4ed107f448da tempest-AttachVolumeShelveTestJSON-967589539 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:22:46.652005 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-d05ba0d3-93b1-40ee-a6db-4ed107f448da tempest-AttachVolumeShelveTestJSON-967589539 None] Deleted volume successfully. Jun 25 21:22:46.668580 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-d05ba0d3-93b1-40ee-a6db-4ed107f448da tempest-AttachVolumeShelveTestJSON-967589539 None] Lock "b'cinder-6ea084b5-50f4-4ac2-a042-fe961b762368-delete_volume'" released by "delete_volume" :: held 0.632s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:22:47.319096 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-e62ca405-7d5c-4d7b-9abd-53a5a3bc2785 tempest-AttachVolumeShelveTestJSON-967589539 None] Lock "b'cinder-d0d28785-d076-4b06-b8c8-1d55430a8bed-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:22:47.370077 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e62ca405-7d5c-4d7b-9abd-53a5a3bc2785 tempest-AttachVolumeShelveTestJSON-967589539 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:22:47.435118 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e62ca405-7d5c-4d7b-9abd-53a5a3bc2785 tempest-AttachVolumeShelveTestJSON-967589539 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:22:47.436255 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e62ca405-7d5c-4d7b-9abd-53a5a3bc2785 tempest-AttachVolumeShelveTestJSON-967589539 None] Volume volume-d0d28785-d076-4b06-b8c8-1d55430a8bed is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:22:47.444851 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e62ca405-7d5c-4d7b-9abd-53a5a3bc2785 tempest-AttachVolumeShelveTestJSON-967589539 None] deleting rbd volume volume-d0d28785-d076-4b06-b8c8-1d55430a8bed {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:22:47.733659 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-e62ca405-7d5c-4d7b-9abd-53a5a3bc2785 tempest-AttachVolumeShelveTestJSON-967589539 None] Created reservations ['3603a5c2-c13f-4c71-9433-3c1d570df6f4', '580e3f7d-ed55-4779-bcfe-eb3de5e1c3eb', '0c4dc8d2-2141-4a00-b751-10742f34fd68', '34601eaf-0094-466d-a2d3-384cf68786d4'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:22:47.811150 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e62ca405-7d5c-4d7b-9abd-53a5a3bc2785 tempest-AttachVolumeShelveTestJSON-967589539 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:22:47.882975 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e62ca405-7d5c-4d7b-9abd-53a5a3bc2785 tempest-AttachVolumeShelveTestJSON-967589539 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:22:47.946725 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-e62ca405-7d5c-4d7b-9abd-53a5a3bc2785 tempest-AttachVolumeShelveTestJSON-967589539 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:22:47.956389 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-e62ca405-7d5c-4d7b-9abd-53a5a3bc2785 tempest-AttachVolumeShelveTestJSON-967589539 None] Deleted volume successfully. Jun 25 21:22:47.981425 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-e62ca405-7d5c-4d7b-9abd-53a5a3bc2785 tempest-AttachVolumeShelveTestJSON-967589539 None] Lock "b'cinder-d0d28785-d076-4b06-b8c8-1d55430a8bed-delete_volume'" released by "delete_volume" :: held 0.662s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:22:52.152115 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:22:52.156783 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:22:52.216364 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:22:52.303978 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:22:56.241576 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [req-993ffd99-44b1-47f9-82ca-9ab5c4d0884a req-2b9e52dc-df8c-4d35-befd-01edaee0597a tempest-VolumesGetTestJSON-1797936046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:22:56.262886 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-993ffd99-44b1-47f9-82ca-9ab5c4d0884a req-2b9e52dc-df8c-4d35-befd-01edaee0597a tempest-VolumesGetTestJSON-1797936046 None] Flow 'volume_create_manager' (4f9c9a2c-4d49-4bf4-ba97-d5310cbc872c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:22:56.273533 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-993ffd99-44b1-47f9-82ca-9ab5c4d0884a req-2b9e52dc-df8c-4d35-befd-01edaee0597a tempest-VolumesGetTestJSON-1797936046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82a4eddc-ccd2-4e9b-9a9b-765578506477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:22:56.290233 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-993ffd99-44b1-47f9-82ca-9ab5c4d0884a req-2b9e52dc-df8c-4d35-befd-01edaee0597a tempest-VolumesGetTestJSON-1797936046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82a4eddc-ccd2-4e9b-9a9b-765578506477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1982344726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=71df2ede-6494-4e66-a815-f8c07ea7cfec,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4aec2f850eac42b2ada24f111fcbcaff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:22:56Z,use_quota=True,user_id='251e78d095684e13ac5404d0c1aed630',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:22:56.296331 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-993ffd99-44b1-47f9-82ca-9ab5c4d0884a req-2b9e52dc-df8c-4d35-befd-01edaee0597a tempest-VolumesGetTestJSON-1797936046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb88451d-aa2e-46a5-b708-b89441da3fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:22:56.300778 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-993ffd99-44b1-47f9-82ca-9ab5c4d0884a req-2b9e52dc-df8c-4d35-befd-01edaee0597a tempest-VolumesGetTestJSON-1797936046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb88451d-aa2e-46a5-b708-b89441da3fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:22:56.306265 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-993ffd99-44b1-47f9-82ca-9ab5c4d0884a req-2b9e52dc-df8c-4d35-befd-01edaee0597a tempest-VolumesGetTestJSON-1797936046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84ce32db-fe89-4d18-b55f-91691fadf35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:22:56.311097 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-993ffd99-44b1-47f9-82ca-9ab5c4d0884a req-2b9e52dc-df8c-4d35-befd-01edaee0597a tempest-VolumesGetTestJSON-1797936046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84ce32db-fe89-4d18-b55f-91691fadf35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71df2ede-6494-4e66-a815-f8c07ea7cfec', 'volume_name': 'volume-71df2ede-6494-4e66-a815-f8c07ea7cfec', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:22:56.316538 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-993ffd99-44b1-47f9-82ca-9ab5c4d0884a req-2b9e52dc-df8c-4d35-befd-01edaee0597a tempest-VolumesGetTestJSON-1797936046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f10f361-09d2-4d3a-a4cb-ae7300d3518b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:22:56.338916 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-993ffd99-44b1-47f9-82ca-9ab5c4d0884a req-2b9e52dc-df8c-4d35-befd-01edaee0597a tempest-VolumesGetTestJSON-1797936046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f10f361-09d2-4d3a-a4cb-ae7300d3518b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:22:56.345842 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-993ffd99-44b1-47f9-82ca-9ab5c4d0884a req-2b9e52dc-df8c-4d35-befd-01edaee0597a tempest-VolumesGetTestJSON-1797936046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37f77b29-e75b-4238-bd54-9832b817b514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:22:56.347534 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [req-993ffd99-44b1-47f9-82ca-9ab5c4d0884a req-2b9e52dc-df8c-4d35-befd-01edaee0597a tempest-VolumesGetTestJSON-1797936046 None] Volume 71df2ede-6494-4e66-a815-f8c07ea7cfec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71df2ede-6494-4e66-a815-f8c07ea7cfec', 'volume_size': 1} Jun 25 21:22:56.348091 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-993ffd99-44b1-47f9-82ca-9ab5c4d0884a req-2b9e52dc-df8c-4d35-befd-01edaee0597a tempest-VolumesGetTestJSON-1797936046 None] creating volume 'volume-71df2ede-6494-4e66-a815-f8c07ea7cfec' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:22:56.349042 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-993ffd99-44b1-47f9-82ca-9ab5c4d0884a req-2b9e52dc-df8c-4d35-befd-01edaee0597a tempest-VolumesGetTestJSON-1797936046 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:22:56.436074 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-993ffd99-44b1-47f9-82ca-9ab5c4d0884a req-2b9e52dc-df8c-4d35-befd-01edaee0597a tempest-VolumesGetTestJSON-1797936046 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:22:56.436538 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-993ffd99-44b1-47f9-82ca-9ab5c4d0884a req-2b9e52dc-df8c-4d35-befd-01edaee0597a tempest-VolumesGetTestJSON-1797936046 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:22:56.440182 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-993ffd99-44b1-47f9-82ca-9ab5c4d0884a req-2b9e52dc-df8c-4d35-befd-01edaee0597a tempest-VolumesGetTestJSON-1797936046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37f77b29-e75b-4238-bd54-9832b817b514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71df2ede-6494-4e66-a815-f8c07ea7cfec', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:22:56.444741 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-993ffd99-44b1-47f9-82ca-9ab5c4d0884a req-2b9e52dc-df8c-4d35-befd-01edaee0597a tempest-VolumesGetTestJSON-1797936046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0ee90a5-fb52-4570-84cb-0157477be63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:22:56.455220 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [req-993ffd99-44b1-47f9-82ca-9ab5c4d0884a req-2b9e52dc-df8c-4d35-befd-01edaee0597a tempest-VolumesGetTestJSON-1797936046 None] Volume volume-71df2ede-6494-4e66-a815-f8c07ea7cfec (71df2ede-6494-4e66-a815-f8c07ea7cfec): created successfully Jun 25 21:22:56.459466 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-993ffd99-44b1-47f9-82ca-9ab5c4d0884a req-2b9e52dc-df8c-4d35-befd-01edaee0597a tempest-VolumesGetTestJSON-1797936046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0ee90a5-fb52-4570-84cb-0157477be63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:22:56.465563 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-993ffd99-44b1-47f9-82ca-9ab5c4d0884a req-2b9e52dc-df8c-4d35-befd-01edaee0597a tempest-VolumesGetTestJSON-1797936046 None] Flow 'volume_create_manager' (4f9c9a2c-4d49-4bf4-ba97-d5310cbc872c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:22:56.475585 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-993ffd99-44b1-47f9-82ca-9ab5c4d0884a req-2b9e52dc-df8c-4d35-befd-01edaee0597a tempest-VolumesGetTestJSON-1797936046 None] Created volume successfully. Jun 25 21:22:57.504090 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [req-c5dbe232-57ed-4614-b4dc-61a8218031eb req-22745490-10bf-4c30-b2d9-13088623318c tempest-VolumesGetTestJSON-1797936046 None] Lock "b'cinder-71df2ede-6494-4e66-a815-f8c07ea7cfec-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:22:57.578787 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-c5dbe232-57ed-4614-b4dc-61a8218031eb req-22745490-10bf-4c30-b2d9-13088623318c tempest-VolumesGetTestJSON-1797936046 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:22:57.624972 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-c5dbe232-57ed-4614-b4dc-61a8218031eb req-22745490-10bf-4c30-b2d9-13088623318c tempest-VolumesGetTestJSON-1797936046 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:22:57.625397 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-c5dbe232-57ed-4614-b4dc-61a8218031eb req-22745490-10bf-4c30-b2d9-13088623318c tempest-VolumesGetTestJSON-1797936046 None] Volume volume-71df2ede-6494-4e66-a815-f8c07ea7cfec is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:22:57.634029 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-c5dbe232-57ed-4614-b4dc-61a8218031eb req-22745490-10bf-4c30-b2d9-13088623318c tempest-VolumesGetTestJSON-1797936046 None] deleting rbd volume volume-71df2ede-6494-4e66-a815-f8c07ea7cfec {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:22:57.926365 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [req-c5dbe232-57ed-4614-b4dc-61a8218031eb req-22745490-10bf-4c30-b2d9-13088623318c tempest-VolumesGetTestJSON-1797936046 None] Created reservations ['629edc00-9ea7-41a3-b9dc-01e86ad3c30c', 'c053cbbf-0bae-4303-b2f3-27bc06a5b9d1', 'e033034c-8e6e-4cd1-b415-4142e8025025', '6ad55928-d242-4048-90b0-c8a71493d2c7'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:22:57.983064 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-c5dbe232-57ed-4614-b4dc-61a8218031eb req-22745490-10bf-4c30-b2d9-13088623318c tempest-VolumesGetTestJSON-1797936046 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:22:58.033561 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-c5dbe232-57ed-4614-b4dc-61a8218031eb req-22745490-10bf-4c30-b2d9-13088623318c tempest-VolumesGetTestJSON-1797936046 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:22:58.073521 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [req-c5dbe232-57ed-4614-b4dc-61a8218031eb req-22745490-10bf-4c30-b2d9-13088623318c tempest-VolumesGetTestJSON-1797936046 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:22:58.077164 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-c5dbe232-57ed-4614-b4dc-61a8218031eb req-22745490-10bf-4c30-b2d9-13088623318c tempest-VolumesGetTestJSON-1797936046 None] Deleted volume successfully. Jun 25 21:22:58.093762 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [req-c5dbe232-57ed-4614-b4dc-61a8218031eb req-22745490-10bf-4c30-b2d9-13088623318c tempest-VolumesGetTestJSON-1797936046 None] Lock "b'cinder-71df2ede-6494-4e66-a815-f8c07ea7cfec-delete_volume'" released by "delete_volume" :: held 0.589s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:23:14.386596 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:UPDATE=27,cinder:SELECT=45,cinder:INSERT=9,cinder:DELETE=4 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:14.389725 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=46,cinder:UPDATE=28,cinder:INSERT=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:44.389438 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:52.150279 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:23:52.150936 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:23:52.208347 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:23:52.279920 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:23:54.396342 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:24:14.401519 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:24:24.401151 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:24:52.155284 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:24:52.156103 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:24:52.224845 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:24:52.300533 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:24:54.399092 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:25:04.394019 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:25:13.454781 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-adfd88dd-3a9c-4f73-834f-ccec8a7ef817 tempest-TestVolumeBootPattern-148826616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:25:13.486059 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-adfd88dd-3a9c-4f73-834f-ccec8a7ef817 tempest-TestVolumeBootPattern-148826616 None] Flow 'volume_create_manager' (544ea3b1-7d34-4b1f-9b23-689d4e37150f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:25:13.495787 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-adfd88dd-3a9c-4f73-834f-ccec8a7ef817 tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5643b9e-b4cf-4e45-a069-bd979148254e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:25:13.532194 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-adfd88dd-3a9c-4f73-834f-ccec8a7ef817 tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5643b9e-b4cf-4e45-a069-bd979148254e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1096969787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=81e93959-3316-48fa-9ebc-7735cc5d8572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1a396ec47a346dc97426df498e54ab2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:25:13Z,use_quota=True,user_id='8d162afa6d9b48ef9fac1bf23c0c41e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:25:13.538552 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-adfd88dd-3a9c-4f73-834f-ccec8a7ef817 tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b1a7e2a-0c0c-4b27-8012-0ba348182c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:25:13.545515 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-adfd88dd-3a9c-4f73-834f-ccec8a7ef817 tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b1a7e2a-0c0c-4b27-8012-0ba348182c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:25:13.558163 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-adfd88dd-3a9c-4f73-834f-ccec8a7ef817 tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c9d0c70-9b2c-4944-b1e7-7cd299304544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:25:13.686226 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-adfd88dd-3a9c-4f73-834f-ccec8a7ef817 tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c9d0c70-9b2c-4944-b1e7-7cd299304544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '81e93959-3316-48fa-9ebc-7735cc5d8572', 'volume_name': 'volume-81e93959-3316-48fa-9ebc-7735cc5d8572', 'volume_size': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d98522b7634403f83ff66fd72edfd9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'created_at': datetime.datetime(2022, 6, 25, 20, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5741eca-b932-4865-b29a-bd2a12a73795/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:25:13.693661 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-adfd88dd-3a9c-4f73-834f-ccec8a7ef817 tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (614d35c4-5fe4-4d48-ba4f-8842d92d97a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:25:13.707911 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-adfd88dd-3a9c-4f73-834f-ccec8a7ef817 tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (614d35c4-5fe4-4d48-ba4f-8842d92d97a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:25:13.725406 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-adfd88dd-3a9c-4f73-834f-ccec8a7ef817 tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1ab9270-e752-4a5c-916a-80261ad6557f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:25:13.727035 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-adfd88dd-3a9c-4f73-834f-ccec8a7ef817 tempest-TestVolumeBootPattern-148826616 None] Volume 81e93959-3316-48fa-9ebc-7735cc5d8572: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-81e93959-3316-48fa-9ebc-7735cc5d8572', 'volume_size': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d98522b7634403f83ff66fd72edfd9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'created_at': datetime.datetime(2022, 6, 25, 20, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5741eca-b932-4865-b29a-bd2a12a73795/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 25 21:25:13.727867 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-adfd88dd-3a9c-4f73-834f-ccec8a7ef817 tempest-TestVolumeBootPattern-148826616 None] Cloning 81e93959-3316-48fa-9ebc-7735cc5d8572 from image c5741eca-b932-4865-b29a-bd2a12a73795 at location (None, None). {{(pid=130674) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1062}} Jun 25 21:25:13.746702 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-adfd88dd-3a9c-4f73-834f-ccec8a7ef817 tempest-TestVolumeBootPattern-148826616 None] Lock "b'cinder-c5741eca-b932-4865-b29a-bd2a12a73795'" acquired by "_prepare_image_cache_entry" :: waited 0.015s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:25:13.770370 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-adfd88dd-3a9c-4f73-834f-ccec8a7ef817 tempest-TestVolumeBootPattern-148826616 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'volume_id': 'c8878629-87cd-43d0-b2bd-d32c807cd322', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53), 'last_used': datetime.datetime(2022, 6, 25, 21, 25, 13, 758284)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 25 21:25:13.771425 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-adfd88dd-3a9c-4f73-834f-ccec8a7ef817 tempest-TestVolumeBootPattern-148826616 None] Image-volume cache entry image_update_at = 2022-06-25 20:42:53+00:00, requested image updated_at = 2022-06-25 20:42:53+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 25 21:25:13.772169 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-adfd88dd-3a9c-4f73-834f-ccec8a7ef817 tempest-TestVolumeBootPattern-148826616 None] Found cache entry for image = c5741eca-b932-4865-b29a-bd2a12a73795 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:877}} Jun 25 21:25:13.778463 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-adfd88dd-3a9c-4f73-834f-ccec8a7ef817 tempest-TestVolumeBootPattern-148826616 None] Lock "b'cinder-c5741eca-b932-4865-b29a-bd2a12a73795'" released by "_prepare_image_cache_entry" :: held 0.032s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:25:13.782160 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-adfd88dd-3a9c-4f73-834f-ccec8a7ef817 tempest-TestVolumeBootPattern-148826616 None] Attempting to retrieve cache entry for image = c5741eca-b932-4865-b29a-bd2a12a73795 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:818}} Jun 25 21:25:13.798573 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-adfd88dd-3a9c-4f73-834f-ccec8a7ef817 tempest-TestVolumeBootPattern-148826616 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'volume_id': 'c8878629-87cd-43d0-b2bd-d32c807cd322', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53), 'last_used': datetime.datetime(2022, 6, 25, 21, 25, 13, 791784)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 25 21:25:13.799766 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-adfd88dd-3a9c-4f73-834f-ccec8a7ef817 tempest-TestVolumeBootPattern-148826616 None] Image-volume cache entry image_update_at = 2022-06-25 20:42:53+00:00, requested image updated_at = 2022-06-25 20:42:53+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 25 21:25:13.802079 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-adfd88dd-3a9c-4f73-834f-ccec8a7ef817 tempest-TestVolumeBootPattern-148826616 None] Creating from source image-volume c8878629-87cd-43d0-b2bd-d32c807cd322 {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:832}} Jun 25 21:25:13.851735 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-adfd88dd-3a9c-4f73-834f-ccec8a7ef817 tempest-TestVolumeBootPattern-148826616 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:25:13.962457 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-adfd88dd-3a9c-4f73-834f-ccec8a7ef817 tempest-TestVolumeBootPattern-148826616 None] creating snapshot='volume-81e93959-3316-48fa-9ebc-7735cc5d8572.clone_snap' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jun 25 21:25:14.103026 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-adfd88dd-3a9c-4f73-834f-ccec8a7ef817 tempest-TestVolumeBootPattern-148826616 None] cloning 'volume-c8878629-87cd-43d0-b2bd-d32c807cd322@volume-81e93959-3316-48fa-9ebc-7735cc5d8572.clone_snap' to 'volume-81e93959-3316-48fa-9ebc-7735cc5d8572' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jun 25 21:25:14.292845 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-adfd88dd-3a9c-4f73-834f-ccec8a7ef817 tempest-TestVolumeBootPattern-148826616 None] Volume volume-74f093be-e96a-4a80-ad38-abd3f5585611.deleted is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:25:14.294076 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-adfd88dd-3a9c-4f73-834f-ccec8a7ef817 tempest-TestVolumeBootPattern-148826616 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:25:14.294449 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-adfd88dd-3a9c-4f73-834f-ccec8a7ef817 tempest-TestVolumeBootPattern-148826616 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:25:14.326739 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-adfd88dd-3a9c-4f73-834f-ccec8a7ef817 tempest-TestVolumeBootPattern-148826616 None] clone created successfully {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jun 25 21:25:14.327628 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.volume_utils [None req-adfd88dd-3a9c-4f73-834f-ccec8a7ef817 tempest-TestVolumeBootPattern-148826616 None] Marking volume 81e93959-3316-48fa-9ebc-7735cc5d8572 as bootable. {{(pid=130674) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 25 21:25:14.345713 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-adfd88dd-3a9c-4f73-834f-ccec8a7ef817 tempest-TestVolumeBootPattern-148826616 None] Copying metadata from image c5741eca-b932-4865-b29a-bd2a12a73795 to 81e93959-3316-48fa-9ebc-7735cc5d8572. {{(pid=130674) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jun 25 21:25:14.346164 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-adfd88dd-3a9c-4f73-834f-ccec8a7ef817 tempest-TestVolumeBootPattern-148826616 None] Creating volume glance metadata for volume 81e93959-3316-48fa-9ebc-7735cc5d8572 backed by image c5741eca-b932-4865-b29a-bd2a12a73795 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=130674) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:674}} Jun 25 21:25:14.470676 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-adfd88dd-3a9c-4f73-834f-ccec8a7ef817 tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1ab9270-e752-4a5c-916a-80261ad6557f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81e93959-3316-48fa-9ebc-7735cc5d8572', 'volume_size': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d98522b7634403f83ff66fd72edfd9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'created_at': datetime.datetime(2022, 6, 25, 20, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5741eca-b932-4865-b29a-bd2a12a73795/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:25:14.480944 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-adfd88dd-3a9c-4f73-834f-ccec8a7ef817 tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce8008b6-cab0-42c4-8403-65e28ac03d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:25:14.500698 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-adfd88dd-3a9c-4f73-834f-ccec8a7ef817 tempest-TestVolumeBootPattern-148826616 None] Volume volume-81e93959-3316-48fa-9ebc-7735cc5d8572 (81e93959-3316-48fa-9ebc-7735cc5d8572): created successfully Jun 25 21:25:14.508747 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-adfd88dd-3a9c-4f73-834f-ccec8a7ef817 tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce8008b6-cab0-42c4-8403-65e28ac03d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:25:14.530642 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-adfd88dd-3a9c-4f73-834f-ccec8a7ef817 tempest-TestVolumeBootPattern-148826616 None] Flow 'volume_create_manager' (544ea3b1-7d34-4b1f-9b23-689d4e37150f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:25:14.543827 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-adfd88dd-3a9c-4f73-834f-ccec8a7ef817 tempest-TestVolumeBootPattern-148826616 None] Created volume successfully. Jun 25 21:25:16.028781 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b0604f86-e40b-4267-b1ba-29cc4af117c0 tempest-TestVolumeBootPattern-148826616 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:25:17.294688 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-b0604f86-e40b-4267-b1ba-29cc4af117c0 tempest-TestVolumeBootPattern-148826616 None] Create snapshot completed successfully Jun 25 21:25:21.854638 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [req-54e7edaf-7a5a-45e4-bc91-16dd6d3feb8e req-5c549441-df22-46f1-9ad6-d93113a81b66 tempest-TestVolumeBootPattern-148826616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:25:21.885580 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-54e7edaf-7a5a-45e4-bc91-16dd6d3feb8e req-5c549441-df22-46f1-9ad6-d93113a81b66 tempest-TestVolumeBootPattern-148826616 None] Flow 'volume_create_manager' (35df2ba2-dd9d-47c9-ae23-97acf0248c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:25:21.893796 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-54e7edaf-7a5a-45e4-bc91-16dd6d3feb8e req-5c549441-df22-46f1-9ad6-d93113a81b66 tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f2ec412-7e34-4eb5-a219-6ca40b85e9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:25:21.917030 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-54e7edaf-7a5a-45e4-bc91-16dd6d3feb8e req-5c549441-df22-46f1-9ad6-d93113a81b66 tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f2ec412-7e34-4eb5-a219-6ca40b85e9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:25:22Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a9fef98c-84da-43c5-8f8c-8180202d136e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1a396ec47a346dc97426df498e54ab2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3890b137-875d-4c17-9e55-a1a15e418962,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:25:22Z,use_quota=True,user_id='8d162afa6d9b48ef9fac1bf23c0c41e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:25:21.922701 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-54e7edaf-7a5a-45e4-bc91-16dd6d3feb8e req-5c549441-df22-46f1-9ad6-d93113a81b66 tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09db3723-23b8-4be6-81c8-2a6726d97304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:25:21.926753 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-54e7edaf-7a5a-45e4-bc91-16dd6d3feb8e req-5c549441-df22-46f1-9ad6-d93113a81b66 tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09db3723-23b8-4be6-81c8-2a6726d97304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:25:21.932383 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-54e7edaf-7a5a-45e4-bc91-16dd6d3feb8e req-5c549441-df22-46f1-9ad6-d93113a81b66 tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca9e9913-aa32-4f76-a4b7-301372c6ee1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:25:21.936598 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-54e7edaf-7a5a-45e4-bc91-16dd6d3feb8e req-5c549441-df22-46f1-9ad6-d93113a81b66 tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca9e9913-aa32-4f76-a4b7-301372c6ee1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a9fef98c-84da-43c5-8f8c-8180202d136e', 'volume_name': 'volume-a9fef98c-84da-43c5-8f8c-8180202d136e', 'volume_size': 1, 'snapshot_id': '3890b137-875d-4c17-9e55-a1a15e418962'}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:25:21.941553 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-54e7edaf-7a5a-45e4-bc91-16dd6d3feb8e req-5c549441-df22-46f1-9ad6-d93113a81b66 tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99402e7c-6450-452c-bc75-7e6c30bbb25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:25:21.945967 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-54e7edaf-7a5a-45e4-bc91-16dd6d3feb8e req-5c549441-df22-46f1-9ad6-d93113a81b66 tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99402e7c-6450-452c-bc75-7e6c30bbb25b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:25:21.951399 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-54e7edaf-7a5a-45e4-bc91-16dd6d3feb8e req-5c549441-df22-46f1-9ad6-d93113a81b66 tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1217c2d3-5a8d-4d64-b0d7-2a4110d449b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:25:21.952625 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [req-54e7edaf-7a5a-45e4-bc91-16dd6d3feb8e req-5c549441-df22-46f1-9ad6-d93113a81b66 tempest-TestVolumeBootPattern-148826616 None] Volume a9fef98c-84da-43c5-8f8c-8180202d136e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a9fef98c-84da-43c5-8f8c-8180202d136e', 'volume_size': 1, 'snapshot_id': '3890b137-875d-4c17-9e55-a1a15e418962'} Jun 25 21:25:21.977365 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-54e7edaf-7a5a-45e4-bc91-16dd6d3feb8e req-5c549441-df22-46f1-9ad6-d93113a81b66 tempest-TestVolumeBootPattern-148826616 None] cloning volumes/volume-81e93959-3316-48fa-9ebc-7735cc5d8572@snapshot-3890b137-875d-4c17-9e55-a1a15e418962 to volume-a9fef98c-84da-43c5-8f8c-8180202d136e {{(pid=130674) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1094}} Jun 25 21:25:21.977989 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-54e7edaf-7a5a-45e4-bc91-16dd6d3feb8e req-5c549441-df22-46f1-9ad6-d93113a81b66 tempest-TestVolumeBootPattern-148826616 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:25:22.090040 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-54e7edaf-7a5a-45e4-bc91-16dd6d3feb8e req-5c549441-df22-46f1-9ad6-d93113a81b66 tempest-TestVolumeBootPattern-148826616 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:25:22.300075 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-54e7edaf-7a5a-45e4-bc91-16dd6d3feb8e req-5c549441-df22-46f1-9ad6-d93113a81b66 tempest-TestVolumeBootPattern-148826616 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:25:22.300962 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-54e7edaf-7a5a-45e4-bc91-16dd6d3feb8e req-5c549441-df22-46f1-9ad6-d93113a81b66 tempest-TestVolumeBootPattern-148826616 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:25:22.330371 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.volume_utils [req-54e7edaf-7a5a-45e4-bc91-16dd6d3feb8e req-5c549441-df22-46f1-9ad6-d93113a81b66 tempest-TestVolumeBootPattern-148826616 None] Marking volume a9fef98c-84da-43c5-8f8c-8180202d136e as bootable. {{(pid=130674) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 25 21:25:22.339856 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [req-54e7edaf-7a5a-45e4-bc91-16dd6d3feb8e req-5c549441-df22-46f1-9ad6-d93113a81b66 tempest-TestVolumeBootPattern-148826616 None] Copying metadata from snapshot 3890b137-875d-4c17-9e55-a1a15e418962 to a9fef98c-84da-43c5-8f8c-8180202d136e. {{(pid=130674) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:430}} Jun 25 21:25:22.410453 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-54e7edaf-7a5a-45e4-bc91-16dd6d3feb8e req-5c549441-df22-46f1-9ad6-d93113a81b66 tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1217c2d3-5a8d-4d64-b0d7-2a4110d449b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9fef98c-84da-43c5-8f8c-8180202d136e', 'volume_size': 1, 'snapshot_id': '3890b137-875d-4c17-9e55-a1a15e418962'}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:25:22.419396 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-54e7edaf-7a5a-45e4-bc91-16dd6d3feb8e req-5c549441-df22-46f1-9ad6-d93113a81b66 tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9beb887a-b10c-4756-a673-3e051babb0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:25:22.436909 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [req-54e7edaf-7a5a-45e4-bc91-16dd6d3feb8e req-5c549441-df22-46f1-9ad6-d93113a81b66 tempest-TestVolumeBootPattern-148826616 None] Volume volume-a9fef98c-84da-43c5-8f8c-8180202d136e (a9fef98c-84da-43c5-8f8c-8180202d136e): created successfully Jun 25 21:25:22.444769 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-54e7edaf-7a5a-45e4-bc91-16dd6d3feb8e req-5c549441-df22-46f1-9ad6-d93113a81b66 tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9beb887a-b10c-4756-a673-3e051babb0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:25:22.474937 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-54e7edaf-7a5a-45e4-bc91-16dd6d3feb8e req-5c549441-df22-46f1-9ad6-d93113a81b66 tempest-TestVolumeBootPattern-148826616 None] Flow 'volume_create_manager' (35df2ba2-dd9d-47c9-ae23-97acf0248c62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:25:22.507533 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-54e7edaf-7a5a-45e4-bc91-16dd6d3feb8e req-5c549441-df22-46f1-9ad6-d93113a81b66 tempest-TestVolumeBootPattern-148826616 None] Created volume successfully. Jun 25 21:25:25.436679 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=30,cinder:UPDATE=8,cinder:INSERT=13,cinder:DELETE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:25:25.439622 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-54e7edaf-7a5a-45e4-bc91-16dd6d3feb8e req-d8cfdcda-8eb1-4723-97db-740b33341f40 tempest-TestVolumeBootPattern-148826616 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 21:25:26.435934 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-54e7edaf-7a5a-45e4-bc91-16dd6d3feb8e req-d8cfdcda-8eb1-4723-97db-740b33341f40 tempest-TestVolumeBootPattern-148826616 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.996s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 21:25:26.437278 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-54e7edaf-7a5a-45e4-bc91-16dd6d3feb8e req-d8cfdcda-8eb1-4723-97db-740b33341f40 tempest-TestVolumeBootPattern-148826616 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a9fef98c-84da-43c5-8f8c-8180202d136e', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': 'a9fef98c-84da-43c5-8f8c-8180202d136e', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 21:25:26.471971 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-54e7edaf-7a5a-45e4-bc91-16dd6d3feb8e req-d8cfdcda-8eb1-4723-97db-740b33341f40 tempest-TestVolumeBootPattern-148826616 None] Connection info returned from driver {'name': 'volumes/volume-a9fef98c-84da-43c5-8f8c-8180202d136e', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a9fef98c-84da-43c5-8f8c-8180202d136e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '7796f84c-da6f-4af1-b15e-e28d461c7b35'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 25 21:25:26.592035 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-54e7edaf-7a5a-45e4-bc91-16dd6d3feb8e req-d8cfdcda-8eb1-4723-97db-740b33341f40 tempest-TestVolumeBootPattern-148826616 None] attachment_update completed successfully. Jun 25 21:25:39.778168 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=59,cinder:UPDATE=7,cinder:INSERT=23,cinder:DELETE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:25:39.781987 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-1d8ce16c-6983-4c22-b762-6b266784ce47 req-f527431b-3e6b-48e7-9fe2-970817aec1ad tempest-TestVolumeBootPattern-148826616 None] Terminate volume connection completed successfully. Jun 25 21:25:39.782646 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-1d8ce16c-6983-4c22-b762-6b266784ce47 req-f527431b-3e6b-48e7-9fe2-970817aec1ad tempest-TestVolumeBootPattern-148826616 None] Deleting attachment 7796f84c-da6f-4af1-b15e-e28d461c7b35. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 25 21:25:40.061718 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [req-1d8ce16c-6983-4c22-b762-6b266784ce47 req-9dd9517c-4f68-46e3-819c-0fae5f9e96d2 tempest-TestVolumeBootPattern-148826616 None] Lock "b'cinder-a9fef98c-84da-43c5-8f8c-8180202d136e-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:25:40.141215 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-1d8ce16c-6983-4c22-b762-6b266784ce47 req-9dd9517c-4f68-46e3-819c-0fae5f9e96d2 tempest-TestVolumeBootPattern-148826616 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:25:40.354134 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-1d8ce16c-6983-4c22-b762-6b266784ce47 req-9dd9517c-4f68-46e3-819c-0fae5f9e96d2 tempest-TestVolumeBootPattern-148826616 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:25:40.368409 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-1d8ce16c-6983-4c22-b762-6b266784ce47 req-9dd9517c-4f68-46e3-819c-0fae5f9e96d2 tempest-TestVolumeBootPattern-148826616 None] deleting rbd volume volume-a9fef98c-84da-43c5-8f8c-8180202d136e {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:25:40.789635 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [req-1d8ce16c-6983-4c22-b762-6b266784ce47 req-9dd9517c-4f68-46e3-819c-0fae5f9e96d2 tempest-TestVolumeBootPattern-148826616 None] Created reservations ['803f7a66-7020-4728-b07e-d26657240b3e', '91e90cb8-ccac-4cc0-88a8-38a72e1f67e8', '06888b08-5151-45d8-8d75-01fd446289df', '9c8d8d60-fbc2-4a42-b6a5-055ba131acc6'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:25:40.904970 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-1d8ce16c-6983-4c22-b762-6b266784ce47 req-9dd9517c-4f68-46e3-819c-0fae5f9e96d2 tempest-TestVolumeBootPattern-148826616 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:25:40.973238 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-1d8ce16c-6983-4c22-b762-6b266784ce47 req-9dd9517c-4f68-46e3-819c-0fae5f9e96d2 tempest-TestVolumeBootPattern-148826616 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:25:41.068780 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [req-1d8ce16c-6983-4c22-b762-6b266784ce47 req-9dd9517c-4f68-46e3-819c-0fae5f9e96d2 tempest-TestVolumeBootPattern-148826616 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:25:41.099089 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-1d8ce16c-6983-4c22-b762-6b266784ce47 req-9dd9517c-4f68-46e3-819c-0fae5f9e96d2 tempest-TestVolumeBootPattern-148826616 None] Deleted volume successfully. Jun 25 21:25:41.128298 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [req-1d8ce16c-6983-4c22-b762-6b266784ce47 req-9dd9517c-4f68-46e3-819c-0fae5f9e96d2 tempest-TestVolumeBootPattern-148826616 None] Lock "b'cinder-a9fef98c-84da-43c5-8f8c-8180202d136e-delete_volume'" released by "delete_volume" :: held 1.066s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:25:41.743024 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-0a6fe4e4-5f32-4e0e-a418-340eac759810 tempest-TestVolumeBootPattern-148826616 None] Lock "b'cinder-3890b137-875d-4c17-9e55-a1a15e418962-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.022s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:25:41.749828 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0a6fe4e4-5f32-4e0e-a418-340eac759810 tempest-TestVolumeBootPattern-148826616 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:25:42.393446 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-0a6fe4e4-5f32-4e0e-a418-340eac759810 tempest-TestVolumeBootPattern-148826616 None] Created reservations ['a7e48c4a-cacd-4201-8255-e66ce3b06894', 'e097c107-47d2-4fa9-be9d-ac1931d3b9e6', '083e838c-8d5d-4d82-87a0-c019fbb967a9', '7790ad0a-23a2-40e3-85c7-733ecd66f5dd'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:25:42.484948 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-0a6fe4e4-5f32-4e0e-a418-340eac759810 tempest-TestVolumeBootPattern-148826616 None] Delete snapshot completed successfully. Jun 25 21:25:42.491854 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-0a6fe4e4-5f32-4e0e-a418-340eac759810 tempest-TestVolumeBootPattern-148826616 None] Lock "b'cinder-3890b137-875d-4c17-9e55-a1a15e418962-delete_snapshot'" released by "delete_snapshot" :: held 0.748s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:25:42.778617 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-85b0a889-b4d6-488e-b082-8a5a5952bef2 tempest-GroupSnapshotsTest-1337242195 None] Group tempest-GroupSnapshotsTest-Group-1159873321: creating Jun 25 21:25:42.826663 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-85b0a889-b4d6-488e-b082-8a5a5952bef2 tempest-GroupSnapshotsTest-1337242195 None] Group tempest-GroupSnapshotsTest-Group-1159873321: created successfully Jun 25 21:25:42.850729 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-85b0a889-b4d6-488e-b082-8a5a5952bef2 tempest-GroupSnapshotsTest-1337242195 None] Create group completed successfully. Jun 25 21:25:42.997258 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-99961ddf-d6e6-417e-a8b2-baccc54cedda tempest-TestVolumeBootPattern-148826616 None] Lock "b'cinder-81e93959-3316-48fa-9ebc-7735cc5d8572-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:25:43.063374 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-99961ddf-d6e6-417e-a8b2-baccc54cedda tempest-TestVolumeBootPattern-148826616 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:25:43.186612 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-99961ddf-d6e6-417e-a8b2-baccc54cedda tempest-TestVolumeBootPattern-148826616 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:25:43.211022 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-99961ddf-d6e6-417e-a8b2-baccc54cedda tempest-TestVolumeBootPattern-148826616 None] deleting rbd volume volume-81e93959-3316-48fa-9ebc-7735cc5d8572 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:25:43.623759 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-99961ddf-d6e6-417e-a8b2-baccc54cedda tempest-TestVolumeBootPattern-148826616 None] volume is a clone so cleaning references {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jun 25 21:25:43.679578 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-99961ddf-d6e6-417e-a8b2-baccc54cedda tempest-TestVolumeBootPattern-148826616 None] deleting parent snapshot volume-81e93959-3316-48fa-9ebc-7735cc5d8572.clone_snap {{(pid=130674) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jun 25 21:25:44.415642 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-99961ddf-d6e6-417e-a8b2-baccc54cedda tempest-TestVolumeBootPattern-148826616 None] Created reservations ['7fc5df7d-da07-4cfb-b68f-cf015621fd5f', 'b7fd34eb-212a-43c3-9068-256726423c13', 'c96ac876-085d-44ef-b908-5fe522fcfad7', 'f7d3ea23-a0ad-4563-b611-8665a51ca3f5'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:25:44.535086 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-99961ddf-d6e6-417e-a8b2-baccc54cedda tempest-TestVolumeBootPattern-148826616 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:25:44.635436 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-99961ddf-d6e6-417e-a8b2-baccc54cedda tempest-TestVolumeBootPattern-148826616 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:25:44.752531 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-99961ddf-d6e6-417e-a8b2-baccc54cedda tempest-TestVolumeBootPattern-148826616 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:25:44.758818 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-99961ddf-d6e6-417e-a8b2-baccc54cedda tempest-TestVolumeBootPattern-148826616 None] Deleted volume successfully. Jun 25 21:25:44.833588 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-99961ddf-d6e6-417e-a8b2-baccc54cedda tempest-TestVolumeBootPattern-148826616 None] Lock "b'cinder-81e93959-3316-48fa-9ebc-7735cc5d8572-delete_volume'" released by "delete_volume" :: held 1.836s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:25:44.838782 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-b87cccd2-948a-46fe-a6a1-d605e5ceedd0 tempest-GroupSnapshotsTest-1337242195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:25:44.860822 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b87cccd2-948a-46fe-a6a1-d605e5ceedd0 tempest-GroupSnapshotsTest-1337242195 None] Flow 'volume_create_manager' (7ccc598f-dee2-464d-8667-c6bdc677e908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:25:44.867935 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b87cccd2-948a-46fe-a6a1-d605e5ceedd0 tempest-GroupSnapshotsTest-1337242195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c85f946f-3230-4287-ae79-4e4ed4882b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:25:44.885859 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b87cccd2-948a-46fe-a6a1-d605e5ceedd0 tempest-GroupSnapshotsTest-1337242195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c85f946f-3230-4287-ae79-4e4ed4882b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-307844508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f9e14fc3-489b-4133-989c-15c2d1151ab1,host='ncdv-master-1@ceph#ceph',id=a5bf44f9-fd81-452f-9aa6-c8caacec50e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f734d027051406d8cf743a5ac95b1ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:25:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:25:45Z,use_quota=True,user_id='8dab83d255f1435497f834b621cc9cbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3342d658-52d5-4dea-acbc-dd1fdc325607),volume_type_id=3342d658-52d5-4dea-acbc-dd1fdc325607)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:25:44.892787 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b87cccd2-948a-46fe-a6a1-d605e5ceedd0 tempest-GroupSnapshotsTest-1337242195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b74d41c0-bcd6-48dd-9bbe-dd11941262e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:25:44.899502 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b87cccd2-948a-46fe-a6a1-d605e5ceedd0 tempest-GroupSnapshotsTest-1337242195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b74d41c0-bcd6-48dd-9bbe-dd11941262e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:25:44.908228 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b87cccd2-948a-46fe-a6a1-d605e5ceedd0 tempest-GroupSnapshotsTest-1337242195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63cd91d0-9260-45e7-8a6d-cb7911651e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:25:44.914106 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b87cccd2-948a-46fe-a6a1-d605e5ceedd0 tempest-GroupSnapshotsTest-1337242195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63cd91d0-9260-45e7-8a6d-cb7911651e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5bf44f9-fd81-452f-9aa6-c8caacec50e3', 'volume_name': 'volume-a5bf44f9-fd81-452f-9aa6-c8caacec50e3', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:25:44.919147 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b87cccd2-948a-46fe-a6a1-d605e5ceedd0 tempest-GroupSnapshotsTest-1337242195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a852d67a-91d9-4dfb-bdf6-4dd5dffc54fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:25:44.923255 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b87cccd2-948a-46fe-a6a1-d605e5ceedd0 tempest-GroupSnapshotsTest-1337242195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a852d67a-91d9-4dfb-bdf6-4dd5dffc54fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:25:44.928138 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b87cccd2-948a-46fe-a6a1-d605e5ceedd0 tempest-GroupSnapshotsTest-1337242195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8345137-662c-4ce1-a19b-0235ec820708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:25:44.929358 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-b87cccd2-948a-46fe-a6a1-d605e5ceedd0 tempest-GroupSnapshotsTest-1337242195 None] Volume a5bf44f9-fd81-452f-9aa6-c8caacec50e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5bf44f9-fd81-452f-9aa6-c8caacec50e3', 'volume_size': 1} Jun 25 21:25:44.929926 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b87cccd2-948a-46fe-a6a1-d605e5ceedd0 tempest-GroupSnapshotsTest-1337242195 None] creating volume 'volume-a5bf44f9-fd81-452f-9aa6-c8caacec50e3' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:25:44.930711 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b87cccd2-948a-46fe-a6a1-d605e5ceedd0 tempest-GroupSnapshotsTest-1337242195 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:25:45.063844 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b87cccd2-948a-46fe-a6a1-d605e5ceedd0 tempest-GroupSnapshotsTest-1337242195 None] extra_specs: {} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:25:45.064734 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b87cccd2-948a-46fe-a6a1-d605e5ceedd0 tempest-GroupSnapshotsTest-1337242195 None] extra_specs: {} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:25:45.071934 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b87cccd2-948a-46fe-a6a1-d605e5ceedd0 tempest-GroupSnapshotsTest-1337242195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8345137-662c-4ce1-a19b-0235ec820708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5bf44f9-fd81-452f-9aa6-c8caacec50e3', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:25:45.082883 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b87cccd2-948a-46fe-a6a1-d605e5ceedd0 tempest-GroupSnapshotsTest-1337242195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc88a7e5-0a27-45ea-a09b-79c6bceab75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:25:45.102673 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-b87cccd2-948a-46fe-a6a1-d605e5ceedd0 tempest-GroupSnapshotsTest-1337242195 None] Volume volume-a5bf44f9-fd81-452f-9aa6-c8caacec50e3 (a5bf44f9-fd81-452f-9aa6-c8caacec50e3): created successfully Jun 25 21:25:45.108063 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b87cccd2-948a-46fe-a6a1-d605e5ceedd0 tempest-GroupSnapshotsTest-1337242195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc88a7e5-0a27-45ea-a09b-79c6bceab75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:25:45.117717 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b87cccd2-948a-46fe-a6a1-d605e5ceedd0 tempest-GroupSnapshotsTest-1337242195 None] Flow 'volume_create_manager' (7ccc598f-dee2-464d-8667-c6bdc677e908) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:25:45.134556 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-b87cccd2-948a-46fe-a6a1-d605e5ceedd0 tempest-GroupSnapshotsTest-1337242195 None] Created volume successfully. Jun 25 21:25:46.141384 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5e0a2d3-5b9b-47d7-879e-b46ebee07a28 tempest-TestVolumeBootPattern-148826616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:25:46.172359 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a5e0a2d3-5b9b-47d7-879e-b46ebee07a28 tempest-TestVolumeBootPattern-148826616 None] Flow 'volume_create_manager' (b2f83bf3-e1e6-4625-baf9-65f9239c0aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:25:46.181179 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a5e0a2d3-5b9b-47d7-879e-b46ebee07a28 tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34f0db5e-b6c9-4330-a19f-e2542057443d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:25:46.228265 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a5e0a2d3-5b9b-47d7-879e-b46ebee07a28 tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34f0db5e-b6c9-4330-a19f-e2542057443d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-321913091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b1408ff2-4778-47fb-a800-57807e1be851,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1a396ec47a346dc97426df498e54ab2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:25:46Z,use_quota=True,user_id='8d162afa6d9b48ef9fac1bf23c0c41e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:25:46.234791 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a5e0a2d3-5b9b-47d7-879e-b46ebee07a28 tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (495e1b29-1c30-4031-b94a-3c827047b6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:25:46.245280 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a5e0a2d3-5b9b-47d7-879e-b46ebee07a28 tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (495e1b29-1c30-4031-b94a-3c827047b6e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:25:46.269270 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a5e0a2d3-5b9b-47d7-879e-b46ebee07a28 tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (418843d9-e8a3-4e39-a05c-725dc0213275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:25:46.302768 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-8c6c0533-9d3d-42be-b936-1a933eb216aa tempest-GroupSnapshotsTest-1337242195 None] GroupSnapshot 294314fd-f6bb-43d3-bb9b-446e8ec12767: creating. Jun 25 21:25:46.404259 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-8c6c0533-9d3d-42be-b936-1a933eb216aa tempest-GroupSnapshotsTest-1337242195 None] Group snapshot 294314fd-f6bb-43d3-bb9b-446e8ec12767: creating. {{(pid=130674) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4081}} Jun 25 21:25:46.460070 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8c6c0533-9d3d-42be-b936-1a933eb216aa tempest-GroupSnapshotsTest-1337242195 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:25:46.615811 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a5e0a2d3-5b9b-47d7-879e-b46ebee07a28 tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (418843d9-e8a3-4e39-a05c-725dc0213275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b1408ff2-4778-47fb-a800-57807e1be851', 'volume_name': 'volume-b1408ff2-4778-47fb-a800-57807e1be851', 'volume_size': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d98522b7634403f83ff66fd72edfd9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'created_at': datetime.datetime(2022, 6, 25, 20, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5741eca-b932-4865-b29a-bd2a12a73795/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:25:46.624841 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a5e0a2d3-5b9b-47d7-879e-b46ebee07a28 tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ab9dac5-8023-47f5-abc7-831d08b86291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:25:46.629406 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a5e0a2d3-5b9b-47d7-879e-b46ebee07a28 tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ab9dac5-8023-47f5-abc7-831d08b86291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:25:46.639363 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a5e0a2d3-5b9b-47d7-879e-b46ebee07a28 tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa18f1b0-6111-4327-8cc9-013634fabcaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:25:46.640631 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-a5e0a2d3-5b9b-47d7-879e-b46ebee07a28 tempest-TestVolumeBootPattern-148826616 None] Volume b1408ff2-4778-47fb-a800-57807e1be851: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b1408ff2-4778-47fb-a800-57807e1be851', 'volume_size': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d98522b7634403f83ff66fd72edfd9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'created_at': datetime.datetime(2022, 6, 25, 20, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5741eca-b932-4865-b29a-bd2a12a73795/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 25 21:25:46.641445 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5e0a2d3-5b9b-47d7-879e-b46ebee07a28 tempest-TestVolumeBootPattern-148826616 None] Cloning b1408ff2-4778-47fb-a800-57807e1be851 from image c5741eca-b932-4865-b29a-bd2a12a73795 at location (None, None). {{(pid=130674) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1062}} Jun 25 21:25:46.655022 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-a5e0a2d3-5b9b-47d7-879e-b46ebee07a28 tempest-TestVolumeBootPattern-148826616 None] Lock "b'cinder-c5741eca-b932-4865-b29a-bd2a12a73795'" acquired by "_prepare_image_cache_entry" :: waited 0.012s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:25:46.670612 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-a5e0a2d3-5b9b-47d7-879e-b46ebee07a28 tempest-TestVolumeBootPattern-148826616 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'volume_id': 'c8878629-87cd-43d0-b2bd-d32c807cd322', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53), 'last_used': datetime.datetime(2022, 6, 25, 21, 25, 46, 661307)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 25 21:25:46.671359 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-a5e0a2d3-5b9b-47d7-879e-b46ebee07a28 tempest-TestVolumeBootPattern-148826616 None] Image-volume cache entry image_update_at = 2022-06-25 20:42:53+00:00, requested image updated_at = 2022-06-25 20:42:53+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 25 21:25:46.672023 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5e0a2d3-5b9b-47d7-879e-b46ebee07a28 tempest-TestVolumeBootPattern-148826616 None] Found cache entry for image = c5741eca-b932-4865-b29a-bd2a12a73795 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:877}} Jun 25 21:25:46.680292 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-a5e0a2d3-5b9b-47d7-879e-b46ebee07a28 tempest-TestVolumeBootPattern-148826616 None] Lock "b'cinder-c5741eca-b932-4865-b29a-bd2a12a73795'" released by "_prepare_image_cache_entry" :: held 0.023s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:25:46.681599 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5e0a2d3-5b9b-47d7-879e-b46ebee07a28 tempest-TestVolumeBootPattern-148826616 None] Attempting to retrieve cache entry for image = c5741eca-b932-4865-b29a-bd2a12a73795 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:818}} Jun 25 21:25:46.694520 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-a5e0a2d3-5b9b-47d7-879e-b46ebee07a28 tempest-TestVolumeBootPattern-148826616 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'volume_id': 'c8878629-87cd-43d0-b2bd-d32c807cd322', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53), 'last_used': datetime.datetime(2022, 6, 25, 21, 25, 46, 690350)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 25 21:25:46.699328 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-a5e0a2d3-5b9b-47d7-879e-b46ebee07a28 tempest-TestVolumeBootPattern-148826616 None] Image-volume cache entry image_update_at = 2022-06-25 20:42:53+00:00, requested image updated_at = 2022-06-25 20:42:53+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 25 21:25:46.700329 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5e0a2d3-5b9b-47d7-879e-b46ebee07a28 tempest-TestVolumeBootPattern-148826616 None] Creating from source image-volume c8878629-87cd-43d0-b2bd-d32c807cd322 {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:832}} Jun 25 21:25:46.727541 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=62,cinder:UPDATE=31,cinder:INSERT=5,cinder:DELETE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:25:46.736380 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a5e0a2d3-5b9b-47d7-879e-b46ebee07a28 tempest-TestVolumeBootPattern-148826616 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:25:46.844518 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a5e0a2d3-5b9b-47d7-879e-b46ebee07a28 tempest-TestVolumeBootPattern-148826616 None] creating snapshot='volume-b1408ff2-4778-47fb-a800-57807e1be851.clone_snap' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jun 25 21:25:47.352326 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a5e0a2d3-5b9b-47d7-879e-b46ebee07a28 tempest-TestVolumeBootPattern-148826616 None] cloning 'volume-c8878629-87cd-43d0-b2bd-d32c807cd322@volume-b1408ff2-4778-47fb-a800-57807e1be851.clone_snap' to 'volume-b1408ff2-4778-47fb-a800-57807e1be851' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jun 25 21:25:47.552649 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a5e0a2d3-5b9b-47d7-879e-b46ebee07a28 tempest-TestVolumeBootPattern-148826616 None] Volume volume-74f093be-e96a-4a80-ad38-abd3f5585611.deleted is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:25:47.554420 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a5e0a2d3-5b9b-47d7-879e-b46ebee07a28 tempest-TestVolumeBootPattern-148826616 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:25:47.556034 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a5e0a2d3-5b9b-47d7-879e-b46ebee07a28 tempest-TestVolumeBootPattern-148826616 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:25:47.589477 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a5e0a2d3-5b9b-47d7-879e-b46ebee07a28 tempest-TestVolumeBootPattern-148826616 None] clone created successfully {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jun 25 21:25:47.590524 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.volume_utils [None req-a5e0a2d3-5b9b-47d7-879e-b46ebee07a28 tempest-TestVolumeBootPattern-148826616 None] Marking volume b1408ff2-4778-47fb-a800-57807e1be851 as bootable. {{(pid=130674) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 25 21:25:47.620575 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-8c6c0533-9d3d-42be-b936-1a933eb216aa tempest-GroupSnapshotsTest-1337242195 None] group_snapshot 294314fd-f6bb-43d3-bb9b-446e8ec12767: created successfully Jun 25 21:25:47.630521 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5e0a2d3-5b9b-47d7-879e-b46ebee07a28 tempest-TestVolumeBootPattern-148826616 None] Copying metadata from image c5741eca-b932-4865-b29a-bd2a12a73795 to b1408ff2-4778-47fb-a800-57807e1be851. {{(pid=130674) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jun 25 21:25:47.631360 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5e0a2d3-5b9b-47d7-879e-b46ebee07a28 tempest-TestVolumeBootPattern-148826616 None] Creating volume glance metadata for volume b1408ff2-4778-47fb-a800-57807e1be851 backed by image c5741eca-b932-4865-b29a-bd2a12a73795 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=130674) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:674}} Jun 25 21:25:47.698836 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=61,cinder:UPDATE=27,cinder:INSERT=11,cinder:DELETE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:25:47.755726 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a5e0a2d3-5b9b-47d7-879e-b46ebee07a28 tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa18f1b0-6111-4327-8cc9-013634fabcaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1408ff2-4778-47fb-a800-57807e1be851', 'volume_size': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d98522b7634403f83ff66fd72edfd9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'created_at': datetime.datetime(2022, 6, 25, 20, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5741eca-b932-4865-b29a-bd2a12a73795/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:25:47.763787 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a5e0a2d3-5b9b-47d7-879e-b46ebee07a28 tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf525e49-e359-4e1e-9017-027671a8f916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:25:47.793674 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-a5e0a2d3-5b9b-47d7-879e-b46ebee07a28 tempest-TestVolumeBootPattern-148826616 None] Volume volume-b1408ff2-4778-47fb-a800-57807e1be851 (b1408ff2-4778-47fb-a800-57807e1be851): created successfully Jun 25 21:25:47.799001 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a5e0a2d3-5b9b-47d7-879e-b46ebee07a28 tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf525e49-e359-4e1e-9017-027671a8f916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:25:47.810273 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a5e0a2d3-5b9b-47d7-879e-b46ebee07a28 tempest-TestVolumeBootPattern-148826616 None] Flow 'volume_create_manager' (b2f83bf3-e1e6-4625-baf9-65f9239c0aba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:25:47.830491 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-a5e0a2d3-5b9b-47d7-879e-b46ebee07a28 tempest-TestVolumeBootPattern-148826616 None] Created volume successfully. Jun 25 21:25:49.434743 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cbae2a67-de86-4c89-b968-a6f4aba1e44b tempest-GroupSnapshotsTest-1337242195 None] cloning volumes/volume-a5bf44f9-fd81-452f-9aa6-c8caacec50e3@snapshot-497fd015-1d79-4185-83f8-7f17924792f1 to volume-78765c74-1606-4b83-a299-1bfb2a13d083 {{(pid=130674) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1094}} Jun 25 21:25:49.435413 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cbae2a67-de86-4c89-b968-a6f4aba1e44b tempest-GroupSnapshotsTest-1337242195 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:25:49.543737 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cbae2a67-de86-4c89-b968-a6f4aba1e44b tempest-GroupSnapshotsTest-1337242195 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:25:49.739110 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cbae2a67-de86-4c89-b968-a6f4aba1e44b tempest-GroupSnapshotsTest-1337242195 None] extra_specs: {} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:25:49.739874 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cbae2a67-de86-4c89-b968-a6f4aba1e44b tempest-GroupSnapshotsTest-1337242195 None] extra_specs: {} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:25:49.841820 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-cbae2a67-de86-4c89-b968-a6f4aba1e44b tempest-GroupSnapshotsTest-1337242195 None] Create group from source-snapshot-294314fd-f6bb-43d3-bb9b-446e8ec12767 completed successfully. Jun 25 21:25:51.162496 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-fc3c61c5-d1d3-4b5c-97da-52767fee2005 tempest-GroupSnapshotsTest-1337242195 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:25:51.273458 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-fc3c61c5-d1d3-4b5c-97da-52767fee2005 tempest-GroupSnapshotsTest-1337242195 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:25:51.283895 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-fc3c61c5-d1d3-4b5c-97da-52767fee2005 tempest-GroupSnapshotsTest-1337242195 None] deleting rbd volume volume-78765c74-1606-4b83-a299-1bfb2a13d083 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:25:51.704632 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-fc3c61c5-d1d3-4b5c-97da-52767fee2005 tempest-GroupSnapshotsTest-1337242195 None] Created reservations ['358e0232-8eac-417d-81e4-dd8bfe311f1a'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:25:51.748511 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-fc3c61c5-d1d3-4b5c-97da-52767fee2005 tempest-GroupSnapshotsTest-1337242195 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-676612466 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-676612466, it is now deprecated. Please use the default quota class for default quota. Jun 25 21:25:51.749382 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-fc3c61c5-d1d3-4b5c-97da-52767fee2005 tempest-GroupSnapshotsTest-1337242195 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-676612466 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-676612466, it is now deprecated. Please use the default quota class for default quota. Jun 25 21:25:51.783814 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-fc3c61c5-d1d3-4b5c-97da-52767fee2005 tempest-GroupSnapshotsTest-1337242195 None] Created reservations ['88e05ebc-211e-4488-b36f-82993bac7e7f', '127c131d-0176-4867-9d40-19b661135d43', '0709a345-e837-4cc6-95e3-df1e832764bb', '680141d0-ca38-4e4a-b189-e54f752f1f4c'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:25:51.968464 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-fc3c61c5-d1d3-4b5c-97da-52767fee2005 tempest-GroupSnapshotsTest-1337242195 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:25:52.049305 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-fc3c61c5-d1d3-4b5c-97da-52767fee2005 tempest-GroupSnapshotsTest-1337242195 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:25:52.106775 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-fc3c61c5-d1d3-4b5c-97da-52767fee2005 tempest-GroupSnapshotsTest-1337242195 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:25:52.111886 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-fc3c61c5-d1d3-4b5c-97da-52767fee2005 tempest-GroupSnapshotsTest-1337242195 None] Delete group completed successfully. Jun 25 21:25:52.157568 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:25:52.158219 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:25:52.225033 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:25:52.280910 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:25:52.464050 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-a9eafa9f-f737-4398-8463-391c6a4706cf tempest-GroupSnapshotsTest-1337242195 None] group_snapshot 294314fd-f6bb-43d3-bb9b-446e8ec12767: deleting Jun 25 21:25:52.498902 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a9eafa9f-f737-4398-8463-391c6a4706cf tempest-GroupSnapshotsTest-1337242195 None] group_snapshot 294314fd-f6bb-43d3-bb9b-446e8ec12767: deleting {{(pid=130674) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4256}} Jun 25 21:25:52.548199 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a9eafa9f-f737-4398-8463-391c6a4706cf tempest-GroupSnapshotsTest-1337242195 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:25:53.255343 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-a9eafa9f-f737-4398-8463-391c6a4706cf tempest-GroupSnapshotsTest-1337242195 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-676612466 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-676612466, it is now deprecated. Please use the default quota class for default quota. Jun 25 21:25:53.265450 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=71,cinder:UPDATE=14,cinder:INSERT=14,cinder:DELETE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:25:53.275755 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-a9eafa9f-f737-4398-8463-391c6a4706cf tempest-GroupSnapshotsTest-1337242195 None] Created reservations ['b3c04895-1e7d-4167-8f05-1a4964de7a32', '2a8f7a7d-a009-44b0-b318-de1a38b531d4', 'b11ea206-67b9-4daf-bdaf-60ba85fcad30', 'e7ba7097-9c77-4fa4-889b-56b0410e5b3a'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:25:53.351425 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-a9eafa9f-f737-4398-8463-391c6a4706cf tempest-GroupSnapshotsTest-1337242195 None] group_snapshot 294314fd-f6bb-43d3-bb9b-446e8ec12767: deleted successfully Jun 25 21:25:54.485325 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c75cef0e-806f-4362-aaf7-81d41adb98dd tempest-GroupSnapshotsTest-1337242195 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:25:54.581069 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c75cef0e-806f-4362-aaf7-81d41adb98dd tempest-GroupSnapshotsTest-1337242195 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:25:54.581495 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c75cef0e-806f-4362-aaf7-81d41adb98dd tempest-GroupSnapshotsTest-1337242195 None] Volume volume-a5bf44f9-fd81-452f-9aa6-c8caacec50e3 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:25:54.588369 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c75cef0e-806f-4362-aaf7-81d41adb98dd tempest-GroupSnapshotsTest-1337242195 None] deleting rbd volume volume-a5bf44f9-fd81-452f-9aa6-c8caacec50e3 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:25:54.932734 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-c75cef0e-806f-4362-aaf7-81d41adb98dd tempest-GroupSnapshotsTest-1337242195 None] Created reservations ['4782bfde-a12c-40d3-a555-e42c977d07ac'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:25:54.971450 ncdv-master-1 cinder-volume[130674]: WARNING cinder.db.sqlalchemy.api [None req-c75cef0e-806f-4362-aaf7-81d41adb98dd tempest-GroupSnapshotsTest-1337242195 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-676612466'] Jun 25 21:25:54.979007 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-c75cef0e-806f-4362-aaf7-81d41adb98dd tempest-GroupSnapshotsTest-1337242195 None] Created reservations ['40ec184d-70a7-44e4-a44e-43188a7ae17a', 'ef730466-c589-4b3e-898a-be3c0016f0aa', '7a16bdf9-a180-4aed-8a15-8f72ca0df5c6', '1caaf67c-0a65-4b95-af2d-549a9adbba8a'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:25:55.041923 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=61,cinder:UPDATE=34,cinder:INSERT=5 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:25:55.093139 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c75cef0e-806f-4362-aaf7-81d41adb98dd tempest-GroupSnapshotsTest-1337242195 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:25:55.184203 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c75cef0e-806f-4362-aaf7-81d41adb98dd tempest-GroupSnapshotsTest-1337242195 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:25:55.241304 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-c75cef0e-806f-4362-aaf7-81d41adb98dd tempest-GroupSnapshotsTest-1337242195 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:25:55.253155 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-c75cef0e-806f-4362-aaf7-81d41adb98dd tempest-GroupSnapshotsTest-1337242195 None] Delete group completed successfully. Jun 25 21:25:55.954882 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-5ba84f8d-996f-406e-a7d8-e7ce8e99dc1d tempest-GroupSnapshotsTest-1337242195 None] Group tempest-GroupSnapshotsTest-Group-1291839661: creating Jun 25 21:25:55.979638 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-5ba84f8d-996f-406e-a7d8-e7ce8e99dc1d tempest-GroupSnapshotsTest-1337242195 None] Group tempest-GroupSnapshotsTest-Group-1291839661: created successfully Jun 25 21:25:55.993566 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-5ba84f8d-996f-406e-a7d8-e7ce8e99dc1d tempest-GroupSnapshotsTest-1337242195 None] Create group completed successfully. Jun 25 21:25:57.546915 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-f783555b-96d9-4def-b417-011629436648 req-caf380a0-031e-4ca4-b137-c76013ebc4bd tempest-TestVolumeBootPattern-148826616 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 21:25:57.914788 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbc785ef-d7fd-4e22-9882-a316d93725cc tempest-GroupSnapshotsTest-1337242195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:25:57.992003 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cbc785ef-d7fd-4e22-9882-a316d93725cc tempest-GroupSnapshotsTest-1337242195 None] Flow 'volume_create_manager' (4ea0a585-210f-414b-8531-86afc2484c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:25:58.024615 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cbc785ef-d7fd-4e22-9882-a316d93725cc tempest-GroupSnapshotsTest-1337242195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ffb7ae3-f77b-45a0-bf24-7987672eb84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:25:58.069506 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cbc785ef-d7fd-4e22-9882-a316d93725cc tempest-GroupSnapshotsTest-1337242195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ffb7ae3-f77b-45a0-bf24-7987672eb84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:25:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-834114007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ca17efa6-d662-46d9-b8a3-2c73334fb6e8,host='ncdv-master-1@ceph#ceph',id=03dfb14e-adb3-4973-8487-e5bc11d59d37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f734d027051406d8cf743a5ac95b1ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:25:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:25:58Z,use_quota=True,user_id='8dab83d255f1435497f834b621cc9cbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7161320c-fd70-47ee-8f47-79f6ea22cdf6),volume_type_id=7161320c-fd70-47ee-8f47-79f6ea22cdf6)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:25:58.087432 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cbc785ef-d7fd-4e22-9882-a316d93725cc tempest-GroupSnapshotsTest-1337242195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a80ec696-7db2-44f5-a475-8a9b5b86d0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:25:58.096921 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cbc785ef-d7fd-4e22-9882-a316d93725cc tempest-GroupSnapshotsTest-1337242195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a80ec696-7db2-44f5-a475-8a9b5b86d0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:25:58.102294 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cbc785ef-d7fd-4e22-9882-a316d93725cc tempest-GroupSnapshotsTest-1337242195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60869e11-46c8-4785-815b-c2fb0d9fd02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:25:58.120797 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cbc785ef-d7fd-4e22-9882-a316d93725cc tempest-GroupSnapshotsTest-1337242195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60869e11-46c8-4785-815b-c2fb0d9fd02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03dfb14e-adb3-4973-8487-e5bc11d59d37', 'volume_name': 'volume-03dfb14e-adb3-4973-8487-e5bc11d59d37', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:25:58.127663 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cbc785ef-d7fd-4e22-9882-a316d93725cc tempest-GroupSnapshotsTest-1337242195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23cb8056-ca2b-45bb-a992-af758e515fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:25:58.139479 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cbc785ef-d7fd-4e22-9882-a316d93725cc tempest-GroupSnapshotsTest-1337242195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23cb8056-ca2b-45bb-a992-af758e515fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:25:58.153008 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cbc785ef-d7fd-4e22-9882-a316d93725cc tempest-GroupSnapshotsTest-1337242195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (342c68cb-7bad-4c7b-978c-4122463ba6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:25:58.154226 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-cbc785ef-d7fd-4e22-9882-a316d93725cc tempest-GroupSnapshotsTest-1337242195 None] Volume 03dfb14e-adb3-4973-8487-e5bc11d59d37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03dfb14e-adb3-4973-8487-e5bc11d59d37', 'volume_size': 1} Jun 25 21:25:58.154638 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cbc785ef-d7fd-4e22-9882-a316d93725cc tempest-GroupSnapshotsTest-1337242195 None] creating volume 'volume-03dfb14e-adb3-4973-8487-e5bc11d59d37' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:25:58.155567 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cbc785ef-d7fd-4e22-9882-a316d93725cc tempest-GroupSnapshotsTest-1337242195 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:25:58.298996 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cbc785ef-d7fd-4e22-9882-a316d93725cc tempest-GroupSnapshotsTest-1337242195 None] extra_specs: {} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:25:58.299756 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-cbc785ef-d7fd-4e22-9882-a316d93725cc tempest-GroupSnapshotsTest-1337242195 None] extra_specs: {} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:25:58.305090 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cbc785ef-d7fd-4e22-9882-a316d93725cc tempest-GroupSnapshotsTest-1337242195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (342c68cb-7bad-4c7b-978c-4122463ba6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03dfb14e-adb3-4973-8487-e5bc11d59d37', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:25:58.310515 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cbc785ef-d7fd-4e22-9882-a316d93725cc tempest-GroupSnapshotsTest-1337242195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9987c24a-0304-4fe2-93e5-fb9805450357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:25:58.354410 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-cbc785ef-d7fd-4e22-9882-a316d93725cc tempest-GroupSnapshotsTest-1337242195 None] Volume volume-03dfb14e-adb3-4973-8487-e5bc11d59d37 (03dfb14e-adb3-4973-8487-e5bc11d59d37): created successfully Jun 25 21:25:58.359111 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cbc785ef-d7fd-4e22-9882-a316d93725cc tempest-GroupSnapshotsTest-1337242195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9987c24a-0304-4fe2-93e5-fb9805450357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:25:58.370234 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-cbc785ef-d7fd-4e22-9882-a316d93725cc tempest-GroupSnapshotsTest-1337242195 None] Flow 'volume_create_manager' (4ea0a585-210f-414b-8531-86afc2484c89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:25:58.384954 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-cbc785ef-d7fd-4e22-9882-a316d93725cc tempest-GroupSnapshotsTest-1337242195 None] Created volume successfully. Jun 25 21:25:59.044467 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-f783555b-96d9-4def-b417-011629436648 req-caf380a0-031e-4ca4-b137-c76013ebc4bd tempest-TestVolumeBootPattern-148826616 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.500s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 21:25:59.046145 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-f783555b-96d9-4def-b417-011629436648 req-caf380a0-031e-4ca4-b137-c76013ebc4bd tempest-TestVolumeBootPattern-148826616 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b1408ff2-4778-47fb-a800-57807e1be851', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': 'b1408ff2-4778-47fb-a800-57807e1be851', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 21:25:59.079857 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-f783555b-96d9-4def-b417-011629436648 req-caf380a0-031e-4ca4-b137-c76013ebc4bd tempest-TestVolumeBootPattern-148826616 None] Connection info returned from driver {'name': 'volumes/volume-b1408ff2-4778-47fb-a800-57807e1be851', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'b1408ff2-4778-47fb-a800-57807e1be851', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'dae66a98-bd2d-4c7b-9a92-10ffc78f9ad6'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 25 21:25:59.164007 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-f783555b-96d9-4def-b417-011629436648 req-caf380a0-031e-4ca4-b137-c76013ebc4bd tempest-TestVolumeBootPattern-148826616 None] attachment_update completed successfully. Jun 25 21:25:59.729992 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-874a5200-9cd3-421b-830c-91ef60c119d9 tempest-GroupSnapshotsTest-1337242195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:25:59.771251 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-874a5200-9cd3-421b-830c-91ef60c119d9 tempest-GroupSnapshotsTest-1337242195 None] Flow 'volume_create_manager' (3991b1b5-6f92-47a6-935d-8d98ccb1388a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:25:59.782259 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-874a5200-9cd3-421b-830c-91ef60c119d9 tempest-GroupSnapshotsTest-1337242195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b93687b-6ae4-4ce0-95a9-fbc731f3f1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:25:59.847004 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-874a5200-9cd3-421b-830c-91ef60c119d9 tempest-GroupSnapshotsTest-1337242195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b93687b-6ae4-4ce0-95a9-fbc731f3f1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1687194826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ca17efa6-d662-46d9-b8a3-2c73334fb6e8,host='ncdv-master-1@ceph#ceph',id=ee6a010d-ce24-4c7f-aa1c-af7f7a1bb592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f734d027051406d8cf743a5ac95b1ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:26:00Z,use_quota=True,user_id='8dab83d255f1435497f834b621cc9cbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7161320c-fd70-47ee-8f47-79f6ea22cdf6),volume_type_id=7161320c-fd70-47ee-8f47-79f6ea22cdf6)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:25:59.854125 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-874a5200-9cd3-421b-830c-91ef60c119d9 tempest-GroupSnapshotsTest-1337242195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf211882-b8e4-477c-be7e-2417f36b58ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:25:59.861105 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-874a5200-9cd3-421b-830c-91ef60c119d9 tempest-GroupSnapshotsTest-1337242195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf211882-b8e4-477c-be7e-2417f36b58ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:25:59.869249 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-874a5200-9cd3-421b-830c-91ef60c119d9 tempest-GroupSnapshotsTest-1337242195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d64e2e01-98f5-49b6-bcdc-487a136d9adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:25:59.876076 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-874a5200-9cd3-421b-830c-91ef60c119d9 tempest-GroupSnapshotsTest-1337242195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d64e2e01-98f5-49b6-bcdc-487a136d9adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee6a010d-ce24-4c7f-aa1c-af7f7a1bb592', 'volume_name': 'volume-ee6a010d-ce24-4c7f-aa1c-af7f7a1bb592', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:25:59.882144 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-874a5200-9cd3-421b-830c-91ef60c119d9 tempest-GroupSnapshotsTest-1337242195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96e41389-c99c-4a05-80bc-9cbed4017413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:25:59.888472 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-874a5200-9cd3-421b-830c-91ef60c119d9 tempest-GroupSnapshotsTest-1337242195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96e41389-c99c-4a05-80bc-9cbed4017413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:25:59.893764 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-874a5200-9cd3-421b-830c-91ef60c119d9 tempest-GroupSnapshotsTest-1337242195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3364a4f5-500a-47ee-814b-2db9264a3164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:25:59.895163 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-874a5200-9cd3-421b-830c-91ef60c119d9 tempest-GroupSnapshotsTest-1337242195 None] Volume ee6a010d-ce24-4c7f-aa1c-af7f7a1bb592: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee6a010d-ce24-4c7f-aa1c-af7f7a1bb592', 'volume_size': 1} Jun 25 21:25:59.895887 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-874a5200-9cd3-421b-830c-91ef60c119d9 tempest-GroupSnapshotsTest-1337242195 None] creating volume 'volume-ee6a010d-ce24-4c7f-aa1c-af7f7a1bb592' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:25:59.896758 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-874a5200-9cd3-421b-830c-91ef60c119d9 tempest-GroupSnapshotsTest-1337242195 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:26:00.020372 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-874a5200-9cd3-421b-830c-91ef60c119d9 tempest-GroupSnapshotsTest-1337242195 None] extra_specs: {} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:26:00.021070 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-874a5200-9cd3-421b-830c-91ef60c119d9 tempest-GroupSnapshotsTest-1337242195 None] extra_specs: {} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:26:00.025184 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-874a5200-9cd3-421b-830c-91ef60c119d9 tempest-GroupSnapshotsTest-1337242195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3364a4f5-500a-47ee-814b-2db9264a3164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee6a010d-ce24-4c7f-aa1c-af7f7a1bb592', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:26:00.030548 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-874a5200-9cd3-421b-830c-91ef60c119d9 tempest-GroupSnapshotsTest-1337242195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa1c9b21-019a-4ab8-a8a7-ae5768189b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:26:00.044345 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-874a5200-9cd3-421b-830c-91ef60c119d9 tempest-GroupSnapshotsTest-1337242195 None] Volume volume-ee6a010d-ce24-4c7f-aa1c-af7f7a1bb592 (ee6a010d-ce24-4c7f-aa1c-af7f7a1bb592): created successfully Jun 25 21:26:00.048664 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-874a5200-9cd3-421b-830c-91ef60c119d9 tempest-GroupSnapshotsTest-1337242195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa1c9b21-019a-4ab8-a8a7-ae5768189b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:26:00.054771 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-874a5200-9cd3-421b-830c-91ef60c119d9 tempest-GroupSnapshotsTest-1337242195 None] Flow 'volume_create_manager' (3991b1b5-6f92-47a6-935d-8d98ccb1388a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:26:00.088144 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-874a5200-9cd3-421b-830c-91ef60c119d9 tempest-GroupSnapshotsTest-1337242195 None] Created volume successfully. Jun 25 21:26:01.099634 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-6eb27640-e772-4f98-9dbe-bcda76936f1b tempest-GroupSnapshotsTest-1337242195 None] Update group completed successfully. Jun 25 21:26:02.295517 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-34df3d6d-0e76-461e-8db2-69ffbbed218a tempest-GroupSnapshotsTest-1337242195 None] Update group completed successfully. Jun 25 21:26:03.472939 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-73f83f53-711c-4e4d-92cb-2c590a9f23a4 tempest-GroupSnapshotsTest-1337242195 None] Update group completed successfully. Jun 25 21:26:04.654979 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-30a91602-6525-46a0-b87f-2912ee897697 tempest-GroupSnapshotsTest-1337242195 None] Update group completed successfully. Jun 25 21:26:06.237240 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-f88a9b2d-a594-4810-9add-155b6381c23d tempest-GroupSnapshotsTest-1337242195 None] GroupSnapshot b5d93a4e-635a-4b6d-8d0e-789efa23f0a2: creating. Jun 25 21:26:06.268219 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f88a9b2d-a594-4810-9add-155b6381c23d tempest-GroupSnapshotsTest-1337242195 None] Group snapshot b5d93a4e-635a-4b6d-8d0e-789efa23f0a2: creating. {{(pid=130674) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4081}} Jun 25 21:26:06.294533 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f88a9b2d-a594-4810-9add-155b6381c23d tempest-GroupSnapshotsTest-1337242195 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:26:07.497804 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f88a9b2d-a594-4810-9add-155b6381c23d tempest-GroupSnapshotsTest-1337242195 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:26:08.540747 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=74,cinder:UPDATE=22,cinder:INSERT=3,cinder:DELETE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:08.630518 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-f88a9b2d-a594-4810-9add-155b6381c23d tempest-GroupSnapshotsTest-1337242195 None] group_snapshot b5d93a4e-635a-4b6d-8d0e-789efa23f0a2: created successfully Jun 25 21:26:09.458373 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-02277918-9710-403c-a01a-40fd8c0068e4 req-4dd02545-6434-4c20-a4c9-9d58493ade04 tempest-TestVolumeBootPattern-148826616 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:26:09.681137 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-699ba997-31d9-4ab6-8d1a-d17c32668aea tempest-GroupSnapshotsTest-1337242195 None] group_snapshot b5d93a4e-635a-4b6d-8d0e-789efa23f0a2: deleting Jun 25 21:26:09.714434 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-699ba997-31d9-4ab6-8d1a-d17c32668aea tempest-GroupSnapshotsTest-1337242195 None] group_snapshot b5d93a4e-635a-4b6d-8d0e-789efa23f0a2: deleting {{(pid=130674) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4256}} Jun 25 21:26:09.737326 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-699ba997-31d9-4ab6-8d1a-d17c32668aea tempest-GroupSnapshotsTest-1337242195 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:26:10.548458 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-699ba997-31d9-4ab6-8d1a-d17c32668aea tempest-GroupSnapshotsTest-1337242195 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:26:10.690659 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-02277918-9710-403c-a01a-40fd8c0068e4 req-4dd02545-6434-4c20-a4c9-9d58493ade04 tempest-TestVolumeBootPattern-148826616 None] Create snapshot completed successfully Jun 25 21:26:11.519008 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:UPDATE=18,cinder:SELECT=76,cinder:DELETE=1,cinder:INSERT=5 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:11.573149 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-699ba997-31d9-4ab6-8d1a-d17c32668aea tempest-GroupSnapshotsTest-1337242195 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-247547049 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-247547049, it is now deprecated. Please use the default quota class for default quota. Jun 25 21:26:11.573838 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-699ba997-31d9-4ab6-8d1a-d17c32668aea tempest-GroupSnapshotsTest-1337242195 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-247547049 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-247547049, it is now deprecated. Please use the default quota class for default quota. Jun 25 21:26:11.595293 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-699ba997-31d9-4ab6-8d1a-d17c32668aea tempest-GroupSnapshotsTest-1337242195 None] Created reservations ['a0434146-45a8-476d-8420-3889f6a9b594', '908d6e06-3bb5-4007-8b4d-879a215d9651', '115f9f7b-f541-4547-96b7-d6016adf9902', '8b7095a9-5b82-478a-8aef-680943b1088d'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:26:11.725273 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-699ba997-31d9-4ab6-8d1a-d17c32668aea tempest-GroupSnapshotsTest-1337242195 None] Created reservations ['f711b306-4b85-4b1b-9ee6-03fb1504a05f', '7a1aead6-5f29-42ca-a9b6-d6fbf176c1ae', '8be6aa59-f581-40a5-84d2-af9a4dd083b1', 'c867ed78-6e7c-433b-bfc7-f17ffbd63b66'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:26:11.787437 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-699ba997-31d9-4ab6-8d1a-d17c32668aea tempest-GroupSnapshotsTest-1337242195 None] group_snapshot b5d93a4e-635a-4b6d-8d0e-789efa23f0a2: deleted successfully Jun 25 21:26:12.386422 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a112c05c-7815-49f3-8b3f-a946ffd72cc0 tempest-GroupSnapshotsTest-1337242195 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:26:12.456813 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a112c05c-7815-49f3-8b3f-a946ffd72cc0 tempest-GroupSnapshotsTest-1337242195 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:26:12.457648 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a112c05c-7815-49f3-8b3f-a946ffd72cc0 tempest-GroupSnapshotsTest-1337242195 None] Volume volume-03dfb14e-adb3-4973-8487-e5bc11d59d37 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:26:12.465426 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a112c05c-7815-49f3-8b3f-a946ffd72cc0 tempest-GroupSnapshotsTest-1337242195 None] deleting rbd volume volume-03dfb14e-adb3-4973-8487-e5bc11d59d37 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:26:12.647246 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a112c05c-7815-49f3-8b3f-a946ffd72cc0 tempest-GroupSnapshotsTest-1337242195 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:26:12.736462 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a112c05c-7815-49f3-8b3f-a946ffd72cc0 tempest-GroupSnapshotsTest-1337242195 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:26:12.737060 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a112c05c-7815-49f3-8b3f-a946ffd72cc0 tempest-GroupSnapshotsTest-1337242195 None] Volume volume-ee6a010d-ce24-4c7f-aa1c-af7f7a1bb592 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:26:12.746324 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a112c05c-7815-49f3-8b3f-a946ffd72cc0 tempest-GroupSnapshotsTest-1337242195 None] deleting rbd volume volume-ee6a010d-ce24-4c7f-aa1c-af7f7a1bb592 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:26:13.207817 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-a112c05c-7815-49f3-8b3f-a946ffd72cc0 tempest-GroupSnapshotsTest-1337242195 None] Created reservations ['720908b8-8a3c-4529-92e7-4ccddaadec10'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:26:13.264762 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-a112c05c-7815-49f3-8b3f-a946ffd72cc0 tempest-GroupSnapshotsTest-1337242195 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-247547049 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-247547049, it is now deprecated. Please use the default quota class for default quota. Jun 25 21:26:13.299677 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-a112c05c-7815-49f3-8b3f-a946ffd72cc0 tempest-GroupSnapshotsTest-1337242195 None] Created reservations ['d3d3af8a-180c-49c1-8e68-11fd34ef7834', 'c0f94212-7816-4d92-8bda-5a4ddabd7897', '0838d677-77cf-46f6-8b78-4f7e22a10339', 'a8a07e2e-d32a-41a9-8bf8-2774674b9af2'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:26:13.397569 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:UPDATE=23,cinder:SELECT=63,cinder:INSERT=13,cinder:DELETE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:13.444598 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-a112c05c-7815-49f3-8b3f-a946ffd72cc0 tempest-GroupSnapshotsTest-1337242195 None] Created reservations ['565062b3-c59a-4a18-8c01-c5628b194847', '6a08824c-118d-492e-aa98-bb31d782fed5', '838b9e17-77c5-499b-8be3-cf1e3ba95d53', 'c844bf31-f3f7-4e88-89d5-8db44a8ce354'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:26:13.596212 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a112c05c-7815-49f3-8b3f-a946ffd72cc0 tempest-GroupSnapshotsTest-1337242195 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:26:13.674573 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a112c05c-7815-49f3-8b3f-a946ffd72cc0 tempest-GroupSnapshotsTest-1337242195 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:26:13.714014 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-a112c05c-7815-49f3-8b3f-a946ffd72cc0 tempest-GroupSnapshotsTest-1337242195 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:26:13.731867 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-a112c05c-7815-49f3-8b3f-a946ffd72cc0 tempest-GroupSnapshotsTest-1337242195 None] Delete group completed successfully. Jun 25 21:26:13.733917 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-5f37e322-3546-40d3-81eb-f263d21dcd12 tempest-GroupSnapshotsV319Test-1772545099 None] Group tempest-GroupSnapshotsV319Test-Group-1991143049: creating Jun 25 21:26:13.758690 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-5f37e322-3546-40d3-81eb-f263d21dcd12 tempest-GroupSnapshotsV319Test-1772545099 None] Group tempest-GroupSnapshotsV319Test-Group-1991143049: created successfully Jun 25 21:26:13.769724 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-5f37e322-3546-40d3-81eb-f263d21dcd12 tempest-GroupSnapshotsV319Test-1772545099 None] Create group completed successfully. Jun 25 21:26:14.976593 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [req-23a05317-d2ce-4beb-8e89-4c784840aab2 req-c0ffb1d5-01f5-49ce-be07-e20d13ab9cae tempest-TestVolumeBootPattern-148826616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:26:15.051165 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-23a05317-d2ce-4beb-8e89-4c784840aab2 req-c0ffb1d5-01f5-49ce-be07-e20d13ab9cae tempest-TestVolumeBootPattern-148826616 None] Flow 'volume_create_manager' (6cb660b2-4af6-4ec0-9a86-a5fe81761923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:26:15.066743 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-23a05317-d2ce-4beb-8e89-4c784840aab2 req-c0ffb1d5-01f5-49ce-be07-e20d13ab9cae tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15d1ce49-170a-4576-a7b8-40ceb817e5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:26:15.104814 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-23a05317-d2ce-4beb-8e89-4c784840aab2 req-c0ffb1d5-01f5-49ce-be07-e20d13ab9cae tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15d1ce49-170a-4576-a7b8-40ceb817e5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:26:15Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0beaf8d2-11d1-4c3a-aca7-a64f23674792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1a396ec47a346dc97426df498e54ab2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=eeaed976-f0d3-4e46-b596-c970e1db7981,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:26:15Z,use_quota=True,user_id='8d162afa6d9b48ef9fac1bf23c0c41e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:26:15.118496 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-23a05317-d2ce-4beb-8e89-4c784840aab2 req-c0ffb1d5-01f5-49ce-be07-e20d13ab9cae tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb4de07c-6781-4930-8f73-e7ddc7c398c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:26:15.129733 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-23a05317-d2ce-4beb-8e89-4c784840aab2 req-c0ffb1d5-01f5-49ce-be07-e20d13ab9cae tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb4de07c-6781-4930-8f73-e7ddc7c398c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:26:15.148703 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-23a05317-d2ce-4beb-8e89-4c784840aab2 req-c0ffb1d5-01f5-49ce-be07-e20d13ab9cae tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0947cca8-0fae-4fff-94c4-1e9a76eee3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:26:15.159152 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-23a05317-d2ce-4beb-8e89-4c784840aab2 req-c0ffb1d5-01f5-49ce-be07-e20d13ab9cae tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0947cca8-0fae-4fff-94c4-1e9a76eee3a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0beaf8d2-11d1-4c3a-aca7-a64f23674792', 'volume_name': 'volume-0beaf8d2-11d1-4c3a-aca7-a64f23674792', 'volume_size': 1, 'snapshot_id': 'eeaed976-f0d3-4e46-b596-c970e1db7981'}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:26:15.165247 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-23a05317-d2ce-4beb-8e89-4c784840aab2 req-c0ffb1d5-01f5-49ce-be07-e20d13ab9cae tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e30c8336-1d7b-4cc5-a586-7105b207ac11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:26:15.181047 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-23a05317-d2ce-4beb-8e89-4c784840aab2 req-c0ffb1d5-01f5-49ce-be07-e20d13ab9cae tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e30c8336-1d7b-4cc5-a586-7105b207ac11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:26:15.192624 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-23a05317-d2ce-4beb-8e89-4c784840aab2 req-c0ffb1d5-01f5-49ce-be07-e20d13ab9cae tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e44be666-2469-4749-8198-55a658fcd394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:26:15.194059 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [req-23a05317-d2ce-4beb-8e89-4c784840aab2 req-c0ffb1d5-01f5-49ce-be07-e20d13ab9cae tempest-TestVolumeBootPattern-148826616 None] Volume 0beaf8d2-11d1-4c3a-aca7-a64f23674792: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0beaf8d2-11d1-4c3a-aca7-a64f23674792', 'volume_size': 1, 'snapshot_id': 'eeaed976-f0d3-4e46-b596-c970e1db7981'} Jun 25 21:26:15.204798 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=55,cinder:INSERT=10,cinder:UPDATE=35 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:15.240990 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-23a05317-d2ce-4beb-8e89-4c784840aab2 req-c0ffb1d5-01f5-49ce-be07-e20d13ab9cae tempest-TestVolumeBootPattern-148826616 None] cloning volumes/volume-b1408ff2-4778-47fb-a800-57807e1be851@snapshot-eeaed976-f0d3-4e46-b596-c970e1db7981 to volume-0beaf8d2-11d1-4c3a-aca7-a64f23674792 {{(pid=130674) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1094}} Jun 25 21:26:15.241636 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-23a05317-d2ce-4beb-8e89-4c784840aab2 req-c0ffb1d5-01f5-49ce-be07-e20d13ab9cae tempest-TestVolumeBootPattern-148826616 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:26:15.382495 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-23a05317-d2ce-4beb-8e89-4c784840aab2 req-c0ffb1d5-01f5-49ce-be07-e20d13ab9cae tempest-TestVolumeBootPattern-148826616 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:26:15.601969 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f1c20b4-6c2f-4839-9fbb-ab73ea94f6b3 tempest-GroupSnapshotsV319Test-1772545099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:26:15.642547 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4f1c20b4-6c2f-4839-9fbb-ab73ea94f6b3 tempest-GroupSnapshotsV319Test-1772545099 None] Flow 'volume_create_manager' (c9924358-1661-47d7-9516-651d806101b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:26:15.662621 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4f1c20b4-6c2f-4839-9fbb-ab73ea94f6b3 tempest-GroupSnapshotsV319Test-1772545099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eea0050c-646e-4f70-b366-8c38b4e0e170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:26:15.717805 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-23a05317-d2ce-4beb-8e89-4c784840aab2 req-c0ffb1d5-01f5-49ce-be07-e20d13ab9cae tempest-TestVolumeBootPattern-148826616 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:26:15.718372 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-23a05317-d2ce-4beb-8e89-4c784840aab2 req-c0ffb1d5-01f5-49ce-be07-e20d13ab9cae tempest-TestVolumeBootPattern-148826616 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:26:15.735272 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-e22e4c1d-f28b-40c8-8988-91de4b289e0f tempest-GroupSnapshotsTest-1337242195 None] Group tempest-GroupSnapshotsTest-Group-2035962547: creating Jun 25 21:26:15.772506 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4f1c20b4-6c2f-4839-9fbb-ab73ea94f6b3 tempest-GroupSnapshotsV319Test-1772545099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eea0050c-646e-4f70-b366-8c38b4e0e170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:26:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsV319Test-Volume-1116518071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9f2f7676-592d-4c79-acab-c2d3beb385da,host='ncdv-master-1@ceph#ceph',id=1732f426-169a-46ec-b080-b3f278298b26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b601a1bbdb44245a1396050141652e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:26:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:26:16Z,use_quota=True,user_id='c5d06f7af97649f58b1552b8700db835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04bcbe82-fb9b-4194-bd35-33cf5113404b),volume_type_id=04bcbe82-fb9b-4194-bd35-33cf5113404b)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:26:15.791310 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4f1c20b4-6c2f-4839-9fbb-ab73ea94f6b3 tempest-GroupSnapshotsV319Test-1772545099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2e07385-f2ea-4689-9d38-f8e221e06dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:26:15.807743 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4f1c20b4-6c2f-4839-9fbb-ab73ea94f6b3 tempest-GroupSnapshotsV319Test-1772545099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2e07385-f2ea-4689-9d38-f8e221e06dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:26:15.819523 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4f1c20b4-6c2f-4839-9fbb-ab73ea94f6b3 tempest-GroupSnapshotsV319Test-1772545099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4136011-2a59-4d52-82a4-d6db8ba52cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:26:15.824624 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4f1c20b4-6c2f-4839-9fbb-ab73ea94f6b3 tempest-GroupSnapshotsV319Test-1772545099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4136011-2a59-4d52-82a4-d6db8ba52cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1732f426-169a-46ec-b080-b3f278298b26', 'volume_name': 'volume-1732f426-169a-46ec-b080-b3f278298b26', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:26:15.829815 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4f1c20b4-6c2f-4839-9fbb-ab73ea94f6b3 tempest-GroupSnapshotsV319Test-1772545099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fac07141-3647-4a41-81d0-8c496f1a4d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:26:15.842482 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4f1c20b4-6c2f-4839-9fbb-ab73ea94f6b3 tempest-GroupSnapshotsV319Test-1772545099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fac07141-3647-4a41-81d0-8c496f1a4d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:26:15.848185 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4f1c20b4-6c2f-4839-9fbb-ab73ea94f6b3 tempest-GroupSnapshotsV319Test-1772545099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06579384-f707-4fbf-a3e1-f88c6c66c2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:26:15.849737 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-4f1c20b4-6c2f-4839-9fbb-ab73ea94f6b3 tempest-GroupSnapshotsV319Test-1772545099 None] Volume 1732f426-169a-46ec-b080-b3f278298b26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1732f426-169a-46ec-b080-b3f278298b26', 'volume_size': 1} Jun 25 21:26:15.850348 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4f1c20b4-6c2f-4839-9fbb-ab73ea94f6b3 tempest-GroupSnapshotsV319Test-1772545099 None] creating volume 'volume-1732f426-169a-46ec-b080-b3f278298b26' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:26:15.851208 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4f1c20b4-6c2f-4839-9fbb-ab73ea94f6b3 tempest-GroupSnapshotsV319Test-1772545099 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:26:15.919550 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.volume_utils [req-23a05317-d2ce-4beb-8e89-4c784840aab2 req-c0ffb1d5-01f5-49ce-be07-e20d13ab9cae tempest-TestVolumeBootPattern-148826616 None] Marking volume 0beaf8d2-11d1-4c3a-aca7-a64f23674792 as bootable. {{(pid=130674) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 25 21:26:15.936506 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-e22e4c1d-f28b-40c8-8988-91de4b289e0f tempest-GroupSnapshotsTest-1337242195 None] Group tempest-GroupSnapshotsTest-Group-2035962547: created successfully Jun 25 21:26:15.967243 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-e22e4c1d-f28b-40c8-8988-91de4b289e0f tempest-GroupSnapshotsTest-1337242195 None] Create group completed successfully. Jun 25 21:26:15.977604 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4f1c20b4-6c2f-4839-9fbb-ab73ea94f6b3 tempest-GroupSnapshotsV319Test-1772545099 None] extra_specs: {} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:26:15.978260 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4f1c20b4-6c2f-4839-9fbb-ab73ea94f6b3 tempest-GroupSnapshotsV319Test-1772545099 None] extra_specs: {} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:26:15.982297 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4f1c20b4-6c2f-4839-9fbb-ab73ea94f6b3 tempest-GroupSnapshotsV319Test-1772545099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06579384-f707-4fbf-a3e1-f88c6c66c2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1732f426-169a-46ec-b080-b3f278298b26', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:26:15.988896 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4f1c20b4-6c2f-4839-9fbb-ab73ea94f6b3 tempest-GroupSnapshotsV319Test-1772545099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a538236e-96d4-4d08-8941-f0ece807221d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:26:15.994052 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [req-23a05317-d2ce-4beb-8e89-4c784840aab2 req-c0ffb1d5-01f5-49ce-be07-e20d13ab9cae tempest-TestVolumeBootPattern-148826616 None] Copying metadata from snapshot eeaed976-f0d3-4e46-b596-c970e1db7981 to 0beaf8d2-11d1-4c3a-aca7-a64f23674792. {{(pid=130674) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:430}} Jun 25 21:26:16.009525 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-4f1c20b4-6c2f-4839-9fbb-ab73ea94f6b3 tempest-GroupSnapshotsV319Test-1772545099 None] Volume volume-1732f426-169a-46ec-b080-b3f278298b26 (1732f426-169a-46ec-b080-b3f278298b26): created successfully Jun 25 21:26:16.014405 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4f1c20b4-6c2f-4839-9fbb-ab73ea94f6b3 tempest-GroupSnapshotsV319Test-1772545099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a538236e-96d4-4d08-8941-f0ece807221d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:26:16.019271 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-4f1c20b4-6c2f-4839-9fbb-ab73ea94f6b3 tempest-GroupSnapshotsV319Test-1772545099 None] Flow 'volume_create_manager' (c9924358-1661-47d7-9516-651d806101b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:26:16.033719 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-4f1c20b4-6c2f-4839-9fbb-ab73ea94f6b3 tempest-GroupSnapshotsV319Test-1772545099 None] Created volume successfully. Jun 25 21:26:16.058276 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-23a05317-d2ce-4beb-8e89-4c784840aab2 req-c0ffb1d5-01f5-49ce-be07-e20d13ab9cae tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e44be666-2469-4749-8198-55a658fcd394) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0beaf8d2-11d1-4c3a-aca7-a64f23674792', 'volume_size': 1, 'snapshot_id': 'eeaed976-f0d3-4e46-b596-c970e1db7981'}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:26:16.069147 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-23a05317-d2ce-4beb-8e89-4c784840aab2 req-c0ffb1d5-01f5-49ce-be07-e20d13ab9cae tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82e58b05-1462-45fc-ad6f-d61307cd7c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:26:16.080262 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [req-23a05317-d2ce-4beb-8e89-4c784840aab2 req-c0ffb1d5-01f5-49ce-be07-e20d13ab9cae tempest-TestVolumeBootPattern-148826616 None] Volume volume-0beaf8d2-11d1-4c3a-aca7-a64f23674792 (0beaf8d2-11d1-4c3a-aca7-a64f23674792): created successfully Jun 25 21:26:16.085982 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-23a05317-d2ce-4beb-8e89-4c784840aab2 req-c0ffb1d5-01f5-49ce-be07-e20d13ab9cae tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82e58b05-1462-45fc-ad6f-d61307cd7c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:26:16.093589 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-23a05317-d2ce-4beb-8e89-4c784840aab2 req-c0ffb1d5-01f5-49ce-be07-e20d13ab9cae tempest-TestVolumeBootPattern-148826616 None] Flow 'volume_create_manager' (6cb660b2-4af6-4ec0-9a86-a5fe81761923) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:26:16.109486 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-23a05317-d2ce-4beb-8e89-4c784840aab2 req-c0ffb1d5-01f5-49ce-be07-e20d13ab9cae tempest-TestVolumeBootPattern-148826616 None] Created volume successfully. Jun 25 21:26:17.061111 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-e1cb815e-6ff9-422d-9742-f1592d3551c3 tempest-GroupSnapshotsV319Test-1772545099 None] GroupSnapshot 5044c972-af2b-4ab9-a2f5-ecdb7d7d3733: creating. Jun 25 21:26:17.118628 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e1cb815e-6ff9-422d-9742-f1592d3551c3 tempest-GroupSnapshotsV319Test-1772545099 None] Group snapshot 5044c972-af2b-4ab9-a2f5-ecdb7d7d3733: creating. {{(pid=130674) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4081}} Jun 25 21:26:17.161772 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e1cb815e-6ff9-422d-9742-f1592d3551c3 tempest-GroupSnapshotsV319Test-1772545099 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:26:17.298420 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f3b24c1-6673-482e-96d7-a4459c278557 tempest-GroupSnapshotsTest-1337242195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:26:17.344489 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7f3b24c1-6673-482e-96d7-a4459c278557 tempest-GroupSnapshotsTest-1337242195 None] Flow 'volume_create_manager' (26e9c9db-3946-41f7-9f34-fa75633675b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:26:17.355511 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7f3b24c1-6673-482e-96d7-a4459c278557 tempest-GroupSnapshotsTest-1337242195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b2ae4f9-e878-48ad-83a8-6bbd9e7e6963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:26:17.382501 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7f3b24c1-6673-482e-96d7-a4459c278557 tempest-GroupSnapshotsTest-1337242195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b2ae4f9-e878-48ad-83a8-6bbd9e7e6963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:26:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1962401457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=436413aa-7ec7-40e5-b640-6561f7e75859,host='ncdv-master-1@ceph#ceph',id=0fe3da0c-0e37-4924-a13d-7b127a2ad132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f734d027051406d8cf743a5ac95b1ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:26:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:26:17Z,use_quota=True,user_id='8dab83d255f1435497f834b621cc9cbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3eaab91-29f5-4a3a-97f9-35731c40cdae),volume_type_id=f3eaab91-29f5-4a3a-97f9-35731c40cdae)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:26:17.390973 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7f3b24c1-6673-482e-96d7-a4459c278557 tempest-GroupSnapshotsTest-1337242195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39a430b1-5c0f-4dd9-acb0-6b55859e1ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:26:17.397884 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7f3b24c1-6673-482e-96d7-a4459c278557 tempest-GroupSnapshotsTest-1337242195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39a430b1-5c0f-4dd9-acb0-6b55859e1ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:26:17.406607 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7f3b24c1-6673-482e-96d7-a4459c278557 tempest-GroupSnapshotsTest-1337242195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeb3b60e-f94d-4b2d-9254-7859839dd9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:26:17.412135 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7f3b24c1-6673-482e-96d7-a4459c278557 tempest-GroupSnapshotsTest-1337242195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeb3b60e-f94d-4b2d-9254-7859839dd9f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fe3da0c-0e37-4924-a13d-7b127a2ad132', 'volume_name': 'volume-0fe3da0c-0e37-4924-a13d-7b127a2ad132', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:26:17.422852 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7f3b24c1-6673-482e-96d7-a4459c278557 tempest-GroupSnapshotsTest-1337242195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7e8599a-9c46-4809-a3e2-6c9e2eddc9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:26:17.428691 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7f3b24c1-6673-482e-96d7-a4459c278557 tempest-GroupSnapshotsTest-1337242195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7e8599a-9c46-4809-a3e2-6c9e2eddc9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:26:17.435778 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7f3b24c1-6673-482e-96d7-a4459c278557 tempest-GroupSnapshotsTest-1337242195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46ecf389-8e68-46b6-aefd-5fb907dbb5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:26:17.440968 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-7f3b24c1-6673-482e-96d7-a4459c278557 tempest-GroupSnapshotsTest-1337242195 None] Volume 0fe3da0c-0e37-4924-a13d-7b127a2ad132: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fe3da0c-0e37-4924-a13d-7b127a2ad132', 'volume_size': 1} Jun 25 21:26:17.445325 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7f3b24c1-6673-482e-96d7-a4459c278557 tempest-GroupSnapshotsTest-1337242195 None] creating volume 'volume-0fe3da0c-0e37-4924-a13d-7b127a2ad132' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:26:17.446634 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7f3b24c1-6673-482e-96d7-a4459c278557 tempest-GroupSnapshotsTest-1337242195 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:26:17.558099 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7f3b24c1-6673-482e-96d7-a4459c278557 tempest-GroupSnapshotsTest-1337242195 None] extra_specs: {} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:26:17.559121 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7f3b24c1-6673-482e-96d7-a4459c278557 tempest-GroupSnapshotsTest-1337242195 None] extra_specs: {} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:26:17.563422 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7f3b24c1-6673-482e-96d7-a4459c278557 tempest-GroupSnapshotsTest-1337242195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46ecf389-8e68-46b6-aefd-5fb907dbb5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fe3da0c-0e37-4924-a13d-7b127a2ad132', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:26:17.568482 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7f3b24c1-6673-482e-96d7-a4459c278557 tempest-GroupSnapshotsTest-1337242195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ce8d321-777b-458b-9ee7-c17ad9fa82d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:26:17.601469 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-7f3b24c1-6673-482e-96d7-a4459c278557 tempest-GroupSnapshotsTest-1337242195 None] Volume volume-0fe3da0c-0e37-4924-a13d-7b127a2ad132 (0fe3da0c-0e37-4924-a13d-7b127a2ad132): created successfully Jun 25 21:26:17.605587 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7f3b24c1-6673-482e-96d7-a4459c278557 tempest-GroupSnapshotsTest-1337242195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ce8d321-777b-458b-9ee7-c17ad9fa82d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:26:17.611530 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7f3b24c1-6673-482e-96d7-a4459c278557 tempest-GroupSnapshotsTest-1337242195 None] Flow 'volume_create_manager' (26e9c9db-3946-41f7-9f34-fa75633675b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:26:17.624189 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-7f3b24c1-6673-482e-96d7-a4459c278557 tempest-GroupSnapshotsTest-1337242195 None] Created volume successfully. Jun 25 21:26:18.347053 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-e1cb815e-6ff9-422d-9742-f1592d3551c3 tempest-GroupSnapshotsV319Test-1772545099 None] group_snapshot 5044c972-af2b-4ab9-a2f5-ecdb7d7d3733: created successfully Jun 25 21:26:18.527281 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-23a05317-d2ce-4beb-8e89-4c784840aab2 req-2cb66499-e55f-4de3-960e-f250824431b1 tempest-TestVolumeBootPattern-148826616 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 21:26:18.657437 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-b8e202aa-1bbc-417c-8afb-caaba902b67b tempest-GroupSnapshotsTest-1337242195 None] GroupSnapshot 4e95f98d-d6fa-4511-9304-15e364a9cfdb: creating. Jun 25 21:26:18.698413 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b8e202aa-1bbc-417c-8afb-caaba902b67b tempest-GroupSnapshotsTest-1337242195 None] Group snapshot 4e95f98d-d6fa-4511-9304-15e364a9cfdb: creating. {{(pid=130674) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4081}} Jun 25 21:26:18.723371 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b8e202aa-1bbc-417c-8afb-caaba902b67b tempest-GroupSnapshotsTest-1337242195 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:26:19.445054 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-b8e202aa-1bbc-417c-8afb-caaba902b67b tempest-GroupSnapshotsTest-1337242195 None] group_snapshot 4e95f98d-d6fa-4511-9304-15e364a9cfdb: created successfully Jun 25 21:26:19.624631 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-23a05317-d2ce-4beb-8e89-4c784840aab2 req-2cb66499-e55f-4de3-960e-f250824431b1 tempest-TestVolumeBootPattern-148826616 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.096s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 21:26:19.626340 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-23a05317-d2ce-4beb-8e89-4c784840aab2 req-2cb66499-e55f-4de3-960e-f250824431b1 tempest-TestVolumeBootPattern-148826616 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0beaf8d2-11d1-4c3a-aca7-a64f23674792', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': '0beaf8d2-11d1-4c3a-aca7-a64f23674792', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 21:26:19.680253 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-23a05317-d2ce-4beb-8e89-4c784840aab2 req-2cb66499-e55f-4de3-960e-f250824431b1 tempest-TestVolumeBootPattern-148826616 None] Connection info returned from driver {'name': 'volumes/volume-0beaf8d2-11d1-4c3a-aca7-a64f23674792', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '0beaf8d2-11d1-4c3a-aca7-a64f23674792', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b7a41174-ab70-4c2a-9be0-589e28c68bb4'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 25 21:26:19.770834 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-23a05317-d2ce-4beb-8e89-4c784840aab2 req-2cb66499-e55f-4de3-960e-f250824431b1 tempest-TestVolumeBootPattern-148826616 None] attachment_update completed successfully. Jun 25 21:26:19.998078 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-dd55ce33-8369-458e-8430-32f982fa75a7 tempest-GroupSnapshotsV319Test-1772545099 None] group_snapshot 5044c972-af2b-4ab9-a2f5-ecdb7d7d3733: deleting Jun 25 21:26:20.073242 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-dd55ce33-8369-458e-8430-32f982fa75a7 tempest-GroupSnapshotsV319Test-1772545099 None] group_snapshot 5044c972-af2b-4ab9-a2f5-ecdb7d7d3733: deleting {{(pid=130674) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4256}} Jun 25 21:26:20.102816 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-dd55ce33-8369-458e-8430-32f982fa75a7 tempest-GroupSnapshotsV319Test-1772545099 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:26:20.226204 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-5cd0daf1-3c37-4bb6-b66c-78678db9c075 tempest-GroupSnapshotsTest-1337242195 None] group_snapshot 4e95f98d-d6fa-4511-9304-15e364a9cfdb: deleting Jun 25 21:26:20.263333 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-5cd0daf1-3c37-4bb6-b66c-78678db9c075 tempest-GroupSnapshotsTest-1337242195 None] group_snapshot 4e95f98d-d6fa-4511-9304-15e364a9cfdb: deleting {{(pid=130674) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4256}} Jun 25 21:26:20.296126 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5cd0daf1-3c37-4bb6-b66c-78678db9c075 tempest-GroupSnapshotsTest-1337242195 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:26:21.369671 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:INSERT=7,cinder:UPDATE=17,cinder:SELECT=75,cinder:DELETE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:21.443878 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-5cd0daf1-3c37-4bb6-b66c-78678db9c075 tempest-GroupSnapshotsTest-1337242195 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-303953293 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-303953293, it is now deprecated. Please use the default quota class for default quota. Jun 25 21:26:21.445684 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-5cd0daf1-3c37-4bb6-b66c-78678db9c075 tempest-GroupSnapshotsTest-1337242195 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-303953293 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-303953293, it is now deprecated. Please use the default quota class for default quota. Jun 25 21:26:21.487398 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-dd55ce33-8369-458e-8430-32f982fa75a7 tempest-GroupSnapshotsV319Test-1772545099 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-534333565 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-534333565, it is now deprecated. Please use the default quota class for default quota. Jun 25 21:26:21.488363 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-dd55ce33-8369-458e-8430-32f982fa75a7 tempest-GroupSnapshotsV319Test-1772545099 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-534333565 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-534333565, it is now deprecated. Please use the default quota class for default quota. Jun 25 21:26:21.503180 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=74,cinder:UPDATE=14,cinder:INSERT=10,cinder:DELETE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:21.505344 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-5cd0daf1-3c37-4bb6-b66c-78678db9c075 tempest-GroupSnapshotsTest-1337242195 None] Created reservations ['db82e5b9-59cc-41ad-bb7a-bdc5342534c3', '085a6a44-583c-4e52-aaf5-573593f8a6a0', 'b39ac479-708c-46eb-af99-8e33eae0c294', 'a945ac1d-f92d-4d49-b8d4-abe6fc0ed7ff'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:26:21.515881 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-dd55ce33-8369-458e-8430-32f982fa75a7 tempest-GroupSnapshotsV319Test-1772545099 None] Created reservations ['b2222f87-c514-4ec6-ae59-4a10066b08be', '5c076456-0c65-46b4-a293-98f39dd43202', 'd0f6d7c0-4fe6-41ab-9700-ab06aa2fac26', 'b93975b2-2075-405c-8e63-d8182507efaa'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:26:21.603485 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-5cd0daf1-3c37-4bb6-b66c-78678db9c075 tempest-GroupSnapshotsTest-1337242195 None] group_snapshot 4e95f98d-d6fa-4511-9304-15e364a9cfdb: deleted successfully Jun 25 21:26:21.623604 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-dd55ce33-8369-458e-8430-32f982fa75a7 tempest-GroupSnapshotsV319Test-1772545099 None] group_snapshot 5044c972-af2b-4ab9-a2f5-ecdb7d7d3733: deleted successfully Jun 25 21:26:22.662905 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0da4696c-29bc-44b3-a84a-04b80f6858d3 tempest-GroupSnapshotsV319Test-1772545099 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:26:22.763784 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0da4696c-29bc-44b3-a84a-04b80f6858d3 tempest-GroupSnapshotsV319Test-1772545099 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:26:22.764587 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0da4696c-29bc-44b3-a84a-04b80f6858d3 tempest-GroupSnapshotsV319Test-1772545099 None] Volume volume-1732f426-169a-46ec-b080-b3f278298b26 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:26:22.775564 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0da4696c-29bc-44b3-a84a-04b80f6858d3 tempest-GroupSnapshotsV319Test-1772545099 None] deleting rbd volume volume-1732f426-169a-46ec-b080-b3f278298b26 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:26:22.971539 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-63ae2392-45fa-418a-8963-87752812db0b tempest-GroupSnapshotsTest-1337242195 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:26:23.057680 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-63ae2392-45fa-418a-8963-87752812db0b tempest-GroupSnapshotsTest-1337242195 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:26:23.058127 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-63ae2392-45fa-418a-8963-87752812db0b tempest-GroupSnapshotsTest-1337242195 None] Volume volume-0fe3da0c-0e37-4924-a13d-7b127a2ad132 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:26:23.075220 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-63ae2392-45fa-418a-8963-87752812db0b tempest-GroupSnapshotsTest-1337242195 None] deleting rbd volume volume-0fe3da0c-0e37-4924-a13d-7b127a2ad132 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:26:23.298425 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-0da4696c-29bc-44b3-a84a-04b80f6858d3 tempest-GroupSnapshotsV319Test-1772545099 None] Created reservations ['82e21835-5843-4b22-a916-c238220442a9'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:26:23.321941 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-0da4696c-29bc-44b3-a84a-04b80f6858d3 tempest-GroupSnapshotsV319Test-1772545099 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-534333565 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-534333565, it is now deprecated. Please use the default quota class for default quota. Jun 25 21:26:23.351109 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-0da4696c-29bc-44b3-a84a-04b80f6858d3 tempest-GroupSnapshotsV319Test-1772545099 None] Created reservations ['e3078e98-ee4e-463a-897d-971c0a4a7a58', 'd1098988-95f0-4940-b7c8-b5d0273837d7', '6c07200f-baad-415b-bfbb-d2856d23625b', 'c3fa55b1-61ad-45ce-9953-5ff88f225755'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:26:23.502623 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-63ae2392-45fa-418a-8963-87752812db0b tempest-GroupSnapshotsTest-1337242195 None] Created reservations ['098c80aa-3d0c-42ea-aee1-d88401fa5491'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:26:23.532156 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0da4696c-29bc-44b3-a84a-04b80f6858d3 tempest-GroupSnapshotsV319Test-1772545099 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:26:23.566814 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0da4696c-29bc-44b3-a84a-04b80f6858d3 tempest-GroupSnapshotsV319Test-1772545099 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:26:23.594869 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-0da4696c-29bc-44b3-a84a-04b80f6858d3 tempest-GroupSnapshotsV319Test-1772545099 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:26:23.605202 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-0da4696c-29bc-44b3-a84a-04b80f6858d3 tempest-GroupSnapshotsV319Test-1772545099 None] Delete group completed successfully. Jun 25 21:26:23.609937 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-63ae2392-45fa-418a-8963-87752812db0b tempest-GroupSnapshotsTest-1337242195 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-303953293 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-303953293, it is now deprecated. Please use the default quota class for default quota. Jun 25 21:26:23.625990 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-63ae2392-45fa-418a-8963-87752812db0b tempest-GroupSnapshotsTest-1337242195 None] Created reservations ['eaff8aaf-a302-4634-a289-c5d19bcfd745', '2617a6d2-0988-402b-ab17-acaa27ff60d8', '7b0c3a06-f22b-47d6-88b7-1143727c0d80', '3b457491-e843-4f3b-ada6-9d07a2bb594a'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:26:23.672089 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=55,cinder:INSERT=11,cinder:UPDATE=34 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:23.746137 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-63ae2392-45fa-418a-8963-87752812db0b tempest-GroupSnapshotsTest-1337242195 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:26:23.801556 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-63ae2392-45fa-418a-8963-87752812db0b tempest-GroupSnapshotsTest-1337242195 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:26:23.855177 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-63ae2392-45fa-418a-8963-87752812db0b tempest-GroupSnapshotsTest-1337242195 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:26:23.861808 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-63ae2392-45fa-418a-8963-87752812db0b tempest-GroupSnapshotsTest-1337242195 None] Delete group completed successfully. Jun 25 21:26:29.052245 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7f4827e-8142-4575-b419-e6199c242cc1 tempest-SnapshotsActionsTest-257520088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:26:29.088177 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e7f4827e-8142-4575-b419-e6199c242cc1 tempest-SnapshotsActionsTest-257520088 None] Flow 'volume_create_manager' (b62528ed-2b05-44ad-8dd9-0469e395db80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:26:29.096047 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e7f4827e-8142-4575-b419-e6199c242cc1 tempest-SnapshotsActionsTest-257520088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fd053dc-3a10-4c0c-8dc7-672aad91bb9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:26:29.116151 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e7f4827e-8142-4575-b419-e6199c242cc1 tempest-SnapshotsActionsTest-257520088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fd053dc-3a10-4c0c-8dc7-672aad91bb9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:26:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1945490547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=62fa0c37-762b-4437-99a6-7a0204573efd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a75e718d6b4742d8b04dc9012467cc53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:26:29Z,use_quota=True,user_id='3681c7f9c6384d63b76beea6c820da9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:26:29.122373 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e7f4827e-8142-4575-b419-e6199c242cc1 tempest-SnapshotsActionsTest-257520088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (743662ea-a801-4f9e-a108-32a7fe2900cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:26:29.127126 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e7f4827e-8142-4575-b419-e6199c242cc1 tempest-SnapshotsActionsTest-257520088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (743662ea-a801-4f9e-a108-32a7fe2900cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:26:29.132669 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e7f4827e-8142-4575-b419-e6199c242cc1 tempest-SnapshotsActionsTest-257520088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19de07e7-04d8-4e6b-ac1d-3089da870de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:26:29.136868 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e7f4827e-8142-4575-b419-e6199c242cc1 tempest-SnapshotsActionsTest-257520088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19de07e7-04d8-4e6b-ac1d-3089da870de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62fa0c37-762b-4437-99a6-7a0204573efd', 'volume_name': 'volume-62fa0c37-762b-4437-99a6-7a0204573efd', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:26:29.141875 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e7f4827e-8142-4575-b419-e6199c242cc1 tempest-SnapshotsActionsTest-257520088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21277640-9ddb-4a51-9766-e4f16d08b12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:26:29.146342 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e7f4827e-8142-4575-b419-e6199c242cc1 tempest-SnapshotsActionsTest-257520088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21277640-9ddb-4a51-9766-e4f16d08b12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:26:29.151103 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e7f4827e-8142-4575-b419-e6199c242cc1 tempest-SnapshotsActionsTest-257520088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed46f76b-6e8b-4b68-b881-7b9019e8fed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:26:29.152208 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-e7f4827e-8142-4575-b419-e6199c242cc1 tempest-SnapshotsActionsTest-257520088 None] Volume 62fa0c37-762b-4437-99a6-7a0204573efd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62fa0c37-762b-4437-99a6-7a0204573efd', 'volume_size': 1} Jun 25 21:26:29.152632 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e7f4827e-8142-4575-b419-e6199c242cc1 tempest-SnapshotsActionsTest-257520088 None] creating volume 'volume-62fa0c37-762b-4437-99a6-7a0204573efd' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:26:29.153422 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e7f4827e-8142-4575-b419-e6199c242cc1 tempest-SnapshotsActionsTest-257520088 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:26:29.276324 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e7f4827e-8142-4575-b419-e6199c242cc1 tempest-SnapshotsActionsTest-257520088 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:26:29.276894 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e7f4827e-8142-4575-b419-e6199c242cc1 tempest-SnapshotsActionsTest-257520088 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:26:29.281111 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e7f4827e-8142-4575-b419-e6199c242cc1 tempest-SnapshotsActionsTest-257520088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed46f76b-6e8b-4b68-b881-7b9019e8fed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62fa0c37-762b-4437-99a6-7a0204573efd', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:26:29.289362 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e7f4827e-8142-4575-b419-e6199c242cc1 tempest-SnapshotsActionsTest-257520088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42506501-0ef4-4458-ae44-ca8de6aea1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:26:29.306399 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-e7f4827e-8142-4575-b419-e6199c242cc1 tempest-SnapshotsActionsTest-257520088 None] Volume volume-62fa0c37-762b-4437-99a6-7a0204573efd (62fa0c37-762b-4437-99a6-7a0204573efd): created successfully Jun 25 21:26:29.310925 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e7f4827e-8142-4575-b419-e6199c242cc1 tempest-SnapshotsActionsTest-257520088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42506501-0ef4-4458-ae44-ca8de6aea1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:26:29.316746 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e7f4827e-8142-4575-b419-e6199c242cc1 tempest-SnapshotsActionsTest-257520088 None] Flow 'volume_create_manager' (b62528ed-2b05-44ad-8dd9-0469e395db80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:26:29.326491 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-e7f4827e-8142-4575-b419-e6199c242cc1 tempest-SnapshotsActionsTest-257520088 None] Created volume successfully. Jun 25 21:26:30.235359 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-583bcd3a-3ff8-463a-88f1-23fd3c67b0d9 tempest-SnapshotsActionsTest-257520088 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:26:31.350411 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-583bcd3a-3ff8-463a-88f1-23fd3c67b0d9 tempest-SnapshotsActionsTest-257520088 None] Create snapshot completed successfully Jun 25 21:26:32.490628 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-3cd1bd30-cff4-43de-9ff4-df6de9f8307d req-3256faaa-b9a0-4cf9-a63f-0129586f3b69 tempest-TestVolumeBootPattern-148826616 None] Terminate volume connection completed successfully. Jun 25 21:26:32.492933 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-3cd1bd30-cff4-43de-9ff4-df6de9f8307d req-3256faaa-b9a0-4cf9-a63f-0129586f3b69 tempest-TestVolumeBootPattern-148826616 None] Deleting attachment b7a41174-ab70-4c2a-9be0-589e28c68bb4. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 25 21:26:32.678409 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [req-3cd1bd30-cff4-43de-9ff4-df6de9f8307d req-8dd466d6-5fcb-4878-9b18-afd7161b0b30 tempest-TestVolumeBootPattern-148826616 None] Lock "b'cinder-0beaf8d2-11d1-4c3a-aca7-a64f23674792-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:26:32.722310 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-3cd1bd30-cff4-43de-9ff4-df6de9f8307d req-8dd466d6-5fcb-4878-9b18-afd7161b0b30 tempest-TestVolumeBootPattern-148826616 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:26:32.873835 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-3cd1bd30-cff4-43de-9ff4-df6de9f8307d req-8dd466d6-5fcb-4878-9b18-afd7161b0b30 tempest-TestVolumeBootPattern-148826616 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:26:32.888018 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-3cd1bd30-cff4-43de-9ff4-df6de9f8307d req-8dd466d6-5fcb-4878-9b18-afd7161b0b30 tempest-TestVolumeBootPattern-148826616 None] deleting rbd volume volume-0beaf8d2-11d1-4c3a-aca7-a64f23674792 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:26:33.248911 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ca235ac7-b5bd-4bd7-9e8e-c6cd1d35aadc tempest-SnapshotsActionsTest-257520088 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:26:33.356668 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [req-3cd1bd30-cff4-43de-9ff4-df6de9f8307d req-8dd466d6-5fcb-4878-9b18-afd7161b0b30 tempest-TestVolumeBootPattern-148826616 None] Created reservations ['3188ac76-0242-4414-b975-c81e41a509c6', '779d5725-ebe8-48b1-8fe7-cb130b23b255', '0aff960d-6830-44e3-8cc6-d01520daaa28', '854092fa-20be-483f-bbcf-98bc7e9b76fa'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:26:33.369938 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:UPDATE=35,cinder:SELECT=60,cinder:INSERT=4,cinder:DELETE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:33.420971 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-3cd1bd30-cff4-43de-9ff4-df6de9f8307d req-8dd466d6-5fcb-4878-9b18-afd7161b0b30 tempest-TestVolumeBootPattern-148826616 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:26:33.468967 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-3cd1bd30-cff4-43de-9ff4-df6de9f8307d req-8dd466d6-5fcb-4878-9b18-afd7161b0b30 tempest-TestVolumeBootPattern-148826616 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:26:33.519726 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [req-3cd1bd30-cff4-43de-9ff4-df6de9f8307d req-8dd466d6-5fcb-4878-9b18-afd7161b0b30 tempest-TestVolumeBootPattern-148826616 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:26:33.525218 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-3cd1bd30-cff4-43de-9ff4-df6de9f8307d req-8dd466d6-5fcb-4878-9b18-afd7161b0b30 tempest-TestVolumeBootPattern-148826616 None] Deleted volume successfully. Jun 25 21:26:33.540056 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [req-3cd1bd30-cff4-43de-9ff4-df6de9f8307d req-8dd466d6-5fcb-4878-9b18-afd7161b0b30 tempest-TestVolumeBootPattern-148826616 None] Lock "b'cinder-0beaf8d2-11d1-4c3a-aca7-a64f23674792-delete_volume'" released by "delete_volume" :: held 0.862s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:26:34.095839 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-31038e0a-5f96-4f8d-917d-541a6fbbe309 tempest-TestVolumeBootPattern-148826616 None] Lock "b'cinder-eeaed976-f0d3-4e46-b596-c970e1db7981-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:26:34.097786 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-31038e0a-5f96-4f8d-917d-541a6fbbe309 tempest-TestVolumeBootPattern-148826616 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:26:34.382582 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-ca235ac7-b5bd-4bd7-9e8e-c6cd1d35aadc tempest-SnapshotsActionsTest-257520088 None] Create snapshot completed successfully Jun 25 21:26:35.521449 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-c71a5e23-d9fc-47a2-ab04-35fb5022c13b tempest-SnapshotsActionsTest-435959877 None] Lock "b'cinder-bfd4c189-608d-43f7-bb81-586dad1d9f08-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.016s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:26:35.523889 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c71a5e23-d9fc-47a2-ab04-35fb5022c13b tempest-SnapshotsActionsTest-435959877 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:26:36.470120 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-c71a5e23-d9fc-47a2-ab04-35fb5022c13b tempest-SnapshotsActionsTest-435959877 None] Created reservations ['8c9a8aca-3928-4d84-bfde-65198c69441f', '1b5129ec-b736-4e56-9600-025d9131b553', '0fa5c5e0-187c-4a57-833e-df33ef72b559', '21d9fb69-61f8-40f6-95fb-7e4dc6e3decf'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:26:36.550047 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-c71a5e23-d9fc-47a2-ab04-35fb5022c13b tempest-SnapshotsActionsTest-435959877 None] Delete snapshot completed successfully. Jun 25 21:26:36.577079 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-c71a5e23-d9fc-47a2-ab04-35fb5022c13b tempest-SnapshotsActionsTest-435959877 None] Lock "b'cinder-bfd4c189-608d-43f7-bb81-586dad1d9f08-delete_snapshot'" released by "delete_snapshot" :: held 1.052s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:26:37.220480 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d2c24108-c9da-490b-a376-ffbf637a9a87 tempest-SnapshotsActionsTest-257520088 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:26:37.467634 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-d2c24108-c9da-490b-a376-ffbf637a9a87 tempest-SnapshotsActionsTest-257520088 None] Create snapshot completed successfully Jun 25 21:26:38.523484 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-9851fdcf-22a9-40cf-8882-1c580631df65 tempest-SnapshotsActionsTest-435959877 None] Lock "b'cinder-483e6790-3ee1-410d-8f1d-1249f34654f5-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:26:38.525564 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9851fdcf-22a9-40cf-8882-1c580631df65 tempest-SnapshotsActionsTest-435959877 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:26:39.580607 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-9851fdcf-22a9-40cf-8882-1c580631df65 tempest-SnapshotsActionsTest-435959877 None] Created reservations ['d48c76e2-06f3-46b6-8600-c02ce4c68601', 'db9c94e2-bff9-4139-8c0c-2ed9b746b135', '89415498-1030-4755-aa33-ee0cc25d6422', '84d808e6-2d7c-42e1-bb6e-06c862a62e74'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:26:39.693287 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-9851fdcf-22a9-40cf-8882-1c580631df65 tempest-SnapshotsActionsTest-435959877 None] Delete snapshot completed successfully. Jun 25 21:26:39.702256 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-9851fdcf-22a9-40cf-8882-1c580631df65 tempest-SnapshotsActionsTest-435959877 None] Lock "b'cinder-483e6790-3ee1-410d-8f1d-1249f34654f5-delete_snapshot'" released by "delete_snapshot" :: held 1.181s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:26:40.248713 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f04d37b3-a207-46bd-b208-ee7d9ff32ef5 tempest-SnapshotsActionsTest-257520088 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:26:40.624146 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-f04d37b3-a207-46bd-b208-ee7d9ff32ef5 tempest-SnapshotsActionsTest-257520088 None] Create snapshot completed successfully Jun 25 21:26:41.451928 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-ecd8a807-e930-4d54-ada5-5c3612af135e tempest-SnapshotsActionsTest-435959877 None] Lock "b'cinder-c4b17e94-a8f9-4fa3-828e-60cdae7c3352-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.013s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:26:41.459066 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ecd8a807-e930-4d54-ada5-5c3612af135e tempest-SnapshotsActionsTest-435959877 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:26:42.611211 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=62,cinder:UPDATE=30,cinder:DELETE=3,cinder:INSERT=5 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:42.641353 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-ecd8a807-e930-4d54-ada5-5c3612af135e tempest-SnapshotsActionsTest-435959877 None] Created reservations ['3d7f2485-8a66-4613-bf1b-812fe75ff78d', '89ab1803-20ab-466c-99bf-342d82ba332c', '3cfc4d1e-a839-43ce-9948-85f9267c62ed', '1a4856ab-510f-43a9-8eb1-d278bcad7143'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:26:42.696128 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-ecd8a807-e930-4d54-ada5-5c3612af135e tempest-SnapshotsActionsTest-435959877 None] Delete snapshot completed successfully. Jun 25 21:26:42.704000 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-ecd8a807-e930-4d54-ada5-5c3612af135e tempest-SnapshotsActionsTest-435959877 None] Lock "b'cinder-c4b17e94-a8f9-4fa3-828e-60cdae7c3352-delete_snapshot'" released by "delete_snapshot" :: held 1.251s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:26:43.320064 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0ca27a7-7280-49e6-af55-e5f42adf91a0 tempest-VolumesImageMetadata-1869465174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:26:43.340839 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f0ca27a7-7280-49e6-af55-e5f42adf91a0 tempest-VolumesImageMetadata-1869465174 None] Flow 'volume_create_manager' (be8c3008-434b-417a-9b2c-551fe99f8cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:26:43.347265 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f0ca27a7-7280-49e6-af55-e5f42adf91a0 tempest-VolumesImageMetadata-1869465174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86b8066b-437f-47a9-9214-bf82c1a7b59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:26:43.365840 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f0ca27a7-7280-49e6-af55-e5f42adf91a0 tempest-VolumesImageMetadata-1869465174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86b8066b-437f-47a9-9214-bf82c1a7b59a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-24888245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=38ca1409-f2d7-4a4d-9777-afe35f3550c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a78b2a07e659460ca4d2e9b2d29ad87a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:26:43Z,use_quota=True,user_id='dbead338fd8047ea980ce985c05806e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:26:43.371726 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f0ca27a7-7280-49e6-af55-e5f42adf91a0 tempest-VolumesImageMetadata-1869465174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (badcd8a2-b9fc-47bf-940e-8c17c78c523b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:26:43.376657 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f0ca27a7-7280-49e6-af55-e5f42adf91a0 tempest-VolumesImageMetadata-1869465174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (badcd8a2-b9fc-47bf-940e-8c17c78c523b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:26:43.382267 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f0ca27a7-7280-49e6-af55-e5f42adf91a0 tempest-VolumesImageMetadata-1869465174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2730da97-b0d8-4a05-ad40-2505073c71f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:26:43.484410 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f0ca27a7-7280-49e6-af55-e5f42adf91a0 tempest-VolumesImageMetadata-1869465174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2730da97-b0d8-4a05-ad40-2505073c71f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '38ca1409-f2d7-4a4d-9777-afe35f3550c8', 'volume_name': 'volume-38ca1409-f2d7-4a4d-9777-afe35f3550c8', 'volume_size': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d98522b7634403f83ff66fd72edfd9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'created_at': datetime.datetime(2022, 6, 25, 20, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5741eca-b932-4865-b29a-bd2a12a73795/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:26:43.489352 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f0ca27a7-7280-49e6-af55-e5f42adf91a0 tempest-VolumesImageMetadata-1869465174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adf3439a-0179-42da-ad90-f7b53242d9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:26:43.493246 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f0ca27a7-7280-49e6-af55-e5f42adf91a0 tempest-VolumesImageMetadata-1869465174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adf3439a-0179-42da-ad90-f7b53242d9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:26:43.498344 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f0ca27a7-7280-49e6-af55-e5f42adf91a0 tempest-VolumesImageMetadata-1869465174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b261a3c2-2e4b-48fb-848b-30f23fd8b09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:26:43.499474 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-f0ca27a7-7280-49e6-af55-e5f42adf91a0 tempest-VolumesImageMetadata-1869465174 None] Volume 38ca1409-f2d7-4a4d-9777-afe35f3550c8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-38ca1409-f2d7-4a4d-9777-afe35f3550c8', 'volume_size': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d98522b7634403f83ff66fd72edfd9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'created_at': datetime.datetime(2022, 6, 25, 20, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5741eca-b932-4865-b29a-bd2a12a73795/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 25 21:26:43.500073 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0ca27a7-7280-49e6-af55-e5f42adf91a0 tempest-VolumesImageMetadata-1869465174 None] Cloning 38ca1409-f2d7-4a4d-9777-afe35f3550c8 from image c5741eca-b932-4865-b29a-bd2a12a73795 at location (None, None). {{(pid=130674) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1062}} Jun 25 21:26:43.514385 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-f0ca27a7-7280-49e6-af55-e5f42adf91a0 tempest-VolumesImageMetadata-1869465174 None] Lock "b'cinder-c5741eca-b932-4865-b29a-bd2a12a73795'" acquired by "_prepare_image_cache_entry" :: waited 0.013s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:26:43.527722 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-f0ca27a7-7280-49e6-af55-e5f42adf91a0 tempest-VolumesImageMetadata-1869465174 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'volume_id': 'c8878629-87cd-43d0-b2bd-d32c807cd322', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53), 'last_used': datetime.datetime(2022, 6, 25, 21, 26, 43, 519421)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 25 21:26:43.528242 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-f0ca27a7-7280-49e6-af55-e5f42adf91a0 tempest-VolumesImageMetadata-1869465174 None] Image-volume cache entry image_update_at = 2022-06-25 20:42:53+00:00, requested image updated_at = 2022-06-25 20:42:53+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 25 21:26:43.528682 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0ca27a7-7280-49e6-af55-e5f42adf91a0 tempest-VolumesImageMetadata-1869465174 None] Found cache entry for image = c5741eca-b932-4865-b29a-bd2a12a73795 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:877}} Jun 25 21:26:43.535885 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-f0ca27a7-7280-49e6-af55-e5f42adf91a0 tempest-VolumesImageMetadata-1869465174 None] Lock "b'cinder-c5741eca-b932-4865-b29a-bd2a12a73795'" released by "_prepare_image_cache_entry" :: held 0.022s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:26:43.538148 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0ca27a7-7280-49e6-af55-e5f42adf91a0 tempest-VolumesImageMetadata-1869465174 None] Attempting to retrieve cache entry for image = c5741eca-b932-4865-b29a-bd2a12a73795 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:818}} Jun 25 21:26:43.545000 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-f0ca27a7-7280-49e6-af55-e5f42adf91a0 tempest-VolumesImageMetadata-1869465174 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'volume_id': 'c8878629-87cd-43d0-b2bd-d32c807cd322', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53), 'last_used': datetime.datetime(2022, 6, 25, 21, 26, 43, 542111)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 25 21:26:43.545555 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-f0ca27a7-7280-49e6-af55-e5f42adf91a0 tempest-VolumesImageMetadata-1869465174 None] Image-volume cache entry image_update_at = 2022-06-25 20:42:53+00:00, requested image updated_at = 2022-06-25 20:42:53+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 25 21:26:43.545955 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0ca27a7-7280-49e6-af55-e5f42adf91a0 tempest-VolumesImageMetadata-1869465174 None] Creating from source image-volume c8878629-87cd-43d0-b2bd-d32c807cd322 {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:832}} Jun 25 21:26:43.568372 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f0ca27a7-7280-49e6-af55-e5f42adf91a0 tempest-VolumesImageMetadata-1869465174 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:26:43.657319 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f0ca27a7-7280-49e6-af55-e5f42adf91a0 tempest-VolumesImageMetadata-1869465174 None] creating snapshot='volume-38ca1409-f2d7-4a4d-9777-afe35f3550c8.clone_snap' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jun 25 21:26:44.594776 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f0ca27a7-7280-49e6-af55-e5f42adf91a0 tempest-VolumesImageMetadata-1869465174 None] cloning 'volume-c8878629-87cd-43d0-b2bd-d32c807cd322@volume-38ca1409-f2d7-4a4d-9777-afe35f3550c8.clone_snap' to 'volume-38ca1409-f2d7-4a4d-9777-afe35f3550c8' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jun 25 21:26:44.677341 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:UPDATE=28,cinder:SELECT=60,cinder:DELETE=2,cinder:INSERT=10 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:44.712536 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1975f890-5480-4059-bd57-15259e31b17b tempest-SnapshotsActionsTest-257520088 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:26:44.841408 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f0ca27a7-7280-49e6-af55-e5f42adf91a0 tempest-VolumesImageMetadata-1869465174 None] Volume volume-74f093be-e96a-4a80-ad38-abd3f5585611.deleted is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:26:44.842571 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f0ca27a7-7280-49e6-af55-e5f42adf91a0 tempest-VolumesImageMetadata-1869465174 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:26:44.842939 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f0ca27a7-7280-49e6-af55-e5f42adf91a0 tempest-VolumesImageMetadata-1869465174 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:26:44.867140 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f0ca27a7-7280-49e6-af55-e5f42adf91a0 tempest-VolumesImageMetadata-1869465174 None] clone created successfully {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jun 25 21:26:44.867930 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.volume_utils [None req-f0ca27a7-7280-49e6-af55-e5f42adf91a0 tempest-VolumesImageMetadata-1869465174 None] Marking volume 38ca1409-f2d7-4a4d-9777-afe35f3550c8 as bootable. {{(pid=130674) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 25 21:26:44.880037 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0ca27a7-7280-49e6-af55-e5f42adf91a0 tempest-VolumesImageMetadata-1869465174 None] Copying metadata from image c5741eca-b932-4865-b29a-bd2a12a73795 to 38ca1409-f2d7-4a4d-9777-afe35f3550c8. {{(pid=130674) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jun 25 21:26:44.880721 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0ca27a7-7280-49e6-af55-e5f42adf91a0 tempest-VolumesImageMetadata-1869465174 None] Creating volume glance metadata for volume 38ca1409-f2d7-4a4d-9777-afe35f3550c8 backed by image c5741eca-b932-4865-b29a-bd2a12a73795 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=130674) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:674}} Jun 25 21:26:44.940920 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f0ca27a7-7280-49e6-af55-e5f42adf91a0 tempest-VolumesImageMetadata-1869465174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b261a3c2-2e4b-48fb-848b-30f23fd8b09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38ca1409-f2d7-4a4d-9777-afe35f3550c8', 'volume_size': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d98522b7634403f83ff66fd72edfd9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'created_at': datetime.datetime(2022, 6, 25, 20, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5741eca-b932-4865-b29a-bd2a12a73795/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:26:44.945693 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f0ca27a7-7280-49e6-af55-e5f42adf91a0 tempest-VolumesImageMetadata-1869465174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccc68509-b278-47d1-b06d-692434f863c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:26:44.955167 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-f0ca27a7-7280-49e6-af55-e5f42adf91a0 tempest-VolumesImageMetadata-1869465174 None] Volume volume-38ca1409-f2d7-4a4d-9777-afe35f3550c8 (38ca1409-f2d7-4a4d-9777-afe35f3550c8): created successfully Jun 25 21:26:44.959607 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f0ca27a7-7280-49e6-af55-e5f42adf91a0 tempest-VolumesImageMetadata-1869465174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccc68509-b278-47d1-b06d-692434f863c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:26:44.965904 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f0ca27a7-7280-49e6-af55-e5f42adf91a0 tempest-VolumesImageMetadata-1869465174 None] Flow 'volume_create_manager' (be8c3008-434b-417a-9b2c-551fe99f8cef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:26:44.974827 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-f0ca27a7-7280-49e6-af55-e5f42adf91a0 tempest-VolumesImageMetadata-1869465174 None] Created volume successfully. Jun 25 21:26:45.671992 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-1975f890-5480-4059-bd57-15259e31b17b tempest-SnapshotsActionsTest-257520088 None] Create snapshot completed successfully Jun 25 21:26:45.749027 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-9ad56510-23cf-465f-91f9-86fe30f4225f tempest-VolumesImageMetadata-1869465174 None] Lock "b'cinder-38ca1409-f2d7-4a4d-9777-afe35f3550c8-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:26:45.796152 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9ad56510-23cf-465f-91f9-86fe30f4225f tempest-VolumesImageMetadata-1869465174 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:26:45.934999 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9ad56510-23cf-465f-91f9-86fe30f4225f tempest-VolumesImageMetadata-1869465174 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:26:45.962935 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9ad56510-23cf-465f-91f9-86fe30f4225f tempest-VolumesImageMetadata-1869465174 None] deleting rbd volume volume-38ca1409-f2d7-4a4d-9777-afe35f3550c8 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:26:46.154570 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-fcaa221c-9e4e-4b6d-a51e-e89287a34913 tempest-SnapshotsActionsTest-435959877 None] Lock "b'cinder-7dff36ef-7008-490d-a394-9ebc34f7a37b-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:26:46.156593 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-fcaa221c-9e4e-4b6d-a51e-e89287a34913 tempest-SnapshotsActionsTest-435959877 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:26:46.278123 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9ad56510-23cf-465f-91f9-86fe30f4225f tempest-VolumesImageMetadata-1869465174 None] volume is a clone so cleaning references {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jun 25 21:26:46.316888 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9ad56510-23cf-465f-91f9-86fe30f4225f tempest-VolumesImageMetadata-1869465174 None] deleting parent snapshot volume-38ca1409-f2d7-4a4d-9777-afe35f3550c8.clone_snap {{(pid=130674) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jun 25 21:26:46.718559 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-9ad56510-23cf-465f-91f9-86fe30f4225f tempest-VolumesImageMetadata-1869465174 None] Created reservations ['36fc2a52-9825-4116-91a7-5cb8825a6b2b', '8118e213-e0d5-4373-bbae-0f4c79d3cfee', '6c7013ce-459a-4eb2-96a8-a569a75fcf63', '394b5d16-3d23-4d51-afd8-c37b42e1f8f3'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:26:46.779911 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-fcaa221c-9e4e-4b6d-a51e-e89287a34913 tempest-SnapshotsActionsTest-435959877 None] Created reservations ['bbdd0440-918d-4d26-a2ff-b5a4eaf093dc', '5aa0f438-92d2-4f29-97a1-089b38afe94a', 'e14a2a81-a150-431f-94bd-beb342d3456c', '2bc7c9c9-e599-4147-a261-ad149ac464f0'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:26:46.798022 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9ad56510-23cf-465f-91f9-86fe30f4225f tempest-VolumesImageMetadata-1869465174 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:26:46.901107 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9ad56510-23cf-465f-91f9-86fe30f4225f tempest-VolumesImageMetadata-1869465174 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:26:46.966357 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-9ad56510-23cf-465f-91f9-86fe30f4225f tempest-VolumesImageMetadata-1869465174 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:26:46.977208 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-9ad56510-23cf-465f-91f9-86fe30f4225f tempest-VolumesImageMetadata-1869465174 None] Deleted volume successfully. Jun 25 21:26:47.032157 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-9ad56510-23cf-465f-91f9-86fe30f4225f tempest-VolumesImageMetadata-1869465174 None] Lock "b'cinder-38ca1409-f2d7-4a4d-9777-afe35f3550c8-delete_volume'" released by "delete_volume" :: held 1.284s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:26:47.036769 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-fcaa221c-9e4e-4b6d-a51e-e89287a34913 tempest-SnapshotsActionsTest-435959877 None] Delete snapshot completed successfully. Jun 25 21:26:47.042912 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-fcaa221c-9e4e-4b6d-a51e-e89287a34913 tempest-SnapshotsActionsTest-435959877 None] Lock "b'cinder-7dff36ef-7008-490d-a394-9ebc34f7a37b-delete_snapshot'" released by "delete_snapshot" :: held 0.888s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:26:48.057520 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-34e02633-661a-404e-983d-e8c4f9007bf7 tempest-SnapshotsActionsTest-257520088 None] Lock "b'cinder-aafb50f7-68fe-4423-b256-708021c1e433-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.020s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:26:48.058952 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-34e02633-661a-404e-983d-e8c4f9007bf7 tempest-SnapshotsActionsTest-257520088 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:26:49.340614 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-34e02633-661a-404e-983d-e8c4f9007bf7 tempest-SnapshotsActionsTest-257520088 None] Created reservations ['9c20ee23-474e-47f1-b624-327b13096b9f', '7f148c97-9226-4811-94fb-bae88ba75b8a', 'e6aae4a8-e058-411a-9e7b-e8cbbc068096', '0505f50f-3c58-46fd-9dc0-3abd2dd6d215'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:26:49.400398 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-34e02633-661a-404e-983d-e8c4f9007bf7 tempest-SnapshotsActionsTest-257520088 None] Delete snapshot completed successfully. Jun 25 21:26:49.409664 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-34e02633-661a-404e-983d-e8c4f9007bf7 tempest-SnapshotsActionsTest-257520088 None] Lock "b'cinder-aafb50f7-68fe-4423-b256-708021c1e433-delete_snapshot'" released by "delete_snapshot" :: held 1.349s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:26:50.230788 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-2dcb620d-cf6c-41ec-9863-3c90557d8af8 tempest-SnapshotsActionsTest-257520088 None] Lock "b'cinder-62fa0c37-762b-4437-99a6-7a0204573efd-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:26:50.293298 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2dcb620d-cf6c-41ec-9863-3c90557d8af8 tempest-SnapshotsActionsTest-257520088 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:26:50.354298 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2dcb620d-cf6c-41ec-9863-3c90557d8af8 tempest-SnapshotsActionsTest-257520088 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:26:50.355003 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2dcb620d-cf6c-41ec-9863-3c90557d8af8 tempest-SnapshotsActionsTest-257520088 None] Volume volume-62fa0c37-762b-4437-99a6-7a0204573efd is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:26:50.363184 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2dcb620d-cf6c-41ec-9863-3c90557d8af8 tempest-SnapshotsActionsTest-257520088 None] deleting rbd volume volume-62fa0c37-762b-4437-99a6-7a0204573efd {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:26:50.652617 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=63,cinder:UPDATE=27,cinder:INSERT=9,cinder:DELETE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:50.667706 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-2dcb620d-cf6c-41ec-9863-3c90557d8af8 tempest-SnapshotsActionsTest-257520088 None] Created reservations ['c2a6cce8-1c5d-4c96-b860-ae1e5aca6598', '13eda5a1-2a96-4b2e-9a12-02304241b4f0', '5fc9043e-5b29-4118-bbe9-c3bdc6d06558', '9e7413e6-3a62-4118-929a-82dd097dad43'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:26:50.713357 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:INSERT=19,cinder:SELECT=50,cinder:UPDATE=29,cinder:DELETE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:50.748695 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2dcb620d-cf6c-41ec-9863-3c90557d8af8 tempest-SnapshotsActionsTest-257520088 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:26:50.798642 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-2dcb620d-cf6c-41ec-9863-3c90557d8af8 tempest-SnapshotsActionsTest-257520088 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:26:50.851803 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-2dcb620d-cf6c-41ec-9863-3c90557d8af8 tempest-SnapshotsActionsTest-257520088 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:26:50.862077 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-2dcb620d-cf6c-41ec-9863-3c90557d8af8 tempest-SnapshotsActionsTest-257520088 None] Deleted volume successfully. Jun 25 21:26:50.893092 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-2dcb620d-cf6c-41ec-9863-3c90557d8af8 tempest-SnapshotsActionsTest-257520088 None] Lock "b'cinder-62fa0c37-762b-4437-99a6-7a0204573efd-delete_volume'" released by "delete_volume" :: held 0.659s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:26:52.158433 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:26:52.159185 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:26:52.200975 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:26:52.246204 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:26:55.970402 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff5079b3-e218-4c69-9e23-e07d627dae62 tempest-VolumesServicesTestJSON-1378723680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:26:55.999822 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ff5079b3-e218-4c69-9e23-e07d627dae62 tempest-VolumesServicesTestJSON-1378723680 None] Flow 'volume_create_manager' (5c3cf594-1a05-47e6-8688-30c14909b670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:26:56.007134 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ff5079b3-e218-4c69-9e23-e07d627dae62 tempest-VolumesServicesTestJSON-1378723680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (987c8471-5e77-41eb-86ea-8dfa580d4f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:26:56.028043 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ff5079b3-e218-4c69-9e23-e07d627dae62 tempest-VolumesServicesTestJSON-1378723680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (987c8471-5e77-41eb-86ea-8dfa580d4f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:26:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2118470437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3c8bd5f2-92b5-4438-b656-2e4554db8c30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02688d6232cf47479d0060bf8539bcb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:26:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:26:56Z,use_quota=True,user_id='51ce29a8e0964b1a9b3467f8ab9a36e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:26:56.036266 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ff5079b3-e218-4c69-9e23-e07d627dae62 tempest-VolumesServicesTestJSON-1378723680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4ca8754-0bf6-402f-bd41-24b3923b9170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:26:56.041342 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ff5079b3-e218-4c69-9e23-e07d627dae62 tempest-VolumesServicesTestJSON-1378723680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4ca8754-0bf6-402f-bd41-24b3923b9170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:26:56.047643 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ff5079b3-e218-4c69-9e23-e07d627dae62 tempest-VolumesServicesTestJSON-1378723680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d960357e-6d5f-4b8a-afd8-23066e7a3ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:26:56.055358 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ff5079b3-e218-4c69-9e23-e07d627dae62 tempest-VolumesServicesTestJSON-1378723680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d960357e-6d5f-4b8a-afd8-23066e7a3ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c8bd5f2-92b5-4438-b656-2e4554db8c30', 'volume_name': 'volume-3c8bd5f2-92b5-4438-b656-2e4554db8c30', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:26:56.062128 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ff5079b3-e218-4c69-9e23-e07d627dae62 tempest-VolumesServicesTestJSON-1378723680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (614ca1bc-2ddf-4c34-a677-18b408a723bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:26:56.070686 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ff5079b3-e218-4c69-9e23-e07d627dae62 tempest-VolumesServicesTestJSON-1378723680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (614ca1bc-2ddf-4c34-a677-18b408a723bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:26:56.079317 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ff5079b3-e218-4c69-9e23-e07d627dae62 tempest-VolumesServicesTestJSON-1378723680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af6e8aaf-ffb6-4a6c-b919-5435b033a02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:26:56.080955 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-ff5079b3-e218-4c69-9e23-e07d627dae62 tempest-VolumesServicesTestJSON-1378723680 None] Volume 3c8bd5f2-92b5-4438-b656-2e4554db8c30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c8bd5f2-92b5-4438-b656-2e4554db8c30', 'volume_size': 1} Jun 25 21:26:56.082032 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ff5079b3-e218-4c69-9e23-e07d627dae62 tempest-VolumesServicesTestJSON-1378723680 None] creating volume 'volume-3c8bd5f2-92b5-4438-b656-2e4554db8c30' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:26:56.083737 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ff5079b3-e218-4c69-9e23-e07d627dae62 tempest-VolumesServicesTestJSON-1378723680 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:26:56.213994 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ff5079b3-e218-4c69-9e23-e07d627dae62 tempest-VolumesServicesTestJSON-1378723680 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:26:56.214620 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ff5079b3-e218-4c69-9e23-e07d627dae62 tempest-VolumesServicesTestJSON-1378723680 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:26:56.218897 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ff5079b3-e218-4c69-9e23-e07d627dae62 tempest-VolumesServicesTestJSON-1378723680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af6e8aaf-ffb6-4a6c-b919-5435b033a02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c8bd5f2-92b5-4438-b656-2e4554db8c30', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:26:56.224038 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ff5079b3-e218-4c69-9e23-e07d627dae62 tempest-VolumesServicesTestJSON-1378723680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (559003f3-7c93-4a85-a9bd-75064f926d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:26:56.239708 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-ff5079b3-e218-4c69-9e23-e07d627dae62 tempest-VolumesServicesTestJSON-1378723680 None] Volume volume-3c8bd5f2-92b5-4438-b656-2e4554db8c30 (3c8bd5f2-92b5-4438-b656-2e4554db8c30): created successfully Jun 25 21:26:56.248910 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ff5079b3-e218-4c69-9e23-e07d627dae62 tempest-VolumesServicesTestJSON-1378723680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (559003f3-7c93-4a85-a9bd-75064f926d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:26:56.267025 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-ff5079b3-e218-4c69-9e23-e07d627dae62 tempest-VolumesServicesTestJSON-1378723680 None] Flow 'volume_create_manager' (5c3cf594-1a05-47e6-8688-30c14909b670) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:26:56.294182 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-ff5079b3-e218-4c69-9e23-e07d627dae62 tempest-VolumesServicesTestJSON-1378723680 None] Created volume successfully. Jun 25 21:26:57.392504 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-1921bc6d-1a71-49c4-93d1-ee9332e362fd tempest-VolumesServicesTestJSON-1378723680 None] Lock "b'cinder-3c8bd5f2-92b5-4438-b656-2e4554db8c30-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:26:57.453814 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1921bc6d-1a71-49c4-93d1-ee9332e362fd tempest-VolumesServicesTestJSON-1378723680 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:26:57.572174 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1921bc6d-1a71-49c4-93d1-ee9332e362fd tempest-VolumesServicesTestJSON-1378723680 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:26:57.572995 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1921bc6d-1a71-49c4-93d1-ee9332e362fd tempest-VolumesServicesTestJSON-1378723680 None] Volume volume-3c8bd5f2-92b5-4438-b656-2e4554db8c30 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:26:57.583639 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1921bc6d-1a71-49c4-93d1-ee9332e362fd tempest-VolumesServicesTestJSON-1378723680 None] deleting rbd volume volume-3c8bd5f2-92b5-4438-b656-2e4554db8c30 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:26:58.049095 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-1921bc6d-1a71-49c4-93d1-ee9332e362fd tempest-VolumesServicesTestJSON-1378723680 None] Created reservations ['38edf2a6-27d8-45fc-af89-05a3e6f9f027', '66a7febd-08dc-4f36-8f9a-11f240cbf69c', '824d0ca1-eafa-4d38-be1a-68687ccfb414', 'b3294750-c627-4991-9163-cc6cd1ff21b3'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:26:58.135179 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1921bc6d-1a71-49c4-93d1-ee9332e362fd tempest-VolumesServicesTestJSON-1378723680 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:26:58.207854 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1921bc6d-1a71-49c4-93d1-ee9332e362fd tempest-VolumesServicesTestJSON-1378723680 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:26:58.286225 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-1921bc6d-1a71-49c4-93d1-ee9332e362fd tempest-VolumesServicesTestJSON-1378723680 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:26:58.291957 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-1921bc6d-1a71-49c4-93d1-ee9332e362fd tempest-VolumesServicesTestJSON-1378723680 None] Deleted volume successfully. Jun 25 21:26:58.318372 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-1921bc6d-1a71-49c4-93d1-ee9332e362fd tempest-VolumesServicesTestJSON-1378723680 None] Lock "b'cinder-3c8bd5f2-92b5-4438-b656-2e4554db8c30-delete_volume'" released by "delete_volume" :: held 0.926s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:27:02.319746 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-caa417e5-a4c2-463a-8a87-0ef4c4cf9817 tempest-VolumeTypesTest-973211132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:27:02.344639 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-caa417e5-a4c2-463a-8a87-0ef4c4cf9817 tempest-VolumeTypesTest-973211132 None] Flow 'volume_create_manager' (6e6cd6cf-e416-4710-954e-5ca7d9b9a8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:27:02.352251 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-caa417e5-a4c2-463a-8a87-0ef4c4cf9817 tempest-VolumeTypesTest-973211132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41df0766-04ff-41c1-ba01-7c8e3ddf7636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:02.370787 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-caa417e5-a4c2-463a-8a87-0ef4c4cf9817 tempest-VolumeTypesTest-973211132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41df0766-04ff-41c1-ba01-7c8e3ddf7636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:27:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesTest-volume-459321544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6fa899c2-772e-45d5-b17e-2fbf7b2fcfe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cab14c1e01a4a81822207adb25a5847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:27:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:27:02Z,use_quota=True,user_id='e9184cba1bfd4cb4871f29c9bdd748f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1bf32912-7e5b-43be-bf8e-abb16799e90c),volume_type_id=1bf32912-7e5b-43be-bf8e-abb16799e90c)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:02.378148 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-caa417e5-a4c2-463a-8a87-0ef4c4cf9817 tempest-VolumeTypesTest-973211132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b6acc95-a97d-4016-8865-ac9376da66ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:02.384837 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-caa417e5-a4c2-463a-8a87-0ef4c4cf9817 tempest-VolumeTypesTest-973211132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b6acc95-a97d-4016-8865-ac9376da66ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:02.390671 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-caa417e5-a4c2-463a-8a87-0ef4c4cf9817 tempest-VolumeTypesTest-973211132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (157897c9-669b-4f38-b482-3c0d36e3f0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:02.395915 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-caa417e5-a4c2-463a-8a87-0ef4c4cf9817 tempest-VolumeTypesTest-973211132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (157897c9-669b-4f38-b482-3c0d36e3f0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fa899c2-772e-45d5-b17e-2fbf7b2fcfe6', 'volume_name': 'volume-6fa899c2-772e-45d5-b17e-2fbf7b2fcfe6', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:02.401904 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-caa417e5-a4c2-463a-8a87-0ef4c4cf9817 tempest-VolumeTypesTest-973211132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99d0f648-d540-40e7-9b1f-60db9238aa9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:02.405966 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-caa417e5-a4c2-463a-8a87-0ef4c4cf9817 tempest-VolumeTypesTest-973211132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99d0f648-d540-40e7-9b1f-60db9238aa9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:02.415290 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-caa417e5-a4c2-463a-8a87-0ef4c4cf9817 tempest-VolumeTypesTest-973211132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b8f7d24-b84f-4428-9c92-419ed0ca15e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:02.416561 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-caa417e5-a4c2-463a-8a87-0ef4c4cf9817 tempest-VolumeTypesTest-973211132 None] Volume 6fa899c2-772e-45d5-b17e-2fbf7b2fcfe6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fa899c2-772e-45d5-b17e-2fbf7b2fcfe6', 'volume_size': 1} Jun 25 21:27:02.416957 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-caa417e5-a4c2-463a-8a87-0ef4c4cf9817 tempest-VolumeTypesTest-973211132 None] creating volume 'volume-6fa899c2-772e-45d5-b17e-2fbf7b2fcfe6' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:27:02.418144 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-caa417e5-a4c2-463a-8a87-0ef4c4cf9817 tempest-VolumeTypesTest-973211132 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:27:02.491247 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-caa417e5-a4c2-463a-8a87-0ef4c4cf9817 tempest-VolumeTypesTest-973211132 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:27:02.491949 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-caa417e5-a4c2-463a-8a87-0ef4c4cf9817 tempest-VolumeTypesTest-973211132 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:27:02.496341 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-caa417e5-a4c2-463a-8a87-0ef4c4cf9817 tempest-VolumeTypesTest-973211132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b8f7d24-b84f-4428-9c92-419ed0ca15e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fa899c2-772e-45d5-b17e-2fbf7b2fcfe6', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:02.501583 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-caa417e5-a4c2-463a-8a87-0ef4c4cf9817 tempest-VolumeTypesTest-973211132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84717880-eaef-4604-bb7d-b2c9a8673728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:02.513252 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-caa417e5-a4c2-463a-8a87-0ef4c4cf9817 tempest-VolumeTypesTest-973211132 None] Volume volume-6fa899c2-772e-45d5-b17e-2fbf7b2fcfe6 (6fa899c2-772e-45d5-b17e-2fbf7b2fcfe6): created successfully Jun 25 21:27:02.518206 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-caa417e5-a4c2-463a-8a87-0ef4c4cf9817 tempest-VolumeTypesTest-973211132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84717880-eaef-4604-bb7d-b2c9a8673728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:02.523712 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-caa417e5-a4c2-463a-8a87-0ef4c4cf9817 tempest-VolumeTypesTest-973211132 None] Flow 'volume_create_manager' (6e6cd6cf-e416-4710-954e-5ca7d9b9a8f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:27:02.535732 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-caa417e5-a4c2-463a-8a87-0ef4c4cf9817 tempest-VolumeTypesTest-973211132 None] Created volume successfully. Jun 25 21:27:03.663661 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-988c8863-9845-4074-ac92-e45c5b5282be tempest-VolumeTypesTest-973211132 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:27:03.721943 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-988c8863-9845-4074-ac92-e45c5b5282be tempest-VolumeTypesTest-973211132 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:27:03.760184 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-988c8863-9845-4074-ac92-e45c5b5282be tempest-VolumeTypesTest-973211132 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:27:03.766571 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-988c8863-9845-4074-ac92-e45c5b5282be tempest-VolumeTypesTest-973211132 None] Retype volume completed successfully. Jun 25 21:27:04.331059 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-31038e0a-5f96-4f8d-917d-541a6fbbe309 tempest-TestVolumeBootPattern-148826616 None] Created reservations ['236bd2ef-dcf5-4522-aee4-56594d6d7c21', '8ef7f622-ac69-4392-ac27-d7b38b67d700', '83701f4d-47a3-49a8-aff7-b7fdb0d893ab', '45c9485b-5a6a-4abe-aede-b643eb70be81'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:27:04.398575 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-31038e0a-5f96-4f8d-917d-541a6fbbe309 tempest-TestVolumeBootPattern-148826616 None] Delete snapshot completed successfully. Jun 25 21:27:04.404627 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-31038e0a-5f96-4f8d-917d-541a6fbbe309 tempest-TestVolumeBootPattern-148826616 None] Lock "b'cinder-eeaed976-f0d3-4e46-b596-c970e1db7981-delete_snapshot'" released by "delete_snapshot" :: held 30.309s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:27:05.088872 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ae381f7-b925-45da-8e5d-87f0214707c1 tempest-VolumesCloneTest-1717377900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:27:05.108132 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1ae381f7-b925-45da-8e5d-87f0214707c1 tempest-VolumesCloneTest-1717377900 None] Flow 'volume_create_manager' (92db474e-7237-4b5c-9951-cb44af92c3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:27:05.114778 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1ae381f7-b925-45da-8e5d-87f0214707c1 tempest-VolumesCloneTest-1717377900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc85e5b5-645a-484a-99c0-b1aabba29b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:05.130809 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1ae381f7-b925-45da-8e5d-87f0214707c1 tempest-VolumesCloneTest-1717377900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc85e5b5-645a-484a-99c0-b1aabba29b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-630337960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0c8db1c2-c158-43c4-9ada-35c8cb71d6da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bcc376f050c4e16a0a4e3597b7b8d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:27:05Z,use_quota=True,user_id='e45a866b09f844deba51275e4ac1f354',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:05.135995 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1ae381f7-b925-45da-8e5d-87f0214707c1 tempest-VolumesCloneTest-1717377900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41a7a93f-b7f2-43d0-986e-5056ab56a471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:05.140030 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1ae381f7-b925-45da-8e5d-87f0214707c1 tempest-VolumesCloneTest-1717377900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41a7a93f-b7f2-43d0-986e-5056ab56a471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:05.144989 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1ae381f7-b925-45da-8e5d-87f0214707c1 tempest-VolumesCloneTest-1717377900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fec80500-fe2f-4110-8314-3bd083b765e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:05.229945 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1ae381f7-b925-45da-8e5d-87f0214707c1 tempest-VolumesCloneTest-1717377900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fec80500-fe2f-4110-8314-3bd083b765e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0c8db1c2-c158-43c4-9ada-35c8cb71d6da', 'volume_name': 'volume-0c8db1c2-c158-43c4-9ada-35c8cb71d6da', 'volume_size': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d98522b7634403f83ff66fd72edfd9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'created_at': datetime.datetime(2022, 6, 25, 20, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5741eca-b932-4865-b29a-bd2a12a73795/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:05.235328 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1ae381f7-b925-45da-8e5d-87f0214707c1 tempest-VolumesCloneTest-1717377900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa115ecf-365c-4dc5-b9c1-1b650168c8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:05.242805 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1ae381f7-b925-45da-8e5d-87f0214707c1 tempest-VolumesCloneTest-1717377900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa115ecf-365c-4dc5-b9c1-1b650168c8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:05.243969 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1ae381f7-b925-45da-8e5d-87f0214707c1 tempest-VolumesCloneTest-1717377900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ae50692-aca0-499e-b75a-dab45fbbf47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:05.245103 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-1ae381f7-b925-45da-8e5d-87f0214707c1 tempest-VolumesCloneTest-1717377900 None] Volume 0c8db1c2-c158-43c4-9ada-35c8cb71d6da: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0c8db1c2-c158-43c4-9ada-35c8cb71d6da', 'volume_size': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d98522b7634403f83ff66fd72edfd9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'created_at': datetime.datetime(2022, 6, 25, 20, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5741eca-b932-4865-b29a-bd2a12a73795/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 25 21:27:05.245744 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ae381f7-b925-45da-8e5d-87f0214707c1 tempest-VolumesCloneTest-1717377900 None] Cloning 0c8db1c2-c158-43c4-9ada-35c8cb71d6da from image c5741eca-b932-4865-b29a-bd2a12a73795 at location (None, None). {{(pid=130674) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1062}} Jun 25 21:27:05.255601 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-1ae381f7-b925-45da-8e5d-87f0214707c1 tempest-VolumesCloneTest-1717377900 None] Lock "b'cinder-c5741eca-b932-4865-b29a-bd2a12a73795'" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:27:05.265997 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-1ae381f7-b925-45da-8e5d-87f0214707c1 tempest-VolumesCloneTest-1717377900 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'volume_id': 'c8878629-87cd-43d0-b2bd-d32c807cd322', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53), 'last_used': datetime.datetime(2022, 6, 25, 21, 27, 5, 260312)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 25 21:27:05.266567 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-1ae381f7-b925-45da-8e5d-87f0214707c1 tempest-VolumesCloneTest-1717377900 None] Image-volume cache entry image_update_at = 2022-06-25 20:42:53+00:00, requested image updated_at = 2022-06-25 20:42:53+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 25 21:27:05.266935 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ae381f7-b925-45da-8e5d-87f0214707c1 tempest-VolumesCloneTest-1717377900 None] Found cache entry for image = c5741eca-b932-4865-b29a-bd2a12a73795 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:877}} Jun 25 21:27:05.271712 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-1ae381f7-b925-45da-8e5d-87f0214707c1 tempest-VolumesCloneTest-1717377900 None] Lock "b'cinder-c5741eca-b932-4865-b29a-bd2a12a73795'" released by "_prepare_image_cache_entry" :: held 0.016s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:27:05.272712 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ae381f7-b925-45da-8e5d-87f0214707c1 tempest-VolumesCloneTest-1717377900 None] Attempting to retrieve cache entry for image = c5741eca-b932-4865-b29a-bd2a12a73795 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:818}} Jun 25 21:27:05.278446 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-1ae381f7-b925-45da-8e5d-87f0214707c1 tempest-VolumesCloneTest-1717377900 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'volume_id': 'c8878629-87cd-43d0-b2bd-d32c807cd322', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53), 'last_used': datetime.datetime(2022, 6, 25, 21, 27, 5, 276144)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 25 21:27:05.278852 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-1ae381f7-b925-45da-8e5d-87f0214707c1 tempest-VolumesCloneTest-1717377900 None] Image-volume cache entry image_update_at = 2022-06-25 20:42:53+00:00, requested image updated_at = 2022-06-25 20:42:53+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 25 21:27:05.279237 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ae381f7-b925-45da-8e5d-87f0214707c1 tempest-VolumesCloneTest-1717377900 None] Creating from source image-volume c8878629-87cd-43d0-b2bd-d32c807cd322 {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:832}} Jun 25 21:27:05.291353 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1ae381f7-b925-45da-8e5d-87f0214707c1 tempest-VolumesCloneTest-1717377900 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:27:05.348203 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1ae381f7-b925-45da-8e5d-87f0214707c1 tempest-VolumesCloneTest-1717377900 None] creating snapshot='volume-0c8db1c2-c158-43c4-9ada-35c8cb71d6da.clone_snap' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jun 25 21:27:06.346491 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1ae381f7-b925-45da-8e5d-87f0214707c1 tempest-VolumesCloneTest-1717377900 None] cloning 'volume-c8878629-87cd-43d0-b2bd-d32c807cd322@volume-0c8db1c2-c158-43c4-9ada-35c8cb71d6da.clone_snap' to 'volume-0c8db1c2-c158-43c4-9ada-35c8cb71d6da' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jun 25 21:27:06.359924 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-0113da91-6868-4c7d-9022-4fbcbb80e5bc tempest-VolumeTypesTest-973211132 None] Lock "b'cinder-6fa899c2-772e-45d5-b17e-2fbf7b2fcfe6-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:27:06.400487 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0113da91-6868-4c7d-9022-4fbcbb80e5bc tempest-VolumeTypesTest-973211132 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:27:06.442016 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0113da91-6868-4c7d-9022-4fbcbb80e5bc tempest-VolumeTypesTest-973211132 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:27:06.442535 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0113da91-6868-4c7d-9022-4fbcbb80e5bc tempest-VolumeTypesTest-973211132 None] Volume volume-6fa899c2-772e-45d5-b17e-2fbf7b2fcfe6 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:27:06.447476 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0113da91-6868-4c7d-9022-4fbcbb80e5bc tempest-VolumeTypesTest-973211132 None] deleting rbd volume volume-6fa899c2-772e-45d5-b17e-2fbf7b2fcfe6 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:27:06.506693 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1ae381f7-b925-45da-8e5d-87f0214707c1 tempest-VolumesCloneTest-1717377900 None] Volume volume-74f093be-e96a-4a80-ad38-abd3f5585611.deleted is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:27:06.509924 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1ae381f7-b925-45da-8e5d-87f0214707c1 tempest-VolumesCloneTest-1717377900 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:27:06.510299 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1ae381f7-b925-45da-8e5d-87f0214707c1 tempest-VolumesCloneTest-1717377900 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:27:06.529035 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1ae381f7-b925-45da-8e5d-87f0214707c1 tempest-VolumesCloneTest-1717377900 None] clone created successfully {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jun 25 21:27:06.529718 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.volume_utils [None req-1ae381f7-b925-45da-8e5d-87f0214707c1 tempest-VolumesCloneTest-1717377900 None] Marking volume 0c8db1c2-c158-43c4-9ada-35c8cb71d6da as bootable. {{(pid=130674) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 25 21:27:06.539050 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ae381f7-b925-45da-8e5d-87f0214707c1 tempest-VolumesCloneTest-1717377900 None] Copying metadata from image c5741eca-b932-4865-b29a-bd2a12a73795 to 0c8db1c2-c158-43c4-9ada-35c8cb71d6da. {{(pid=130674) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jun 25 21:27:06.539558 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ae381f7-b925-45da-8e5d-87f0214707c1 tempest-VolumesCloneTest-1717377900 None] Creating volume glance metadata for volume 0c8db1c2-c158-43c4-9ada-35c8cb71d6da backed by image c5741eca-b932-4865-b29a-bd2a12a73795 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=130674) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:674}} Jun 25 21:27:06.570161 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=62,cinder:UPDATE=26,cinder:DELETE=3,cinder:INSERT=9 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:27:06.581880 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=60,cinder:UPDATE=31,cinder:DELETE=1,cinder:INSERT=8 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:27:06.606794 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1ae381f7-b925-45da-8e5d-87f0214707c1 tempest-VolumesCloneTest-1717377900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ae50692-aca0-499e-b75a-dab45fbbf47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c8db1c2-c158-43c4-9ada-35c8cb71d6da', 'volume_size': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d98522b7634403f83ff66fd72edfd9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'created_at': datetime.datetime(2022, 6, 25, 20, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5741eca-b932-4865-b29a-bd2a12a73795/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:06.612368 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1ae381f7-b925-45da-8e5d-87f0214707c1 tempest-VolumesCloneTest-1717377900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3f86e69-f1ab-4a86-af7e-e1cb09cc9b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:06.630922 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-1ae381f7-b925-45da-8e5d-87f0214707c1 tempest-VolumesCloneTest-1717377900 None] Volume volume-0c8db1c2-c158-43c4-9ada-35c8cb71d6da (0c8db1c2-c158-43c4-9ada-35c8cb71d6da): created successfully Jun 25 21:27:06.635034 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1ae381f7-b925-45da-8e5d-87f0214707c1 tempest-VolumesCloneTest-1717377900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3f86e69-f1ab-4a86-af7e-e1cb09cc9b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:06.642394 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1ae381f7-b925-45da-8e5d-87f0214707c1 tempest-VolumesCloneTest-1717377900 None] Flow 'volume_create_manager' (92db474e-7237-4b5c-9951-cb44af92c3f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:27:06.660136 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-1ae381f7-b925-45da-8e5d-87f0214707c1 tempest-VolumesCloneTest-1717377900 None] Created volume successfully. Jun 25 21:27:06.681521 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-0113da91-6868-4c7d-9022-4fbcbb80e5bc tempest-VolumeTypesTest-973211132 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesTest-volume-type-48323007 is set by the default quota flag: quota_volumes_tempest-VolumeTypesTest-volume-type-48323007, it is now deprecated. Please use the default quota class for default quota. Jun 25 21:27:06.682318 ncdv-master-1 cinder-volume[130674]: WARNING cinder.quota [None req-0113da91-6868-4c7d-9022-4fbcbb80e5bc tempest-VolumeTypesTest-973211132 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesTest-volume-type-48323007 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesTest-volume-type-48323007, it is now deprecated. Please use the default quota class for default quota. Jun 25 21:27:06.711640 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-0113da91-6868-4c7d-9022-4fbcbb80e5bc tempest-VolumeTypesTest-973211132 None] Created reservations ['9978d62b-b5ee-490a-b548-f0a997c4310e', '6017ce6e-d27d-4669-b255-fb55ceafebd1', '4db04f4d-9ee0-4e85-bb02-6c4117e0dc0c', '8a9e38ce-ccb9-456e-915e-bd31ecb79ea7'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:27:06.763343 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0113da91-6868-4c7d-9022-4fbcbb80e5bc tempest-VolumeTypesTest-973211132 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:27:06.792011 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0113da91-6868-4c7d-9022-4fbcbb80e5bc tempest-VolumeTypesTest-973211132 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:27:06.840008 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-0113da91-6868-4c7d-9022-4fbcbb80e5bc tempest-VolumeTypesTest-973211132 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:27:06.847318 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-0113da91-6868-4c7d-9022-4fbcbb80e5bc tempest-VolumeTypesTest-973211132 None] Deleted volume successfully. Jun 25 21:27:06.862773 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-0113da91-6868-4c7d-9022-4fbcbb80e5bc tempest-VolumeTypesTest-973211132 None] Lock "b'cinder-6fa899c2-772e-45d5-b17e-2fbf7b2fcfe6-delete_volume'" released by "delete_volume" :: held 0.503s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:27:07.153510 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-e6c0c929-4c68-419a-aa6a-094939d10069 req-1bde8a9a-b10b-477f-936a-2408cbc77572 tempest-TestVolumeBootPattern-148826616 None] Terminate volume connection completed successfully. Jun 25 21:27:07.154288 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-e6c0c929-4c68-419a-aa6a-094939d10069 req-1bde8a9a-b10b-477f-936a-2408cbc77572 tempest-TestVolumeBootPattern-148826616 None] Deleting attachment dae66a98-bd2d-4c7b-9a92-10ffc78f9ad6. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 25 21:27:07.294073 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [req-e6c0c929-4c68-419a-aa6a-094939d10069 req-73442577-1bb0-4832-8ce2-7cd148cf3853 tempest-TestVolumeBootPattern-148826616 None] Lock "b'cinder-b1408ff2-4778-47fb-a800-57807e1be851-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:27:07.370667 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-e6c0c929-4c68-419a-aa6a-094939d10069 req-73442577-1bb0-4832-8ce2-7cd148cf3853 tempest-TestVolumeBootPattern-148826616 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:27:07.513823 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-e6c0c929-4c68-419a-aa6a-094939d10069 req-73442577-1bb0-4832-8ce2-7cd148cf3853 tempest-TestVolumeBootPattern-148826616 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:27:07.526624 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-e6c0c929-4c68-419a-aa6a-094939d10069 req-73442577-1bb0-4832-8ce2-7cd148cf3853 tempest-TestVolumeBootPattern-148826616 None] deleting rbd volume volume-b1408ff2-4778-47fb-a800-57807e1be851 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:27:07.676043 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bdc9a9d-a51a-4c28-b456-457bcedf3f69 tempest-VolumesCloneTest-1717377900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:27:07.707598 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7bdc9a9d-a51a-4c28-b456-457bcedf3f69 tempest-VolumesCloneTest-1717377900 None] Flow 'volume_create_manager' (7069121b-660b-4a38-9536-bf66746230aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:27:07.714772 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7bdc9a9d-a51a-4c28-b456-457bcedf3f69 tempest-VolumesCloneTest-1717377900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ac8d6e5-bbd8-4f43-b433-1947be7481df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:07.731601 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7bdc9a9d-a51a-4c28-b456-457bcedf3f69 tempest-VolumesCloneTest-1717377900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ac8d6e5-bbd8-4f43-b433-1947be7481df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-515480965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ff477777-76ea-4720-a6fd-8c4b7979437b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bcc376f050c4e16a0a4e3597b7b8d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=0c8db1c2-c158-43c4-9ada-35c8cb71d6da,status='creating',terminated_at=None,updated_at=2022-06-25T21:27:08Z,use_quota=True,user_id='e45a866b09f844deba51275e4ac1f354',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:07.737995 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7bdc9a9d-a51a-4c28-b456-457bcedf3f69 tempest-VolumesCloneTest-1717377900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e33656-ef7d-47a0-958a-8eae674a7a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:07.745319 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7bdc9a9d-a51a-4c28-b456-457bcedf3f69 tempest-VolumesCloneTest-1717377900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e33656-ef7d-47a0-958a-8eae674a7a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:07.750522 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7bdc9a9d-a51a-4c28-b456-457bcedf3f69 tempest-VolumesCloneTest-1717377900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (856cf464-ae8b-4519-979e-8834d1c87eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:07.770665 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7bdc9a9d-a51a-4c28-b456-457bcedf3f69 tempest-VolumesCloneTest-1717377900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (856cf464-ae8b-4519-979e-8834d1c87eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ff477777-76ea-4720-a6fd-8c4b7979437b', 'volume_name': 'volume-ff477777-76ea-4720-a6fd-8c4b7979437b', 'volume_size': 1, 'source_volid': '0c8db1c2-c158-43c4-9ada-35c8cb71d6da', 'source_volstatus': 'available'}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:07.774666 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7bdc9a9d-a51a-4c28-b456-457bcedf3f69 tempest-VolumesCloneTest-1717377900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d06722-768e-40f6-832c-6244005424ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:07.779981 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7bdc9a9d-a51a-4c28-b456-457bcedf3f69 tempest-VolumesCloneTest-1717377900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d06722-768e-40f6-832c-6244005424ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:07.785517 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7bdc9a9d-a51a-4c28-b456-457bcedf3f69 tempest-VolumesCloneTest-1717377900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e1d2a97-161e-440a-bd05-ab7c4ad93526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:07.786882 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-7bdc9a9d-a51a-4c28-b456-457bcedf3f69 tempest-VolumesCloneTest-1717377900 None] Volume ff477777-76ea-4720-a6fd-8c4b7979437b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ff477777-76ea-4720-a6fd-8c4b7979437b', 'volume_size': 1, 'source_volid': '0c8db1c2-c158-43c4-9ada-35c8cb71d6da', 'source_volstatus': 'available'} Jun 25 21:27:07.800165 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7bdc9a9d-a51a-4c28-b456-457bcedf3f69 tempest-VolumesCloneTest-1717377900 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:27:07.875746 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7bdc9a9d-a51a-4c28-b456-457bcedf3f69 tempest-VolumesCloneTest-1717377900 None] creating snapshot='volume-ff477777-76ea-4720-a6fd-8c4b7979437b.clone_snap' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jun 25 21:27:08.362415 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7bdc9a9d-a51a-4c28-b456-457bcedf3f69 tempest-VolumesCloneTest-1717377900 None] cloning 'volume-0c8db1c2-c158-43c4-9ada-35c8cb71d6da@volume-ff477777-76ea-4720-a6fd-8c4b7979437b.clone_snap' to 'volume-ff477777-76ea-4720-a6fd-8c4b7979437b' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jun 25 21:27:08.365295 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-e6c0c929-4c68-419a-aa6a-094939d10069 req-73442577-1bb0-4832-8ce2-7cd148cf3853 tempest-TestVolumeBootPattern-148826616 None] volume is a clone so cleaning references {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jun 25 21:27:08.411546 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-e6c0c929-4c68-419a-aa6a-094939d10069 req-73442577-1bb0-4832-8ce2-7cd148cf3853 tempest-TestVolumeBootPattern-148826616 None] deleting parent snapshot volume-b1408ff2-4778-47fb-a800-57807e1be851.clone_snap {{(pid=130674) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jun 25 21:27:09.493090 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7bdc9a9d-a51a-4c28-b456-457bcedf3f69 tempest-VolumesCloneTest-1717377900 None] Volume volume-74f093be-e96a-4a80-ad38-abd3f5585611.deleted is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:27:09.493090 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7bdc9a9d-a51a-4c28-b456-457bcedf3f69 tempest-VolumesCloneTest-1717377900 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:27:09.493744 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7bdc9a9d-a51a-4c28-b456-457bcedf3f69 tempest-VolumesCloneTest-1717377900 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:27:09.516831 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7bdc9a9d-a51a-4c28-b456-457bcedf3f69 tempest-VolumesCloneTest-1717377900 None] clone created successfully {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jun 25 21:27:09.517419 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.volume_utils [None req-7bdc9a9d-a51a-4c28-b456-457bcedf3f69 tempest-VolumesCloneTest-1717377900 None] Marking volume ff477777-76ea-4720-a6fd-8c4b7979437b as bootable. {{(pid=130674) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 25 21:27:09.542689 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bdc9a9d-a51a-4c28-b456-457bcedf3f69 tempest-VolumesCloneTest-1717377900 None] Copying metadata from source volume 0c8db1c2-c158-43c4-9ada-35c8cb71d6da to ff477777-76ea-4720-a6fd-8c4b7979437b. {{(pid=130674) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:439}} Jun 25 21:27:09.595544 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7bdc9a9d-a51a-4c28-b456-457bcedf3f69 tempest-VolumesCloneTest-1717377900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e1d2a97-161e-440a-bd05-ab7c4ad93526) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff477777-76ea-4720-a6fd-8c4b7979437b', 'volume_size': 1, 'source_volid': '0c8db1c2-c158-43c4-9ada-35c8cb71d6da', 'source_volstatus': 'available'}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:09.600711 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7bdc9a9d-a51a-4c28-b456-457bcedf3f69 tempest-VolumesCloneTest-1717377900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ae92118-f232-4953-804b-cf9fbb7d5669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:09.606698 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [req-e6c0c929-4c68-419a-aa6a-094939d10069 req-73442577-1bb0-4832-8ce2-7cd148cf3853 tempest-TestVolumeBootPattern-148826616 None] Created reservations ['65834e26-c6a2-4434-b461-3e9f7a736434', 'b89e65e3-abe4-4aee-b522-d22ec60b90a4', '081620fb-fc6f-4c7d-a0ea-ef2d010f8581', '90bcf4fc-1723-4ab2-8f55-1be8325b478b'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:27:09.611350 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-7bdc9a9d-a51a-4c28-b456-457bcedf3f69 tempest-VolumesCloneTest-1717377900 None] Volume volume-ff477777-76ea-4720-a6fd-8c4b7979437b (ff477777-76ea-4720-a6fd-8c4b7979437b): created successfully Jun 25 21:27:09.615062 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7bdc9a9d-a51a-4c28-b456-457bcedf3f69 tempest-VolumesCloneTest-1717377900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ae92118-f232-4953-804b-cf9fbb7d5669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:09.620613 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7bdc9a9d-a51a-4c28-b456-457bcedf3f69 tempest-VolumesCloneTest-1717377900 None] Flow 'volume_create_manager' (7069121b-660b-4a38-9536-bf66746230aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:27:09.650900 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-7bdc9a9d-a51a-4c28-b456-457bcedf3f69 tempest-VolumesCloneTest-1717377900 None] Created volume successfully. Jun 25 21:27:09.689327 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-e6c0c929-4c68-419a-aa6a-094939d10069 req-73442577-1bb0-4832-8ce2-7cd148cf3853 tempest-TestVolumeBootPattern-148826616 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:27:09.736675 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-e6c0c929-4c68-419a-aa6a-094939d10069 req-73442577-1bb0-4832-8ce2-7cd148cf3853 tempest-TestVolumeBootPattern-148826616 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:27:09.783910 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [req-e6c0c929-4c68-419a-aa6a-094939d10069 req-73442577-1bb0-4832-8ce2-7cd148cf3853 tempest-TestVolumeBootPattern-148826616 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:27:09.793161 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-e6c0c929-4c68-419a-aa6a-094939d10069 req-73442577-1bb0-4832-8ce2-7cd148cf3853 tempest-TestVolumeBootPattern-148826616 None] Deleted volume successfully. Jun 25 21:27:09.806980 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [req-e6c0c929-4c68-419a-aa6a-094939d10069 req-73442577-1bb0-4832-8ce2-7cd148cf3853 tempest-TestVolumeBootPattern-148826616 None] Lock "b'cinder-b1408ff2-4778-47fb-a800-57807e1be851-delete_volume'" released by "delete_volume" :: held 2.513s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:27:10.137423 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d49839e-516f-4875-b508-555ec661c009 tempest-VolumesCloneTest-1717377900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:27:10.156281 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1d49839e-516f-4875-b508-555ec661c009 tempest-VolumesCloneTest-1717377900 None] Flow 'volume_create_manager' (76b88245-4169-42ce-8ae7-3fd48fc74b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:27:10.162562 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1d49839e-516f-4875-b508-555ec661c009 tempest-VolumesCloneTest-1717377900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc101d4f-eaae-4fee-9211-a2cc914c19a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:10.180179 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1d49839e-516f-4875-b508-555ec661c009 tempest-VolumesCloneTest-1717377900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc101d4f-eaae-4fee-9211-a2cc914c19a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2091514411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6f3d629c-1074-4401-844d-d7b2464bdbfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bcc376f050c4e16a0a4e3597b7b8d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:27:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:27:10Z,use_quota=True,user_id='e45a866b09f844deba51275e4ac1f354',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:10.185306 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1d49839e-516f-4875-b508-555ec661c009 tempest-VolumesCloneTest-1717377900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c129da1-0e1e-4ea6-aca0-4ad94df4f595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:10.189268 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1d49839e-516f-4875-b508-555ec661c009 tempest-VolumesCloneTest-1717377900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c129da1-0e1e-4ea6-aca0-4ad94df4f595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:10.194169 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1d49839e-516f-4875-b508-555ec661c009 tempest-VolumesCloneTest-1717377900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bae71d2-68c5-44ed-8f45-2ccffd44558d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:10.198584 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1d49839e-516f-4875-b508-555ec661c009 tempest-VolumesCloneTest-1717377900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bae71d2-68c5-44ed-8f45-2ccffd44558d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f3d629c-1074-4401-844d-d7b2464bdbfb', 'volume_name': 'volume-6f3d629c-1074-4401-844d-d7b2464bdbfb', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:10.203240 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1d49839e-516f-4875-b508-555ec661c009 tempest-VolumesCloneTest-1717377900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (014cdbd6-cfec-49f7-a25f-573bdfc327df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:10.207164 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1d49839e-516f-4875-b508-555ec661c009 tempest-VolumesCloneTest-1717377900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (014cdbd6-cfec-49f7-a25f-573bdfc327df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:10.211687 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1d49839e-516f-4875-b508-555ec661c009 tempest-VolumesCloneTest-1717377900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b65776df-802e-41fa-8a46-6a1eac4e22aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:10.212864 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-1d49839e-516f-4875-b508-555ec661c009 tempest-VolumesCloneTest-1717377900 None] Volume 6f3d629c-1074-4401-844d-d7b2464bdbfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f3d629c-1074-4401-844d-d7b2464bdbfb', 'volume_size': 1} Jun 25 21:27:10.213249 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1d49839e-516f-4875-b508-555ec661c009 tempest-VolumesCloneTest-1717377900 None] creating volume 'volume-6f3d629c-1074-4401-844d-d7b2464bdbfb' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:27:10.214097 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1d49839e-516f-4875-b508-555ec661c009 tempest-VolumesCloneTest-1717377900 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:27:10.267468 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1d49839e-516f-4875-b508-555ec661c009 tempest-VolumesCloneTest-1717377900 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:27:10.267831 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1d49839e-516f-4875-b508-555ec661c009 tempest-VolumesCloneTest-1717377900 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:27:10.271523 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1d49839e-516f-4875-b508-555ec661c009 tempest-VolumesCloneTest-1717377900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b65776df-802e-41fa-8a46-6a1eac4e22aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f3d629c-1074-4401-844d-d7b2464bdbfb', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:10.276167 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1d49839e-516f-4875-b508-555ec661c009 tempest-VolumesCloneTest-1717377900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf336b26-88cb-44b1-a2e6-b6365bafbf05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:10.286403 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-1d49839e-516f-4875-b508-555ec661c009 tempest-VolumesCloneTest-1717377900 None] Volume volume-6f3d629c-1074-4401-844d-d7b2464bdbfb (6f3d629c-1074-4401-844d-d7b2464bdbfb): created successfully Jun 25 21:27:10.289968 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1d49839e-516f-4875-b508-555ec661c009 tempest-VolumesCloneTest-1717377900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf336b26-88cb-44b1-a2e6-b6365bafbf05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:10.295172 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-1d49839e-516f-4875-b508-555ec661c009 tempest-VolumesCloneTest-1717377900 None] Flow 'volume_create_manager' (76b88245-4169-42ce-8ae7-3fd48fc74b6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:27:10.304068 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-1d49839e-516f-4875-b508-555ec661c009 tempest-VolumesCloneTest-1717377900 None] Created volume successfully. Jun 25 21:27:10.537567 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc15a169-592f-424f-a03d-b6a1486815e0 tempest-VolumesBackupsTest-1925542344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:27:10.556580 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-dc15a169-592f-424f-a03d-b6a1486815e0 tempest-VolumesBackupsTest-1925542344 None] Flow 'volume_create_manager' (dc261e4c-e4e1-490c-837c-9bcad77c7023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:27:10.562870 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-dc15a169-592f-424f-a03d-b6a1486815e0 tempest-VolumesBackupsTest-1925542344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd653cad-6fe7-4243-a7b0-861eff94adae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:10.580454 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-dc15a169-592f-424f-a03d-b6a1486815e0 tempest-VolumesBackupsTest-1925542344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd653cad-6fe7-4243-a7b0-861eff94adae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-2026915303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=44fe462f-9405-4a4b-8ae6-cdb5db308015,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b43e0900925e4794b3be4da0a844654f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:27:11Z,use_quota=True,user_id='15a1ef42555447b2b55b74917e926040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:10.585842 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-dc15a169-592f-424f-a03d-b6a1486815e0 tempest-VolumesBackupsTest-1925542344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (423c9672-181c-44b9-8e32-b9a4d04864ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:10.590118 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-dc15a169-592f-424f-a03d-b6a1486815e0 tempest-VolumesBackupsTest-1925542344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (423c9672-181c-44b9-8e32-b9a4d04864ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:10.595095 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-dc15a169-592f-424f-a03d-b6a1486815e0 tempest-VolumesBackupsTest-1925542344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfeb5ee8-fbeb-44b4-a078-8ffa108812ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:10.599143 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-dc15a169-592f-424f-a03d-b6a1486815e0 tempest-VolumesBackupsTest-1925542344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfeb5ee8-fbeb-44b4-a078-8ffa108812ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44fe462f-9405-4a4b-8ae6-cdb5db308015', 'volume_name': 'volume-44fe462f-9405-4a4b-8ae6-cdb5db308015', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:10.603892 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-dc15a169-592f-424f-a03d-b6a1486815e0 tempest-VolumesBackupsTest-1925542344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f77bea84-a31c-44c4-9532-36a093d9da8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:10.607711 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-dc15a169-592f-424f-a03d-b6a1486815e0 tempest-VolumesBackupsTest-1925542344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f77bea84-a31c-44c4-9532-36a093d9da8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:10.612936 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-dc15a169-592f-424f-a03d-b6a1486815e0 tempest-VolumesBackupsTest-1925542344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (761b91c8-0d67-4c11-b86f-d3c384060e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:10.613999 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-dc15a169-592f-424f-a03d-b6a1486815e0 tempest-VolumesBackupsTest-1925542344 None] Volume 44fe462f-9405-4a4b-8ae6-cdb5db308015: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44fe462f-9405-4a4b-8ae6-cdb5db308015', 'volume_size': 1} Jun 25 21:27:10.614387 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-dc15a169-592f-424f-a03d-b6a1486815e0 tempest-VolumesBackupsTest-1925542344 None] creating volume 'volume-44fe462f-9405-4a4b-8ae6-cdb5db308015' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:27:10.615034 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-dc15a169-592f-424f-a03d-b6a1486815e0 tempest-VolumesBackupsTest-1925542344 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:27:10.667639 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-dc15a169-592f-424f-a03d-b6a1486815e0 tempest-VolumesBackupsTest-1925542344 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:27:10.668016 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-dc15a169-592f-424f-a03d-b6a1486815e0 tempest-VolumesBackupsTest-1925542344 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:27:10.671906 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-dc15a169-592f-424f-a03d-b6a1486815e0 tempest-VolumesBackupsTest-1925542344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (761b91c8-0d67-4c11-b86f-d3c384060e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44fe462f-9405-4a4b-8ae6-cdb5db308015', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:10.676585 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-dc15a169-592f-424f-a03d-b6a1486815e0 tempest-VolumesBackupsTest-1925542344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41a6bb4a-f5b0-4be7-9159-540e530289ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:10.687676 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-dc15a169-592f-424f-a03d-b6a1486815e0 tempest-VolumesBackupsTest-1925542344 None] Volume volume-44fe462f-9405-4a4b-8ae6-cdb5db308015 (44fe462f-9405-4a4b-8ae6-cdb5db308015): created successfully Jun 25 21:27:10.692034 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-dc15a169-592f-424f-a03d-b6a1486815e0 tempest-VolumesBackupsTest-1925542344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41a6bb4a-f5b0-4be7-9159-540e530289ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:10.697432 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-dc15a169-592f-424f-a03d-b6a1486815e0 tempest-VolumesBackupsTest-1925542344 None] Flow 'volume_create_manager' (dc261e4c-e4e1-490c-837c-9bcad77c7023) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:27:10.706846 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-dc15a169-592f-424f-a03d-b6a1486815e0 tempest-VolumesBackupsTest-1925542344 None] Created volume successfully. Jun 25 21:27:11.664355 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-368d6b8b-b9fb-40f1-95fc-8dc83cb7ba76 tempest-VolumesCloneTest-1717377900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:27:11.699919 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-368d6b8b-b9fb-40f1-95fc-8dc83cb7ba76 tempest-VolumesCloneTest-1717377900 None] Flow 'volume_create_manager' (badc5c64-1740-4f05-babb-e4ddd20707c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:27:11.706266 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-368d6b8b-b9fb-40f1-95fc-8dc83cb7ba76 tempest-VolumesCloneTest-1717377900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bbbaddf-9271-4ef6-88e9-c60fed483e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:11.733375 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-368d6b8b-b9fb-40f1-95fc-8dc83cb7ba76 tempest-VolumesCloneTest-1717377900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bbbaddf-9271-4ef6-88e9-c60fed483e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1224112587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=eb459849-2915-42f5-a009-45e37e326c8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bcc376f050c4e16a0a4e3597b7b8d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:27:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=6f3d629c-1074-4401-844d-d7b2464bdbfb,status='creating',terminated_at=None,updated_at=2022-06-25T21:27:12Z,use_quota=True,user_id='e45a866b09f844deba51275e4ac1f354',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:11.738894 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-368d6b8b-b9fb-40f1-95fc-8dc83cb7ba76 tempest-VolumesCloneTest-1717377900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f872fe2-6773-4834-91a5-823af2f90ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:11.743177 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-368d6b8b-b9fb-40f1-95fc-8dc83cb7ba76 tempest-VolumesCloneTest-1717377900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f872fe2-6773-4834-91a5-823af2f90ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:11.748262 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-368d6b8b-b9fb-40f1-95fc-8dc83cb7ba76 tempest-VolumesCloneTest-1717377900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (428c5614-3776-44cc-b45b-315aae322da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:11.764631 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-368d6b8b-b9fb-40f1-95fc-8dc83cb7ba76 tempest-VolumesCloneTest-1717377900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (428c5614-3776-44cc-b45b-315aae322da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'eb459849-2915-42f5-a009-45e37e326c8e', 'volume_name': 'volume-eb459849-2915-42f5-a009-45e37e326c8e', 'volume_size': 2, 'source_volid': '6f3d629c-1074-4401-844d-d7b2464bdbfb', 'source_volstatus': 'available'}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:11.769752 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-368d6b8b-b9fb-40f1-95fc-8dc83cb7ba76 tempest-VolumesCloneTest-1717377900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bb85d83-3e72-4950-a779-cec9b5bbc313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:11.773649 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-368d6b8b-b9fb-40f1-95fc-8dc83cb7ba76 tempest-VolumesCloneTest-1717377900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bb85d83-3e72-4950-a779-cec9b5bbc313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:11.778227 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-368d6b8b-b9fb-40f1-95fc-8dc83cb7ba76 tempest-VolumesCloneTest-1717377900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6df284e6-8b42-4dac-9d3d-1fe8e60be15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:11.779306 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-368d6b8b-b9fb-40f1-95fc-8dc83cb7ba76 tempest-VolumesCloneTest-1717377900 None] Volume eb459849-2915-42f5-a009-45e37e326c8e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-eb459849-2915-42f5-a009-45e37e326c8e', 'volume_size': 2, 'source_volid': '6f3d629c-1074-4401-844d-d7b2464bdbfb', 'source_volstatus': 'available'} Jun 25 21:27:11.791654 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-368d6b8b-b9fb-40f1-95fc-8dc83cb7ba76 tempest-VolumesCloneTest-1717377900 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:27:11.849032 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-368d6b8b-b9fb-40f1-95fc-8dc83cb7ba76 tempest-VolumesCloneTest-1717377900 None] creating snapshot='volume-eb459849-2915-42f5-a009-45e37e326c8e.clone_snap' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jun 25 21:27:12.446385 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-368d6b8b-b9fb-40f1-95fc-8dc83cb7ba76 tempest-VolumesCloneTest-1717377900 None] cloning 'volume-6f3d629c-1074-4401-844d-d7b2464bdbfb@volume-eb459849-2915-42f5-a009-45e37e326c8e.clone_snap' to 'volume-eb459849-2915-42f5-a009-45e37e326c8e' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jun 25 21:27:12.553154 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-368d6b8b-b9fb-40f1-95fc-8dc83cb7ba76 tempest-VolumesCloneTest-1717377900 None] Volume volume-6f3d629c-1074-4401-844d-d7b2464bdbfb is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:27:12.554393 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-368d6b8b-b9fb-40f1-95fc-8dc83cb7ba76 tempest-VolumesCloneTest-1717377900 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:27:12.554757 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-368d6b8b-b9fb-40f1-95fc-8dc83cb7ba76 tempest-VolumesCloneTest-1717377900 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:27:12.568893 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-368d6b8b-b9fb-40f1-95fc-8dc83cb7ba76 tempest-VolumesCloneTest-1717377900 None] resize volume 'volume-eb459849-2915-42f5-a009-45e37e326c8e' from 1 to 2 {{(pid=130674) _extend_if_required /opt/stack/cinder/cinder/volume/drivers/rbd.py:745}} Jun 25 21:27:12.569995 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-368d6b8b-b9fb-40f1-95fc-8dc83cb7ba76 tempest-VolumesCloneTest-1717377900 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:27:12.714171 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-368d6b8b-b9fb-40f1-95fc-8dc83cb7ba76 tempest-VolumesCloneTest-1717377900 None] clone created successfully {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jun 25 21:27:12.718610 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-368d6b8b-b9fb-40f1-95fc-8dc83cb7ba76 tempest-VolumesCloneTest-1717377900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6df284e6-8b42-4dac-9d3d-1fe8e60be15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb459849-2915-42f5-a009-45e37e326c8e', 'volume_size': 2, 'source_volid': '6f3d629c-1074-4401-844d-d7b2464bdbfb', 'source_volstatus': 'available'}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:12.725574 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-368d6b8b-b9fb-40f1-95fc-8dc83cb7ba76 tempest-VolumesCloneTest-1717377900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (101da368-0127-4a8e-b318-de40c18ef821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:12.736876 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-368d6b8b-b9fb-40f1-95fc-8dc83cb7ba76 tempest-VolumesCloneTest-1717377900 None] Volume volume-eb459849-2915-42f5-a009-45e37e326c8e (eb459849-2915-42f5-a009-45e37e326c8e): created successfully Jun 25 21:27:12.740518 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-368d6b8b-b9fb-40f1-95fc-8dc83cb7ba76 tempest-VolumesCloneTest-1717377900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (101da368-0127-4a8e-b318-de40c18ef821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:12.746560 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-368d6b8b-b9fb-40f1-95fc-8dc83cb7ba76 tempest-VolumesCloneTest-1717377900 None] Flow 'volume_create_manager' (badc5c64-1740-4f05-babb-e4ddd20707c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:27:12.754661 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=53,cinder:INSERT=17,cinder:UPDATE=25,cinder:DELETE=5 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:27:12.761919 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-368d6b8b-b9fb-40f1-95fc-8dc83cb7ba76 tempest-VolumesCloneTest-1717377900 None] Created volume successfully. Jun 25 21:27:13.131820 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eba7536-4592-43e6-a7dc-ea7f5a05f7cc tempest-TestVolumeBootPattern-148826616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:27:13.155777 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-5eba7536-4592-43e6-a7dc-ea7f5a05f7cc tempest-TestVolumeBootPattern-148826616 None] Flow 'volume_create_manager' (aaa8a2c2-bcaf-4b14-92ed-5b9856d2cb73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:27:13.163222 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-5eba7536-4592-43e6-a7dc-ea7f5a05f7cc tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9b4eb8b-05bf-4483-9869-b11875f99e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:13.179545 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-5eba7536-4592-43e6-a7dc-ea7f5a05f7cc tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9b4eb8b-05bf-4483-9869-b11875f99e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1783273443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=45c469bc-53fa-489d-b96f-d0f49a47cac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1a396ec47a346dc97426df498e54ab2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:27:13Z,use_quota=True,user_id='8d162afa6d9b48ef9fac1bf23c0c41e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:13.184777 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-5eba7536-4592-43e6-a7dc-ea7f5a05f7cc tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (144561da-c193-4a97-83b5-3dd580857dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:13.189046 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-5eba7536-4592-43e6-a7dc-ea7f5a05f7cc tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (144561da-c193-4a97-83b5-3dd580857dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:13.194212 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-5eba7536-4592-43e6-a7dc-ea7f5a05f7cc tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99ad35a2-b7f5-4249-afbd-39dbd7464cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:13.307914 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-5eba7536-4592-43e6-a7dc-ea7f5a05f7cc tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99ad35a2-b7f5-4249-afbd-39dbd7464cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '45c469bc-53fa-489d-b96f-d0f49a47cac1', 'volume_name': 'volume-45c469bc-53fa-489d-b96f-d0f49a47cac1', 'volume_size': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d98522b7634403f83ff66fd72edfd9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'created_at': datetime.datetime(2022, 6, 25, 20, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5741eca-b932-4865-b29a-bd2a12a73795/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:13.312849 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-5eba7536-4592-43e6-a7dc-ea7f5a05f7cc tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3335b741-0194-4f96-a77a-153fb9094eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:13.316765 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-5eba7536-4592-43e6-a7dc-ea7f5a05f7cc tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3335b741-0194-4f96-a77a-153fb9094eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:13.321225 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-5eba7536-4592-43e6-a7dc-ea7f5a05f7cc tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0173490-239b-4c74-86a1-c0699919072c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:13.322310 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-5eba7536-4592-43e6-a7dc-ea7f5a05f7cc tempest-TestVolumeBootPattern-148826616 None] Volume 45c469bc-53fa-489d-b96f-d0f49a47cac1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-45c469bc-53fa-489d-b96f-d0f49a47cac1', 'volume_size': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d98522b7634403f83ff66fd72edfd9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'created_at': datetime.datetime(2022, 6, 25, 20, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5741eca-b932-4865-b29a-bd2a12a73795/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 25 21:27:13.322854 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eba7536-4592-43e6-a7dc-ea7f5a05f7cc tempest-TestVolumeBootPattern-148826616 None] Cloning 45c469bc-53fa-489d-b96f-d0f49a47cac1 from image c5741eca-b932-4865-b29a-bd2a12a73795 at location (None, None). {{(pid=130674) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1062}} Jun 25 21:27:13.331635 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-5eba7536-4592-43e6-a7dc-ea7f5a05f7cc tempest-TestVolumeBootPattern-148826616 None] Lock "b'cinder-c5741eca-b932-4865-b29a-bd2a12a73795'" acquired by "_prepare_image_cache_entry" :: waited 0.007s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:27:13.345929 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-5eba7536-4592-43e6-a7dc-ea7f5a05f7cc tempest-TestVolumeBootPattern-148826616 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'volume_id': 'c8878629-87cd-43d0-b2bd-d32c807cd322', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53), 'last_used': datetime.datetime(2022, 6, 25, 21, 27, 13, 338982)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 25 21:27:13.346406 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-5eba7536-4592-43e6-a7dc-ea7f5a05f7cc tempest-TestVolumeBootPattern-148826616 None] Image-volume cache entry image_update_at = 2022-06-25 20:42:53+00:00, requested image updated_at = 2022-06-25 20:42:53+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 25 21:27:13.346920 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eba7536-4592-43e6-a7dc-ea7f5a05f7cc tempest-TestVolumeBootPattern-148826616 None] Found cache entry for image = c5741eca-b932-4865-b29a-bd2a12a73795 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:877}} Jun 25 21:27:13.352076 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-5eba7536-4592-43e6-a7dc-ea7f5a05f7cc tempest-TestVolumeBootPattern-148826616 None] Lock "b'cinder-c5741eca-b932-4865-b29a-bd2a12a73795'" released by "_prepare_image_cache_entry" :: held 0.020s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:27:13.353471 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eba7536-4592-43e6-a7dc-ea7f5a05f7cc tempest-TestVolumeBootPattern-148826616 None] Attempting to retrieve cache entry for image = c5741eca-b932-4865-b29a-bd2a12a73795 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:818}} Jun 25 21:27:13.359771 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-5eba7536-4592-43e6-a7dc-ea7f5a05f7cc tempest-TestVolumeBootPattern-148826616 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'volume_id': 'c8878629-87cd-43d0-b2bd-d32c807cd322', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53), 'last_used': datetime.datetime(2022, 6, 25, 21, 27, 13, 357295)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 25 21:27:13.360299 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-5eba7536-4592-43e6-a7dc-ea7f5a05f7cc tempest-TestVolumeBootPattern-148826616 None] Image-volume cache entry image_update_at = 2022-06-25 20:42:53+00:00, requested image updated_at = 2022-06-25 20:42:53+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 25 21:27:13.360825 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eba7536-4592-43e6-a7dc-ea7f5a05f7cc tempest-TestVolumeBootPattern-148826616 None] Creating from source image-volume c8878629-87cd-43d0-b2bd-d32c807cd322 {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:832}} Jun 25 21:27:13.372584 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5eba7536-4592-43e6-a7dc-ea7f5a05f7cc tempest-TestVolumeBootPattern-148826616 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:27:13.431510 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5eba7536-4592-43e6-a7dc-ea7f5a05f7cc tempest-TestVolumeBootPattern-148826616 None] creating snapshot='volume-45c469bc-53fa-489d-b96f-d0f49a47cac1.clone_snap' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jun 25 21:27:14.481815 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5eba7536-4592-43e6-a7dc-ea7f5a05f7cc tempest-TestVolumeBootPattern-148826616 None] cloning 'volume-c8878629-87cd-43d0-b2bd-d32c807cd322@volume-45c469bc-53fa-489d-b96f-d0f49a47cac1.clone_snap' to 'volume-45c469bc-53fa-489d-b96f-d0f49a47cac1' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jun 25 21:27:14.516646 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-f004eeb8-4497-4981-9d9a-2c971c9962dd tempest-VolumesCloneTest-1717377900 None] Lock "b'cinder-eb459849-2915-42f5-a009-45e37e326c8e-delete_volume'" acquired by "delete_volume" :: waited 0.030s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:27:14.579207 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f004eeb8-4497-4981-9d9a-2c971c9962dd tempest-VolumesCloneTest-1717377900 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:27:14.677350 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f004eeb8-4497-4981-9d9a-2c971c9962dd tempest-VolumesCloneTest-1717377900 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:27:14.685049 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f004eeb8-4497-4981-9d9a-2c971c9962dd tempest-VolumesCloneTest-1717377900 None] deleting rbd volume volume-eb459849-2915-42f5-a009-45e37e326c8e {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:27:14.751299 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5eba7536-4592-43e6-a7dc-ea7f5a05f7cc tempest-TestVolumeBootPattern-148826616 None] Volume volume-74f093be-e96a-4a80-ad38-abd3f5585611.deleted is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:27:14.753236 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5eba7536-4592-43e6-a7dc-ea7f5a05f7cc tempest-TestVolumeBootPattern-148826616 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:27:14.753692 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5eba7536-4592-43e6-a7dc-ea7f5a05f7cc tempest-TestVolumeBootPattern-148826616 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:27:14.783402 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5eba7536-4592-43e6-a7dc-ea7f5a05f7cc tempest-TestVolumeBootPattern-148826616 None] clone created successfully {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jun 25 21:27:14.784498 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.volume_utils [None req-5eba7536-4592-43e6-a7dc-ea7f5a05f7cc tempest-TestVolumeBootPattern-148826616 None] Marking volume 45c469bc-53fa-489d-b96f-d0f49a47cac1 as bootable. {{(pid=130674) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 25 21:27:14.818058 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eba7536-4592-43e6-a7dc-ea7f5a05f7cc tempest-TestVolumeBootPattern-148826616 None] Copying metadata from image c5741eca-b932-4865-b29a-bd2a12a73795 to 45c469bc-53fa-489d-b96f-d0f49a47cac1. {{(pid=130674) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jun 25 21:27:14.819325 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eba7536-4592-43e6-a7dc-ea7f5a05f7cc tempest-TestVolumeBootPattern-148826616 None] Creating volume glance metadata for volume 45c469bc-53fa-489d-b96f-d0f49a47cac1 backed by image c5741eca-b932-4865-b29a-bd2a12a73795 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=130674) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:674}} Jun 25 21:27:14.947532 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=63,cinder:INSERT=11,cinder:UPDATE=24,cinder:DELETE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:27:14.962853 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-5eba7536-4592-43e6-a7dc-ea7f5a05f7cc tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0173490-239b-4c74-86a1-c0699919072c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45c469bc-53fa-489d-b96f-d0f49a47cac1', 'volume_size': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d98522b7634403f83ff66fd72edfd9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'created_at': datetime.datetime(2022, 6, 25, 20, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5741eca-b932-4865-b29a-bd2a12a73795/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:14.980665 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-5eba7536-4592-43e6-a7dc-ea7f5a05f7cc tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d514e691-7e3a-4227-8d60-26d5c1984798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:14.992532 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f004eeb8-4497-4981-9d9a-2c971c9962dd tempest-VolumesCloneTest-1717377900 None] volume is a clone so cleaning references {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jun 25 21:27:15.015645 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f004eeb8-4497-4981-9d9a-2c971c9962dd tempest-VolumesCloneTest-1717377900 None] Volume volume-6f3d629c-1074-4401-844d-d7b2464bdbfb is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:27:15.016158 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f004eeb8-4497-4981-9d9a-2c971c9962dd tempest-VolumesCloneTest-1717377900 None] deleting parent snapshot volume-eb459849-2915-42f5-a009-45e37e326c8e.clone_snap {{(pid=130674) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jun 25 21:27:15.499344 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-5eba7536-4592-43e6-a7dc-ea7f5a05f7cc tempest-TestVolumeBootPattern-148826616 None] Volume volume-45c469bc-53fa-489d-b96f-d0f49a47cac1 (45c469bc-53fa-489d-b96f-d0f49a47cac1): created successfully Jun 25 21:27:15.503185 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-5eba7536-4592-43e6-a7dc-ea7f5a05f7cc tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d514e691-7e3a-4227-8d60-26d5c1984798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:15.508619 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-5eba7536-4592-43e6-a7dc-ea7f5a05f7cc tempest-TestVolumeBootPattern-148826616 None] Flow 'volume_create_manager' (aaa8a2c2-bcaf-4b14-92ed-5b9856d2cb73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:27:15.523357 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-5eba7536-4592-43e6-a7dc-ea7f5a05f7cc tempest-TestVolumeBootPattern-148826616 None] Created volume successfully. Jun 25 21:27:15.550418 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-f004eeb8-4497-4981-9d9a-2c971c9962dd tempest-VolumesCloneTest-1717377900 None] Created reservations ['39eb7f1b-38c9-46f0-bb0f-50d63771586b', '37086828-2e13-4e0d-aa28-0df65adc7475', '071af231-779b-4370-81ce-3c202438029a', '60ba7651-0a9b-4034-90b4-7a751c07b2f3'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:27:15.598877 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f004eeb8-4497-4981-9d9a-2c971c9962dd tempest-VolumesCloneTest-1717377900 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:27:15.629031 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f004eeb8-4497-4981-9d9a-2c971c9962dd tempest-VolumesCloneTest-1717377900 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:27:15.666589 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-f004eeb8-4497-4981-9d9a-2c971c9962dd tempest-VolumesCloneTest-1717377900 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:27:15.676188 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-f004eeb8-4497-4981-9d9a-2c971c9962dd tempest-VolumesCloneTest-1717377900 None] Deleted volume successfully. Jun 25 21:27:15.691093 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-f004eeb8-4497-4981-9d9a-2c971c9962dd tempest-VolumesCloneTest-1717377900 None] Lock "b'cinder-eb459849-2915-42f5-a009-45e37e326c8e-delete_volume'" released by "delete_volume" :: held 1.175s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:27:16.097871 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-c4001b72-efce-47bf-b961-82280fcf7b82 tempest-VolumesCloneTest-1717377900 None] Lock "b'cinder-6f3d629c-1074-4401-844d-d7b2464bdbfb-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:27:16.165830 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c4001b72-efce-47bf-b961-82280fcf7b82 tempest-VolumesCloneTest-1717377900 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:27:16.237826 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c4001b72-efce-47bf-b961-82280fcf7b82 tempest-VolumesCloneTest-1717377900 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:27:16.238448 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c4001b72-efce-47bf-b961-82280fcf7b82 tempest-VolumesCloneTest-1717377900 None] Volume volume-6f3d629c-1074-4401-844d-d7b2464bdbfb is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:27:16.246108 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c4001b72-efce-47bf-b961-82280fcf7b82 tempest-VolumesCloneTest-1717377900 None] deleting rbd volume volume-6f3d629c-1074-4401-844d-d7b2464bdbfb {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:27:16.651753 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-c4001b72-efce-47bf-b961-82280fcf7b82 tempest-VolumesCloneTest-1717377900 None] Created reservations ['fde7bb15-1aa1-4ffb-a8ca-5ef56b1928ed', '6562c008-6c95-4f3a-9106-9f61e4822a7e', '2fefcb55-b4ed-4b97-af15-350c19c913f0', 'e0a7b011-c1f6-42c0-bd9d-de5f512f619f'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:27:16.721324 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c4001b72-efce-47bf-b961-82280fcf7b82 tempest-VolumesCloneTest-1717377900 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:27:16.771452 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-c4001b72-efce-47bf-b961-82280fcf7b82 tempest-VolumesCloneTest-1717377900 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:27:16.829342 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-c4001b72-efce-47bf-b961-82280fcf7b82 tempest-VolumesCloneTest-1717377900 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:27:16.834702 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-c4001b72-efce-47bf-b961-82280fcf7b82 tempest-VolumesCloneTest-1717377900 None] Deleted volume successfully. Jun 25 21:27:16.848857 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-c4001b72-efce-47bf-b961-82280fcf7b82 tempest-VolumesCloneTest-1717377900 None] Lock "b'cinder-6f3d629c-1074-4401-844d-d7b2464bdbfb-delete_volume'" released by "delete_volume" :: held 0.751s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:27:17.282233 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-24106033-5e55-4e80-9cc6-70480afde299 tempest-VolumesCloneTest-1717377900 None] Lock "b'cinder-ff477777-76ea-4720-a6fd-8c4b7979437b-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:27:17.363244 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-24106033-5e55-4e80-9cc6-70480afde299 tempest-VolumesCloneTest-1717377900 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:27:17.472494 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-24106033-5e55-4e80-9cc6-70480afde299 tempest-VolumesCloneTest-1717377900 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:27:17.480135 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-24106033-5e55-4e80-9cc6-70480afde299 tempest-VolumesCloneTest-1717377900 None] deleting rbd volume volume-ff477777-76ea-4720-a6fd-8c4b7979437b {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:27:17.673327 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-24106033-5e55-4e80-9cc6-70480afde299 tempest-VolumesCloneTest-1717377900 None] volume is a clone so cleaning references {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jun 25 21:27:17.723023 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-24106033-5e55-4e80-9cc6-70480afde299 tempest-VolumesCloneTest-1717377900 None] deleting parent snapshot volume-ff477777-76ea-4720-a6fd-8c4b7979437b.clone_snap {{(pid=130674) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jun 25 21:27:18.310326 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-24106033-5e55-4e80-9cc6-70480afde299 tempest-VolumesCloneTest-1717377900 None] Created reservations ['d5111b3b-cbed-4f18-860f-be6d2883dd21', 'bbb1752d-0ad2-4e1f-a040-e82f7812c716', 'e9b266f3-61d8-401c-b5cc-bc4b7b6ed268', '19c4f43f-3cba-485a-90f7-ec939cda3382'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:27:18.350596 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=53,cinder:UPDATE=30,cinder:INSERT=14,cinder:DELETE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:27:18.362235 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-24106033-5e55-4e80-9cc6-70480afde299 tempest-VolumesCloneTest-1717377900 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:27:18.409620 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-24106033-5e55-4e80-9cc6-70480afde299 tempest-VolumesCloneTest-1717377900 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:27:18.478710 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-24106033-5e55-4e80-9cc6-70480afde299 tempest-VolumesCloneTest-1717377900 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:27:18.512503 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-24106033-5e55-4e80-9cc6-70480afde299 tempest-VolumesCloneTest-1717377900 None] Deleted volume successfully. Jun 25 21:27:18.547349 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-6cba12d9-3d3c-4fc4-91e7-90c103e19d5e tempest-VolumesCloneTest-1717377900 None] Lock "b'cinder-0c8db1c2-c158-43c4-9ada-35c8cb71d6da-delete_volume'" acquired by "delete_volume" :: waited 0.060s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:27:18.575056 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-24106033-5e55-4e80-9cc6-70480afde299 tempest-VolumesCloneTest-1717377900 None] Lock "b'cinder-ff477777-76ea-4720-a6fd-8c4b7979437b-delete_volume'" released by "delete_volume" :: held 1.294s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:27:18.613093 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6cba12d9-3d3c-4fc4-91e7-90c103e19d5e tempest-VolumesCloneTest-1717377900 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:27:18.705823 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6cba12d9-3d3c-4fc4-91e7-90c103e19d5e tempest-VolumesCloneTest-1717377900 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:27:18.713303 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6cba12d9-3d3c-4fc4-91e7-90c103e19d5e tempest-VolumesCloneTest-1717377900 None] deleting rbd volume volume-0c8db1c2-c158-43c4-9ada-35c8cb71d6da {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:27:18.881690 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6cba12d9-3d3c-4fc4-91e7-90c103e19d5e tempest-VolumesCloneTest-1717377900 None] volume is a clone so cleaning references {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jun 25 21:27:18.913319 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6cba12d9-3d3c-4fc4-91e7-90c103e19d5e tempest-VolumesCloneTest-1717377900 None] deleting parent snapshot volume-0c8db1c2-c158-43c4-9ada-35c8cb71d6da.clone_snap {{(pid=130674) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jun 25 21:27:19.587521 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-6cba12d9-3d3c-4fc4-91e7-90c103e19d5e tempest-VolumesCloneTest-1717377900 None] Created reservations ['6d5ead9f-2571-4f90-9420-8661d61f9b3e', 'db8c39f2-f3cb-4f35-96e7-9cdafd6b93a7', '877eee2a-0340-4a99-afc8-0e6e38f79572', 'd8b522ce-e48d-47af-9dfc-a27dfd6a6af8'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:27:19.653300 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6cba12d9-3d3c-4fc4-91e7-90c103e19d5e tempest-VolumesCloneTest-1717377900 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:27:19.702044 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-6cba12d9-3d3c-4fc4-91e7-90c103e19d5e tempest-VolumesCloneTest-1717377900 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:27:19.767272 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-6cba12d9-3d3c-4fc4-91e7-90c103e19d5e tempest-VolumesCloneTest-1717377900 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:27:19.789921 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-6cba12d9-3d3c-4fc4-91e7-90c103e19d5e tempest-VolumesCloneTest-1717377900 None] Deleted volume successfully. Jun 25 21:27:19.799792 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-05bac10c-179f-4749-8187-a6f99e2945db req-18dad58d-5745-4468-b876-067980530c9c tempest-TestVolumeBootPattern-148826616 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 21:27:19.846290 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-6cba12d9-3d3c-4fc4-91e7-90c103e19d5e tempest-VolumesCloneTest-1717377900 None] Lock "b'cinder-0c8db1c2-c158-43c4-9ada-35c8cb71d6da-delete_volume'" released by "delete_volume" :: held 1.300s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:27:20.634206 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-05bac10c-179f-4749-8187-a6f99e2945db req-18dad58d-5745-4468-b876-067980530c9c tempest-TestVolumeBootPattern-148826616 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.834s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 21:27:20.635437 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-05bac10c-179f-4749-8187-a6f99e2945db req-18dad58d-5745-4468-b876-067980530c9c tempest-TestVolumeBootPattern-148826616 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-45c469bc-53fa-489d-b96f-d0f49a47cac1', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': '45c469bc-53fa-489d-b96f-d0f49a47cac1', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 21:27:20.667067 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-05bac10c-179f-4749-8187-a6f99e2945db req-18dad58d-5745-4468-b876-067980530c9c tempest-TestVolumeBootPattern-148826616 None] Connection info returned from driver {'name': 'volumes/volume-45c469bc-53fa-489d-b96f-d0f49a47cac1', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '45c469bc-53fa-489d-b96f-d0f49a47cac1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '43eef746-275f-4b72-99d9-18c12bb39ad2'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 25 21:27:20.721597 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-05bac10c-179f-4749-8187-a6f99e2945db req-18dad58d-5745-4468-b876-067980530c9c tempest-TestVolumeBootPattern-148826616 None] attachment_update completed successfully. Jun 25 21:27:23.499668 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-667ee222-6841-46b3-9103-259f623d51a8 req-00da18a3-060a-4bc6-87ff-ea40e6cf2aa7 tempest-VolumesBackupsTest-1925542344 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 21:27:24.321405 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-667ee222-6841-46b3-9103-259f623d51a8 req-00da18a3-060a-4bc6-87ff-ea40e6cf2aa7 tempest-VolumesBackupsTest-1925542344 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.821s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 21:27:24.322191 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-667ee222-6841-46b3-9103-259f623d51a8 req-00da18a3-060a-4bc6-87ff-ea40e6cf2aa7 tempest-VolumesBackupsTest-1925542344 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-44fe462f-9405-4a4b-8ae6-cdb5db308015', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': '44fe462f-9405-4a4b-8ae6-cdb5db308015', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 21:27:24.348660 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-667ee222-6841-46b3-9103-259f623d51a8 req-00da18a3-060a-4bc6-87ff-ea40e6cf2aa7 tempest-VolumesBackupsTest-1925542344 None] Connection info returned from driver {'name': 'volumes/volume-44fe462f-9405-4a4b-8ae6-cdb5db308015', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '44fe462f-9405-4a4b-8ae6-cdb5db308015', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0731e1dc-4725-45d3-8506-8c036e8de6f9'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 25 21:27:24.395750 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=57,cinder:INSERT=5,cinder:UPDATE=37,cinder:DELETE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:27:24.413887 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-667ee222-6841-46b3-9103-259f623d51a8 req-00da18a3-060a-4bc6-87ff-ea40e6cf2aa7 tempest-VolumesBackupsTest-1925542344 None] attachment_update completed successfully. Jun 25 21:27:26.883868 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-8d6274a9-82db-4bb8-8961-0c61cc1619d2 tempest-VolumesBackupsTest-1925542344 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-06-25T21:27:26Z,data_timestamp=2022-06-25T21:27:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-222952779',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=75dc4290-9b96-44fa-9fe0-5b1e62ba87d6,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='b43e0900925e4794b3be4da0a844654f',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='15a1ef42555447b2b55b74917e926040',volume_id=44fe462f-9405-4a4b-8ae6-cdb5db308015) Jun 25 21:27:26.886269 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.backup.rpcapi [None req-8d6274a9-82db-4bb8-8961-0c61cc1619d2 tempest-VolumesBackupsTest-1925542344 None] continue_backup in rpcapi backup_id 75dc4290-9b96-44fa-9fe0-5b1e62ba87d6 {{(pid=130674) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Jun 25 21:27:27.110185 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-8d6274a9-82db-4bb8-8961-0c61cc1619d2 tempest-VolumesBackupsTest-1925542344 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 21:27:27.998556 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-8d6274a9-82db-4bb8-8961-0c61cc1619d2 tempest-VolumesBackupsTest-1925542344 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.888s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 21:27:27.999711 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-8d6274a9-82db-4bb8-8961-0c61cc1619d2 tempest-VolumesBackupsTest-1925542344 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-44fe462f-9405-4a4b-8ae6-cdb5db308015', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': '44fe462f-9405-4a4b-8ae6-cdb5db308015', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 21:27:28.018267 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-8d6274a9-82db-4bb8-8961-0c61cc1619d2 tempest-VolumesBackupsTest-1925542344 None] Initialize volume connection completed successfully. Jun 25 21:27:30.471233 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-8d6274a9-82db-4bb8-8961-0c61cc1619d2 tempest-VolumesBackupsTest-1925542344 None] Terminate volume connection completed successfully. Jun 25 21:27:30.491941 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-8d6274a9-82db-4bb8-8961-0c61cc1619d2 tempest-VolumesBackupsTest-1925542344 None] Remove volume export completed successfully. Jun 25 21:27:34.451317 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-f684bcd2-915e-4359-9236-0b59e217ee88 req-fa8bc043-7978-4832-82c6-8c10c8eed91e tempest-VolumesBackupsTest-1925542344 None] Terminate volume connection completed successfully. Jun 25 21:27:34.451957 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-f684bcd2-915e-4359-9236-0b59e217ee88 req-fa8bc043-7978-4832-82c6-8c10c8eed91e tempest-VolumesBackupsTest-1925542344 None] Deleting attachment 0731e1dc-4725-45d3-8506-8c036e8de6f9. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 25 21:27:35.105134 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-f78b71e5-df00-49c6-8c35-6b63247e2a8b tempest-TestVolumeBackupRestore-224445072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:27:35.153982 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f78b71e5-df00-49c6-8c35-6b63247e2a8b tempest-TestVolumeBackupRestore-224445072 None] Flow 'volume_create_manager' (2c986c98-3459-414f-8dfd-94e5d6e0854f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:27:35.175846 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f78b71e5-df00-49c6-8c35-6b63247e2a8b tempest-TestVolumeBackupRestore-224445072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff09aaff-8bba-47b2-b110-fb46464830ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:35.199991 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f78b71e5-df00-49c6-8c35-6b63247e2a8b tempest-TestVolumeBackupRestore-224445072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff09aaff-8bba-47b2-b110-fb46464830ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-volume-6217105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5fdae7cd-d3c0-4540-9bfc-5c5833c67dd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='039691ff93174f54aaaa13770a444aa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:27:35Z,use_quota=True,user_id='f7ea2397650748afa9edf0864829c434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:35.207797 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f78b71e5-df00-49c6-8c35-6b63247e2a8b tempest-TestVolumeBackupRestore-224445072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fa0960d-8fab-478b-a1ce-744553da0013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:35.214085 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f78b71e5-df00-49c6-8c35-6b63247e2a8b tempest-TestVolumeBackupRestore-224445072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fa0960d-8fab-478b-a1ce-744553da0013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:35.222909 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f78b71e5-df00-49c6-8c35-6b63247e2a8b tempest-TestVolumeBackupRestore-224445072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97156cbb-f0a8-4ff8-b9ad-7dc8e917d94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:35.344691 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f78b71e5-df00-49c6-8c35-6b63247e2a8b tempest-TestVolumeBackupRestore-224445072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97156cbb-f0a8-4ff8-b9ad-7dc8e917d94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5fdae7cd-d3c0-4540-9bfc-5c5833c67dd7', 'volume_name': 'volume-5fdae7cd-d3c0-4540-9bfc-5c5833c67dd7', 'volume_size': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d98522b7634403f83ff66fd72edfd9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'created_at': datetime.datetime(2022, 6, 25, 20, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5741eca-b932-4865-b29a-bd2a12a73795/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:35.352338 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f78b71e5-df00-49c6-8c35-6b63247e2a8b tempest-TestVolumeBackupRestore-224445072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feeef75f-13ab-483f-b162-ca1da1d4d0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:35.359055 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f78b71e5-df00-49c6-8c35-6b63247e2a8b tempest-TestVolumeBackupRestore-224445072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feeef75f-13ab-483f-b162-ca1da1d4d0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:35.364557 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f78b71e5-df00-49c6-8c35-6b63247e2a8b tempest-TestVolumeBackupRestore-224445072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (149f07bb-6f41-4eda-ab9c-4d1ba503605b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:35.366009 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-f78b71e5-df00-49c6-8c35-6b63247e2a8b tempest-TestVolumeBackupRestore-224445072 None] Volume 5fdae7cd-d3c0-4540-9bfc-5c5833c67dd7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5fdae7cd-d3c0-4540-9bfc-5c5833c67dd7', 'volume_size': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d98522b7634403f83ff66fd72edfd9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'created_at': datetime.datetime(2022, 6, 25, 20, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5741eca-b932-4865-b29a-bd2a12a73795/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 25 21:27:35.366735 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-f78b71e5-df00-49c6-8c35-6b63247e2a8b tempest-TestVolumeBackupRestore-224445072 None] Cloning 5fdae7cd-d3c0-4540-9bfc-5c5833c67dd7 from image c5741eca-b932-4865-b29a-bd2a12a73795 at location (None, None). {{(pid=130674) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1062}} Jun 25 21:27:35.376911 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-f78b71e5-df00-49c6-8c35-6b63247e2a8b tempest-TestVolumeBackupRestore-224445072 None] Lock "b'cinder-c5741eca-b932-4865-b29a-bd2a12a73795'" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:27:35.390285 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-f78b71e5-df00-49c6-8c35-6b63247e2a8b tempest-TestVolumeBackupRestore-224445072 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'volume_id': 'c8878629-87cd-43d0-b2bd-d32c807cd322', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53), 'last_used': datetime.datetime(2022, 6, 25, 21, 27, 35, 381152)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 25 21:27:35.390866 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-f78b71e5-df00-49c6-8c35-6b63247e2a8b tempest-TestVolumeBackupRestore-224445072 None] Image-volume cache entry image_update_at = 2022-06-25 20:42:53+00:00, requested image updated_at = 2022-06-25 20:42:53+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 25 21:27:35.391287 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-f78b71e5-df00-49c6-8c35-6b63247e2a8b tempest-TestVolumeBackupRestore-224445072 None] Found cache entry for image = c5741eca-b932-4865-b29a-bd2a12a73795 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:877}} Jun 25 21:27:35.396802 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-f78b71e5-df00-49c6-8c35-6b63247e2a8b tempest-TestVolumeBackupRestore-224445072 None] Lock "b'cinder-c5741eca-b932-4865-b29a-bd2a12a73795'" released by "_prepare_image_cache_entry" :: held 0.020s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:27:35.397746 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-f78b71e5-df00-49c6-8c35-6b63247e2a8b tempest-TestVolumeBackupRestore-224445072 None] Attempting to retrieve cache entry for image = c5741eca-b932-4865-b29a-bd2a12a73795 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:818}} Jun 25 21:27:35.404726 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-f78b71e5-df00-49c6-8c35-6b63247e2a8b tempest-TestVolumeBackupRestore-224445072 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'volume_id': 'c8878629-87cd-43d0-b2bd-d32c807cd322', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53), 'last_used': datetime.datetime(2022, 6, 25, 21, 27, 35, 402208)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 25 21:27:35.405640 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-f78b71e5-df00-49c6-8c35-6b63247e2a8b tempest-TestVolumeBackupRestore-224445072 None] Image-volume cache entry image_update_at = 2022-06-25 20:42:53+00:00, requested image updated_at = 2022-06-25 20:42:53+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 25 21:27:35.406213 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-f78b71e5-df00-49c6-8c35-6b63247e2a8b tempest-TestVolumeBackupRestore-224445072 None] Creating from source image-volume c8878629-87cd-43d0-b2bd-d32c807cd322 {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:832}} Jun 25 21:27:35.421700 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f78b71e5-df00-49c6-8c35-6b63247e2a8b tempest-TestVolumeBackupRestore-224445072 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:27:35.513565 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f78b71e5-df00-49c6-8c35-6b63247e2a8b tempest-TestVolumeBackupRestore-224445072 None] creating snapshot='volume-5fdae7cd-d3c0-4540-9bfc-5c5833c67dd7.clone_snap' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jun 25 21:27:35.638275 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f78b71e5-df00-49c6-8c35-6b63247e2a8b tempest-TestVolumeBackupRestore-224445072 None] cloning 'volume-c8878629-87cd-43d0-b2bd-d32c807cd322@volume-5fdae7cd-d3c0-4540-9bfc-5c5833c67dd7.clone_snap' to 'volume-5fdae7cd-d3c0-4540-9bfc-5c5833c67dd7' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jun 25 21:27:35.801778 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f78b71e5-df00-49c6-8c35-6b63247e2a8b tempest-TestVolumeBackupRestore-224445072 None] Volume volume-74f093be-e96a-4a80-ad38-abd3f5585611.deleted is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:27:35.802881 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f78b71e5-df00-49c6-8c35-6b63247e2a8b tempest-TestVolumeBackupRestore-224445072 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:27:35.803485 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f78b71e5-df00-49c6-8c35-6b63247e2a8b tempest-TestVolumeBackupRestore-224445072 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:27:35.838103 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f78b71e5-df00-49c6-8c35-6b63247e2a8b tempest-TestVolumeBackupRestore-224445072 None] clone created successfully {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jun 25 21:27:35.845654 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.volume_utils [None req-f78b71e5-df00-49c6-8c35-6b63247e2a8b tempest-TestVolumeBackupRestore-224445072 None] Marking volume 5fdae7cd-d3c0-4540-9bfc-5c5833c67dd7 as bootable. {{(pid=130674) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 25 21:27:35.854499 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-f78b71e5-df00-49c6-8c35-6b63247e2a8b tempest-TestVolumeBackupRestore-224445072 None] Copying metadata from image c5741eca-b932-4865-b29a-bd2a12a73795 to 5fdae7cd-d3c0-4540-9bfc-5c5833c67dd7. {{(pid=130674) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jun 25 21:27:35.855209 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-f78b71e5-df00-49c6-8c35-6b63247e2a8b tempest-TestVolumeBackupRestore-224445072 None] Creating volume glance metadata for volume 5fdae7cd-d3c0-4540-9bfc-5c5833c67dd7 backed by image c5741eca-b932-4865-b29a-bd2a12a73795 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=130674) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:674}} Jun 25 21:27:35.913496 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f78b71e5-df00-49c6-8c35-6b63247e2a8b tempest-TestVolumeBackupRestore-224445072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (149f07bb-6f41-4eda-ab9c-4d1ba503605b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fdae7cd-d3c0-4540-9bfc-5c5833c67dd7', 'volume_size': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d98522b7634403f83ff66fd72edfd9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'created_at': datetime.datetime(2022, 6, 25, 20, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5741eca-b932-4865-b29a-bd2a12a73795/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:35.919033 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f78b71e5-df00-49c6-8c35-6b63247e2a8b tempest-TestVolumeBackupRestore-224445072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0c758d0-0671-4fd1-a04a-969eca1da9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:35.929135 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-f78b71e5-df00-49c6-8c35-6b63247e2a8b tempest-TestVolumeBackupRestore-224445072 None] Volume volume-5fdae7cd-d3c0-4540-9bfc-5c5833c67dd7 (5fdae7cd-d3c0-4540-9bfc-5c5833c67dd7): created successfully Jun 25 21:27:35.933389 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f78b71e5-df00-49c6-8c35-6b63247e2a8b tempest-TestVolumeBackupRestore-224445072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0c758d0-0671-4fd1-a04a-969eca1da9d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:35.938887 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-f78b71e5-df00-49c6-8c35-6b63247e2a8b tempest-TestVolumeBackupRestore-224445072 None] Flow 'volume_create_manager' (2c986c98-3459-414f-8dfd-94e5d6e0854f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:27:35.949149 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-f78b71e5-df00-49c6-8c35-6b63247e2a8b tempest-TestVolumeBackupRestore-224445072 None] Created volume successfully. Jun 25 21:27:36.274748 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-ab1d75f8-209f-4267-a48d-1c01c650fd73 tempest-TestVolumeBackupRestore-224445072 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-06-25T21:27:36Z,data_timestamp=2022-06-25T21:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name=None,encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=9a294fcd-1c96-451b-90d9-0e3acd896b0a,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='039691ff93174f54aaaa13770a444aa2',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='f7ea2397650748afa9edf0864829c434',volume_id=5fdae7cd-d3c0-4540-9bfc-5c5833c67dd7) Jun 25 21:27:36.275626 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.backup.rpcapi [None req-ab1d75f8-209f-4267-a48d-1c01c650fd73 tempest-TestVolumeBackupRestore-224445072 None] continue_backup in rpcapi backup_id 9a294fcd-1c96-451b-90d9-0e3acd896b0a {{(pid=130674) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Jun 25 21:27:36.383461 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-ab1d75f8-209f-4267-a48d-1c01c650fd73 tempest-TestVolumeBackupRestore-224445072 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 21:27:37.304193 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-ab1d75f8-209f-4267-a48d-1c01c650fd73 tempest-TestVolumeBackupRestore-224445072 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.920s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 21:27:37.310474 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-ab1d75f8-209f-4267-a48d-1c01c650fd73 tempest-TestVolumeBackupRestore-224445072 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-5fdae7cd-d3c0-4540-9bfc-5c5833c67dd7', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': '5fdae7cd-d3c0-4540-9bfc-5c5833c67dd7', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 21:27:37.350079 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-ab1d75f8-209f-4267-a48d-1c01c650fd73 tempest-TestVolumeBackupRestore-224445072 None] Initialize volume connection completed successfully. Jun 25 21:27:38.261222 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-e6c1a472-e89f-46f9-a521-d12f896bd8d4 tempest-VolumesBackupsTest-1925542344 None] Lock "b'cinder-44fe462f-9405-4a4b-8ae6-cdb5db308015-delete_volume'" acquired by "delete_volume" :: waited 0.038s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:27:38.334861 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e6c1a472-e89f-46f9-a521-d12f896bd8d4 tempest-VolumesBackupsTest-1925542344 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:27:39.462182 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e6c1a472-e89f-46f9-a521-d12f896bd8d4 tempest-VolumesBackupsTest-1925542344 None] Volume volume-44fe462f-9405-4a4b-8ae6-cdb5db308015 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:27:40.110464 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e6c1a472-e89f-46f9-a521-d12f896bd8d4 tempest-VolumesBackupsTest-1925542344 None] deleting rbd volume volume-44fe462f-9405-4a4b-8ae6-cdb5db308015 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:27:41.900925 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-e6c1a472-e89f-46f9-a521-d12f896bd8d4 tempest-VolumesBackupsTest-1925542344 None] Created reservations ['33500b70-8353-4756-8f6f-e3e98aec1678', 'eb5d66cb-685b-4308-839a-59cfc6c68646', 'e2883018-7caa-421e-b990-93cae17abea7', '57ad097e-bb10-4582-9cd8-bdeae29bb710'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:27:41.908627 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:DELETE=2,cinder:SELECT=81,cinder:UPDATE=11,cinder:INSERT=6 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:27:41.970078 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e6c1a472-e89f-46f9-a521-d12f896bd8d4 tempest-VolumesBackupsTest-1925542344 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:27:42.005598 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e6c1a472-e89f-46f9-a521-d12f896bd8d4 tempest-VolumesBackupsTest-1925542344 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:27:42.032512 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-e6c1a472-e89f-46f9-a521-d12f896bd8d4 tempest-VolumesBackupsTest-1925542344 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:27:42.036340 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-e6c1a472-e89f-46f9-a521-d12f896bd8d4 tempest-VolumesBackupsTest-1925542344 None] Deleted volume successfully. Jun 25 21:27:42.059649 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-e6c1a472-e89f-46f9-a521-d12f896bd8d4 tempest-VolumesBackupsTest-1925542344 None] Lock "b'cinder-44fe462f-9405-4a4b-8ae6-cdb5db308015-delete_volume'" released by "delete_volume" :: held 3.798s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:27:43.123522 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-a210fefd-7536-4a2c-b43a-3ca53f804ebf tempest-VolumesBackupsTest-1925542344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:27:43.143887 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a210fefd-7536-4a2c-b43a-3ca53f804ebf tempest-VolumesBackupsTest-1925542344 None] Flow 'volume_create_manager' (8e3ea631-ed17-4f51-b271-139199a4844f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:27:43.150344 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a210fefd-7536-4a2c-b43a-3ca53f804ebf tempest-VolumesBackupsTest-1925542344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (842210bc-313a-4fa5-a44d-0974912afbd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:43.174675 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a210fefd-7536-4a2c-b43a-3ca53f804ebf tempest-VolumesBackupsTest-1925542344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (842210bc-313a-4fa5-a44d-0974912afbd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-1563612637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b15034ac-1e3c-4600-a246-03a3b4deb76e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b43e0900925e4794b3be4da0a844654f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:27:43Z,use_quota=True,user_id='15a1ef42555447b2b55b74917e926040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:43.181001 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a210fefd-7536-4a2c-b43a-3ca53f804ebf tempest-VolumesBackupsTest-1925542344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8aab4a6-d4db-400c-899b-bca895c4c562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:43.185833 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a210fefd-7536-4a2c-b43a-3ca53f804ebf tempest-VolumesBackupsTest-1925542344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8aab4a6-d4db-400c-899b-bca895c4c562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:43.191432 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a210fefd-7536-4a2c-b43a-3ca53f804ebf tempest-VolumesBackupsTest-1925542344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd28bffa-b966-42ab-b7f9-5526f7b67550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:43.297047 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a210fefd-7536-4a2c-b43a-3ca53f804ebf tempest-VolumesBackupsTest-1925542344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd28bffa-b966-42ab-b7f9-5526f7b67550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b15034ac-1e3c-4600-a246-03a3b4deb76e', 'volume_name': 'volume-b15034ac-1e3c-4600-a246-03a3b4deb76e', 'volume_size': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d98522b7634403f83ff66fd72edfd9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'created_at': datetime.datetime(2022, 6, 25, 20, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5741eca-b932-4865-b29a-bd2a12a73795/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:43.301896 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a210fefd-7536-4a2c-b43a-3ca53f804ebf tempest-VolumesBackupsTest-1925542344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (010a020a-be5b-4fe4-9818-294a3468a89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:43.305732 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a210fefd-7536-4a2c-b43a-3ca53f804ebf tempest-VolumesBackupsTest-1925542344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (010a020a-be5b-4fe4-9818-294a3468a89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:43.311104 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a210fefd-7536-4a2c-b43a-3ca53f804ebf tempest-VolumesBackupsTest-1925542344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d261306-c800-4ae9-97b4-fb99e4ad4f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:43.312697 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-a210fefd-7536-4a2c-b43a-3ca53f804ebf tempest-VolumesBackupsTest-1925542344 None] Volume b15034ac-1e3c-4600-a246-03a3b4deb76e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b15034ac-1e3c-4600-a246-03a3b4deb76e', 'volume_size': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d98522b7634403f83ff66fd72edfd9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'created_at': datetime.datetime(2022, 6, 25, 20, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5741eca-b932-4865-b29a-bd2a12a73795/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 25 21:27:43.313334 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-a210fefd-7536-4a2c-b43a-3ca53f804ebf tempest-VolumesBackupsTest-1925542344 None] Cloning b15034ac-1e3c-4600-a246-03a3b4deb76e from image c5741eca-b932-4865-b29a-bd2a12a73795 at location (None, None). {{(pid=130674) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1062}} Jun 25 21:27:43.325182 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-a210fefd-7536-4a2c-b43a-3ca53f804ebf tempest-VolumesBackupsTest-1925542344 None] Lock "b'cinder-c5741eca-b932-4865-b29a-bd2a12a73795'" acquired by "_prepare_image_cache_entry" :: waited 0.011s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:27:43.338337 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-a210fefd-7536-4a2c-b43a-3ca53f804ebf tempest-VolumesBackupsTest-1925542344 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'volume_id': 'c8878629-87cd-43d0-b2bd-d32c807cd322', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53), 'last_used': datetime.datetime(2022, 6, 25, 21, 27, 43, 330741)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 25 21:27:43.339070 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-a210fefd-7536-4a2c-b43a-3ca53f804ebf tempest-VolumesBackupsTest-1925542344 None] Image-volume cache entry image_update_at = 2022-06-25 20:42:53+00:00, requested image updated_at = 2022-06-25 20:42:53+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 25 21:27:43.339867 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-a210fefd-7536-4a2c-b43a-3ca53f804ebf tempest-VolumesBackupsTest-1925542344 None] Found cache entry for image = c5741eca-b932-4865-b29a-bd2a12a73795 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:877}} Jun 25 21:27:43.346848 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-a210fefd-7536-4a2c-b43a-3ca53f804ebf tempest-VolumesBackupsTest-1925542344 None] Lock "b'cinder-c5741eca-b932-4865-b29a-bd2a12a73795'" released by "_prepare_image_cache_entry" :: held 0.022s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:27:43.347903 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-a210fefd-7536-4a2c-b43a-3ca53f804ebf tempest-VolumesBackupsTest-1925542344 None] Attempting to retrieve cache entry for image = c5741eca-b932-4865-b29a-bd2a12a73795 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:818}} Jun 25 21:27:43.355609 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-a210fefd-7536-4a2c-b43a-3ca53f804ebf tempest-VolumesBackupsTest-1925542344 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'volume_id': 'c8878629-87cd-43d0-b2bd-d32c807cd322', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53), 'last_used': datetime.datetime(2022, 6, 25, 21, 27, 43, 352736)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 25 21:27:43.356119 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-a210fefd-7536-4a2c-b43a-3ca53f804ebf tempest-VolumesBackupsTest-1925542344 None] Image-volume cache entry image_update_at = 2022-06-25 20:42:53+00:00, requested image updated_at = 2022-06-25 20:42:53+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 25 21:27:43.356578 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-a210fefd-7536-4a2c-b43a-3ca53f804ebf tempest-VolumesBackupsTest-1925542344 None] Creating from source image-volume c8878629-87cd-43d0-b2bd-d32c807cd322 {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:832}} Jun 25 21:27:43.373115 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a210fefd-7536-4a2c-b43a-3ca53f804ebf tempest-VolumesBackupsTest-1925542344 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:27:43.516761 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a210fefd-7536-4a2c-b43a-3ca53f804ebf tempest-VolumesBackupsTest-1925542344 None] creating snapshot='volume-b15034ac-1e3c-4600-a246-03a3b4deb76e.clone_snap' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jun 25 21:27:44.499939 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a210fefd-7536-4a2c-b43a-3ca53f804ebf tempest-VolumesBackupsTest-1925542344 None] cloning 'volume-c8878629-87cd-43d0-b2bd-d32c807cd322@volume-b15034ac-1e3c-4600-a246-03a3b4deb76e.clone_snap' to 'volume-b15034ac-1e3c-4600-a246-03a3b4deb76e' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jun 25 21:27:44.629979 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a210fefd-7536-4a2c-b43a-3ca53f804ebf tempest-VolumesBackupsTest-1925542344 None] Volume volume-74f093be-e96a-4a80-ad38-abd3f5585611.deleted is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:27:44.631288 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a210fefd-7536-4a2c-b43a-3ca53f804ebf tempest-VolumesBackupsTest-1925542344 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:27:44.631682 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a210fefd-7536-4a2c-b43a-3ca53f804ebf tempest-VolumesBackupsTest-1925542344 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:27:44.646475 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-a210fefd-7536-4a2c-b43a-3ca53f804ebf tempest-VolumesBackupsTest-1925542344 None] clone created successfully {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jun 25 21:27:44.647096 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.volume_utils [None req-a210fefd-7536-4a2c-b43a-3ca53f804ebf tempest-VolumesBackupsTest-1925542344 None] Marking volume b15034ac-1e3c-4600-a246-03a3b4deb76e as bootable. {{(pid=130674) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 25 21:27:44.665255 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-a210fefd-7536-4a2c-b43a-3ca53f804ebf tempest-VolumesBackupsTest-1925542344 None] Copying metadata from image c5741eca-b932-4865-b29a-bd2a12a73795 to b15034ac-1e3c-4600-a246-03a3b4deb76e. {{(pid=130674) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jun 25 21:27:44.665677 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-a210fefd-7536-4a2c-b43a-3ca53f804ebf tempest-VolumesBackupsTest-1925542344 None] Creating volume glance metadata for volume b15034ac-1e3c-4600-a246-03a3b4deb76e backed by image c5741eca-b932-4865-b29a-bd2a12a73795 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=130674) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:674}} Jun 25 21:27:44.668200 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-ab1d75f8-209f-4267-a48d-1c01c650fd73 tempest-TestVolumeBackupRestore-224445072 None] Terminate volume connection completed successfully. Jun 25 21:27:44.690990 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-ab1d75f8-209f-4267-a48d-1c01c650fd73 tempest-TestVolumeBackupRestore-224445072 None] Remove volume export completed successfully. Jun 25 21:27:44.731818 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=59,cinder:UPDATE=23,cinder:INSERT=18 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:27:44.746219 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a210fefd-7536-4a2c-b43a-3ca53f804ebf tempest-VolumesBackupsTest-1925542344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d261306-c800-4ae9-97b4-fb99e4ad4f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b15034ac-1e3c-4600-a246-03a3b4deb76e', 'volume_size': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d98522b7634403f83ff66fd72edfd9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'created_at': datetime.datetime(2022, 6, 25, 20, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5741eca-b932-4865-b29a-bd2a12a73795/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:44.754201 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a210fefd-7536-4a2c-b43a-3ca53f804ebf tempest-VolumesBackupsTest-1925542344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (006ae921-f986-4d71-9228-3729cec12769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:44.766115 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-a210fefd-7536-4a2c-b43a-3ca53f804ebf tempest-VolumesBackupsTest-1925542344 None] Volume volume-b15034ac-1e3c-4600-a246-03a3b4deb76e (b15034ac-1e3c-4600-a246-03a3b4deb76e): created successfully Jun 25 21:27:44.769674 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a210fefd-7536-4a2c-b43a-3ca53f804ebf tempest-VolumesBackupsTest-1925542344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (006ae921-f986-4d71-9228-3729cec12769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:44.775109 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-a210fefd-7536-4a2c-b43a-3ca53f804ebf tempest-VolumesBackupsTest-1925542344 None] Flow 'volume_create_manager' (8e3ea631-ed17-4f51-b271-139199a4844f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:27:44.784554 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-a210fefd-7536-4a2c-b43a-3ca53f804ebf tempest-VolumesBackupsTest-1925542344 None] Created volume successfully. Jun 25 21:27:45.381949 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-7b96cfe1-2f2e-4edf-9726-7d251d682960 tempest-VolumesBackupsTest-1925542344 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-06-25T21:27:45Z,data_timestamp=2022-06-25T21:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-98716523',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=025840f5-b009-42e6-85e4-179efcc70ed9,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='b43e0900925e4794b3be4da0a844654f',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='15a1ef42555447b2b55b74917e926040',volume_id=b15034ac-1e3c-4600-a246-03a3b4deb76e) Jun 25 21:27:45.382705 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.backup.rpcapi [None req-7b96cfe1-2f2e-4edf-9726-7d251d682960 tempest-VolumesBackupsTest-1925542344 None] continue_backup in rpcapi backup_id 025840f5-b009-42e6-85e4-179efcc70ed9 {{(pid=130674) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}} Jun 25 21:27:45.498582 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-7b96cfe1-2f2e-4edf-9726-7d251d682960 tempest-VolumesBackupsTest-1925542344 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 21:27:45.946562 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7e229dc-d1a6-4374-88cd-f425cbce977e tempest-TestVolumeBackupRestore-224445072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:27:45.966796 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e7e229dc-d1a6-4374-88cd-f425cbce977e tempest-TestVolumeBackupRestore-224445072 None] Flow 'volume_create_manager' (7fd3152a-4d83-4fd8-a3d7-183dda764a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:27:45.973432 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e7e229dc-d1a6-4374-88cd-f425cbce977e tempest-TestVolumeBackupRestore-224445072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ff6896-0141-4580-bbe6-8a3749f7aada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:45.990226 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e7e229dc-d1a6-4374-88cd-f425cbce977e tempest-TestVolumeBackupRestore-224445072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ff6896-0141-4580-bbe6-8a3749f7aada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:27:46Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_9a294fcd-1c96-451b-90d9-0e3acd896b0a',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f6251652-63b0-4878-98de-193b1d448e3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='039691ff93174f54aaaa13770a444aa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:27:46Z,use_quota=True,user_id='f7ea2397650748afa9edf0864829c434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:45.995456 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e7e229dc-d1a6-4374-88cd-f425cbce977e tempest-TestVolumeBackupRestore-224445072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e568492-7f26-4454-930f-eb3df3e3fa69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:45.999542 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e7e229dc-d1a6-4374-88cd-f425cbce977e tempest-TestVolumeBackupRestore-224445072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e568492-7f26-4454-930f-eb3df3e3fa69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:46.004407 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e7e229dc-d1a6-4374-88cd-f425cbce977e tempest-TestVolumeBackupRestore-224445072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7d574f0-8a9d-4bb0-b977-7c9d782d1666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:46.008629 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e7e229dc-d1a6-4374-88cd-f425cbce977e tempest-TestVolumeBackupRestore-224445072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7d574f0-8a9d-4bb0-b977-7c9d782d1666) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6251652-63b0-4878-98de-193b1d448e3b', 'volume_name': 'volume-f6251652-63b0-4878-98de-193b1d448e3b', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:46.013320 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e7e229dc-d1a6-4374-88cd-f425cbce977e tempest-TestVolumeBackupRestore-224445072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fa0fa38-a325-4e27-b068-41e41c60429d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:46.017212 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e7e229dc-d1a6-4374-88cd-f425cbce977e tempest-TestVolumeBackupRestore-224445072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fa0fa38-a325-4e27-b068-41e41c60429d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:46.021830 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e7e229dc-d1a6-4374-88cd-f425cbce977e tempest-TestVolumeBackupRestore-224445072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3be3fe7a-d37f-49a7-9d55-75967ad0b71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:46.022842 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-e7e229dc-d1a6-4374-88cd-f425cbce977e tempest-TestVolumeBackupRestore-224445072 None] Volume f6251652-63b0-4878-98de-193b1d448e3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6251652-63b0-4878-98de-193b1d448e3b', 'volume_size': 1} Jun 25 21:27:46.023239 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e7e229dc-d1a6-4374-88cd-f425cbce977e tempest-TestVolumeBackupRestore-224445072 None] creating volume 'volume-f6251652-63b0-4878-98de-193b1d448e3b' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:27:46.024375 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e7e229dc-d1a6-4374-88cd-f425cbce977e tempest-TestVolumeBackupRestore-224445072 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:27:46.105653 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e7e229dc-d1a6-4374-88cd-f425cbce977e tempest-TestVolumeBackupRestore-224445072 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:27:46.106027 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e7e229dc-d1a6-4374-88cd-f425cbce977e tempest-TestVolumeBackupRestore-224445072 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:27:46.109799 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e7e229dc-d1a6-4374-88cd-f425cbce977e tempest-TestVolumeBackupRestore-224445072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3be3fe7a-d37f-49a7-9d55-75967ad0b71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6251652-63b0-4878-98de-193b1d448e3b', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:46.115149 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e7e229dc-d1a6-4374-88cd-f425cbce977e tempest-TestVolumeBackupRestore-224445072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b6d5149-6296-45f2-9c4f-8bae8b00d93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:46.124378 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-e7e229dc-d1a6-4374-88cd-f425cbce977e tempest-TestVolumeBackupRestore-224445072 None] Volume volume-f6251652-63b0-4878-98de-193b1d448e3b (f6251652-63b0-4878-98de-193b1d448e3b): created successfully Jun 25 21:27:46.128010 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e7e229dc-d1a6-4374-88cd-f425cbce977e tempest-TestVolumeBackupRestore-224445072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b6d5149-6296-45f2-9c4f-8bae8b00d93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:46.133623 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-e7e229dc-d1a6-4374-88cd-f425cbce977e tempest-TestVolumeBackupRestore-224445072 None] Flow 'volume_create_manager' (7fd3152a-4d83-4fd8-a3d7-183dda764a8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:27:46.143234 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-e7e229dc-d1a6-4374-88cd-f425cbce977e tempest-TestVolumeBackupRestore-224445072 None] Created volume successfully. Jun 25 21:27:46.282733 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-7b96cfe1-2f2e-4edf-9726-7d251d682960 tempest-VolumesBackupsTest-1925542344 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.784s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 21:27:46.283520 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7b96cfe1-2f2e-4edf-9726-7d251d682960 tempest-VolumesBackupsTest-1925542344 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b15034ac-1e3c-4600-a246-03a3b4deb76e', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': 'b15034ac-1e3c-4600-a246-03a3b4deb76e', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 21:27:46.297881 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-7b96cfe1-2f2e-4edf-9726-7d251d682960 tempest-VolumesBackupsTest-1925542344 None] Initialize volume connection completed successfully. Jun 25 21:27:47.021996 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-e7e229dc-d1a6-4374-88cd-f425cbce977e tempest-TestVolumeBackupRestore-224445072 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 21:27:47.801514 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-e7e229dc-d1a6-4374-88cd-f425cbce977e tempest-TestVolumeBackupRestore-224445072 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.779s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 21:27:47.802399 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-e7e229dc-d1a6-4374-88cd-f425cbce977e tempest-TestVolumeBackupRestore-224445072 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f6251652-63b0-4878-98de-193b1d448e3b', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': 'f6251652-63b0-4878-98de-193b1d448e3b', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 21:27:47.825490 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-e7e229dc-d1a6-4374-88cd-f425cbce977e tempest-TestVolumeBackupRestore-224445072 None] Initialize volume connection completed successfully. Jun 25 21:27:52.159357 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:27:52.160669 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:27:52.221705 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:27:52.256254 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:27:54.506625 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-7b96cfe1-2f2e-4edf-9726-7d251d682960 tempest-VolumesBackupsTest-1925542344 None] Terminate volume connection completed successfully. Jun 25 21:27:54.544379 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-7b96cfe1-2f2e-4edf-9726-7d251d682960 tempest-VolumesBackupsTest-1925542344 None] Remove volume export completed successfully. Jun 25 21:27:55.114459 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-deb470a9-8e99-453d-87a1-a1e371271112 tempest-VolumesBackupsTest-1925542344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:27:55.136317 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-deb470a9-8e99-453d-87a1-a1e371271112 tempest-VolumesBackupsTest-1925542344 None] Flow 'volume_create_manager' (5d76cb4d-126e-4a8e-912b-f395712682b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:27:55.143158 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-deb470a9-8e99-453d-87a1-a1e371271112 tempest-VolumesBackupsTest-1925542344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93d07aa2-32ff-4c8c-9c80-9df38b8faed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:55.163718 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-deb470a9-8e99-453d-87a1-a1e371271112 tempest-VolumesBackupsTest-1925542344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93d07aa2-32ff-4c8c-9c80-9df38b8faed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:27:55Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_025840f5-b009-42e6-85e4-179efcc70ed9',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=544bf09b-0016-4600-9314-42a1d7e2a78b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b43e0900925e4794b3be4da0a844654f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:27:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:27:55Z,use_quota=True,user_id='15a1ef42555447b2b55b74917e926040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:55.169388 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-deb470a9-8e99-453d-87a1-a1e371271112 tempest-VolumesBackupsTest-1925542344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e6c337d-64f3-4e86-bccd-318bd6df9bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:55.174001 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-deb470a9-8e99-453d-87a1-a1e371271112 tempest-VolumesBackupsTest-1925542344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e6c337d-64f3-4e86-bccd-318bd6df9bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:55.179813 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-deb470a9-8e99-453d-87a1-a1e371271112 tempest-VolumesBackupsTest-1925542344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (275f4438-8de8-4003-8e2d-d8c324369b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:55.185409 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-deb470a9-8e99-453d-87a1-a1e371271112 tempest-VolumesBackupsTest-1925542344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (275f4438-8de8-4003-8e2d-d8c324369b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '544bf09b-0016-4600-9314-42a1d7e2a78b', 'volume_name': 'volume-544bf09b-0016-4600-9314-42a1d7e2a78b', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:55.190859 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-deb470a9-8e99-453d-87a1-a1e371271112 tempest-VolumesBackupsTest-1925542344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac49dbf9-0d07-41cb-b621-839eb7a1f1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:55.195478 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-deb470a9-8e99-453d-87a1-a1e371271112 tempest-VolumesBackupsTest-1925542344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac49dbf9-0d07-41cb-b621-839eb7a1f1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:55.200861 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-deb470a9-8e99-453d-87a1-a1e371271112 tempest-VolumesBackupsTest-1925542344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b5fa807-0b8f-4259-8490-d9786f702a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:55.202308 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-deb470a9-8e99-453d-87a1-a1e371271112 tempest-VolumesBackupsTest-1925542344 None] Volume 544bf09b-0016-4600-9314-42a1d7e2a78b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-544bf09b-0016-4600-9314-42a1d7e2a78b', 'volume_size': 1} Jun 25 21:27:55.202782 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-deb470a9-8e99-453d-87a1-a1e371271112 tempest-VolumesBackupsTest-1925542344 None] creating volume 'volume-544bf09b-0016-4600-9314-42a1d7e2a78b' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:27:55.203595 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-deb470a9-8e99-453d-87a1-a1e371271112 tempest-VolumesBackupsTest-1925542344 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:27:55.323454 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-deb470a9-8e99-453d-87a1-a1e371271112 tempest-VolumesBackupsTest-1925542344 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:27:55.323751 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-deb470a9-8e99-453d-87a1-a1e371271112 tempest-VolumesBackupsTest-1925542344 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:27:55.327943 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-deb470a9-8e99-453d-87a1-a1e371271112 tempest-VolumesBackupsTest-1925542344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b5fa807-0b8f-4259-8490-d9786f702a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-544bf09b-0016-4600-9314-42a1d7e2a78b', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:55.332583 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-deb470a9-8e99-453d-87a1-a1e371271112 tempest-VolumesBackupsTest-1925542344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1090c182-bf3c-4c05-acdc-12787ee2ec4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:27:55.342342 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-deb470a9-8e99-453d-87a1-a1e371271112 tempest-VolumesBackupsTest-1925542344 None] Volume volume-544bf09b-0016-4600-9314-42a1d7e2a78b (544bf09b-0016-4600-9314-42a1d7e2a78b): created successfully Jun 25 21:27:55.346087 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-deb470a9-8e99-453d-87a1-a1e371271112 tempest-VolumesBackupsTest-1925542344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1090c182-bf3c-4c05-acdc-12787ee2ec4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:27:55.351554 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-deb470a9-8e99-453d-87a1-a1e371271112 tempest-VolumesBackupsTest-1925542344 None] Flow 'volume_create_manager' (5d76cb4d-126e-4a8e-912b-f395712682b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:27:55.360909 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-deb470a9-8e99-453d-87a1-a1e371271112 tempest-VolumesBackupsTest-1925542344 None] Created volume successfully. Jun 25 21:27:55.922862 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-e7e229dc-d1a6-4374-88cd-f425cbce977e tempest-TestVolumeBackupRestore-224445072 None] Terminate volume connection completed successfully. Jun 25 21:27:55.944358 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-e7e229dc-d1a6-4374-88cd-f425cbce977e tempest-TestVolumeBackupRestore-224445072 None] Remove volume export completed successfully. Jun 25 21:27:56.145045 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-deb470a9-8e99-453d-87a1-a1e371271112 tempest-VolumesBackupsTest-1925542344 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 21:27:56.919704 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [None req-deb470a9-8e99-453d-87a1-a1e371271112 tempest-VolumesBackupsTest-1925542344 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.774s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 21:27:56.920919 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-deb470a9-8e99-453d-87a1-a1e371271112 tempest-VolumesBackupsTest-1925542344 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-544bf09b-0016-4600-9314-42a1d7e2a78b', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': '544bf09b-0016-4600-9314-42a1d7e2a78b', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 21:27:56.939838 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-deb470a9-8e99-453d-87a1-a1e371271112 tempest-VolumesBackupsTest-1925542344 None] Initialize volume connection completed successfully. Jun 25 21:28:00.758006 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-134287a4-7d1e-4c82-b094-b7874915d9cc req-551e0575-8802-42e7-bc2a-16b61d2aea24 tempest-TestVolumeBackupRestore-224445072 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 21:28:01.739919 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-134287a4-7d1e-4c82-b094-b7874915d9cc req-551e0575-8802-42e7-bc2a-16b61d2aea24 tempest-TestVolumeBackupRestore-224445072 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.981s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 21:28:01.740976 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-134287a4-7d1e-4c82-b094-b7874915d9cc req-551e0575-8802-42e7-bc2a-16b61d2aea24 tempest-TestVolumeBackupRestore-224445072 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f6251652-63b0-4878-98de-193b1d448e3b', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': 'f6251652-63b0-4878-98de-193b1d448e3b', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 21:28:01.810649 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-134287a4-7d1e-4c82-b094-b7874915d9cc req-551e0575-8802-42e7-bc2a-16b61d2aea24 tempest-TestVolumeBackupRestore-224445072 None] Connection info returned from driver {'name': 'volumes/volume-f6251652-63b0-4878-98de-193b1d448e3b', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f6251652-63b0-4878-98de-193b1d448e3b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'bfa44152-5f2f-45c2-af53-9a3eff1e49bb'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 25 21:28:01.936070 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-134287a4-7d1e-4c82-b094-b7874915d9cc req-551e0575-8802-42e7-bc2a-16b61d2aea24 tempest-TestVolumeBackupRestore-224445072 None] attachment_update completed successfully. Jun 25 21:28:05.409632 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-deb470a9-8e99-453d-87a1-a1e371271112 tempest-VolumesBackupsTest-1925542344 None] Terminate volume connection completed successfully. Jun 25 21:28:05.429662 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-deb470a9-8e99-453d-87a1-a1e371271112 tempest-VolumesBackupsTest-1925542344 None] Remove volume export completed successfully. Jun 25 21:28:06.574395 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-459e0415-ca07-4d76-a6b3-44f224cd27bb tempest-VolumesBackupsTest-1925542344 None] Lock "b'cinder-544bf09b-0016-4600-9314-42a1d7e2a78b-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:28:06.609957 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-459e0415-ca07-4d76-a6b3-44f224cd27bb tempest-VolumesBackupsTest-1925542344 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:28:07.112380 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-459e0415-ca07-4d76-a6b3-44f224cd27bb tempest-VolumesBackupsTest-1925542344 None] Volume volume-544bf09b-0016-4600-9314-42a1d7e2a78b is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:28:07.144891 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-459e0415-ca07-4d76-a6b3-44f224cd27bb tempest-VolumesBackupsTest-1925542344 None] deleting rbd volume volume-544bf09b-0016-4600-9314-42a1d7e2a78b {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:28:07.808055 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-459e0415-ca07-4d76-a6b3-44f224cd27bb tempest-VolumesBackupsTest-1925542344 None] Created reservations ['e289627e-22d9-4206-a261-6319ce97dbe8', '8e32814b-e594-42ad-9d75-82df1153d1ab', 'b8046af6-e21b-44bc-96f7-3f1f0463794a', 'cb9025a2-de5d-4359-8921-b47cb18c7d58'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:28:07.860475 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-459e0415-ca07-4d76-a6b3-44f224cd27bb tempest-VolumesBackupsTest-1925542344 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:28:07.885813 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-459e0415-ca07-4d76-a6b3-44f224cd27bb tempest-VolumesBackupsTest-1925542344 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:28:07.913410 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-459e0415-ca07-4d76-a6b3-44f224cd27bb tempest-VolumesBackupsTest-1925542344 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:28:07.918102 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-459e0415-ca07-4d76-a6b3-44f224cd27bb tempest-VolumesBackupsTest-1925542344 None] Deleted volume successfully. Jun 25 21:28:07.931679 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-459e0415-ca07-4d76-a6b3-44f224cd27bb tempest-VolumesBackupsTest-1925542344 None] Lock "b'cinder-544bf09b-0016-4600-9314-42a1d7e2a78b-delete_volume'" released by "delete_volume" :: held 1.357s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:28:09.908053 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-0afb9a1a-7155-4cb8-8a2f-ca8c1de46ad5 tempest-VolumesBackupsTest-1925542344 None] Lock "b'cinder-b15034ac-1e3c-4600-a246-03a3b4deb76e-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:28:09.939570 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0afb9a1a-7155-4cb8-8a2f-ca8c1de46ad5 tempest-VolumesBackupsTest-1925542344 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:28:10.150503 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0afb9a1a-7155-4cb8-8a2f-ca8c1de46ad5 tempest-VolumesBackupsTest-1925542344 None] deleting rbd volume volume-b15034ac-1e3c-4600-a246-03a3b4deb76e {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:28:10.325340 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0afb9a1a-7155-4cb8-8a2f-ca8c1de46ad5 tempest-VolumesBackupsTest-1925542344 None] volume is a clone so cleaning references {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jun 25 21:28:10.354948 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0afb9a1a-7155-4cb8-8a2f-ca8c1de46ad5 tempest-VolumesBackupsTest-1925542344 None] deleting parent snapshot volume-b15034ac-1e3c-4600-a246-03a3b4deb76e.clone_snap {{(pid=130674) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jun 25 21:28:11.165114 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:UPDATE=17,cinder:SELECT=70,cinder:DELETE=3,cinder:INSERT=10 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:28:11.200807 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-0afb9a1a-7155-4cb8-8a2f-ca8c1de46ad5 tempest-VolumesBackupsTest-1925542344 None] Created reservations ['d7a44018-05e0-4e55-827a-aede2682d0e4', 'f2d90349-87f7-45a9-b410-a59e9de1ab86', '35dfdab0-19f0-4f90-9e10-6a171960aadd', '5a945d60-a8b8-4f67-8861-173cde64ba1b'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:28:11.247484 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0afb9a1a-7155-4cb8-8a2f-ca8c1de46ad5 tempest-VolumesBackupsTest-1925542344 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:28:11.276579 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0afb9a1a-7155-4cb8-8a2f-ca8c1de46ad5 tempest-VolumesBackupsTest-1925542344 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:28:11.304737 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-0afb9a1a-7155-4cb8-8a2f-ca8c1de46ad5 tempest-VolumesBackupsTest-1925542344 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:28:11.309081 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-0afb9a1a-7155-4cb8-8a2f-ca8c1de46ad5 tempest-VolumesBackupsTest-1925542344 None] Deleted volume successfully. Jun 25 21:28:11.321418 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-0afb9a1a-7155-4cb8-8a2f-ca8c1de46ad5 tempest-VolumesBackupsTest-1925542344 None] Lock "b'cinder-b15034ac-1e3c-4600-a246-03a3b4deb76e-delete_volume'" released by "delete_volume" :: held 1.413s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:28:14.425786 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-b99fe69e-17a4-492d-9a90-d70f5d2e1b1e tempest-VolumesCloneNegativeTest-1299388873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:28:14.448023 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b99fe69e-17a4-492d-9a90-d70f5d2e1b1e tempest-VolumesCloneNegativeTest-1299388873 None] Flow 'volume_create_manager' (088137c2-938e-49a0-b738-c57e0242dd32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:28:14.455534 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b99fe69e-17a4-492d-9a90-d70f5d2e1b1e tempest-VolumesCloneNegativeTest-1299388873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63ddbd9d-0aab-4002-88a0-2bbc9672951f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:28:14.459796 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:UPDATE=23,cinder:SELECT=69,cinder:DELETE=3,cinder:INSERT=5 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:28:14.473507 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b99fe69e-17a4-492d-9a90-d70f5d2e1b1e tempest-VolumesCloneNegativeTest-1299388873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63ddbd9d-0aab-4002-88a0-2bbc9672951f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-986682246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=dbb9a404-f2ed-476f-aed8-2eed893afb49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d63f351e447949f18301dac1e599ecaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:28:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:28:14Z,use_quota=True,user_id='c03893d97aca4b5b8b319f02ec4851da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:28:14.479571 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b99fe69e-17a4-492d-9a90-d70f5d2e1b1e tempest-VolumesCloneNegativeTest-1299388873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42a14b4e-441c-4c35-af47-52d83d60be87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:28:14.484105 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b99fe69e-17a4-492d-9a90-d70f5d2e1b1e tempest-VolumesCloneNegativeTest-1299388873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42a14b4e-441c-4c35-af47-52d83d60be87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:28:14.491084 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b99fe69e-17a4-492d-9a90-d70f5d2e1b1e tempest-VolumesCloneNegativeTest-1299388873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5405feb4-53f9-4568-a6fc-aae409988898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:28:14.495924 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b99fe69e-17a4-492d-9a90-d70f5d2e1b1e tempest-VolumesCloneNegativeTest-1299388873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5405feb4-53f9-4568-a6fc-aae409988898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbb9a404-f2ed-476f-aed8-2eed893afb49', 'volume_name': 'volume-dbb9a404-f2ed-476f-aed8-2eed893afb49', 'volume_size': 2}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:28:14.501612 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b99fe69e-17a4-492d-9a90-d70f5d2e1b1e tempest-VolumesCloneNegativeTest-1299388873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e245f12-555a-4ed5-88cc-8303535e1b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:28:14.507141 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b99fe69e-17a4-492d-9a90-d70f5d2e1b1e tempest-VolumesCloneNegativeTest-1299388873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e245f12-555a-4ed5-88cc-8303535e1b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:28:14.512989 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b99fe69e-17a4-492d-9a90-d70f5d2e1b1e tempest-VolumesCloneNegativeTest-1299388873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (886216dc-8d09-40d2-872e-dab2d816d4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:28:14.514108 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-b99fe69e-17a4-492d-9a90-d70f5d2e1b1e tempest-VolumesCloneNegativeTest-1299388873 None] Volume dbb9a404-f2ed-476f-aed8-2eed893afb49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbb9a404-f2ed-476f-aed8-2eed893afb49', 'volume_size': 2} Jun 25 21:28:14.514519 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b99fe69e-17a4-492d-9a90-d70f5d2e1b1e tempest-VolumesCloneNegativeTest-1299388873 None] creating volume 'volume-dbb9a404-f2ed-476f-aed8-2eed893afb49' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:28:14.515466 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b99fe69e-17a4-492d-9a90-d70f5d2e1b1e tempest-VolumesCloneNegativeTest-1299388873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:28:14.586850 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b99fe69e-17a4-492d-9a90-d70f5d2e1b1e tempest-VolumesCloneNegativeTest-1299388873 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:28:14.587650 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b99fe69e-17a4-492d-9a90-d70f5d2e1b1e tempest-VolumesCloneNegativeTest-1299388873 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:28:14.592065 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b99fe69e-17a4-492d-9a90-d70f5d2e1b1e tempest-VolumesCloneNegativeTest-1299388873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (886216dc-8d09-40d2-872e-dab2d816d4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbb9a404-f2ed-476f-aed8-2eed893afb49', 'volume_size': 2}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:28:14.597880 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b99fe69e-17a4-492d-9a90-d70f5d2e1b1e tempest-VolumesCloneNegativeTest-1299388873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d374633-062f-4a56-8980-f5736ecd6b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:28:14.610218 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-b99fe69e-17a4-492d-9a90-d70f5d2e1b1e tempest-VolumesCloneNegativeTest-1299388873 None] Volume volume-dbb9a404-f2ed-476f-aed8-2eed893afb49 (dbb9a404-f2ed-476f-aed8-2eed893afb49): created successfully Jun 25 21:28:14.615846 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b99fe69e-17a4-492d-9a90-d70f5d2e1b1e tempest-VolumesCloneNegativeTest-1299388873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d374633-062f-4a56-8980-f5736ecd6b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:28:14.622682 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-b99fe69e-17a4-492d-9a90-d70f5d2e1b1e tempest-VolumesCloneNegativeTest-1299388873 None] Flow 'volume_create_manager' (088137c2-938e-49a0-b738-c57e0242dd32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:28:14.633365 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-b99fe69e-17a4-492d-9a90-d70f5d2e1b1e tempest-VolumesCloneNegativeTest-1299388873 None] Created volume successfully. Jun 25 21:28:15.553593 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-1ccf7fa6-00b2-4e85-9884-2c6f6797b1dc tempest-VolumesCloneNegativeTest-1299388873 None] Lock "b'cinder-dbb9a404-f2ed-476f-aed8-2eed893afb49-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:28:15.591071 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1ccf7fa6-00b2-4e85-9884-2c6f6797b1dc tempest-VolumesCloneNegativeTest-1299388873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:28:15.632268 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1ccf7fa6-00b2-4e85-9884-2c6f6797b1dc tempest-VolumesCloneNegativeTest-1299388873 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:28:15.632885 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1ccf7fa6-00b2-4e85-9884-2c6f6797b1dc tempest-VolumesCloneNegativeTest-1299388873 None] Volume volume-dbb9a404-f2ed-476f-aed8-2eed893afb49 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:28:15.638351 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1ccf7fa6-00b2-4e85-9884-2c6f6797b1dc tempest-VolumesCloneNegativeTest-1299388873 None] deleting rbd volume volume-dbb9a404-f2ed-476f-aed8-2eed893afb49 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:28:15.881477 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-1ccf7fa6-00b2-4e85-9884-2c6f6797b1dc tempest-VolumesCloneNegativeTest-1299388873 None] Created reservations ['6a5e6c90-f075-4c24-a00c-162bb2007517', 'a8f74b39-9784-4574-bf7c-48110134518c', 'ea828fa8-befd-41cb-b2c0-6831ecfcb62b', '84abfe72-90b6-4841-bc43-d2b10afcaed8'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:28:15.930538 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1ccf7fa6-00b2-4e85-9884-2c6f6797b1dc tempest-VolumesCloneNegativeTest-1299388873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:28:15.959475 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-1ccf7fa6-00b2-4e85-9884-2c6f6797b1dc tempest-VolumesCloneNegativeTest-1299388873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:28:15.992081 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-1ccf7fa6-00b2-4e85-9884-2c6f6797b1dc tempest-VolumesCloneNegativeTest-1299388873 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:28:15.997172 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-1ccf7fa6-00b2-4e85-9884-2c6f6797b1dc tempest-VolumesCloneNegativeTest-1299388873 None] Deleted volume successfully. Jun 25 21:28:16.013778 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-1ccf7fa6-00b2-4e85-9884-2c6f6797b1dc tempest-VolumesCloneNegativeTest-1299388873 None] Lock "b'cinder-dbb9a404-f2ed-476f-aed8-2eed893afb49-delete_volume'" released by "delete_volume" :: held 0.460s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:28:26.002075 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=16,cinder:DELETE=2,cinder:UPDATE=9,cinder:INSERT=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:28:44.690621 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=27,cinder:INSERT=4,cinder:UPDATE=20 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:28:52.163322 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:28:52.165979 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:28:52.218943 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:28:52.263218 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:29:02.119280 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:29:02.122465 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-88b8d286-a03a-4074-ba8c-ec1b8d33a969 req-0618a264-d910-46c3-b9d9-65ae7d60419c tempest-TestVolumeBackupRestore-224445072 None] Terminate volume connection completed successfully. Jun 25 21:29:02.123204 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-88b8d286-a03a-4074-ba8c-ec1b8d33a969 req-0618a264-d910-46c3-b9d9-65ae7d60419c tempest-TestVolumeBackupRestore-224445072 None] Deleting attachment bfa44152-5f2f-45c2-af53-9a3eff1e49bb. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 25 21:29:03.925384 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-b764be72-0e71-409c-999b-330bd42d7c2e tempest-TestVolumeBackupRestore-224445072 None] Lock "b'cinder-f6251652-63b0-4878-98de-193b1d448e3b-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:29:04.004343 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b764be72-0e71-409c-999b-330bd42d7c2e tempest-TestVolumeBackupRestore-224445072 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:29:05.122146 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b764be72-0e71-409c-999b-330bd42d7c2e tempest-TestVolumeBackupRestore-224445072 None] Volume volume-f6251652-63b0-4878-98de-193b1d448e3b is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:29:05.147145 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b764be72-0e71-409c-999b-330bd42d7c2e tempest-TestVolumeBackupRestore-224445072 None] deleting rbd volume volume-f6251652-63b0-4878-98de-193b1d448e3b {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:29:05.208761 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-4d99e935-f111-4236-876b-06f3daed4163 tempest-TestVolumeBackupRestore-224445072 None] Lock "b'cinder-5fdae7cd-d3c0-4540-9bfc-5c5833c67dd7-delete_volume'" acquired by "delete_volume" :: waited 0.045s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:29:05.279849 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4d99e935-f111-4236-876b-06f3daed4163 tempest-TestVolumeBackupRestore-224445072 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:29:06.316101 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4d99e935-f111-4236-876b-06f3daed4163 tempest-TestVolumeBackupRestore-224445072 None] deleting rbd volume volume-5fdae7cd-d3c0-4540-9bfc-5c5833c67dd7 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:29:06.367731 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-b764be72-0e71-409c-999b-330bd42d7c2e tempest-TestVolumeBackupRestore-224445072 None] Created reservations ['698a3749-d25f-47ad-a67f-6a13ce6daed9', 'ea985866-26ac-4f88-9494-d29969eb67fb', '0c37d60e-f7f0-409e-b81c-abc5b4f398c6', '26909279-3b2d-4c14-b9f2-52ce787d8de2'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:29:06.427632 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b764be72-0e71-409c-999b-330bd42d7c2e tempest-TestVolumeBackupRestore-224445072 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:29:06.485961 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-b764be72-0e71-409c-999b-330bd42d7c2e tempest-TestVolumeBackupRestore-224445072 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:29:06.528706 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-b764be72-0e71-409c-999b-330bd42d7c2e tempest-TestVolumeBackupRestore-224445072 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:29:06.534308 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-b764be72-0e71-409c-999b-330bd42d7c2e tempest-TestVolumeBackupRestore-224445072 None] Deleted volume successfully. Jun 25 21:29:06.548147 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4d99e935-f111-4236-876b-06f3daed4163 tempest-TestVolumeBackupRestore-224445072 None] volume is a clone so cleaning references {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jun 25 21:29:06.587628 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4d99e935-f111-4236-876b-06f3daed4163 tempest-TestVolumeBackupRestore-224445072 None] deleting parent snapshot volume-5fdae7cd-d3c0-4540-9bfc-5c5833c67dd7.clone_snap {{(pid=130674) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jun 25 21:29:07.373263 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-b764be72-0e71-409c-999b-330bd42d7c2e tempest-TestVolumeBackupRestore-224445072 None] Lock "b'cinder-f6251652-63b0-4878-98de-193b1d448e3b-delete_volume'" released by "delete_volume" :: held 3.448s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:29:07.417744 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-4d99e935-f111-4236-876b-06f3daed4163 tempest-TestVolumeBackupRestore-224445072 None] Created reservations ['5456049c-de21-4009-8312-b1d804f5c60b', '03b13a95-8b25-4431-ba45-8e704996eba7', 'a6e10870-7d3d-465f-99d4-e1c3ee5c3f7a', '5f5b46b0-9ca5-49af-9585-d20e46ab2b89'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:29:07.493549 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4d99e935-f111-4236-876b-06f3daed4163 tempest-TestVolumeBackupRestore-224445072 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:29:07.550151 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-4d99e935-f111-4236-876b-06f3daed4163 tempest-TestVolumeBackupRestore-224445072 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:29:07.587278 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-4d99e935-f111-4236-876b-06f3daed4163 tempest-TestVolumeBackupRestore-224445072 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:29:07.593519 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-4d99e935-f111-4236-876b-06f3daed4163 tempest-TestVolumeBackupRestore-224445072 None] Deleted volume successfully. Jun 25 21:29:07.611084 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-4d99e935-f111-4236-876b-06f3daed4163 tempest-TestVolumeBackupRestore-224445072 None] Lock "b'cinder-5fdae7cd-d3c0-4540-9bfc-5c5833c67dd7-delete_volume'" released by "delete_volume" :: held 2.403s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:29:25.164362 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=31,cinder:UPDATE=12,cinder:INSERT=5 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:29:35.161308 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=30,cinder:UPDATE=23,cinder:INSERT=3,cinder:DELETE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:29:52.159927 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:29:52.160990 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:29:52.198964 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:29:52.224353 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:29:55.151449 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-2d09cc58-60fb-4a62-b123-2db9d078c085 req-cca17984-d8fb-40de-99e8-501d4ca91abd tempest-TestVolumeBootPattern-148826616 None] Terminate volume connection completed successfully. Jun 25 21:29:55.152113 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-2d09cc58-60fb-4a62-b123-2db9d078c085 req-cca17984-d8fb-40de-99e8-501d4ca91abd tempest-TestVolumeBootPattern-148826616 None] Deleting attachment 43eef746-275f-4b72-99d9-18c12bb39ad2. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 25 21:29:58.418983 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:29:58.432004 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-2fc33086-c92b-4709-831c-8ca720a630b0 req-e887c592-a6a4-4679-9f00-f0f6390325bb tempest-TestVolumeBootPattern-148826616 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 21:29:59.190104 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-2fc33086-c92b-4709-831c-8ca720a630b0 req-e887c592-a6a4-4679-9f00-f0f6390325bb tempest-TestVolumeBootPattern-148826616 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.758s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 21:29:59.191108 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-2fc33086-c92b-4709-831c-8ca720a630b0 req-e887c592-a6a4-4679-9f00-f0f6390325bb tempest-TestVolumeBootPattern-148826616 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-45c469bc-53fa-489d-b96f-d0f49a47cac1', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': '45c469bc-53fa-489d-b96f-d0f49a47cac1', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 21:29:59.221486 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-2fc33086-c92b-4709-831c-8ca720a630b0 req-e887c592-a6a4-4679-9f00-f0f6390325bb tempest-TestVolumeBootPattern-148826616 None] Connection info returned from driver {'name': 'volumes/volume-45c469bc-53fa-489d-b96f-d0f49a47cac1', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '45c469bc-53fa-489d-b96f-d0f49a47cac1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '7e762c0f-aa96-4bf6-b5ba-d70f16c96db3'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 25 21:29:59.284049 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-2fc33086-c92b-4709-831c-8ca720a630b0 req-e887c592-a6a4-4679-9f00-f0f6390325bb tempest-TestVolumeBootPattern-148826616 None] attachment_update completed successfully. Jun 25 21:30:15.158630 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=19,cinder:UPDATE=4 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:30:35.168847 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=16,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:30:45.181371 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:30:52.159351 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:30:52.160126 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:30:52.188693 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:30:52.215431 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:31:05.177585 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:31:05.186640 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:31:15.187828 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:31:35.200332 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:31:45.218149 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:31:45.239963 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-fa0a086b-7bb8-4f87-8f0c-fbd9fcae7494 tempest-TestVolumeBootPattern-148826616 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:31:45.423317 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-fa0a086b-7bb8-4f87-8f0c-fbd9fcae7494 tempest-TestVolumeBootPattern-148826616 None] Create snapshot completed successfully Jun 25 21:31:46.670843 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bec07fd-60e0-47c4-bd61-11964d6f7205 tempest-TestVolumeBootPattern-148826616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:31:46.698942 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7bec07fd-60e0-47c4-bd61-11964d6f7205 tempest-TestVolumeBootPattern-148826616 None] Flow 'volume_create_manager' (8b7c3178-98ae-4bce-9778-17e436305ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:31:46.705937 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7bec07fd-60e0-47c4-bd61-11964d6f7205 tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec7c377c-e4b8-4ceb-b8e4-7eab80a52ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:31:46.722703 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7bec07fd-60e0-47c4-bd61-11964d6f7205 tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec7c377c-e4b8-4ceb-b8e4-7eab80a52ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-1581637246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=020f313c-d48f-42f6-9ac9-70ef9031c609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1a396ec47a346dc97426df498e54ab2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=857ab67a-f209-4f3d-80b4-fa5a64193dfa,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:31:47Z,use_quota=True,user_id='8d162afa6d9b48ef9fac1bf23c0c41e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:31:46.728555 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7bec07fd-60e0-47c4-bd61-11964d6f7205 tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b6d427-9e19-4874-bcae-72f89b279308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:31:46.732596 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7bec07fd-60e0-47c4-bd61-11964d6f7205 tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b6d427-9e19-4874-bcae-72f89b279308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:31:46.737449 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7bec07fd-60e0-47c4-bd61-11964d6f7205 tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e0147eb-f89c-4f92-85ce-e85f6e382f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:31:46.741434 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7bec07fd-60e0-47c4-bd61-11964d6f7205 tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e0147eb-f89c-4f92-85ce-e85f6e382f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '020f313c-d48f-42f6-9ac9-70ef9031c609', 'volume_name': 'volume-020f313c-d48f-42f6-9ac9-70ef9031c609', 'volume_size': 1, 'snapshot_id': '857ab67a-f209-4f3d-80b4-fa5a64193dfa'}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:31:46.746169 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7bec07fd-60e0-47c4-bd61-11964d6f7205 tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35fc0225-143c-46e0-9e23-9f4e94f8a0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:31:46.749958 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7bec07fd-60e0-47c4-bd61-11964d6f7205 tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35fc0225-143c-46e0-9e23-9f4e94f8a0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:31:46.754512 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7bec07fd-60e0-47c4-bd61-11964d6f7205 tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87f98ff6-130d-4a15-8c3d-f917c51e03b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:31:46.755566 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-7bec07fd-60e0-47c4-bd61-11964d6f7205 tempest-TestVolumeBootPattern-148826616 None] Volume 020f313c-d48f-42f6-9ac9-70ef9031c609: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-020f313c-d48f-42f6-9ac9-70ef9031c609', 'volume_size': 1, 'snapshot_id': '857ab67a-f209-4f3d-80b4-fa5a64193dfa'} Jun 25 21:31:46.780637 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7bec07fd-60e0-47c4-bd61-11964d6f7205 tempest-TestVolumeBootPattern-148826616 None] cloning volumes/volume-45c469bc-53fa-489d-b96f-d0f49a47cac1@snapshot-857ab67a-f209-4f3d-80b4-fa5a64193dfa to volume-020f313c-d48f-42f6-9ac9-70ef9031c609 {{(pid=130674) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1094}} Jun 25 21:31:46.781755 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7bec07fd-60e0-47c4-bd61-11964d6f7205 tempest-TestVolumeBootPattern-148826616 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:31:46.855162 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7bec07fd-60e0-47c4-bd61-11964d6f7205 tempest-TestVolumeBootPattern-148826616 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:31:46.974618 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7bec07fd-60e0-47c4-bd61-11964d6f7205 tempest-TestVolumeBootPattern-148826616 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:31:46.974995 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-7bec07fd-60e0-47c4-bd61-11964d6f7205 tempest-TestVolumeBootPattern-148826616 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:31:46.996821 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.volume_utils [None req-7bec07fd-60e0-47c4-bd61-11964d6f7205 tempest-TestVolumeBootPattern-148826616 None] Marking volume 020f313c-d48f-42f6-9ac9-70ef9031c609 as bootable. {{(pid=130674) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 25 21:31:47.001767 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bec07fd-60e0-47c4-bd61-11964d6f7205 tempest-TestVolumeBootPattern-148826616 None] Copying metadata from snapshot 857ab67a-f209-4f3d-80b4-fa5a64193dfa to 020f313c-d48f-42f6-9ac9-70ef9031c609. {{(pid=130674) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:430}} Jun 25 21:31:47.037987 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7bec07fd-60e0-47c4-bd61-11964d6f7205 tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87f98ff6-130d-4a15-8c3d-f917c51e03b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-020f313c-d48f-42f6-9ac9-70ef9031c609', 'volume_size': 1, 'snapshot_id': '857ab67a-f209-4f3d-80b4-fa5a64193dfa'}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:31:47.042536 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7bec07fd-60e0-47c4-bd61-11964d6f7205 tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a36a816-6447-4b0b-bda8-cc0c91ece51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:31:47.052382 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-7bec07fd-60e0-47c4-bd61-11964d6f7205 tempest-TestVolumeBootPattern-148826616 None] Volume volume-020f313c-d48f-42f6-9ac9-70ef9031c609 (020f313c-d48f-42f6-9ac9-70ef9031c609): created successfully Jun 25 21:31:47.056002 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7bec07fd-60e0-47c4-bd61-11964d6f7205 tempest-TestVolumeBootPattern-148826616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a36a816-6447-4b0b-bda8-cc0c91ece51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:31:47.061372 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-7bec07fd-60e0-47c4-bd61-11964d6f7205 tempest-TestVolumeBootPattern-148826616 None] Flow 'volume_create_manager' (8b7c3178-98ae-4bce-9778-17e436305ae0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:31:47.077612 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-7bec07fd-60e0-47c4-bd61-11964d6f7205 tempest-TestVolumeBootPattern-148826616 None] Created volume successfully. Jun 25 21:31:49.724082 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-d6dbcea0-229f-4db9-a780-1600d11d9799 req-d24e9486-3bbb-463d-b816-09bb75954315 tempest-TestVolumeBootPattern-148826616 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 21:31:50.470528 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-d6dbcea0-229f-4db9-a780-1600d11d9799 req-d24e9486-3bbb-463d-b816-09bb75954315 tempest-TestVolumeBootPattern-148826616 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.746s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 21:31:50.471482 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-d6dbcea0-229f-4db9-a780-1600d11d9799 req-d24e9486-3bbb-463d-b816-09bb75954315 tempest-TestVolumeBootPattern-148826616 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-020f313c-d48f-42f6-9ac9-70ef9031c609', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': '020f313c-d48f-42f6-9ac9-70ef9031c609', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 21:31:50.497174 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-d6dbcea0-229f-4db9-a780-1600d11d9799 req-d24e9486-3bbb-463d-b816-09bb75954315 tempest-TestVolumeBootPattern-148826616 None] Connection info returned from driver {'name': 'volumes/volume-020f313c-d48f-42f6-9ac9-70ef9031c609', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '020f313c-d48f-42f6-9ac9-70ef9031c609', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '1eb8a8ce-c1e5-4352-af9d-3c2396c6e4d0'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 25 21:31:50.547105 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-d6dbcea0-229f-4db9-a780-1600d11d9799 req-d24e9486-3bbb-463d-b816-09bb75954315 tempest-TestVolumeBootPattern-148826616 None] attachment_update completed successfully. Jun 25 21:31:52.160473 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:31:52.161436 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:31:52.200113 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:31:52.238107 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:32:15.198943 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=33,cinder:UPDATE=5,cinder:INSERT=11,cinder:DELETE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:32:25.208573 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=37,cinder:INSERT=13,cinder:DELETE=1,cinder:UPDATE=7 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:32:45.210374 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:32:52.163345 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:32:52.164016 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:32:52.188301 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:32:52.221328 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:32:55.208364 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:33:15.210108 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:33:25.208048 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:33:40.319036 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-476540a5-b7e9-4745-a3d4-039eadecbcf9 req-1cd8738d-be92-4e29-85a6-ed58749fd9f3 tempest-TestVolumeBootPattern-148826616 None] Terminate volume connection completed successfully. Jun 25 21:33:40.319733 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-476540a5-b7e9-4745-a3d4-039eadecbcf9 req-1cd8738d-be92-4e29-85a6-ed58749fd9f3 tempest-TestVolumeBootPattern-148826616 None] Deleting attachment 1eb8a8ce-c1e5-4352-af9d-3c2396c6e4d0. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 25 21:33:40.896140 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-f834c412-9454-485d-a963-749bf4dc52ab tempest-TestVolumeBootPattern-148826616 None] Lock "b'cinder-020f313c-d48f-42f6-9ac9-70ef9031c609-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:33:40.930015 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f834c412-9454-485d-a963-749bf4dc52ab tempest-TestVolumeBootPattern-148826616 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:33:41.001982 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f834c412-9454-485d-a963-749bf4dc52ab tempest-TestVolumeBootPattern-148826616 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:33:41.009418 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f834c412-9454-485d-a963-749bf4dc52ab tempest-TestVolumeBootPattern-148826616 None] deleting rbd volume volume-020f313c-d48f-42f6-9ac9-70ef9031c609 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:33:41.246456 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-f834c412-9454-485d-a963-749bf4dc52ab tempest-TestVolumeBootPattern-148826616 None] Created reservations ['a32fa4a7-4b6f-4f5c-aaee-ae10384113f5', 'cd305ee0-ae6e-44f3-a272-46ba1e5df81a', '109de8f6-9bf4-4755-b945-dfc95767a58b', 'fb8a20f6-b7d3-447a-aa6d-2075c6dc3924'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:33:41.300731 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f834c412-9454-485d-a963-749bf4dc52ab tempest-TestVolumeBootPattern-148826616 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:33:41.325429 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-f834c412-9454-485d-a963-749bf4dc52ab tempest-TestVolumeBootPattern-148826616 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:33:41.350340 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-f834c412-9454-485d-a963-749bf4dc52ab tempest-TestVolumeBootPattern-148826616 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:33:41.355536 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-f834c412-9454-485d-a963-749bf4dc52ab tempest-TestVolumeBootPattern-148826616 None] Deleted volume successfully. Jun 25 21:33:41.370886 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-f834c412-9454-485d-a963-749bf4dc52ab tempest-TestVolumeBootPattern-148826616 None] Lock "b'cinder-020f313c-d48f-42f6-9ac9-70ef9031c609-delete_volume'" released by "delete_volume" :: held 0.475s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:33:42.028746 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-9193b2e4-d85d-4747-96ae-4fc44b757c55 tempest-TestVolumeBootPattern-148826616 None] Lock "b'cinder-857ab67a-f209-4f3d-80b4-fa5a64193dfa-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:33:42.030371 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-9193b2e4-d85d-4747-96ae-4fc44b757c55 tempest-TestVolumeBootPattern-148826616 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:33:45.225101 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=19,cinder:UPDATE=10,cinder:INSERT=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:33:52.166265 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:33:52.167250 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:33:52.192251 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:33:52.214783 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:34:05.222344 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=19,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:34:12.195068 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-9193b2e4-d85d-4747-96ae-4fc44b757c55 tempest-TestVolumeBootPattern-148826616 None] Created reservations ['50b0b8d2-da38-4b7e-813d-95407f47b468', '8426adfa-e21b-419b-b51b-acf750b69172', 'b8040668-5c18-41d2-acd7-a544f5b9d29b', '4397b22f-13ac-4adb-85e7-c428411c63d4'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:34:12.250208 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-9193b2e4-d85d-4747-96ae-4fc44b757c55 tempest-TestVolumeBootPattern-148826616 None] Delete snapshot completed successfully. Jun 25 21:34:12.255626 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-9193b2e4-d85d-4747-96ae-4fc44b757c55 tempest-TestVolumeBootPattern-148826616 None] Lock "b'cinder-857ab67a-f209-4f3d-80b4-fa5a64193dfa-delete_snapshot'" released by "delete_snapshot" :: held 30.227s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:34:16.390544 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=15,cinder:UPDATE=10,cinder:INSERT=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:34:16.401705 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-b6461ff4-76e3-4fd6-a091-53ad7cdd8ec7 req-b2b9480c-76a8-4696-879d-1fcca6a41094 tempest-TestVolumeBootPattern-148826616 None] Terminate volume connection completed successfully. Jun 25 21:34:16.402177 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-b6461ff4-76e3-4fd6-a091-53ad7cdd8ec7 req-b2b9480c-76a8-4696-879d-1fcca6a41094 tempest-TestVolumeBootPattern-148826616 None] Deleting attachment 7e762c0f-aa96-4bf6-b5ba-d70f16c96db3. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 25 21:34:18.486091 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-236f93f7-6c5b-4d9b-92b3-719c1e4b56af tempest-TestVolumeBootPattern-148826616 None] Lock "b'cinder-45c469bc-53fa-489d-b96f-d0f49a47cac1-delete_volume'" acquired by "delete_volume" :: waited 0.008s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:34:18.519687 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-236f93f7-6c5b-4d9b-92b3-719c1e4b56af tempest-TestVolumeBootPattern-148826616 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:34:18.580303 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-236f93f7-6c5b-4d9b-92b3-719c1e4b56af tempest-TestVolumeBootPattern-148826616 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:34:18.587050 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-236f93f7-6c5b-4d9b-92b3-719c1e4b56af tempest-TestVolumeBootPattern-148826616 None] deleting rbd volume volume-45c469bc-53fa-489d-b96f-d0f49a47cac1 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:34:18.806653 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-236f93f7-6c5b-4d9b-92b3-719c1e4b56af tempest-TestVolumeBootPattern-148826616 None] volume is a clone so cleaning references {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jun 25 21:34:18.838580 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-236f93f7-6c5b-4d9b-92b3-719c1e4b56af tempest-TestVolumeBootPattern-148826616 None] deleting parent snapshot volume-45c469bc-53fa-489d-b96f-d0f49a47cac1.clone_snap {{(pid=130674) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jun 25 21:34:19.019313 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-236f93f7-6c5b-4d9b-92b3-719c1e4b56af tempest-TestVolumeBootPattern-148826616 None] Created reservations ['582af718-fe13-447f-851a-c0020cce2076', '4da408d7-bbc2-4f84-af8a-1040ea8b832a', '02d591af-f080-47d6-932a-b61f7a18f2d4', 'a742f148-9d6e-4e59-b52f-e1874baa5f2e'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:34:19.070675 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-236f93f7-6c5b-4d9b-92b3-719c1e4b56af tempest-TestVolumeBootPattern-148826616 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:34:19.096265 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-236f93f7-6c5b-4d9b-92b3-719c1e4b56af tempest-TestVolumeBootPattern-148826616 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:34:19.123340 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-236f93f7-6c5b-4d9b-92b3-719c1e4b56af tempest-TestVolumeBootPattern-148826616 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:34:19.127627 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-236f93f7-6c5b-4d9b-92b3-719c1e4b56af tempest-TestVolumeBootPattern-148826616 None] Deleted volume successfully. Jun 25 21:34:19.142256 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-236f93f7-6c5b-4d9b-92b3-719c1e4b56af tempest-TestVolumeBootPattern-148826616 None] Lock "b'cinder-45c469bc-53fa-489d-b96f-d0f49a47cac1-delete_volume'" released by "delete_volume" :: held 0.656s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:34:29.132751 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:34:45.244508 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=33,cinder:INSERT=5,cinder:UPDATE=16 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:34:52.169274 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:34:52.170037 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:34:52.195588 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:34:52.223958 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:35:05.232757 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=6 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:35:15.236711 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:35:35.239110 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:35:35.244328 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:35:52.169643 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:35:52.170309 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:35:52.196681 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:35:52.222063 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:36:15.238785 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:36:15.240259 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:UPDATE=2,cinder:SELECT=7 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:36:52.167603 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:36:52.168325 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:36:52.194264 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:36:52.218808 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:36:55.222427 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:36:55.223130 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:37:15.227688 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:37:25.238991 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:37:45.235297 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:37:45.243876 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:37:52.164289 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:37:52.165094 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:37:52.196235 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:37:52.223878 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:38:05.241032 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:38:25.250200 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:38:35.260492 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:38:52.169542 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:38:52.170290 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:38:52.199097 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:38:52.224219 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:38:55.263589 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:39:05.260800 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:39:35.265147 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:39:52.169599 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:39:52.170231 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:39:52.194856 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:39:52.218930 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:39:55.266243 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:39:55.267297 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:40:35.255888 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:40:35.257814 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:40:52.174226 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:40:52.175270 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:40:52.214271 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:40:52.238214 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:41:15.257335 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:41:15.260772 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:41:52.174976 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:41:52.176019 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:41:52.208932 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:41:52.239814 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:41:55.254644 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:41:55.256705 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:42:05.268124 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:42:25.265828 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:42:45.264707 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:42:52.175107 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:42:52.176143 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:42:52.205050 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:42:52.229186 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:43:05.271619 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:43:05.272875 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:43:35.273771 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:43:35.283564 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:43:51.530286 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-04dfcc38-ab3d-473d-80cb-6a3efad32402 tempest-ServerActionsTestJSON-1210636320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:43:51.550154 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-04dfcc38-ab3d-473d-80cb-6a3efad32402 tempest-ServerActionsTestJSON-1210636320 None] Flow 'volume_create_manager' (2818bfc9-9b39-4fbf-a361-93fbd896f582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:43:51.556446 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-04dfcc38-ab3d-473d-80cb-6a3efad32402 tempest-ServerActionsTestJSON-1210636320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8af07cb6-ce99-4cec-82da-349a250fd214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:43:51.572743 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-04dfcc38-ab3d-473d-80cb-6a3efad32402 tempest-ServerActionsTestJSON-1210636320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8af07cb6-ce99-4cec-82da-349a250fd214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:43:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-2073962377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f533e81c-9e79-499b-b6ce-b38f2384d888,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='252cb11a6c804df8840720793581d971',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:43:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:43:51Z,use_quota=True,user_id='39b0356717474e7fabff20aa3fa9e309',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:43:51.577988 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-04dfcc38-ab3d-473d-80cb-6a3efad32402 tempest-ServerActionsTestJSON-1210636320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a18cb926-8fb0-4517-b46b-a452cc111bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:43:51.581976 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-04dfcc38-ab3d-473d-80cb-6a3efad32402 tempest-ServerActionsTestJSON-1210636320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a18cb926-8fb0-4517-b46b-a452cc111bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:43:51.586952 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-04dfcc38-ab3d-473d-80cb-6a3efad32402 tempest-ServerActionsTestJSON-1210636320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (805134e1-3f8f-4c65-9d1c-eda2e5d6b9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:43:51.591280 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-04dfcc38-ab3d-473d-80cb-6a3efad32402 tempest-ServerActionsTestJSON-1210636320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (805134e1-3f8f-4c65-9d1c-eda2e5d6b9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f533e81c-9e79-499b-b6ce-b38f2384d888', 'volume_name': 'volume-f533e81c-9e79-499b-b6ce-b38f2384d888', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:43:51.596057 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-04dfcc38-ab3d-473d-80cb-6a3efad32402 tempest-ServerActionsTestJSON-1210636320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a48c9fa3-c0b7-4454-80af-4b2764d6e4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:43:51.599824 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-04dfcc38-ab3d-473d-80cb-6a3efad32402 tempest-ServerActionsTestJSON-1210636320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a48c9fa3-c0b7-4454-80af-4b2764d6e4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:43:51.604399 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-04dfcc38-ab3d-473d-80cb-6a3efad32402 tempest-ServerActionsTestJSON-1210636320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (734b59fe-70a2-4e94-9c00-a2b93f8f4c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:43:51.605469 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-04dfcc38-ab3d-473d-80cb-6a3efad32402 tempest-ServerActionsTestJSON-1210636320 None] Volume f533e81c-9e79-499b-b6ce-b38f2384d888: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f533e81c-9e79-499b-b6ce-b38f2384d888', 'volume_size': 1} Jun 25 21:43:51.605947 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-04dfcc38-ab3d-473d-80cb-6a3efad32402 tempest-ServerActionsTestJSON-1210636320 None] creating volume 'volume-f533e81c-9e79-499b-b6ce-b38f2384d888' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:43:51.606617 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-04dfcc38-ab3d-473d-80cb-6a3efad32402 tempest-ServerActionsTestJSON-1210636320 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:43:51.669051 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-04dfcc38-ab3d-473d-80cb-6a3efad32402 tempest-ServerActionsTestJSON-1210636320 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:43:51.669326 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-04dfcc38-ab3d-473d-80cb-6a3efad32402 tempest-ServerActionsTestJSON-1210636320 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:43:51.672944 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-04dfcc38-ab3d-473d-80cb-6a3efad32402 tempest-ServerActionsTestJSON-1210636320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (734b59fe-70a2-4e94-9c00-a2b93f8f4c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f533e81c-9e79-499b-b6ce-b38f2384d888', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:43:51.677417 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-04dfcc38-ab3d-473d-80cb-6a3efad32402 tempest-ServerActionsTestJSON-1210636320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (876bc8a4-f8d3-4f83-ae0f-5ac9a5bbf2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:43:51.688694 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-04dfcc38-ab3d-473d-80cb-6a3efad32402 tempest-ServerActionsTestJSON-1210636320 None] Volume volume-f533e81c-9e79-499b-b6ce-b38f2384d888 (f533e81c-9e79-499b-b6ce-b38f2384d888): created successfully Jun 25 21:43:51.692123 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-04dfcc38-ab3d-473d-80cb-6a3efad32402 tempest-ServerActionsTestJSON-1210636320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (876bc8a4-f8d3-4f83-ae0f-5ac9a5bbf2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:43:51.697546 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-04dfcc38-ab3d-473d-80cb-6a3efad32402 tempest-ServerActionsTestJSON-1210636320 None] Flow 'volume_create_manager' (2818bfc9-9b39-4fbf-a361-93fbd896f582) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:43:51.708297 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-04dfcc38-ab3d-473d-80cb-6a3efad32402 tempest-ServerActionsTestJSON-1210636320 None] Created volume successfully. Jun 25 21:43:52.175134 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:43:52.176182 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:43:52.208198 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:43:52.233181 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:43:53.329161 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-9d4be520-c70b-42fa-a3cf-7c5cbab03224 req-90761c73-d77a-4dac-a7c5-1841ca66cb3f tempest-ServerActionsTestJSON-1210636320 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 21:43:54.069408 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-9d4be520-c70b-42fa-a3cf-7c5cbab03224 req-90761c73-d77a-4dac-a7c5-1841ca66cb3f tempest-ServerActionsTestJSON-1210636320 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.740s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 21:43:54.070259 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-9d4be520-c70b-42fa-a3cf-7c5cbab03224 req-90761c73-d77a-4dac-a7c5-1841ca66cb3f tempest-ServerActionsTestJSON-1210636320 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f533e81c-9e79-499b-b6ce-b38f2384d888', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': 'f533e81c-9e79-499b-b6ce-b38f2384d888', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 21:43:54.098719 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-9d4be520-c70b-42fa-a3cf-7c5cbab03224 req-90761c73-d77a-4dac-a7c5-1841ca66cb3f tempest-ServerActionsTestJSON-1210636320 None] Connection info returned from driver {'name': 'volumes/volume-f533e81c-9e79-499b-b6ce-b38f2384d888', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f533e81c-9e79-499b-b6ce-b38f2384d888', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '5b8d525c-c9eb-4c7b-903d-e1dcb12eeca2'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 25 21:43:54.148699 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-9d4be520-c70b-42fa-a3cf-7c5cbab03224 req-90761c73-d77a-4dac-a7c5-1841ca66cb3f tempest-ServerActionsTestJSON-1210636320 None] attachment_update completed successfully. Jun 25 21:44:05.312996 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=17,cinder:UPDATE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:44:05.313808 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:UPDATE=6,cinder:SELECT=18,cinder:DELETE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:44:15.030521 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-5c4fb423-8705-4d9e-bd99-d9e455ffec8f req-1d0fb15f-5b42-4ccb-b9ed-c75493bf7065 tempest-ServerActionsTestJSON-1210636320 None] Terminate volume connection completed successfully. Jun 25 21:44:15.031202 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-5c4fb423-8705-4d9e-bd99-d9e455ffec8f req-1d0fb15f-5b42-4ccb-b9ed-c75493bf7065 tempest-ServerActionsTestJSON-1210636320 None] Deleting attachment 5b8d525c-c9eb-4c7b-903d-e1dcb12eeca2. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 25 21:44:16.216347 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-5c4fb423-8705-4d9e-bd99-d9e455ffec8f req-664df277-3ac3-4aa9-854e-54cfd5dec1e0 tempest-ServerActionsTestJSON-1210636320 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 21:44:16.949997 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-5c4fb423-8705-4d9e-bd99-d9e455ffec8f req-664df277-3ac3-4aa9-854e-54cfd5dec1e0 tempest-ServerActionsTestJSON-1210636320 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.733s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 21:44:16.950876 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-5c4fb423-8705-4d9e-bd99-d9e455ffec8f req-664df277-3ac3-4aa9-854e-54cfd5dec1e0 tempest-ServerActionsTestJSON-1210636320 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f533e81c-9e79-499b-b6ce-b38f2384d888', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': 'f533e81c-9e79-499b-b6ce-b38f2384d888', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 21:44:16.978114 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-5c4fb423-8705-4d9e-bd99-d9e455ffec8f req-664df277-3ac3-4aa9-854e-54cfd5dec1e0 tempest-ServerActionsTestJSON-1210636320 None] Connection info returned from driver {'name': 'volumes/volume-f533e81c-9e79-499b-b6ce-b38f2384d888', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f533e81c-9e79-499b-b6ce-b38f2384d888', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '9699f52d-8222-4571-9703-834130553424'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 25 21:44:17.028719 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-5c4fb423-8705-4d9e-bd99-d9e455ffec8f req-664df277-3ac3-4aa9-854e-54cfd5dec1e0 tempest-ServerActionsTestJSON-1210636320 None] attachment_update completed successfully. Jun 25 21:44:24.602568 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-48ce8346-4931-4d62-9e41-d1a55dce938d req-7cf2406b-ec67-46d0-99a3-bdb26430aa6b tempest-ServerActionsTestJSON-1210636320 None] Terminate volume connection completed successfully. Jun 25 21:44:24.603743 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-48ce8346-4931-4d62-9e41-d1a55dce938d req-7cf2406b-ec67-46d0-99a3-bdb26430aa6b tempest-ServerActionsTestJSON-1210636320 None] Deleting attachment 9699f52d-8222-4571-9703-834130553424. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 25 21:44:26.021165 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-48ce8346-4931-4d62-9e41-d1a55dce938d req-18880177-73fb-4dee-b6d7-ec6278b69d99 tempest-ServerActionsTestJSON-1210636320 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 21:44:26.755127 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-48ce8346-4931-4d62-9e41-d1a55dce938d req-18880177-73fb-4dee-b6d7-ec6278b69d99 tempest-ServerActionsTestJSON-1210636320 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.734s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 21:44:26.755983 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-48ce8346-4931-4d62-9e41-d1a55dce938d req-18880177-73fb-4dee-b6d7-ec6278b69d99 tempest-ServerActionsTestJSON-1210636320 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f533e81c-9e79-499b-b6ce-b38f2384d888', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': 'f533e81c-9e79-499b-b6ce-b38f2384d888', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 21:44:26.782230 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-48ce8346-4931-4d62-9e41-d1a55dce938d req-18880177-73fb-4dee-b6d7-ec6278b69d99 tempest-ServerActionsTestJSON-1210636320 None] Connection info returned from driver {'name': 'volumes/volume-f533e81c-9e79-499b-b6ce-b38f2384d888', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f533e81c-9e79-499b-b6ce-b38f2384d888', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '323fdac7-aa06-4a8b-8d52-7a08c272dd80'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 25 21:44:26.839991 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-48ce8346-4931-4d62-9e41-d1a55dce938d req-18880177-73fb-4dee-b6d7-ec6278b69d99 tempest-ServerActionsTestJSON-1210636320 None] attachment_update completed successfully. Jun 25 21:44:34.892560 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-4b72400a-bd9a-4d96-ae59-207cfbdd7698 req-f4b7f35c-89dd-4495-861b-d8bc4461090f tempest-ServerActionsTestJSON-1210636320 None] Terminate volume connection completed successfully. Jun 25 21:44:34.893308 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-4b72400a-bd9a-4d96-ae59-207cfbdd7698 req-f4b7f35c-89dd-4495-861b-d8bc4461090f tempest-ServerActionsTestJSON-1210636320 None] Deleting attachment 323fdac7-aa06-4a8b-8d52-7a08c272dd80. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 25 21:44:35.893774 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-088d14e0-3917-4732-8afa-9b2814a44db3 tempest-ServerActionsTestJSON-1210636320 None] Lock "b'cinder-f533e81c-9e79-499b-b6ce-b38f2384d888-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:44:35.896142 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=36,cinder:UPDATE=6 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:44:35.897884 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=32,cinder:UPDATE=4 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:44:35.931089 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-088d14e0-3917-4732-8afa-9b2814a44db3 tempest-ServerActionsTestJSON-1210636320 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:44:35.972876 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-088d14e0-3917-4732-8afa-9b2814a44db3 tempest-ServerActionsTestJSON-1210636320 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:44:35.973398 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-088d14e0-3917-4732-8afa-9b2814a44db3 tempest-ServerActionsTestJSON-1210636320 None] Volume volume-f533e81c-9e79-499b-b6ce-b38f2384d888 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:44:35.977956 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-088d14e0-3917-4732-8afa-9b2814a44db3 tempest-ServerActionsTestJSON-1210636320 None] deleting rbd volume volume-f533e81c-9e79-499b-b6ce-b38f2384d888 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:44:36.165404 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-088d14e0-3917-4732-8afa-9b2814a44db3 tempest-ServerActionsTestJSON-1210636320 None] Created reservations ['9018ffae-d4f3-4ddb-ae33-9a3ac1562fcb', '8ecf1262-80a1-455e-b14d-51a1a9e96493', '00631553-384d-4604-961f-efac7258603a', '9f6196e6-6005-4698-8e4e-e252809011bf'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:44:36.219909 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-088d14e0-3917-4732-8afa-9b2814a44db3 tempest-ServerActionsTestJSON-1210636320 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:44:36.243568 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-088d14e0-3917-4732-8afa-9b2814a44db3 tempest-ServerActionsTestJSON-1210636320 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:44:36.269057 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-088d14e0-3917-4732-8afa-9b2814a44db3 tempest-ServerActionsTestJSON-1210636320 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:44:36.274269 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-088d14e0-3917-4732-8afa-9b2814a44db3 tempest-ServerActionsTestJSON-1210636320 None] Deleted volume successfully. Jun 25 21:44:36.288817 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-088d14e0-3917-4732-8afa-9b2814a44db3 tempest-ServerActionsTestJSON-1210636320 None] Lock "b'cinder-f533e81c-9e79-499b-b6ce-b38f2384d888-delete_volume'" released by "delete_volume" :: held 0.395s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:44:46.278784 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=11,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:44:52.180221 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:44:52.181344 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:44:52.217291 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:44:52.243370 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:45:15.293838 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=20,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:45:25.290332 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:UPDATE=3,cinder:SELECT=4 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:45:45.294373 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:45:52.179913 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:45:52.182210 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:45:52.229393 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:45:52.280183 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:46:05.296613 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:46:15.309133 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:UPDATE=2,cinder:SELECT=5 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:46:24.226555 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-98310add-5af9-41a6-970f-fe9379d979ec tempest-TestMinimumBasicScenario-700856057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:46:24.246209 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-98310add-5af9-41a6-970f-fe9379d979ec tempest-TestMinimumBasicScenario-700856057 None] Flow 'volume_create_manager' (7c210da1-40e9-402c-92cb-695470051239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:46:24.252642 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-98310add-5af9-41a6-970f-fe9379d979ec tempest-TestMinimumBasicScenario-700856057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (692e15e3-99bf-41c2-b23b-6e63fa163f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:46:24.268809 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-98310add-5af9-41a6-970f-fe9379d979ec tempest-TestMinimumBasicScenario-700856057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (692e15e3-99bf-41c2-b23b-6e63fa163f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:46:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1274094404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d71ea031-7686-4a9e-b248-7fbd51e5acf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1aca77315704d338f4f0f881e741a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:46:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:46:24Z,use_quota=True,user_id='53b9cc03262c41d682254f9cf61f34a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:46:24.274006 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-98310add-5af9-41a6-970f-fe9379d979ec tempest-TestMinimumBasicScenario-700856057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c51553f2-e589-4fc2-a682-fb3f3f13221e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:46:24.278017 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-98310add-5af9-41a6-970f-fe9379d979ec tempest-TestMinimumBasicScenario-700856057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c51553f2-e589-4fc2-a682-fb3f3f13221e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:46:24.283042 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-98310add-5af9-41a6-970f-fe9379d979ec tempest-TestMinimumBasicScenario-700856057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0300546-a478-40a0-967e-6eb3c9fed583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:46:24.286955 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-98310add-5af9-41a6-970f-fe9379d979ec tempest-TestMinimumBasicScenario-700856057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0300546-a478-40a0-967e-6eb3c9fed583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd71ea031-7686-4a9e-b248-7fbd51e5acf0', 'volume_name': 'volume-d71ea031-7686-4a9e-b248-7fbd51e5acf0', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:46:24.291710 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-98310add-5af9-41a6-970f-fe9379d979ec tempest-TestMinimumBasicScenario-700856057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49706a8c-e4af-4fb5-8859-4b95214aee97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:46:24.295505 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-98310add-5af9-41a6-970f-fe9379d979ec tempest-TestMinimumBasicScenario-700856057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49706a8c-e4af-4fb5-8859-4b95214aee97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:46:24.300292 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-98310add-5af9-41a6-970f-fe9379d979ec tempest-TestMinimumBasicScenario-700856057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2b689a8-f23b-4aa3-8d76-5f42742342f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:46:24.301370 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-98310add-5af9-41a6-970f-fe9379d979ec tempest-TestMinimumBasicScenario-700856057 None] Volume d71ea031-7686-4a9e-b248-7fbd51e5acf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d71ea031-7686-4a9e-b248-7fbd51e5acf0', 'volume_size': 1} Jun 25 21:46:24.301765 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-98310add-5af9-41a6-970f-fe9379d979ec tempest-TestMinimumBasicScenario-700856057 None] creating volume 'volume-d71ea031-7686-4a9e-b248-7fbd51e5acf0' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:46:24.302532 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-98310add-5af9-41a6-970f-fe9379d979ec tempest-TestMinimumBasicScenario-700856057 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:46:24.360294 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-98310add-5af9-41a6-970f-fe9379d979ec tempest-TestMinimumBasicScenario-700856057 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:46:24.360695 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-98310add-5af9-41a6-970f-fe9379d979ec tempest-TestMinimumBasicScenario-700856057 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:46:24.364284 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-98310add-5af9-41a6-970f-fe9379d979ec tempest-TestMinimumBasicScenario-700856057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2b689a8-f23b-4aa3-8d76-5f42742342f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d71ea031-7686-4a9e-b248-7fbd51e5acf0', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:46:24.368778 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-98310add-5af9-41a6-970f-fe9379d979ec tempest-TestMinimumBasicScenario-700856057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b64fa11f-63c3-4d57-bfb9-eac2fe6274e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:46:24.380789 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-98310add-5af9-41a6-970f-fe9379d979ec tempest-TestMinimumBasicScenario-700856057 None] Volume volume-d71ea031-7686-4a9e-b248-7fbd51e5acf0 (d71ea031-7686-4a9e-b248-7fbd51e5acf0): created successfully Jun 25 21:46:24.384579 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-98310add-5af9-41a6-970f-fe9379d979ec tempest-TestMinimumBasicScenario-700856057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b64fa11f-63c3-4d57-bfb9-eac2fe6274e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:46:24.389962 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-98310add-5af9-41a6-970f-fe9379d979ec tempest-TestMinimumBasicScenario-700856057 None] Flow 'volume_create_manager' (7c210da1-40e9-402c-92cb-695470051239) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:46:24.401428 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-98310add-5af9-41a6-970f-fe9379d979ec tempest-TestMinimumBasicScenario-700856057 None] Created volume successfully. Jun 25 21:46:25.817408 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-cc8f7173-786e-441f-9425-b9ef9851a456 req-045acfef-7463-4795-992f-43f46d58e630 tempest-TestMinimumBasicScenario-700856057 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 21:46:26.596307 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-cc8f7173-786e-441f-9425-b9ef9851a456 req-045acfef-7463-4795-992f-43f46d58e630 tempest-TestMinimumBasicScenario-700856057 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.778s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 21:46:26.597192 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-cc8f7173-786e-441f-9425-b9ef9851a456 req-045acfef-7463-4795-992f-43f46d58e630 tempest-TestMinimumBasicScenario-700856057 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d71ea031-7686-4a9e-b248-7fbd51e5acf0', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': 'd71ea031-7686-4a9e-b248-7fbd51e5acf0', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 21:46:26.624902 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-cc8f7173-786e-441f-9425-b9ef9851a456 req-045acfef-7463-4795-992f-43f46d58e630 tempest-TestMinimumBasicScenario-700856057 None] Connection info returned from driver {'name': 'volumes/volume-d71ea031-7686-4a9e-b248-7fbd51e5acf0', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd71ea031-7686-4a9e-b248-7fbd51e5acf0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'aa406cb1-db58-42a0-ab9c-7cac088c35a4'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 25 21:46:26.674166 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-cc8f7173-786e-441f-9425-b9ef9851a456 req-045acfef-7463-4795-992f-43f46d58e630 tempest-TestMinimumBasicScenario-700856057 None] attachment_update completed successfully. Jun 25 21:46:29.172738 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-43ab3e1f-b088-4494-8397-bcadab2c9329 tempest-TestMinimumBasicScenario-700856057 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:46:29.639407 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-43ab3e1f-b088-4494-8397-bcadab2c9329 tempest-TestMinimumBasicScenario-700856057 None] Create snapshot completed successfully Jun 25 21:46:45.306072 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=16,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:46:45.308993 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=32,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:46:52.176529 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:46:52.177286 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:46:52.201561 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:46:52.225787 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:47:05.315007 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:47:25.311956 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:47:35.327705 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:47:45.317453 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:47:52.181995 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:47:52.183097 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:47:52.208837 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:47:52.233758 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:48:05.325094 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=4 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:48:15.327229 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:48:35.324249 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:48:35.336505 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:48:52.179117 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:48:52.180280 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:48:52.207132 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:48:52.231320 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:48:55.326791 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:48:56.663628 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-118be354-10a6-4870-88f4-dbd26b418ee2 tempest-TestMinimumBasicScenario-700856057 None] Lock "b'cinder-13bac5b8-0997-4edf-be36-b83aaac0edef-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:48:56.665225 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-118be354-10a6-4870-88f4-dbd26b418ee2 tempest-TestMinimumBasicScenario-700856057 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:49:15.323511 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:49:25.337838 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:49:26.813104 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-118be354-10a6-4870-88f4-dbd26b418ee2 tempest-TestMinimumBasicScenario-700856057 None] Created reservations ['b48905b7-f901-4408-9842-1d7f10441abb', '185f717c-9ff3-4131-9de5-7cb948453f32', 'a714a391-0612-412c-80f2-461c8ceb4f1e', 'b33d4648-7b8a-4ceb-ba39-9bfd5f1f9de0'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:49:26.853096 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-118be354-10a6-4870-88f4-dbd26b418ee2 tempest-TestMinimumBasicScenario-700856057 None] Delete snapshot completed successfully. Jun 25 21:49:26.857688 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-118be354-10a6-4870-88f4-dbd26b418ee2 tempest-TestMinimumBasicScenario-700856057 None] Lock "b'cinder-13bac5b8-0997-4edf-be36-b83aaac0edef-delete_snapshot'" released by "delete_snapshot" :: held 30.194s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:49:52.176585 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:49:52.177658 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:49:52.201476 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:49:52.226103 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:49:55.340561 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=10,cinder:UPDATE=9,cinder:INSERT=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:50:05.337763 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=19,cinder:INSERT=2,cinder:UPDATE=6 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:50:35.348858 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:50:45.343383 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:50:52.181450 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:50:52.182153 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:50:52.206161 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:50:52.230894 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:51:10.238689 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:51:10.250122 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-35fe86b7-b532-4e35-a502-39bc20294d92 req-04d446a8-982c-466c-ab07-2e3adace1a0c tempest-TestMinimumBasicScenario-700856057 None] Terminate volume connection completed successfully. Jun 25 21:51:10.250534 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-35fe86b7-b532-4e35-a502-39bc20294d92 req-04d446a8-982c-466c-ab07-2e3adace1a0c tempest-TestMinimumBasicScenario-700856057 None] Deleting attachment aa406cb1-db58-42a0-ab9c-7cac088c35a4. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 25 21:51:11.023507 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-09be2921-3048-4974-b48e-b94df2a7dd23 tempest-TestMinimumBasicScenario-700856057 None] Lock "b'cinder-d71ea031-7686-4a9e-b248-7fbd51e5acf0-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:51:11.066638 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-09be2921-3048-4974-b48e-b94df2a7dd23 tempest-TestMinimumBasicScenario-700856057 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:51:11.114045 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-09be2921-3048-4974-b48e-b94df2a7dd23 tempest-TestMinimumBasicScenario-700856057 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:51:11.114565 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-09be2921-3048-4974-b48e-b94df2a7dd23 tempest-TestMinimumBasicScenario-700856057 None] Volume volume-d71ea031-7686-4a9e-b248-7fbd51e5acf0 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:51:11.118525 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-09be2921-3048-4974-b48e-b94df2a7dd23 tempest-TestMinimumBasicScenario-700856057 None] deleting rbd volume volume-d71ea031-7686-4a9e-b248-7fbd51e5acf0 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:51:11.317557 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-09be2921-3048-4974-b48e-b94df2a7dd23 tempest-TestMinimumBasicScenario-700856057 None] Created reservations ['85c370ec-d18d-4eca-8601-a548bc569761', 'e6bd81aa-a780-42bf-afaa-b88b9495f9ed', 'a875f953-1532-4b25-b356-7b4a0ba7c477', '22aad827-b9ec-4e4e-8f41-84664770ebe4'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:51:11.367001 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-09be2921-3048-4974-b48e-b94df2a7dd23 tempest-TestMinimumBasicScenario-700856057 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:51:11.399133 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-09be2921-3048-4974-b48e-b94df2a7dd23 tempest-TestMinimumBasicScenario-700856057 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:51:11.425197 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-09be2921-3048-4974-b48e-b94df2a7dd23 tempest-TestMinimumBasicScenario-700856057 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:51:11.429463 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-09be2921-3048-4974-b48e-b94df2a7dd23 tempest-TestMinimumBasicScenario-700856057 None] Deleted volume successfully. Jun 25 21:51:11.444223 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-09be2921-3048-4974-b48e-b94df2a7dd23 tempest-TestMinimumBasicScenario-700856057 None] Lock "b'cinder-d71ea031-7686-4a9e-b248-7fbd51e5acf0-delete_volume'" released by "delete_volume" :: held 0.421s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:51:15.367619 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=18,cinder:UPDATE=7,cinder:INSERT=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:51:35.350023 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=15,cinder:UPDATE=11,cinder:INSERT=2,cinder:DELETE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:51:45.362108 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:51:47.609144 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-29585a84-9d0a-43ff-9e2a-dd631d389c72 tempest-TestMinimumBasicScenario-700856057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 21:51:47.628558 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-29585a84-9d0a-43ff-9e2a-dd631d389c72 tempest-TestMinimumBasicScenario-700856057 None] Flow 'volume_create_manager' (7a4ce6a6-82a0-417e-bb1c-c0056d86cc5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:51:47.634973 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-29585a84-9d0a-43ff-9e2a-dd631d389c72 tempest-TestMinimumBasicScenario-700856057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92eebee1-efab-4428-a7c3-7fb8ece01fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:51:47.651358 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-29585a84-9d0a-43ff-9e2a-dd631d389c72 tempest-TestMinimumBasicScenario-700856057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92eebee1-efab-4428-a7c3-7fb8ece01fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T21:51:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-377565227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1048aa47-e900-4c3e-8db7-58c5919f6ae3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1aca77315704d338f4f0f881e741a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T21:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T21:51:48Z,use_quota=True,user_id='53b9cc03262c41d682254f9cf61f34a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:51:47.656664 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-29585a84-9d0a-43ff-9e2a-dd631d389c72 tempest-TestMinimumBasicScenario-700856057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb083132-9a1b-424c-a94e-8a48ab3052cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:51:47.660632 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-29585a84-9d0a-43ff-9e2a-dd631d389c72 tempest-TestMinimumBasicScenario-700856057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb083132-9a1b-424c-a94e-8a48ab3052cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:51:47.665507 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-29585a84-9d0a-43ff-9e2a-dd631d389c72 tempest-TestMinimumBasicScenario-700856057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b12d2ea-5c69-4bd5-966d-96dd25a61b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:51:47.669481 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-29585a84-9d0a-43ff-9e2a-dd631d389c72 tempest-TestMinimumBasicScenario-700856057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b12d2ea-5c69-4bd5-966d-96dd25a61b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1048aa47-e900-4c3e-8db7-58c5919f6ae3', 'volume_name': 'volume-1048aa47-e900-4c3e-8db7-58c5919f6ae3', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:51:47.674237 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-29585a84-9d0a-43ff-9e2a-dd631d389c72 tempest-TestMinimumBasicScenario-700856057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcc5630c-343e-4669-8869-f7b8ea564af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:51:47.677992 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-29585a84-9d0a-43ff-9e2a-dd631d389c72 tempest-TestMinimumBasicScenario-700856057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcc5630c-343e-4669-8869-f7b8ea564af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:51:47.682488 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-29585a84-9d0a-43ff-9e2a-dd631d389c72 tempest-TestMinimumBasicScenario-700856057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2791ac2a-a4a8-4a69-8cdb-7e2608cdee2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:51:47.683491 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-29585a84-9d0a-43ff-9e2a-dd631d389c72 tempest-TestMinimumBasicScenario-700856057 None] Volume 1048aa47-e900-4c3e-8db7-58c5919f6ae3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1048aa47-e900-4c3e-8db7-58c5919f6ae3', 'volume_size': 1} Jun 25 21:51:47.683902 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-29585a84-9d0a-43ff-9e2a-dd631d389c72 tempest-TestMinimumBasicScenario-700856057 None] creating volume 'volume-1048aa47-e900-4c3e-8db7-58c5919f6ae3' {{(pid=130674) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}} Jun 25 21:51:47.684681 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-29585a84-9d0a-43ff-9e2a-dd631d389c72 tempest-TestMinimumBasicScenario-700856057 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:51:47.743122 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-29585a84-9d0a-43ff-9e2a-dd631d389c72 tempest-TestMinimumBasicScenario-700856057 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 21:51:47.743488 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-29585a84-9d0a-43ff-9e2a-dd631d389c72 tempest-TestMinimumBasicScenario-700856057 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 21:51:47.747168 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-29585a84-9d0a-43ff-9e2a-dd631d389c72 tempest-TestMinimumBasicScenario-700856057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2791ac2a-a4a8-4a69-8cdb-7e2608cdee2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1048aa47-e900-4c3e-8db7-58c5919f6ae3', 'volume_size': 1}' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:51:47.751711 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-29585a84-9d0a-43ff-9e2a-dd631d389c72 tempest-TestMinimumBasicScenario-700856057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f9d73de-2871-44f6-8be2-1b3c90c00013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 21:51:47.763744 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-29585a84-9d0a-43ff-9e2a-dd631d389c72 tempest-TestMinimumBasicScenario-700856057 None] Volume volume-1048aa47-e900-4c3e-8db7-58c5919f6ae3 (1048aa47-e900-4c3e-8db7-58c5919f6ae3): created successfully Jun 25 21:51:47.767370 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-29585a84-9d0a-43ff-9e2a-dd631d389c72 tempest-TestMinimumBasicScenario-700856057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f9d73de-2871-44f6-8be2-1b3c90c00013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 21:51:47.772782 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-29585a84-9d0a-43ff-9e2a-dd631d389c72 tempest-TestMinimumBasicScenario-700856057 None] Flow 'volume_create_manager' (7a4ce6a6-82a0-417e-bb1c-c0056d86cc5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 21:51:47.782127 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-29585a84-9d0a-43ff-9e2a-dd631d389c72 tempest-TestMinimumBasicScenario-700856057 None] Created volume successfully. Jun 25 21:51:49.216871 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-dbc4ada3-ab18-4170-8e96-2342bd39ab42 req-c9f2ffd5-77ff-42c4-9864-12d5b814f5f7 tempest-TestMinimumBasicScenario-700856057 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 21:51:49.963825 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-dbc4ada3-ab18-4170-8e96-2342bd39ab42 req-c9f2ffd5-77ff-42c4-9864-12d5b814f5f7 tempest-TestMinimumBasicScenario-700856057 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.746s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 21:51:49.965097 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-dbc4ada3-ab18-4170-8e96-2342bd39ab42 req-c9f2ffd5-77ff-42c4-9864-12d5b814f5f7 tempest-TestMinimumBasicScenario-700856057 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1048aa47-e900-4c3e-8db7-58c5919f6ae3', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': '1048aa47-e900-4c3e-8db7-58c5919f6ae3', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 21:51:50.000606 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-dbc4ada3-ab18-4170-8e96-2342bd39ab42 req-c9f2ffd5-77ff-42c4-9864-12d5b814f5f7 tempest-TestMinimumBasicScenario-700856057 None] Connection info returned from driver {'name': 'volumes/volume-1048aa47-e900-4c3e-8db7-58c5919f6ae3', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1048aa47-e900-4c3e-8db7-58c5919f6ae3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '85f8e4ee-e28c-4da5-b453-2268f0c2b772'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 25 21:51:50.052588 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-dbc4ada3-ab18-4170-8e96-2342bd39ab42 req-c9f2ffd5-77ff-42c4-9864-12d5b814f5f7 tempest-TestMinimumBasicScenario-700856057 None] attachment_update completed successfully. Jun 25 21:51:52.186020 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:51:52.187124 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:51:52.219652 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:51:52.251669 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:52:05.362811 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=15,cinder:UPDATE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:52:05.374549 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=23,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:52:35.363130 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:52:45.367766 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:UPDATE=3,cinder:SELECT=7 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:52:52.187893 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:52:52.188971 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:52:52.218842 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:52:52.242745 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:53:05.371165 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:53:15.383807 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:53:35.386244 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:53:45.377072 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:53:52.189183 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:53:52.190292 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:53:52.218080 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:53:52.241839 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:54:07.173563 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:54:07.186111 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-bd8592ef-88a6-415f-ba9f-9dce4d84b422 req-59101000-f55a-46e2-be7f-4ad482a13c24 tempest-TestMinimumBasicScenario-700856057 None] Terminate volume connection completed successfully. Jun 25 21:54:07.186599 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-bd8592ef-88a6-415f-ba9f-9dce4d84b422 req-59101000-f55a-46e2-be7f-4ad482a13c24 tempest-TestMinimumBasicScenario-700856057 None] Deleting attachment 85f8e4ee-e28c-4da5-b453-2268f0c2b772. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 25 21:54:07.721541 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-5ed73bb9-9007-4d6d-bcca-2cef279c38c0 tempest-TestMinimumBasicScenario-700856057 None] Lock "b'cinder-1048aa47-e900-4c3e-8db7-58c5919f6ae3-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 21:54:07.755860 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5ed73bb9-9007-4d6d-bcca-2cef279c38c0 tempest-TestMinimumBasicScenario-700856057 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:54:07.795247 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5ed73bb9-9007-4d6d-bcca-2cef279c38c0 tempest-TestMinimumBasicScenario-700856057 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 21:54:07.795699 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5ed73bb9-9007-4d6d-bcca-2cef279c38c0 tempest-TestMinimumBasicScenario-700856057 None] Volume volume-1048aa47-e900-4c3e-8db7-58c5919f6ae3 is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 21:54:07.801855 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5ed73bb9-9007-4d6d-bcca-2cef279c38c0 tempest-TestMinimumBasicScenario-700856057 None] deleting rbd volume volume-1048aa47-e900-4c3e-8db7-58c5919f6ae3 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 21:54:07.998378 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [None req-5ed73bb9-9007-4d6d-bcca-2cef279c38c0 tempest-TestMinimumBasicScenario-700856057 None] Created reservations ['2e3299e9-0798-4eb2-acdb-09022b4107cb', '764ad692-7cdc-4fa8-9970-e45aad3f38d8', '0ea2eacf-78e0-461d-85d0-339266b9de01', 'd26cf285-cec9-4085-90f2-0718421ad826'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 21:54:08.046284 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5ed73bb9-9007-4d6d-bcca-2cef279c38c0 tempest-TestMinimumBasicScenario-700856057 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:54:08.070283 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-5ed73bb9-9007-4d6d-bcca-2cef279c38c0 tempest-TestMinimumBasicScenario-700856057 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:54:08.095729 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-5ed73bb9-9007-4d6d-bcca-2cef279c38c0 tempest-TestMinimumBasicScenario-700856057 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:54:08.099977 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-5ed73bb9-9007-4d6d-bcca-2cef279c38c0 tempest-TestMinimumBasicScenario-700856057 None] Deleted volume successfully. Jun 25 21:54:08.113529 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-5ed73bb9-9007-4d6d-bcca-2cef279c38c0 tempest-TestMinimumBasicScenario-700856057 None] Lock "b'cinder-1048aa47-e900-4c3e-8db7-58c5919f6ae3-delete_volume'" released by "delete_volume" :: held 0.392s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 21:54:15.387033 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=22,cinder:UPDATE=8,cinder:INSERT=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:54:35.385876 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=14,cinder:UPDATE=11,cinder:INSERT=3,cinder:DELETE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:54:52.186803 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:54:52.187644 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:54:52.219217 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:54:52.243369 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:54:55.391460 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:54:55.392587 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:55:15.398546 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:55:25.406889 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:55:25.408005 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:55:45.406460 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:55:52.189201 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:55:52.190010 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:55:52.220967 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:55:52.244104 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:56:05.407141 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:UPDATE=2,cinder:SELECT=8 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:56:05.408717 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:56:35.420852 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:56:35.423332 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:56:52.189842 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:56:52.190863 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:56:52.222688 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:56:52.247529 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:57:15.422708 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:57:15.425387 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:57:45.424574 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:57:52.192449 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:57:52.193167 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:57:52.217105 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:57:52.241369 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:57:55.424092 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:58:15.431963 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:58:15.437203 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:58:45.439637 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:58:52.196959 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:58:52.198068 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:58:52.233064 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:58:52.259010 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:58:55.439407 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:59:15.450674 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:59:25.451491 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:59:52.193932 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 21:59:52.194681 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:59:52.226323 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 21:59:52.256048 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 21:59:55.448602 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:00:05.447288 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:00:15.480107 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:00:45.457078 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:00:52.191332 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 22:00:52.192114 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:00:52.216014 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:00:52.246099 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 22:00:55.452357 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:UPDATE=2,cinder:SELECT=5 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:01:15.462314 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:01:15.468775 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:01:35.464829 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:01:45.472667 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:UPDATE=3,cinder:SELECT=7 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:01:52.192294 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 22:01:52.192999 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:01:52.219555 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:01:52.242644 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 22:02:05.470188 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:02:15.487630 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:02:35.483697 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:02:52.198432 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 22:02:52.199503 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:02:52.235546 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:02:52.269248 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 22:02:55.490912 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:02:55.497102 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:03:25.508027 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:03:25.510082 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:03:52.197100 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 22:03:52.197880 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:03:52.223413 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:03:52.250985 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 22:04:05.490675 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:04:05.493561 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:04:45.500192 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:04:52.196522 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 22:04:52.197209 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:04:52.223378 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:04:52.249282 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 22:04:55.497172 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:05:05.511086 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:05:35.510683 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:05:45.510897 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:05:52.194074 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 22:05:52.194756 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:05:52.224803 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:05:52.261217 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 22:06:05.521160 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:06:25.515407 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:06:45.515062 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:06:55.529950 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:07:15.528042 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=4 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:07:35.531227 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:07:45.540754 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:07:52.197613 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 22:07:52.198609 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:07:52.224694 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:07:52.250666 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 22:08:05.551636 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:08:25.543500 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:08:45.539586 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:08:45.541541 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:08:52.196127 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 22:08:52.196955 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:08:52.227812 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:08:52.259898 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 22:09:05.553044 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:09:15.561152 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:09:35.566482 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:09:35.572238 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:09:52.195456 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 22:09:52.196207 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:09:52.225001 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:09:52.249688 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 22:10:05.555137 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:UPDATE=2,cinder:SELECT=4 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:10:15.569734 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:10:35.569764 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:10:52.197250 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 22:10:52.199332 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:10:52.228950 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:10:52.253799 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 22:10:55.574815 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:11:02.976165 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-0549222e-e07e-49cf-b512-f71b1db9807a tempest-TestShelveInstance-1899059185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=130674) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1359}} Jun 25 22:11:02.995587 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0549222e-e07e-49cf-b512-f71b1db9807a tempest-TestShelveInstance-1899059185 None] Flow 'volume_create_manager' (77b62409-1ee0-4684-8b3c-a475624ff744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 22:11:03.001954 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0549222e-e07e-49cf-b512-f71b1db9807a tempest-TestShelveInstance-1899059185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08d50ea3-2fe0-4cae-a1b4-89690148596d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 22:11:03.018306 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0549222e-e07e-49cf-b512-f71b1db9807a tempest-TestShelveInstance-1899059185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08d50ea3-2fe0-4cae-a1b4-89690148596d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2022-06-25T22:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1757687640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=51685089-e2ae-4572-8638-311f0ca7d2b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7659c265b2b14bdb9ac0b22dfbb8d2ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-06-25T22:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2022-06-25T22:11:03Z,use_quota=True,user_id='bd5bd999a2b74f6b820b67f376486e7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0),volume_type_id=1a044ce3-93e2-4f61-9a90-8c6c10d1f9a0)' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 22:11:03.023481 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0549222e-e07e-49cf-b512-f71b1db9807a tempest-TestShelveInstance-1899059185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (677f9988-88f5-4d67-841f-86ce3a312ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 22:11:03.027569 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0549222e-e07e-49cf-b512-f71b1db9807a tempest-TestShelveInstance-1899059185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (677f9988-88f5-4d67-841f-86ce3a312ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 22:11:03.032482 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0549222e-e07e-49cf-b512-f71b1db9807a tempest-TestShelveInstance-1899059185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dccc640-a520-43eb-83c7-bb3e37e21685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 22:11:03.119693 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0549222e-e07e-49cf-b512-f71b1db9807a tempest-TestShelveInstance-1899059185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dccc640-a520-43eb-83c7-bb3e37e21685) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '51685089-e2ae-4572-8638-311f0ca7d2b7', 'volume_name': 'volume-51685089-e2ae-4572-8638-311f0ca7d2b7', 'volume_size': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d98522b7634403f83ff66fd72edfd9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'created_at': datetime.datetime(2022, 6, 25, 20, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5741eca-b932-4865-b29a-bd2a12a73795/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 22:11:03.124491 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0549222e-e07e-49cf-b512-f71b1db9807a tempest-TestShelveInstance-1899059185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17bfb787-268b-4099-8fcc-c243131308a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 22:11:03.128299 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0549222e-e07e-49cf-b512-f71b1db9807a tempest-TestShelveInstance-1899059185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17bfb787-268b-4099-8fcc-c243131308a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 22:11:03.133160 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0549222e-e07e-49cf-b512-f71b1db9807a tempest-TestShelveInstance-1899059185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebcc4182-3123-47df-9639-f51720a775ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 22:11:03.134252 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-0549222e-e07e-49cf-b512-f71b1db9807a tempest-TestShelveInstance-1899059185 None] Volume 51685089-e2ae-4572-8638-311f0ca7d2b7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-51685089-e2ae-4572-8638-311f0ca7d2b7', 'volume_size': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d98522b7634403f83ff66fd72edfd9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'created_at': datetime.datetime(2022, 6, 25, 20, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5741eca-b932-4865-b29a-bd2a12a73795/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 25 22:11:03.134817 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-0549222e-e07e-49cf-b512-f71b1db9807a tempest-TestShelveInstance-1899059185 None] Cloning 51685089-e2ae-4572-8638-311f0ca7d2b7 from image c5741eca-b932-4865-b29a-bd2a12a73795 at location (None, None). {{(pid=130674) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1062}} Jun 25 22:11:03.173171 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-0549222e-e07e-49cf-b512-f71b1db9807a tempest-TestShelveInstance-1899059185 None] Lock "b'cinder-c5741eca-b932-4865-b29a-bd2a12a73795'" acquired by "_prepare_image_cache_entry" :: waited 0.038s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 22:11:03.184172 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-0549222e-e07e-49cf-b512-f71b1db9807a tempest-TestShelveInstance-1899059185 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'volume_id': 'c8878629-87cd-43d0-b2bd-d32c807cd322', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53), 'last_used': datetime.datetime(2022, 6, 25, 22, 11, 3, 177377)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 25 22:11:03.184693 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-0549222e-e07e-49cf-b512-f71b1db9807a tempest-TestShelveInstance-1899059185 None] Image-volume cache entry image_update_at = 2022-06-25 20:42:53+00:00, requested image updated_at = 2022-06-25 20:42:53+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 25 22:11:03.185242 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-0549222e-e07e-49cf-b512-f71b1db9807a tempest-TestShelveInstance-1899059185 None] Found cache entry for image = c5741eca-b932-4865-b29a-bd2a12a73795 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:877}} Jun 25 22:11:03.199201 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [None req-0549222e-e07e-49cf-b512-f71b1db9807a tempest-TestShelveInstance-1899059185 None] Lock "b'cinder-c5741eca-b932-4865-b29a-bd2a12a73795'" released by "_prepare_image_cache_entry" :: held 0.026s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 22:11:03.200121 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-0549222e-e07e-49cf-b512-f71b1db9807a tempest-TestShelveInstance-1899059185 None] Attempting to retrieve cache entry for image = c5741eca-b932-4865-b29a-bd2a12a73795 on host ncdv-master-1@ceph#ceph. {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:818}} Jun 25 22:11:03.206290 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-0549222e-e07e-49cf-b512-f71b1db9807a tempest-TestShelveInstance-1899059185 None] Found image-volume cache entry: {'id': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'volume_id': 'c8878629-87cd-43d0-b2bd-d32c807cd322', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53), 'last_used': datetime.datetime(2022, 6, 25, 22, 11, 3, 203957)}. {{(pid=130674) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Jun 25 22:11:03.206704 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.image.cache [None req-0549222e-e07e-49cf-b512-f71b1db9807a tempest-TestShelveInstance-1899059185 None] Image-volume cache entry image_update_at = 2022-06-25 20:42:53+00:00, requested image updated_at = 2022-06-25 20:42:53+00:00. {{(pid=130674) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Jun 25 22:11:03.207082 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-0549222e-e07e-49cf-b512-f71b1db9807a tempest-TestShelveInstance-1899059185 None] Creating from source image-volume c8878629-87cd-43d0-b2bd-d32c807cd322 {{(pid=130674) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:832}} Jun 25 22:11:03.219448 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0549222e-e07e-49cf-b512-f71b1db9807a tempest-TestShelveInstance-1899059185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:11:03.292075 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0549222e-e07e-49cf-b512-f71b1db9807a tempest-TestShelveInstance-1899059185 None] creating snapshot='volume-51685089-e2ae-4572-8638-311f0ca7d2b7.clone_snap' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}} Jun 25 22:11:03.855949 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0549222e-e07e-49cf-b512-f71b1db9807a tempest-TestShelveInstance-1899059185 None] cloning 'volume-c8878629-87cd-43d0-b2bd-d32c807cd322@volume-51685089-e2ae-4572-8638-311f0ca7d2b7.clone_snap' to 'volume-51685089-e2ae-4572-8638-311f0ca7d2b7' {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}} Jun 25 22:11:04.006648 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0549222e-e07e-49cf-b512-f71b1db9807a tempest-TestShelveInstance-1899059185 None] Volume volume-74f093be-e96a-4a80-ad38-abd3f5585611.deleted is not a clone. {{(pid=130674) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}} Jun 25 22:11:04.007850 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0549222e-e07e-49cf-b512-f71b1db9807a tempest-TestShelveInstance-1899059185 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}} Jun 25 22:11:04.008257 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0549222e-e07e-49cf-b512-f71b1db9807a tempest-TestShelveInstance-1899059185 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=130674) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}} Jun 25 22:11:04.029964 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-0549222e-e07e-49cf-b512-f71b1db9807a tempest-TestShelveInstance-1899059185 None] clone created successfully {{(pid=130674) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}} Jun 25 22:11:04.030944 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.volume_utils [None req-0549222e-e07e-49cf-b512-f71b1db9807a tempest-TestShelveInstance-1899059185 None] Marking volume 51685089-e2ae-4572-8638-311f0ca7d2b7 as bootable. {{(pid=130674) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1131}} Jun 25 22:11:04.047783 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-0549222e-e07e-49cf-b512-f71b1db9807a tempest-TestShelveInstance-1899059185 None] Copying metadata from image c5741eca-b932-4865-b29a-bd2a12a73795 to 51685089-e2ae-4572-8638-311f0ca7d2b7. {{(pid=130674) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}} Jun 25 22:11:04.048132 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.flows.manager.create_volume [None req-0549222e-e07e-49cf-b512-f71b1db9807a tempest-TestShelveInstance-1899059185 None] Creating volume glance metadata for volume 51685089-e2ae-4572-8638-311f0ca7d2b7 backed by image c5741eca-b932-4865-b29a-bd2a12a73795 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=130674) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:674}} Jun 25 22:11:04.104879 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0549222e-e07e-49cf-b512-f71b1db9807a tempest-TestShelveInstance-1899059185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebcc4182-3123-47df-9639-f51720a775ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51685089-e2ae-4572-8638-311f0ca7d2b7', 'volume_size': 1, 'image_id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d98522b7634403f83ff66fd72edfd9e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'created_at': datetime.datetime(2022, 6, 25, 20, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 6, 25, 20, 42, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5741eca-b932-4865-b29a-bd2a12a73795/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 22:11:04.109291 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0549222e-e07e-49cf-b512-f71b1db9807a tempest-TestShelveInstance-1899059185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d96f23d9-7348-45ab-a88d-72afd840ab3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jun 25 22:11:04.119780 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.flows.manager.create_volume [None req-0549222e-e07e-49cf-b512-f71b1db9807a tempest-TestShelveInstance-1899059185 None] Volume volume-51685089-e2ae-4572-8638-311f0ca7d2b7 (51685089-e2ae-4572-8638-311f0ca7d2b7): created successfully Jun 25 22:11:04.123491 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0549222e-e07e-49cf-b512-f71b1db9807a tempest-TestShelveInstance-1899059185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d96f23d9-7348-45ab-a88d-72afd840ab3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=130674) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jun 25 22:11:04.128822 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [None req-0549222e-e07e-49cf-b512-f71b1db9807a tempest-TestShelveInstance-1899059185 None] Flow 'volume_create_manager' (77b62409-1ee0-4684-8b3c-a475624ff744) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=130674) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jun 25 22:11:04.137591 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [None req-0549222e-e07e-49cf-b512-f71b1db9807a tempest-TestShelveInstance-1899059185 None] Created volume successfully. Jun 25 22:11:07.430432 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=24,cinder:UPDATE=6,cinder:INSERT=4 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:11:07.441838 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-2939a275-b335-44b9-88d1-f1cd89289cf0 req-60eb1921-11ea-4940-b1bf-b5d1cbe57547 tempest-TestShelveInstance-1899059185 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 22:11:08.251045 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-2939a275-b335-44b9-88d1-f1cd89289cf0 req-60eb1921-11ea-4940-b1bf-b5d1cbe57547 tempest-TestShelveInstance-1899059185 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.809s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 22:11:08.252321 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-2939a275-b335-44b9-88d1-f1cd89289cf0 req-60eb1921-11ea-4940-b1bf-b5d1cbe57547 tempest-TestShelveInstance-1899059185 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-51685089-e2ae-4572-8638-311f0ca7d2b7', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': '51685089-e2ae-4572-8638-311f0ca7d2b7', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 22:11:08.280708 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-2939a275-b335-44b9-88d1-f1cd89289cf0 req-60eb1921-11ea-4940-b1bf-b5d1cbe57547 tempest-TestShelveInstance-1899059185 None] Connection info returned from driver {'name': 'volumes/volume-51685089-e2ae-4572-8638-311f0ca7d2b7', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '51685089-e2ae-4572-8638-311f0ca7d2b7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'd9029417-5965-4913-9a6c-7053c6b26d63'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 25 22:11:08.332677 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-2939a275-b335-44b9-88d1-f1cd89289cf0 req-60eb1921-11ea-4940-b1bf-b5d1cbe57547 tempest-TestShelveInstance-1899059185 None] attachment_update completed successfully. Jun 25 22:11:25.576391 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=24,cinder:UPDATE=5,cinder:INSERT=8,cinder:DELETE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:11:45.590001 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=18,cinder:UPDATE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:11:52.200125 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 22:11:52.200946 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:11:52.231149 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:11:52.259243 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 22:12:05.591009 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:12:15.605153 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:12:35.609917 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:12:35.610717 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=7 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:12:52.205731 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 22:12:52.206836 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:12:52.234656 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:12:52.258367 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 22:13:05.618487 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:UPDATE=2,cinder:SELECT=5 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:13:15.609817 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:13:35.620737 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:13:36.760008 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-0f8de16f-3a86-445e-9278-fc0d7b8d9ad4 req-eb29af65-8aef-4a48-997c-51c25e2b4e44 tempest-TestShelveInstance-1899059185 None] Terminate volume connection completed successfully. Jun 25 22:13:36.760752 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-0f8de16f-3a86-445e-9278-fc0d7b8d9ad4 req-eb29af65-8aef-4a48-997c-51c25e2b4e44 tempest-TestShelveInstance-1899059185 None] Deleting attachment d9029417-5965-4913-9a6c-7053c6b26d63. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 25 22:13:38.499562 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-b41f9bda-6ae7-4d33-8799-fede027f0a9c req-6b747a33-a39d-42a0-b074-a56895a8be33 tempest-TestShelveInstance-1899059185 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 22:13:39.242503 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_concurrency.processutils [req-b41f9bda-6ae7-4d33-8799-fede027f0a9c req-6b747a33-a39d-42a0-b074-a56895a8be33 tempest-TestShelveInstance-1899059185 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.742s {{(pid=130674) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 22:13:39.243643 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-b41f9bda-6ae7-4d33-8799-fede027f0a9c req-6b747a33-a39d-42a0-b074-a56895a8be33 tempest-TestShelveInstance-1899059185 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-51685089-e2ae-4572-8638-311f0ca7d2b7', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'b1fae50d-3f02-47a8-90c2-b7e0c0e1be59', 'volume_id': '51685089-e2ae-4572-8638-311f0ca7d2b7', 'discard': True}} {{(pid=130674) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}} Jun 25 22:13:39.271245 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-b41f9bda-6ae7-4d33-8799-fede027f0a9c req-6b747a33-a39d-42a0-b074-a56895a8be33 tempest-TestShelveInstance-1899059185 None] Connection info returned from driver {'name': 'volumes/volume-51685089-e2ae-4572-8638-311f0ca7d2b7', 'hosts': ['10.222.0.39'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '51685089-e2ae-4572-8638-311f0ca7d2b7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'e87b5404-fadf-4dca-b1d6-d45121af20f7'} {{(pid=130674) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4827}} Jun 25 22:13:39.323120 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-b41f9bda-6ae7-4d33-8799-fede027f0a9c req-6b747a33-a39d-42a0-b074-a56895a8be33 tempest-TestShelveInstance-1899059185 None] attachment_update completed successfully. Jun 25 22:13:45.627225 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:UPDATE=4,cinder:SELECT=20 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:13:52.205395 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 22:13:52.206683 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:13:52.236992 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:13:52.263930 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 22:14:15.628395 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=14,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:14:15.638112 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:14:45.638825 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:UPDATE=2,cinder:SELECT=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:14:52.209770 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 22:14:52.210919 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:14:52.245639 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:14:52.271390 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 22:14:55.638867 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:15:16.950058 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:15:16.965177 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-5a48ad75-6d28-4b88-8ff0-c18cd00b96e2 req-7bbea09a-26c1-40b5-a1b4-161a541651ee tempest-TestShelveInstance-1899059185 None] Terminate volume connection completed successfully. Jun 25 22:15:16.965593 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.manager [req-5a48ad75-6d28-4b88-8ff0-c18cd00b96e2 req-7bbea09a-26c1-40b5-a1b4-161a541651ee tempest-TestShelveInstance-1899059185 None] Deleting attachment e87b5404-fadf-4dca-b1d6-d45121af20f7. {{(pid=130674) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4958}} Jun 25 22:15:17.093863 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [req-5a48ad75-6d28-4b88-8ff0-c18cd00b96e2 req-6953c2c9-be68-4a66-b765-6c128346dde8 tempest-TestShelveInstance-1899059185 None] Lock "b'cinder-51685089-e2ae-4572-8638-311f0ca7d2b7-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:191}} Jun 25 22:15:17.132257 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-5a48ad75-6d28-4b88-8ff0-c18cd00b96e2 req-6953c2c9-be68-4a66-b765-6c128346dde8 tempest-TestShelveInstance-1899059185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:15:17.218255 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-5a48ad75-6d28-4b88-8ff0-c18cd00b96e2 req-6953c2c9-be68-4a66-b765-6c128346dde8 tempest-TestShelveInstance-1899059185 None] volume has no backup snaps {{(pid=130674) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}} Jun 25 22:15:17.225070 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-5a48ad75-6d28-4b88-8ff0-c18cd00b96e2 req-6953c2c9-be68-4a66-b765-6c128346dde8 tempest-TestShelveInstance-1899059185 None] deleting rbd volume volume-51685089-e2ae-4572-8638-311f0ca7d2b7 {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}} Jun 25 22:15:17.421695 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-5a48ad75-6d28-4b88-8ff0-c18cd00b96e2 req-6953c2c9-be68-4a66-b765-6c128346dde8 tempest-TestShelveInstance-1899059185 None] volume is a clone so cleaning references {{(pid=130674) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}} Jun 25 22:15:17.452110 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-5a48ad75-6d28-4b88-8ff0-c18cd00b96e2 req-6953c2c9-be68-4a66-b765-6c128346dde8 tempest-TestShelveInstance-1899059185 None] deleting parent snapshot volume-51685089-e2ae-4572-8638-311f0ca7d2b7.clone_snap {{(pid=130674) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}} Jun 25 22:15:17.751094 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.quota [req-5a48ad75-6d28-4b88-8ff0-c18cd00b96e2 req-6953c2c9-be68-4a66-b765-6c128346dde8 tempest-TestShelveInstance-1899059185 None] Created reservations ['22b8421a-3008-4e5a-b9b0-d7505feec711', 'a588df40-8413-4ecc-96ad-e33ec0afef7b', 'd420b0c5-f69f-438f-9082-526b1cf869c7', 'b13b68b2-7982-4ef6-80e0-1dbc1a295ecc'] {{(pid=130674) reserve /opt/stack/cinder/cinder/quota.py:755}} Jun 25 22:15:17.806381 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-5a48ad75-6d28-4b88-8ff0-c18cd00b96e2 req-6953c2c9-be68-4a66-b765-6c128346dde8 tempest-TestShelveInstance-1899059185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:15:17.831835 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [req-5a48ad75-6d28-4b88-8ff0-c18cd00b96e2 req-6953c2c9-be68-4a66-b765-6c128346dde8 tempest-TestShelveInstance-1899059185 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:15:17.856350 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [req-5a48ad75-6d28-4b88-8ff0-c18cd00b96e2 req-6953c2c9-be68-4a66-b765-6c128346dde8 tempest-TestShelveInstance-1899059185 None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 22:15:17.860783 ncdv-master-1 cinder-volume[130674]: INFO cinder.volume.manager [req-5a48ad75-6d28-4b88-8ff0-c18cd00b96e2 req-6953c2c9-be68-4a66-b765-6c128346dde8 tempest-TestShelveInstance-1899059185 None] Deleted volume successfully. Jun 25 22:15:17.874583 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.coordination [req-5a48ad75-6d28-4b88-8ff0-c18cd00b96e2 req-6953c2c9-be68-4a66-b765-6c128346dde8 tempest-TestShelveInstance-1899059185 None] Lock "b'cinder-51685089-e2ae-4572-8638-311f0ca7d2b7-delete_volume'" released by "delete_volume" :: held 0.781s {{(pid=130674) _synchronized /opt/stack/cinder/cinder/coordination.py:203}} Jun 25 22:15:35.631314 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=20,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:15:52.206722 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 22:15:52.207903 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:15:52.242118 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:15:52.266488 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 22:15:55.633042 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=19,cinder:UPDATE=11,cinder:INSERT=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:16:15.639776 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:16:35.638103 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:16:52.212641 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 22:16:52.217979 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:16:52.243728 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:16:52.267479 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 22:16:55.636013 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:17:15.630900 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:17:35.632094 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:17:35.633864 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:17:52.212735 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 22:17:52.214053 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:17:52.238952 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:17:52.263441 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 22:18:05.643801 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:18:05.645365 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:18:35.659835 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=7 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:18:35.662094 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:18:52.208291 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 22:18:52.209034 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:18:52.251289 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:18:52.287537 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 22:18:55.652206 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:19:15.658268 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:19:15.663108 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:19:35.665802 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:19:45.676673 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:19:52.214176 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 22:19:52.214973 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:19:52.243970 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:19:52.268018 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 22:20:05.670373 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:20:25.679497 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:20:45.674792 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:20:52.212996 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 22:20:52.213643 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:20:52.241085 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:20:52.273227 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 22:21:05.686779 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:21:15.692538 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:21:45.684241 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:21:45.691164 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:21:52.218651 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 22:21:52.219956 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:21:52.291661 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:21:52.325568 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 22:22:05.687552 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:22:15.704146 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:22:35.708397 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:22:52.221919 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 22:22:52.223011 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:22:52.260122 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:22:52.284815 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 22:22:55.711059 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:23:15.706802 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:23:25.722156 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:23:45.723675 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:23:52.220765 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 22:23:52.221862 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:23:52.251023 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:23:52.274861 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 22:24:05.733667 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:24:15.739043 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:24:45.739861 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:24:45.751667 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:24:52.220848 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 22:24:52.222034 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:24:52.255108 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:24:52.283729 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 22:25:25.749333 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:25:25.752398 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:25:35.764747 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:25:45.760298 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:25:52.219009 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 22:25:52.219843 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:25:52.244540 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:25:52.268857 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 22:25:55.763059 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:26:05.768770 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:26:35.766041 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:26:35.770041 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:26:52.224849 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 22:26:52.226294 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:26:52.251059 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:26:52.274744 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 22:27:05.784697 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:27:05.793814 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=6 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:27:25.791177 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:27:35.800150 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:UPDATE=3,cinder:SELECT=6 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:27:52.222222 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 22:27:52.223353 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:27:52.248836 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:27:52.278212 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 22:27:55.802896 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:28:15.795787 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:28:35.801762 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:28:52.226730 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 22:28:52.227449 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:28:52.252473 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:28:52.276647 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 22:28:55.796201 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:29:05.812791 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:29:35.809375 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:29:45.808272 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:29:52.232133 ncdv-master-1 cinder-volume[130674]: DEBUG oslo_service.periodic_task [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=130674) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jun 25 22:29:52.233287 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:29:52.269242 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.volume.drivers.rbd [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=130674) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}} Jun 25 22:29:52.294381 ncdv-master-1 cinder-volume[130674]: DEBUG cinder.manager [None req-d38ee79d-b176-4d34-8c38-00b378f12d6c None None] Notifying Schedulers of capabilities ... {{(pid=130674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 25 22:30:15.814757 ncdv-master-1 cinder-volume[130674]: DEBUG dbcounter [-] [130674] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=130674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}